00:00:00.000 Started by upstream project "autotest-spdk-v24.01-LTS-vs-dpdk-v23.11" build number 1006 00:00:00.000 originally caused by: 00:00:00.000 Started by upstream project "nightly-trigger" build number 3673 00:00:00.000 originally caused by: 00:00:00.000 Started by timer 00:00:00.065 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.066 The recommended git tool is: git 00:00:00.066 using credential 00000000-0000-0000-0000-000000000002 00:00:00.068 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.094 Fetching changes from the remote Git repository 00:00:00.098 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.130 Using shallow fetch with depth 1 00:00:00.130 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.130 > git --version # timeout=10 00:00:00.162 > git --version # 'git version 2.39.2' 00:00:00.162 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.193 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.193 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:03.793 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:03.805 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:03.818 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:03.818 > git config core.sparsecheckout # timeout=10 00:00:03.830 > git read-tree -mu HEAD # timeout=10 00:00:03.848 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:03.875 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:03.875 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:03.954 [Pipeline] Start of Pipeline 00:00:03.965 [Pipeline] library 00:00:03.967 Loading library shm_lib@master 00:00:03.967 Library shm_lib@master is cached. Copying from home. 00:00:03.984 [Pipeline] node 00:00:03.994 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:03.995 [Pipeline] { 00:00:04.007 [Pipeline] catchError 00:00:04.009 [Pipeline] { 00:00:04.025 [Pipeline] wrap 00:00:04.035 [Pipeline] { 00:00:04.045 [Pipeline] stage 00:00:04.047 [Pipeline] { (Prologue) 00:00:04.270 [Pipeline] sh 00:00:04.552 + logger -p user.info -t JENKINS-CI 00:00:04.569 [Pipeline] echo 00:00:04.571 Node: GP11 00:00:04.579 [Pipeline] sh 00:00:04.882 [Pipeline] setCustomBuildProperty 00:00:04.895 [Pipeline] echo 00:00:04.898 Cleanup processes 00:00:04.903 [Pipeline] sh 00:00:05.181 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:05.181 1824356 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:05.193 [Pipeline] sh 00:00:05.473 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:05.473 ++ grep -v 'sudo pgrep' 00:00:05.473 ++ awk '{print $1}' 00:00:05.473 + sudo kill -9 00:00:05.473 + true 00:00:05.483 [Pipeline] cleanWs 00:00:05.492 [WS-CLEANUP] Deleting project workspace... 00:00:05.492 [WS-CLEANUP] Deferred wipeout is used... 00:00:05.497 [WS-CLEANUP] done 00:00:05.501 [Pipeline] setCustomBuildProperty 00:00:05.512 [Pipeline] sh 00:00:05.792 + sudo git config --global --replace-all safe.directory '*' 00:00:05.888 [Pipeline] httpRequest 00:00:07.169 [Pipeline] echo 00:00:07.170 Sorcerer 10.211.164.20 is alive 00:00:07.176 [Pipeline] retry 00:00:07.178 [Pipeline] { 00:00:07.193 [Pipeline] httpRequest 00:00:07.199 HttpMethod: GET 00:00:07.199 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:07.200 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:07.215 Response Code: HTTP/1.1 200 OK 00:00:07.215 Success: Status code 200 is in the accepted range: 200,404 00:00:07.216 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:10.373 [Pipeline] } 00:00:10.389 [Pipeline] // retry 00:00:10.396 [Pipeline] sh 00:00:10.678 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:10.698 [Pipeline] httpRequest 00:00:11.106 [Pipeline] echo 00:00:11.108 Sorcerer 10.211.164.20 is alive 00:00:11.118 [Pipeline] retry 00:00:11.120 [Pipeline] { 00:00:11.134 [Pipeline] httpRequest 00:00:11.139 HttpMethod: GET 00:00:11.139 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:11.140 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:11.146 Response Code: HTTP/1.1 200 OK 00:00:11.147 Success: Status code 200 is in the accepted range: 200,404 00:00:11.147 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:32.546 [Pipeline] } 00:01:32.563 [Pipeline] // retry 00:01:32.571 [Pipeline] sh 00:01:32.856 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:36.154 [Pipeline] sh 00:01:36.437 + git -C spdk log --oneline -n5 00:01:36.437 c13c99a5e test: Various fixes for Fedora40 00:01:36.437 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:36.437 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:36.437 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:36.437 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:36.452 [Pipeline] withCredentials 00:01:36.461 > git --version # timeout=10 00:01:36.472 > git --version # 'git version 2.39.2' 00:01:36.487 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:01:36.489 [Pipeline] { 00:01:36.498 [Pipeline] retry 00:01:36.500 [Pipeline] { 00:01:36.515 [Pipeline] sh 00:01:36.797 + git ls-remote http://dpdk.org/git/dpdk-stable v23.11 00:01:37.379 [Pipeline] } 00:01:37.401 [Pipeline] // retry 00:01:37.407 [Pipeline] } 00:01:37.427 [Pipeline] // withCredentials 00:01:37.438 [Pipeline] httpRequest 00:01:37.911 [Pipeline] echo 00:01:37.913 Sorcerer 10.211.164.20 is alive 00:01:37.924 [Pipeline] retry 00:01:37.926 [Pipeline] { 00:01:37.941 [Pipeline] httpRequest 00:01:37.946 HttpMethod: GET 00:01:37.947 URL: http://10.211.164.20/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:37.947 Sending request to url: http://10.211.164.20/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:37.950 Response Code: HTTP/1.1 200 OK 00:01:37.950 Success: Status code 200 is in the accepted range: 200,404 00:01:37.951 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:43.560 [Pipeline] } 00:01:43.577 [Pipeline] // retry 00:01:43.584 [Pipeline] sh 00:01:43.865 + tar --no-same-owner -xf dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:45.246 [Pipeline] sh 00:01:45.524 + git -C dpdk log --oneline -n5 00:01:45.524 eeb0605f11 version: 23.11.0 00:01:45.524 238778122a doc: update release notes for 23.11 00:01:45.524 46aa6b3cfc doc: fix description of RSS features 00:01:45.524 dd88f51a57 devtools: forbid DPDK API in cnxk base driver 00:01:45.524 7e421ae345 devtools: support skipping forbid rule check 00:01:45.530 [Pipeline] } 00:01:45.542 [Pipeline] // stage 00:01:45.550 [Pipeline] stage 00:01:45.552 [Pipeline] { (Prepare) 00:01:45.570 [Pipeline] writeFile 00:01:45.583 [Pipeline] sh 00:01:45.859 + logger -p user.info -t JENKINS-CI 00:01:45.869 [Pipeline] sh 00:01:46.149 + logger -p user.info -t JENKINS-CI 00:01:46.160 [Pipeline] sh 00:01:46.447 + cat autorun-spdk.conf 00:01:46.447 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:46.447 SPDK_TEST_NVMF=1 00:01:46.447 SPDK_TEST_NVME_CLI=1 00:01:46.447 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:46.447 SPDK_TEST_NVMF_NICS=e810 00:01:46.447 SPDK_TEST_VFIOUSER=1 00:01:46.447 SPDK_RUN_UBSAN=1 00:01:46.447 NET_TYPE=phy 00:01:46.447 SPDK_TEST_NATIVE_DPDK=v23.11 00:01:46.447 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:46.454 RUN_NIGHTLY=1 00:01:46.459 [Pipeline] readFile 00:01:46.486 [Pipeline] withEnv 00:01:46.488 [Pipeline] { 00:01:46.501 [Pipeline] sh 00:01:46.787 + set -ex 00:01:46.788 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:46.788 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:46.788 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:46.788 ++ SPDK_TEST_NVMF=1 00:01:46.788 ++ SPDK_TEST_NVME_CLI=1 00:01:46.788 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:46.788 ++ SPDK_TEST_NVMF_NICS=e810 00:01:46.788 ++ SPDK_TEST_VFIOUSER=1 00:01:46.788 ++ SPDK_RUN_UBSAN=1 00:01:46.788 ++ NET_TYPE=phy 00:01:46.788 ++ SPDK_TEST_NATIVE_DPDK=v23.11 00:01:46.788 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:46.788 ++ RUN_NIGHTLY=1 00:01:46.788 + case $SPDK_TEST_NVMF_NICS in 00:01:46.788 + DRIVERS=ice 00:01:46.788 + [[ tcp == \r\d\m\a ]] 00:01:46.788 + [[ -n ice ]] 00:01:46.788 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:46.788 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:46.788 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:46.788 rmmod: ERROR: Module irdma is not currently loaded 00:01:46.788 rmmod: ERROR: Module i40iw is not currently loaded 00:01:46.788 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:46.788 + true 00:01:46.788 + for D in $DRIVERS 00:01:46.788 + sudo modprobe ice 00:01:46.788 + exit 0 00:01:46.797 [Pipeline] } 00:01:46.812 [Pipeline] // withEnv 00:01:46.817 [Pipeline] } 00:01:46.833 [Pipeline] // stage 00:01:46.845 [Pipeline] catchError 00:01:46.847 [Pipeline] { 00:01:46.861 [Pipeline] timeout 00:01:46.861 Timeout set to expire in 1 hr 0 min 00:01:46.863 [Pipeline] { 00:01:46.877 [Pipeline] stage 00:01:46.879 [Pipeline] { (Tests) 00:01:46.893 [Pipeline] sh 00:01:47.179 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:47.179 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:47.179 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:47.179 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:47.179 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:47.179 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:47.179 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:47.179 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:47.179 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:47.179 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:47.179 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:47.179 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:47.179 + source /etc/os-release 00:01:47.179 ++ NAME='Fedora Linux' 00:01:47.179 ++ VERSION='39 (Cloud Edition)' 00:01:47.179 ++ ID=fedora 00:01:47.179 ++ VERSION_ID=39 00:01:47.179 ++ VERSION_CODENAME= 00:01:47.179 ++ PLATFORM_ID=platform:f39 00:01:47.179 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:47.179 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:47.179 ++ LOGO=fedora-logo-icon 00:01:47.179 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:47.179 ++ HOME_URL=https://fedoraproject.org/ 00:01:47.179 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:47.179 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:47.179 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:47.179 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:47.179 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:47.179 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:47.179 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:47.179 ++ SUPPORT_END=2024-11-12 00:01:47.179 ++ VARIANT='Cloud Edition' 00:01:47.179 ++ VARIANT_ID=cloud 00:01:47.179 + uname -a 00:01:47.179 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:47.179 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:48.114 Hugepages 00:01:48.114 node hugesize free / total 00:01:48.114 node0 1048576kB 0 / 0 00:01:48.114 node0 2048kB 0 / 0 00:01:48.114 node1 1048576kB 0 / 0 00:01:48.114 node1 2048kB 0 / 0 00:01:48.114 00:01:48.114 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:48.114 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:48.114 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:48.114 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:48.114 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:48.114 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:48.114 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:48.114 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:48.114 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:48.114 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:48.114 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:48.114 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:48.114 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:48.114 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:48.114 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:48.114 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:48.114 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:48.114 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:48.114 + rm -f /tmp/spdk-ld-path 00:01:48.114 + source autorun-spdk.conf 00:01:48.114 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:48.114 ++ SPDK_TEST_NVMF=1 00:01:48.114 ++ SPDK_TEST_NVME_CLI=1 00:01:48.114 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:48.114 ++ SPDK_TEST_NVMF_NICS=e810 00:01:48.114 ++ SPDK_TEST_VFIOUSER=1 00:01:48.114 ++ SPDK_RUN_UBSAN=1 00:01:48.114 ++ NET_TYPE=phy 00:01:48.114 ++ SPDK_TEST_NATIVE_DPDK=v23.11 00:01:48.114 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:48.114 ++ RUN_NIGHTLY=1 00:01:48.114 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:48.114 + [[ -n '' ]] 00:01:48.114 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:48.114 + for M in /var/spdk/build-*-manifest.txt 00:01:48.114 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:48.114 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:48.114 + for M in /var/spdk/build-*-manifest.txt 00:01:48.114 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:48.114 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:48.114 + for M in /var/spdk/build-*-manifest.txt 00:01:48.114 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:48.114 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:48.114 ++ uname 00:01:48.114 + [[ Linux == \L\i\n\u\x ]] 00:01:48.114 + sudo dmesg -T 00:01:48.114 + sudo dmesg --clear 00:01:48.114 + dmesg_pid=1825051 00:01:48.114 + [[ Fedora Linux == FreeBSD ]] 00:01:48.114 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:48.114 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:48.114 + sudo dmesg -Tw 00:01:48.114 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:48.114 + [[ -x /usr/src/fio-static/fio ]] 00:01:48.114 + export FIO_BIN=/usr/src/fio-static/fio 00:01:48.114 + FIO_BIN=/usr/src/fio-static/fio 00:01:48.114 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:48.114 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:48.114 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:48.114 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:48.114 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:48.114 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:48.115 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:48.115 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:48.115 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:48.115 Test configuration: 00:01:48.115 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:48.115 SPDK_TEST_NVMF=1 00:01:48.115 SPDK_TEST_NVME_CLI=1 00:01:48.115 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:48.115 SPDK_TEST_NVMF_NICS=e810 00:01:48.115 SPDK_TEST_VFIOUSER=1 00:01:48.115 SPDK_RUN_UBSAN=1 00:01:48.115 NET_TYPE=phy 00:01:48.115 SPDK_TEST_NATIVE_DPDK=v23.11 00:01:48.115 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:48.374 RUN_NIGHTLY=1 00:56:02 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:48.374 00:56:02 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:48.374 00:56:02 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:48.374 00:56:02 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:48.374 00:56:02 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:48.374 00:56:02 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:48.374 00:56:02 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:48.374 00:56:02 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:48.374 00:56:02 -- paths/export.sh@5 -- $ export PATH 00:01:48.374 00:56:02 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:48.374 00:56:02 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:48.374 00:56:02 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:48.374 00:56:02 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732751762.XXXXXX 00:01:48.374 00:56:02 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732751762.LBGHTZ 00:01:48.374 00:56:02 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:48.374 00:56:02 -- common/autobuild_common.sh@446 -- $ '[' -n v23.11 ']' 00:01:48.374 00:56:02 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:48.374 00:56:02 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:01:48.374 00:56:02 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:48.374 00:56:02 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:48.374 00:56:02 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:48.374 00:56:02 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:48.374 00:56:02 -- common/autotest_common.sh@10 -- $ set +x 00:01:48.374 00:56:02 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:01:48.374 00:56:02 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:48.374 00:56:02 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:48.374 00:56:02 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:48.374 00:56:02 -- spdk/autobuild.sh@16 -- $ date -u 00:01:48.374 Wed Nov 27 11:56:02 PM UTC 2024 00:01:48.374 00:56:02 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:48.374 LTS-67-gc13c99a5e 00:01:48.374 00:56:02 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:48.374 00:56:02 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:48.374 00:56:02 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:48.374 00:56:02 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:48.374 00:56:02 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:48.374 00:56:02 -- common/autotest_common.sh@10 -- $ set +x 00:01:48.374 ************************************ 00:01:48.374 START TEST ubsan 00:01:48.374 ************************************ 00:01:48.374 00:56:02 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:48.374 using ubsan 00:01:48.374 00:01:48.374 real 0m0.000s 00:01:48.374 user 0m0.000s 00:01:48.374 sys 0m0.000s 00:01:48.374 00:56:02 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:48.374 00:56:02 -- common/autotest_common.sh@10 -- $ set +x 00:01:48.374 ************************************ 00:01:48.374 END TEST ubsan 00:01:48.374 ************************************ 00:01:48.374 00:56:02 -- spdk/autobuild.sh@27 -- $ '[' -n v23.11 ']' 00:01:48.374 00:56:02 -- spdk/autobuild.sh@28 -- $ build_native_dpdk 00:01:48.374 00:56:02 -- common/autobuild_common.sh@432 -- $ run_test build_native_dpdk _build_native_dpdk 00:01:48.374 00:56:02 -- common/autotest_common.sh@1087 -- $ '[' 2 -le 1 ']' 00:01:48.374 00:56:02 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:48.374 00:56:02 -- common/autotest_common.sh@10 -- $ set +x 00:01:48.374 ************************************ 00:01:48.374 START TEST build_native_dpdk 00:01:48.374 ************************************ 00:01:48.374 00:56:02 -- common/autotest_common.sh@1114 -- $ _build_native_dpdk 00:01:48.374 00:56:02 -- common/autobuild_common.sh@48 -- $ local external_dpdk_dir 00:01:48.374 00:56:02 -- common/autobuild_common.sh@49 -- $ local external_dpdk_base_dir 00:01:48.374 00:56:02 -- common/autobuild_common.sh@50 -- $ local compiler_version 00:01:48.374 00:56:02 -- common/autobuild_common.sh@51 -- $ local compiler 00:01:48.374 00:56:02 -- common/autobuild_common.sh@52 -- $ local dpdk_kmods 00:01:48.374 00:56:02 -- common/autobuild_common.sh@53 -- $ local repo=dpdk 00:01:48.374 00:56:02 -- common/autobuild_common.sh@55 -- $ compiler=gcc 00:01:48.374 00:56:02 -- common/autobuild_common.sh@61 -- $ export CC=gcc 00:01:48.374 00:56:02 -- common/autobuild_common.sh@61 -- $ CC=gcc 00:01:48.374 00:56:02 -- common/autobuild_common.sh@63 -- $ [[ gcc != *clang* ]] 00:01:48.374 00:56:02 -- common/autobuild_common.sh@63 -- $ [[ gcc != *gcc* ]] 00:01:48.374 00:56:02 -- common/autobuild_common.sh@68 -- $ gcc -dumpversion 00:01:48.374 00:56:02 -- common/autobuild_common.sh@68 -- $ compiler_version=13 00:01:48.374 00:56:02 -- common/autobuild_common.sh@69 -- $ compiler_version=13 00:01:48.374 00:56:02 -- common/autobuild_common.sh@70 -- $ external_dpdk_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:48.374 00:56:02 -- common/autobuild_common.sh@71 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:48.375 00:56:02 -- common/autobuild_common.sh@71 -- $ external_dpdk_base_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:48.375 00:56:02 -- common/autobuild_common.sh@73 -- $ [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk ]] 00:01:48.375 00:56:02 -- common/autobuild_common.sh@82 -- $ orgdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:48.375 00:56:02 -- common/autobuild_common.sh@83 -- $ git -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk log --oneline -n 5 00:01:48.375 eeb0605f11 version: 23.11.0 00:01:48.375 238778122a doc: update release notes for 23.11 00:01:48.375 46aa6b3cfc doc: fix description of RSS features 00:01:48.375 dd88f51a57 devtools: forbid DPDK API in cnxk base driver 00:01:48.375 7e421ae345 devtools: support skipping forbid rule check 00:01:48.375 00:56:02 -- common/autobuild_common.sh@85 -- $ dpdk_cflags='-fPIC -g -fcommon' 00:01:48.375 00:56:02 -- common/autobuild_common.sh@86 -- $ dpdk_ldflags= 00:01:48.375 00:56:02 -- common/autobuild_common.sh@87 -- $ dpdk_ver=23.11.0 00:01:48.375 00:56:02 -- common/autobuild_common.sh@89 -- $ [[ gcc == *gcc* ]] 00:01:48.375 00:56:02 -- common/autobuild_common.sh@89 -- $ [[ 13 -ge 5 ]] 00:01:48.375 00:56:02 -- common/autobuild_common.sh@90 -- $ dpdk_cflags+=' -Werror' 00:01:48.375 00:56:02 -- common/autobuild_common.sh@93 -- $ [[ gcc == *gcc* ]] 00:01:48.375 00:56:02 -- common/autobuild_common.sh@93 -- $ [[ 13 -ge 10 ]] 00:01:48.375 00:56:02 -- common/autobuild_common.sh@94 -- $ dpdk_cflags+=' -Wno-stringop-overflow' 00:01:48.375 00:56:02 -- common/autobuild_common.sh@100 -- $ DPDK_DRIVERS=("bus" "bus/pci" "bus/vdev" "mempool/ring" "net/i40e" "net/i40e/base") 00:01:48.375 00:56:02 -- common/autobuild_common.sh@102 -- $ local mlx5_libs_added=n 00:01:48.375 00:56:02 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:48.375 00:56:02 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:48.375 00:56:02 -- common/autobuild_common.sh@139 -- $ [[ 0 -eq 1 ]] 00:01:48.375 00:56:02 -- common/autobuild_common.sh@167 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:48.375 00:56:02 -- common/autobuild_common.sh@168 -- $ uname -s 00:01:48.375 00:56:02 -- common/autobuild_common.sh@168 -- $ '[' Linux = Linux ']' 00:01:48.375 00:56:02 -- common/autobuild_common.sh@169 -- $ lt 23.11.0 21.11.0 00:01:48.375 00:56:02 -- scripts/common.sh@372 -- $ cmp_versions 23.11.0 '<' 21.11.0 00:01:48.375 00:56:02 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:48.375 00:56:02 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:48.375 00:56:02 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:48.375 00:56:02 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:48.375 00:56:02 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:48.375 00:56:02 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:48.375 00:56:02 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:48.375 00:56:02 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:48.375 00:56:02 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:48.375 00:56:02 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:48.375 00:56:02 -- scripts/common.sh@343 -- $ case "$op" in 00:01:48.375 00:56:02 -- scripts/common.sh@344 -- $ : 1 00:01:48.375 00:56:02 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:48.375 00:56:02 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:48.375 00:56:02 -- scripts/common.sh@364 -- $ decimal 23 00:01:48.375 00:56:02 -- scripts/common.sh@352 -- $ local d=23 00:01:48.375 00:56:02 -- scripts/common.sh@353 -- $ [[ 23 =~ ^[0-9]+$ ]] 00:01:48.375 00:56:02 -- scripts/common.sh@354 -- $ echo 23 00:01:48.375 00:56:02 -- scripts/common.sh@364 -- $ ver1[v]=23 00:01:48.375 00:56:02 -- scripts/common.sh@365 -- $ decimal 21 00:01:48.375 00:56:02 -- scripts/common.sh@352 -- $ local d=21 00:01:48.375 00:56:02 -- scripts/common.sh@353 -- $ [[ 21 =~ ^[0-9]+$ ]] 00:01:48.375 00:56:02 -- scripts/common.sh@354 -- $ echo 21 00:01:48.375 00:56:02 -- scripts/common.sh@365 -- $ ver2[v]=21 00:01:48.375 00:56:02 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:48.375 00:56:02 -- scripts/common.sh@366 -- $ return 1 00:01:48.375 00:56:02 -- common/autobuild_common.sh@173 -- $ patch -p1 00:01:48.375 patching file config/rte_config.h 00:01:48.375 Hunk #1 succeeded at 60 (offset 1 line). 00:01:48.375 00:56:02 -- common/autobuild_common.sh@176 -- $ lt 23.11.0 24.07.0 00:01:48.375 00:56:02 -- scripts/common.sh@372 -- $ cmp_versions 23.11.0 '<' 24.07.0 00:01:48.375 00:56:02 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:48.375 00:56:02 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:48.375 00:56:02 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:48.375 00:56:02 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:48.375 00:56:02 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:48.375 00:56:02 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:48.375 00:56:02 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:48.375 00:56:02 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:48.375 00:56:02 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:48.375 00:56:02 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:48.375 00:56:02 -- scripts/common.sh@343 -- $ case "$op" in 00:01:48.375 00:56:02 -- scripts/common.sh@344 -- $ : 1 00:01:48.375 00:56:02 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:48.375 00:56:02 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:48.375 00:56:02 -- scripts/common.sh@364 -- $ decimal 23 00:01:48.375 00:56:02 -- scripts/common.sh@352 -- $ local d=23 00:01:48.375 00:56:02 -- scripts/common.sh@353 -- $ [[ 23 =~ ^[0-9]+$ ]] 00:01:48.375 00:56:02 -- scripts/common.sh@354 -- $ echo 23 00:01:48.375 00:56:02 -- scripts/common.sh@364 -- $ ver1[v]=23 00:01:48.375 00:56:02 -- scripts/common.sh@365 -- $ decimal 24 00:01:48.375 00:56:02 -- scripts/common.sh@352 -- $ local d=24 00:01:48.375 00:56:02 -- scripts/common.sh@353 -- $ [[ 24 =~ ^[0-9]+$ ]] 00:01:48.375 00:56:02 -- scripts/common.sh@354 -- $ echo 24 00:01:48.375 00:56:02 -- scripts/common.sh@365 -- $ ver2[v]=24 00:01:48.375 00:56:02 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:48.375 00:56:02 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:01:48.375 00:56:02 -- scripts/common.sh@367 -- $ return 0 00:01:48.375 00:56:02 -- common/autobuild_common.sh@177 -- $ patch -p1 00:01:48.375 patching file lib/pcapng/rte_pcapng.c 00:01:48.375 00:56:02 -- common/autobuild_common.sh@180 -- $ dpdk_kmods=false 00:01:48.375 00:56:02 -- common/autobuild_common.sh@181 -- $ uname -s 00:01:48.375 00:56:02 -- common/autobuild_common.sh@181 -- $ '[' Linux = FreeBSD ']' 00:01:48.375 00:56:02 -- common/autobuild_common.sh@185 -- $ printf %s, bus bus/pci bus/vdev mempool/ring net/i40e net/i40e/base 00:01:48.375 00:56:02 -- common/autobuild_common.sh@185 -- $ meson build-tmp --prefix=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --libdir lib -Denable_docs=false -Denable_kmods=false -Dtests=false -Dc_link_args= '-Dc_args=-fPIC -g -fcommon -Werror -Wno-stringop-overflow' -Dmachine=native -Denable_drivers=bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:52.566 The Meson build system 00:01:52.566 Version: 1.5.0 00:01:52.566 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:52.566 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp 00:01:52.566 Build type: native build 00:01:52.566 Program cat found: YES (/usr/bin/cat) 00:01:52.566 Project name: DPDK 00:01:52.566 Project version: 23.11.0 00:01:52.566 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:52.566 C linker for the host machine: gcc ld.bfd 2.40-14 00:01:52.566 Host machine cpu family: x86_64 00:01:52.566 Host machine cpu: x86_64 00:01:52.566 Message: ## Building in Developer Mode ## 00:01:52.566 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:52.566 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/check-symbols.sh) 00:01:52.566 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/options-ibverbs-static.sh) 00:01:52.566 Program python3 found: YES (/usr/bin/python3) 00:01:52.566 Program cat found: YES (/usr/bin/cat) 00:01:52.566 config/meson.build:113: WARNING: The "machine" option is deprecated. Please use "cpu_instruction_set" instead. 00:01:52.566 Compiler for C supports arguments -march=native: YES 00:01:52.566 Checking for size of "void *" : 8 00:01:52.566 Checking for size of "void *" : 8 (cached) 00:01:52.566 Library m found: YES 00:01:52.566 Library numa found: YES 00:01:52.566 Has header "numaif.h" : YES 00:01:52.566 Library fdt found: NO 00:01:52.566 Library execinfo found: NO 00:01:52.566 Has header "execinfo.h" : YES 00:01:52.566 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:52.566 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:52.566 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:52.566 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:52.566 Run-time dependency openssl found: YES 3.1.1 00:01:52.566 Run-time dependency libpcap found: YES 1.10.4 00:01:52.566 Has header "pcap.h" with dependency libpcap: YES 00:01:52.566 Compiler for C supports arguments -Wcast-qual: YES 00:01:52.566 Compiler for C supports arguments -Wdeprecated: YES 00:01:52.566 Compiler for C supports arguments -Wformat: YES 00:01:52.566 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:52.566 Compiler for C supports arguments -Wformat-security: NO 00:01:52.566 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:52.566 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:52.566 Compiler for C supports arguments -Wnested-externs: YES 00:01:52.566 Compiler for C supports arguments -Wold-style-definition: YES 00:01:52.566 Compiler for C supports arguments -Wpointer-arith: YES 00:01:52.566 Compiler for C supports arguments -Wsign-compare: YES 00:01:52.566 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:52.566 Compiler for C supports arguments -Wundef: YES 00:01:52.566 Compiler for C supports arguments -Wwrite-strings: YES 00:01:52.566 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:52.566 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:52.566 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:52.566 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:52.566 Program objdump found: YES (/usr/bin/objdump) 00:01:52.566 Compiler for C supports arguments -mavx512f: YES 00:01:52.566 Checking if "AVX512 checking" compiles: YES 00:01:52.566 Fetching value of define "__SSE4_2__" : 1 00:01:52.566 Fetching value of define "__AES__" : 1 00:01:52.566 Fetching value of define "__AVX__" : 1 00:01:52.566 Fetching value of define "__AVX2__" : (undefined) 00:01:52.566 Fetching value of define "__AVX512BW__" : (undefined) 00:01:52.566 Fetching value of define "__AVX512CD__" : (undefined) 00:01:52.566 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:52.567 Fetching value of define "__AVX512F__" : (undefined) 00:01:52.567 Fetching value of define "__AVX512VL__" : (undefined) 00:01:52.567 Fetching value of define "__PCLMUL__" : 1 00:01:52.567 Fetching value of define "__RDRND__" : 1 00:01:52.567 Fetching value of define "__RDSEED__" : (undefined) 00:01:52.567 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:52.567 Fetching value of define "__znver1__" : (undefined) 00:01:52.567 Fetching value of define "__znver2__" : (undefined) 00:01:52.567 Fetching value of define "__znver3__" : (undefined) 00:01:52.567 Fetching value of define "__znver4__" : (undefined) 00:01:52.567 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:52.567 Message: lib/log: Defining dependency "log" 00:01:52.567 Message: lib/kvargs: Defining dependency "kvargs" 00:01:52.567 Message: lib/telemetry: Defining dependency "telemetry" 00:01:52.567 Checking for function "getentropy" : NO 00:01:52.567 Message: lib/eal: Defining dependency "eal" 00:01:52.567 Message: lib/ring: Defining dependency "ring" 00:01:52.567 Message: lib/rcu: Defining dependency "rcu" 00:01:52.567 Message: lib/mempool: Defining dependency "mempool" 00:01:52.567 Message: lib/mbuf: Defining dependency "mbuf" 00:01:52.567 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:52.567 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:52.567 Compiler for C supports arguments -mpclmul: YES 00:01:52.567 Compiler for C supports arguments -maes: YES 00:01:52.567 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:52.567 Compiler for C supports arguments -mavx512bw: YES 00:01:52.567 Compiler for C supports arguments -mavx512dq: YES 00:01:52.567 Compiler for C supports arguments -mavx512vl: YES 00:01:52.567 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:52.567 Compiler for C supports arguments -mavx2: YES 00:01:52.567 Compiler for C supports arguments -mavx: YES 00:01:52.567 Message: lib/net: Defining dependency "net" 00:01:52.567 Message: lib/meter: Defining dependency "meter" 00:01:52.567 Message: lib/ethdev: Defining dependency "ethdev" 00:01:52.567 Message: lib/pci: Defining dependency "pci" 00:01:52.567 Message: lib/cmdline: Defining dependency "cmdline" 00:01:52.567 Message: lib/metrics: Defining dependency "metrics" 00:01:52.567 Message: lib/hash: Defining dependency "hash" 00:01:52.567 Message: lib/timer: Defining dependency "timer" 00:01:52.567 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:52.567 Fetching value of define "__AVX512VL__" : (undefined) (cached) 00:01:52.567 Fetching value of define "__AVX512CD__" : (undefined) (cached) 00:01:52.567 Fetching value of define "__AVX512BW__" : (undefined) (cached) 00:01:52.567 Compiler for C supports arguments -mavx512f -mavx512vl -mavx512cd -mavx512bw: YES 00:01:52.567 Message: lib/acl: Defining dependency "acl" 00:01:52.567 Message: lib/bbdev: Defining dependency "bbdev" 00:01:52.567 Message: lib/bitratestats: Defining dependency "bitratestats" 00:01:52.567 Run-time dependency libelf found: YES 0.191 00:01:52.567 Message: lib/bpf: Defining dependency "bpf" 00:01:52.567 Message: lib/cfgfile: Defining dependency "cfgfile" 00:01:52.567 Message: lib/compressdev: Defining dependency "compressdev" 00:01:52.567 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:52.567 Message: lib/distributor: Defining dependency "distributor" 00:01:52.567 Message: lib/dmadev: Defining dependency "dmadev" 00:01:52.567 Message: lib/efd: Defining dependency "efd" 00:01:52.567 Message: lib/eventdev: Defining dependency "eventdev" 00:01:52.567 Message: lib/dispatcher: Defining dependency "dispatcher" 00:01:52.567 Message: lib/gpudev: Defining dependency "gpudev" 00:01:52.567 Message: lib/gro: Defining dependency "gro" 00:01:52.567 Message: lib/gso: Defining dependency "gso" 00:01:52.567 Message: lib/ip_frag: Defining dependency "ip_frag" 00:01:52.567 Message: lib/jobstats: Defining dependency "jobstats" 00:01:52.567 Message: lib/latencystats: Defining dependency "latencystats" 00:01:52.567 Message: lib/lpm: Defining dependency "lpm" 00:01:52.567 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:52.567 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:52.567 Fetching value of define "__AVX512IFMA__" : (undefined) 00:01:52.567 Compiler for C supports arguments -mavx512f -mavx512dq -mavx512ifma: YES 00:01:52.567 Message: lib/member: Defining dependency "member" 00:01:52.567 Message: lib/pcapng: Defining dependency "pcapng" 00:01:52.567 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:52.567 Message: lib/power: Defining dependency "power" 00:01:52.567 Message: lib/rawdev: Defining dependency "rawdev" 00:01:52.567 Message: lib/regexdev: Defining dependency "regexdev" 00:01:52.567 Message: lib/mldev: Defining dependency "mldev" 00:01:52.567 Message: lib/rib: Defining dependency "rib" 00:01:52.567 Message: lib/reorder: Defining dependency "reorder" 00:01:52.567 Message: lib/sched: Defining dependency "sched" 00:01:52.567 Message: lib/security: Defining dependency "security" 00:01:52.567 Message: lib/stack: Defining dependency "stack" 00:01:52.567 Has header "linux/userfaultfd.h" : YES 00:01:52.567 Has header "linux/vduse.h" : YES 00:01:52.567 Message: lib/vhost: Defining dependency "vhost" 00:01:52.567 Message: lib/ipsec: Defining dependency "ipsec" 00:01:52.567 Message: lib/pdcp: Defining dependency "pdcp" 00:01:52.567 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:52.567 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:52.567 Compiler for C supports arguments -mavx512f -mavx512dq: YES 00:01:52.567 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:52.567 Message: lib/fib: Defining dependency "fib" 00:01:52.567 Message: lib/port: Defining dependency "port" 00:01:52.567 Message: lib/pdump: Defining dependency "pdump" 00:01:52.567 Message: lib/table: Defining dependency "table" 00:01:52.567 Message: lib/pipeline: Defining dependency "pipeline" 00:01:52.567 Message: lib/graph: Defining dependency "graph" 00:01:52.567 Message: lib/node: Defining dependency "node" 00:01:54.475 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:54.475 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:54.475 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:54.475 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:54.475 Compiler for C supports arguments -Wno-sign-compare: YES 00:01:54.475 Compiler for C supports arguments -Wno-unused-value: YES 00:01:54.475 Compiler for C supports arguments -Wno-format: YES 00:01:54.475 Compiler for C supports arguments -Wno-format-security: YES 00:01:54.475 Compiler for C supports arguments -Wno-format-nonliteral: YES 00:01:54.475 Compiler for C supports arguments -Wno-strict-aliasing: YES 00:01:54.475 Compiler for C supports arguments -Wno-unused-but-set-variable: YES 00:01:54.475 Compiler for C supports arguments -Wno-unused-parameter: YES 00:01:54.475 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:54.475 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:54.475 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:54.475 Compiler for C supports arguments -march=skylake-avx512: YES 00:01:54.475 Message: drivers/net/i40e: Defining dependency "net_i40e" 00:01:54.475 Has header "sys/epoll.h" : YES 00:01:54.475 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:54.475 Configuring doxy-api-html.conf using configuration 00:01:54.475 Configuring doxy-api-man.conf using configuration 00:01:54.475 Program mandb found: YES (/usr/bin/mandb) 00:01:54.475 Program sphinx-build found: NO 00:01:54.475 Configuring rte_build_config.h using configuration 00:01:54.475 Message: 00:01:54.475 ================= 00:01:54.475 Applications Enabled 00:01:54.475 ================= 00:01:54.475 00:01:54.475 apps: 00:01:54.475 dumpcap, graph, pdump, proc-info, test-acl, test-bbdev, test-cmdline, test-compress-perf, 00:01:54.475 test-crypto-perf, test-dma-perf, test-eventdev, test-fib, test-flow-perf, test-gpudev, test-mldev, test-pipeline, 00:01:54.475 test-pmd, test-regex, test-sad, test-security-perf, 00:01:54.475 00:01:54.475 Message: 00:01:54.475 ================= 00:01:54.475 Libraries Enabled 00:01:54.475 ================= 00:01:54.475 00:01:54.475 libs: 00:01:54.475 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:54.475 net, meter, ethdev, pci, cmdline, metrics, hash, timer, 00:01:54.475 acl, bbdev, bitratestats, bpf, cfgfile, compressdev, cryptodev, distributor, 00:01:54.475 dmadev, efd, eventdev, dispatcher, gpudev, gro, gso, ip_frag, 00:01:54.475 jobstats, latencystats, lpm, member, pcapng, power, rawdev, regexdev, 00:01:54.475 mldev, rib, reorder, sched, security, stack, vhost, ipsec, 00:01:54.475 pdcp, fib, port, pdump, table, pipeline, graph, node, 00:01:54.475 00:01:54.475 00:01:54.475 Message: 00:01:54.475 =============== 00:01:54.475 Drivers Enabled 00:01:54.475 =============== 00:01:54.475 00:01:54.475 common: 00:01:54.475 00:01:54.475 bus: 00:01:54.475 pci, vdev, 00:01:54.475 mempool: 00:01:54.475 ring, 00:01:54.475 dma: 00:01:54.475 00:01:54.475 net: 00:01:54.475 i40e, 00:01:54.475 raw: 00:01:54.475 00:01:54.475 crypto: 00:01:54.475 00:01:54.475 compress: 00:01:54.475 00:01:54.475 regex: 00:01:54.475 00:01:54.475 ml: 00:01:54.475 00:01:54.475 vdpa: 00:01:54.475 00:01:54.475 event: 00:01:54.475 00:01:54.475 baseband: 00:01:54.475 00:01:54.475 gpu: 00:01:54.475 00:01:54.475 00:01:54.475 Message: 00:01:54.475 ================= 00:01:54.475 Content Skipped 00:01:54.475 ================= 00:01:54.475 00:01:54.475 apps: 00:01:54.475 00:01:54.475 libs: 00:01:54.475 00:01:54.475 drivers: 00:01:54.475 common/cpt: not in enabled drivers build config 00:01:54.475 common/dpaax: not in enabled drivers build config 00:01:54.475 common/iavf: not in enabled drivers build config 00:01:54.475 common/idpf: not in enabled drivers build config 00:01:54.475 common/mvep: not in enabled drivers build config 00:01:54.475 common/octeontx: not in enabled drivers build config 00:01:54.475 bus/auxiliary: not in enabled drivers build config 00:01:54.475 bus/cdx: not in enabled drivers build config 00:01:54.475 bus/dpaa: not in enabled drivers build config 00:01:54.475 bus/fslmc: not in enabled drivers build config 00:01:54.475 bus/ifpga: not in enabled drivers build config 00:01:54.475 bus/platform: not in enabled drivers build config 00:01:54.475 bus/vmbus: not in enabled drivers build config 00:01:54.475 common/cnxk: not in enabled drivers build config 00:01:54.475 common/mlx5: not in enabled drivers build config 00:01:54.475 common/nfp: not in enabled drivers build config 00:01:54.475 common/qat: not in enabled drivers build config 00:01:54.475 common/sfc_efx: not in enabled drivers build config 00:01:54.475 mempool/bucket: not in enabled drivers build config 00:01:54.475 mempool/cnxk: not in enabled drivers build config 00:01:54.475 mempool/dpaa: not in enabled drivers build config 00:01:54.475 mempool/dpaa2: not in enabled drivers build config 00:01:54.475 mempool/octeontx: not in enabled drivers build config 00:01:54.475 mempool/stack: not in enabled drivers build config 00:01:54.475 dma/cnxk: not in enabled drivers build config 00:01:54.475 dma/dpaa: not in enabled drivers build config 00:01:54.475 dma/dpaa2: not in enabled drivers build config 00:01:54.475 dma/hisilicon: not in enabled drivers build config 00:01:54.475 dma/idxd: not in enabled drivers build config 00:01:54.475 dma/ioat: not in enabled drivers build config 00:01:54.475 dma/skeleton: not in enabled drivers build config 00:01:54.475 net/af_packet: not in enabled drivers build config 00:01:54.475 net/af_xdp: not in enabled drivers build config 00:01:54.475 net/ark: not in enabled drivers build config 00:01:54.475 net/atlantic: not in enabled drivers build config 00:01:54.475 net/avp: not in enabled drivers build config 00:01:54.475 net/axgbe: not in enabled drivers build config 00:01:54.475 net/bnx2x: not in enabled drivers build config 00:01:54.475 net/bnxt: not in enabled drivers build config 00:01:54.475 net/bonding: not in enabled drivers build config 00:01:54.475 net/cnxk: not in enabled drivers build config 00:01:54.475 net/cpfl: not in enabled drivers build config 00:01:54.475 net/cxgbe: not in enabled drivers build config 00:01:54.475 net/dpaa: not in enabled drivers build config 00:01:54.475 net/dpaa2: not in enabled drivers build config 00:01:54.475 net/e1000: not in enabled drivers build config 00:01:54.475 net/ena: not in enabled drivers build config 00:01:54.475 net/enetc: not in enabled drivers build config 00:01:54.475 net/enetfec: not in enabled drivers build config 00:01:54.475 net/enic: not in enabled drivers build config 00:01:54.475 net/failsafe: not in enabled drivers build config 00:01:54.475 net/fm10k: not in enabled drivers build config 00:01:54.475 net/gve: not in enabled drivers build config 00:01:54.475 net/hinic: not in enabled drivers build config 00:01:54.475 net/hns3: not in enabled drivers build config 00:01:54.475 net/iavf: not in enabled drivers build config 00:01:54.475 net/ice: not in enabled drivers build config 00:01:54.475 net/idpf: not in enabled drivers build config 00:01:54.475 net/igc: not in enabled drivers build config 00:01:54.475 net/ionic: not in enabled drivers build config 00:01:54.475 net/ipn3ke: not in enabled drivers build config 00:01:54.475 net/ixgbe: not in enabled drivers build config 00:01:54.475 net/mana: not in enabled drivers build config 00:01:54.475 net/memif: not in enabled drivers build config 00:01:54.475 net/mlx4: not in enabled drivers build config 00:01:54.475 net/mlx5: not in enabled drivers build config 00:01:54.475 net/mvneta: not in enabled drivers build config 00:01:54.475 net/mvpp2: not in enabled drivers build config 00:01:54.475 net/netvsc: not in enabled drivers build config 00:01:54.475 net/nfb: not in enabled drivers build config 00:01:54.475 net/nfp: not in enabled drivers build config 00:01:54.475 net/ngbe: not in enabled drivers build config 00:01:54.475 net/null: not in enabled drivers build config 00:01:54.475 net/octeontx: not in enabled drivers build config 00:01:54.475 net/octeon_ep: not in enabled drivers build config 00:01:54.475 net/pcap: not in enabled drivers build config 00:01:54.476 net/pfe: not in enabled drivers build config 00:01:54.476 net/qede: not in enabled drivers build config 00:01:54.476 net/ring: not in enabled drivers build config 00:01:54.476 net/sfc: not in enabled drivers build config 00:01:54.476 net/softnic: not in enabled drivers build config 00:01:54.476 net/tap: not in enabled drivers build config 00:01:54.476 net/thunderx: not in enabled drivers build config 00:01:54.476 net/txgbe: not in enabled drivers build config 00:01:54.476 net/vdev_netvsc: not in enabled drivers build config 00:01:54.476 net/vhost: not in enabled drivers build config 00:01:54.476 net/virtio: not in enabled drivers build config 00:01:54.476 net/vmxnet3: not in enabled drivers build config 00:01:54.476 raw/cnxk_bphy: not in enabled drivers build config 00:01:54.476 raw/cnxk_gpio: not in enabled drivers build config 00:01:54.476 raw/dpaa2_cmdif: not in enabled drivers build config 00:01:54.476 raw/ifpga: not in enabled drivers build config 00:01:54.476 raw/ntb: not in enabled drivers build config 00:01:54.476 raw/skeleton: not in enabled drivers build config 00:01:54.476 crypto/armv8: not in enabled drivers build config 00:01:54.476 crypto/bcmfs: not in enabled drivers build config 00:01:54.476 crypto/caam_jr: not in enabled drivers build config 00:01:54.476 crypto/ccp: not in enabled drivers build config 00:01:54.476 crypto/cnxk: not in enabled drivers build config 00:01:54.476 crypto/dpaa_sec: not in enabled drivers build config 00:01:54.476 crypto/dpaa2_sec: not in enabled drivers build config 00:01:54.476 crypto/ipsec_mb: not in enabled drivers build config 00:01:54.476 crypto/mlx5: not in enabled drivers build config 00:01:54.476 crypto/mvsam: not in enabled drivers build config 00:01:54.476 crypto/nitrox: not in enabled drivers build config 00:01:54.476 crypto/null: not in enabled drivers build config 00:01:54.476 crypto/octeontx: not in enabled drivers build config 00:01:54.476 crypto/openssl: not in enabled drivers build config 00:01:54.476 crypto/scheduler: not in enabled drivers build config 00:01:54.476 crypto/uadk: not in enabled drivers build config 00:01:54.476 crypto/virtio: not in enabled drivers build config 00:01:54.476 compress/isal: not in enabled drivers build config 00:01:54.476 compress/mlx5: not in enabled drivers build config 00:01:54.476 compress/octeontx: not in enabled drivers build config 00:01:54.476 compress/zlib: not in enabled drivers build config 00:01:54.476 regex/mlx5: not in enabled drivers build config 00:01:54.476 regex/cn9k: not in enabled drivers build config 00:01:54.476 ml/cnxk: not in enabled drivers build config 00:01:54.476 vdpa/ifc: not in enabled drivers build config 00:01:54.476 vdpa/mlx5: not in enabled drivers build config 00:01:54.476 vdpa/nfp: not in enabled drivers build config 00:01:54.476 vdpa/sfc: not in enabled drivers build config 00:01:54.476 event/cnxk: not in enabled drivers build config 00:01:54.476 event/dlb2: not in enabled drivers build config 00:01:54.476 event/dpaa: not in enabled drivers build config 00:01:54.476 event/dpaa2: not in enabled drivers build config 00:01:54.476 event/dsw: not in enabled drivers build config 00:01:54.476 event/opdl: not in enabled drivers build config 00:01:54.476 event/skeleton: not in enabled drivers build config 00:01:54.476 event/sw: not in enabled drivers build config 00:01:54.476 event/octeontx: not in enabled drivers build config 00:01:54.476 baseband/acc: not in enabled drivers build config 00:01:54.476 baseband/fpga_5gnr_fec: not in enabled drivers build config 00:01:54.476 baseband/fpga_lte_fec: not in enabled drivers build config 00:01:54.476 baseband/la12xx: not in enabled drivers build config 00:01:54.476 baseband/null: not in enabled drivers build config 00:01:54.476 baseband/turbo_sw: not in enabled drivers build config 00:01:54.476 gpu/cuda: not in enabled drivers build config 00:01:54.476 00:01:54.476 00:01:54.476 Build targets in project: 220 00:01:54.476 00:01:54.476 DPDK 23.11.0 00:01:54.476 00:01:54.476 User defined options 00:01:54.476 libdir : lib 00:01:54.476 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:54.476 c_args : -fPIC -g -fcommon -Werror -Wno-stringop-overflow 00:01:54.476 c_link_args : 00:01:54.476 enable_docs : false 00:01:54.476 enable_drivers: bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:54.476 enable_kmods : false 00:01:54.476 machine : native 00:01:54.476 tests : false 00:01:54.476 00:01:54.476 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:54.476 WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated. 00:01:54.476 00:56:08 -- common/autobuild_common.sh@189 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 00:01:54.476 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:01:54.476 [1/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:54.476 [2/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:54.742 [3/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:54.742 [4/710] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:54.742 [5/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:54.742 [6/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:54.742 [7/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:54.742 [8/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:54.742 [9/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:54.742 [10/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:54.742 [11/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:54.742 [12/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:54.742 [13/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:54.742 [14/710] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:54.742 [15/710] Linking static target lib/librte_kvargs.a 00:01:54.742 [16/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:54.742 [17/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:55.001 [18/710] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:55.001 [19/710] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:55.001 [20/710] Linking static target lib/librte_log.a 00:01:55.001 [21/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:55.001 [22/710] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.576 [23/710] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.576 [24/710] Linking target lib/librte_log.so.24.0 00:01:55.576 [25/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:55.576 [26/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:55.576 [27/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:55.576 [28/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:55.839 [29/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:55.839 [30/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:55.839 [31/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:55.839 [32/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:55.839 [33/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:55.839 [34/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:55.839 [35/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:55.839 [36/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:55.839 [37/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:55.839 [38/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:55.839 [39/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:55.839 [40/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:55.839 [41/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:55.839 [42/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:55.839 [43/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:55.839 [44/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:55.839 [45/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:55.839 [46/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:55.839 [47/710] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:55.839 [48/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:55.839 [49/710] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:55.839 [50/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:55.839 [51/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:55.839 [52/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:55.839 [53/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:55.839 [54/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:55.839 [55/710] Linking target lib/librte_kvargs.so.24.0 00:01:55.839 [56/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:55.839 [57/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:56.100 [58/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:56.100 [59/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:56.100 [60/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:56.100 [61/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:56.100 [62/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:56.100 [63/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:56.100 [64/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:56.100 [65/710] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:56.365 [66/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:56.365 [67/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:56.365 [68/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:56.365 [69/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:56.365 [70/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:56.365 [71/710] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:56.365 [72/710] Linking static target lib/librte_pci.a 00:01:56.626 [73/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:56.626 [74/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:56.626 [75/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:56.626 [76/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:56.626 [77/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:56.889 [78/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:56.889 [79/710] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.889 [80/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:56.889 [81/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:56.889 [82/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:56.889 [83/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:56.889 [84/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:56.889 [85/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:56.889 [86/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:56.889 [87/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:56.889 [88/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:56.889 [89/710] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:56.889 [90/710] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:56.889 [91/710] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:56.889 [92/710] Linking static target lib/librte_ring.a 00:01:56.889 [93/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:57.160 [94/710] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:57.160 [95/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:57.160 [96/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:57.161 [97/710] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:57.161 [98/710] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:57.161 [99/710] Linking static target lib/librte_meter.a 00:01:57.161 [100/710] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:57.161 [101/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:57.161 [102/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:57.161 [103/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:57.161 [104/710] Linking static target lib/librte_telemetry.a 00:01:57.161 [105/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:57.161 [106/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:57.161 [107/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:57.161 [108/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:57.426 [109/710] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:57.426 [110/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:57.426 [111/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:57.426 [112/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:57.426 [113/710] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:57.426 [114/710] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.426 [115/710] Linking static target lib/librte_eal.a 00:01:57.426 [116/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:57.426 [117/710] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.426 [118/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:57.426 [119/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:57.690 [120/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:57.690 [121/710] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:57.690 [122/710] Linking static target lib/librte_net.a 00:01:57.690 [123/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:57.690 [124/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:57.690 [125/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:57.949 [126/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:57.949 [127/710] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.949 [128/710] Linking static target lib/librte_cmdline.a 00:01:57.949 [129/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:57.949 [130/710] Linking static target lib/librte_mempool.a 00:01:57.949 [131/710] Linking target lib/librte_telemetry.so.24.0 00:01:57.949 [132/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:57.949 [133/710] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.949 [134/710] Compiling C object lib/librte_cfgfile.a.p/cfgfile_rte_cfgfile.c.o 00:01:57.949 [135/710] Linking static target lib/librte_cfgfile.a 00:01:57.949 [136/710] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics.c.o 00:01:58.215 [137/710] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:58.215 [138/710] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:58.215 [139/710] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics_telemetry.c.o 00:01:58.215 [140/710] Linking static target lib/librte_metrics.a 00:01:58.215 [141/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:58.215 [142/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:58.215 [143/710] Compiling C object lib/librte_acl.a.p/acl_tb_mem.c.o 00:01:58.215 [144/710] Compiling C object lib/librte_acl.a.p/acl_rte_acl.c.o 00:01:58.482 [145/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf.c.o 00:01:58.482 [146/710] Compiling C object lib/librte_bitratestats.a.p/bitratestats_rte_bitrate.c.o 00:01:58.482 [147/710] Linking static target lib/librte_bitratestats.a 00:01:58.482 [148/710] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:58.482 [149/710] Linking static target lib/librte_rcu.a 00:01:58.482 [150/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load.c.o 00:01:58.482 [151/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_stub.c.o 00:01:58.482 [152/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_dump.c.o 00:01:58.482 [153/710] Generating lib/cfgfile.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.747 [154/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:58.747 [155/710] Compiling C object lib/librte_acl.a.p/acl_acl_gen.c.o 00:01:58.747 [156/710] Compiling C object lib/librte_acl.a.p/acl_acl_run_scalar.c.o 00:01:58.747 [157/710] Generating lib/metrics.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.747 [158/710] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:58.747 [159/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load_elf.c.o 00:01:58.747 [160/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:58.747 [161/710] Linking static target lib/librte_timer.a 00:01:58.747 [162/710] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.747 [163/710] Generating lib/bitratestats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.010 [164/710] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.010 [165/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:59.010 [166/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_exec.c.o 00:01:59.010 [167/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_convert.c.o 00:01:59.010 [168/710] Compiling C object lib/librte_bbdev.a.p/bbdev_rte_bbdev.c.o 00:01:59.010 [169/710] Linking static target lib/librte_bbdev.a 00:01:59.010 [170/710] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.010 [171/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:59.273 [172/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_match_sse.c.o 00:01:59.273 [173/710] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:59.273 [174/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:59.273 [175/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:59.273 [176/710] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.273 [177/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:59.273 [178/710] Linking static target lib/librte_compressdev.a 00:01:59.535 [179/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_single.c.o 00:01:59.535 [180/710] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_private.c.o 00:01:59.535 [181/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_pkt.c.o 00:01:59.796 [182/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_validate.c.o 00:01:59.796 [183/710] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:59.796 [184/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor.c.o 00:01:59.796 [185/710] Linking static target lib/librte_distributor.a 00:01:59.796 [186/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_ring.c.o 00:02:00.055 [187/710] Generating lib/bbdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.055 [188/710] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:02:00.055 [189/710] Linking static target lib/librte_dmadev.a 00:02:00.055 [190/710] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_trace_points.c.o 00:02:00.055 [191/710] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.055 [192/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_jit_x86.c.o 00:02:00.055 [193/710] Linking static target lib/librte_bpf.a 00:02:00.318 [194/710] Compiling C object lib/librte_gso.a.p/gso_gso_tcp4.c.o 00:02:00.318 [195/710] Compiling C object lib/librte_gso.a.p/gso_gso_udp4.c.o 00:02:00.318 [196/710] Generating lib/distributor.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.318 [197/710] Compiling C object lib/librte_dispatcher.a.p/dispatcher_rte_dispatcher.c.o 00:02:00.318 [198/710] Linking static target lib/librte_dispatcher.a 00:02:00.318 [199/710] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_udp4.c.o 00:02:00.318 [200/710] Compiling C object lib/librte_gro.a.p/gro_gro_tcp6.c.o 00:02:00.318 [201/710] Compiling C object lib/librte_gro.a.p/gro_gro_tcp4.c.o 00:02:00.318 [202/710] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_tcp4.c.o 00:02:00.318 [203/710] Compiling C object lib/librte_gso.a.p/gso_rte_gso.c.o 00:02:00.318 [204/710] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:02:00.582 [205/710] Compiling C object lib/librte_gro.a.p/gro_gro_udp4.c.o 00:02:00.582 [206/710] Compiling C object lib/librte_gro.a.p/gro_rte_gro.c.o 00:02:00.582 [207/710] Compiling C object lib/librte_gpudev.a.p/gpudev_gpudev.c.o 00:02:00.582 [208/710] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_udp4.c.o 00:02:00.582 [209/710] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:02:00.582 [210/710] Linking static target lib/librte_gpudev.a 00:02:00.582 [211/710] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_tcp4.c.o 00:02:00.582 [212/710] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:02:00.582 [213/710] Linking static target lib/librte_gro.a 00:02:00.582 [214/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_reassembly.c.o 00:02:00.582 [215/710] Generating lib/bpf.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.582 [216/710] Compiling C object lib/librte_jobstats.a.p/jobstats_rte_jobstats.c.o 00:02:00.583 [217/710] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.583 [218/710] Linking static target lib/librte_jobstats.a 00:02:00.847 [219/710] Compiling C object lib/librte_acl.a.p/acl_acl_bld.c.o 00:02:00.847 [220/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_reassembly.c.o 00:02:00.847 [221/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_dma_adapter.c.o 00:02:00.847 [222/710] Generating lib/gro.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.110 [223/710] Generating lib/dispatcher.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.110 [224/710] Compiling C object lib/librte_latencystats.a.p/latencystats_rte_latencystats.c.o 00:02:01.110 [225/710] Linking static target lib/librte_latencystats.a 00:02:01.110 [226/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_ip_frag_internal.c.o 00:02:01.110 [227/710] Generating lib/jobstats.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.375 [228/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ip_frag_common.c.o 00:02:01.375 [229/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_fragmentation.c.o 00:02:01.375 [230/710] Compiling C object lib/member/libsketch_avx512_tmp.a.p/rte_member_sketch_avx512.c.o 00:02:01.375 [231/710] Linking static target lib/member/libsketch_avx512_tmp.a 00:02:01.375 [232/710] Compiling C object lib/librte_member.a.p/member_rte_member.c.o 00:02:01.375 [233/710] Compiling C object lib/librte_acl.a.p/acl_acl_run_sse.c.o 00:02:01.375 [234/710] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm.c.o 00:02:01.375 [235/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_fragmentation.c.o 00:02:01.375 [236/710] Linking static target lib/librte_ip_frag.a 00:02:01.375 [237/710] Generating lib/latencystats.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.636 [238/710] Compiling C object lib/librte_sched.a.p/sched_rte_approx.c.o 00:02:01.636 [239/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_crypto_adapter.c.o 00:02:01.636 [240/710] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:02:01.636 [241/710] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:02:01.897 [242/710] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:02:01.897 [243/710] Compiling C object lib/librte_mldev.a.p/mldev_rte_mldev_pmd.c.o 00:02:01.897 [244/710] Generating lib/gpudev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.897 [245/710] Generating lib/ip_frag.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.897 [246/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils.c.o 00:02:01.897 [247/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_tx_adapter.c.o 00:02:02.158 [248/710] Compiling C object lib/librte_gso.a.p/gso_gso_common.c.o 00:02:02.158 [249/710] Linking static target lib/librte_gso.a 00:02:02.158 [250/710] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:02:02.158 [251/710] Compiling C object lib/librte_regexdev.a.p/regexdev_rte_regexdev.c.o 00:02:02.158 [252/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_eventdev.c.o 00:02:02.158 [253/710] Linking static target lib/librte_regexdev.a 00:02:02.158 [254/710] Compiling C object lib/librte_member.a.p/member_rte_member_vbf.c.o 00:02:02.158 [255/710] Compiling C object lib/librte_rawdev.a.p/rawdev_rte_rawdev.c.o 00:02:02.158 [256/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils_scalar_bfloat16.c.o 00:02:02.158 [257/710] Linking static target lib/librte_rawdev.a 00:02:02.158 [258/710] Compiling C object lib/librte_mldev.a.p/mldev_rte_mldev.c.o 00:02:02.423 [259/710] Compiling C object lib/librte_sched.a.p/sched_rte_red.c.o 00:02:02.423 [260/710] Generating lib/gso.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.423 [261/710] Compiling C object lib/librte_sched.a.p/sched_rte_pie.c.o 00:02:02.423 [262/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils_scalar.c.o 00:02:02.423 [263/710] Linking static target lib/librte_mldev.a 00:02:02.423 [264/710] Compiling C object lib/librte_efd.a.p/efd_rte_efd.c.o 00:02:02.423 [265/710] Linking static target lib/librte_efd.a 00:02:02.423 [266/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack.c.o 00:02:02.423 [267/710] Compiling C object lib/librte_pcapng.a.p/pcapng_rte_pcapng.c.o 00:02:02.689 [268/710] Linking static target lib/librte_pcapng.a 00:02:02.689 [269/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack_std.c.o 00:02:02.689 [270/710] Compiling C object lib/acl/libavx2_tmp.a.p/acl_run_avx2.c.o 00:02:02.689 [271/710] Linking static target lib/acl/libavx2_tmp.a 00:02:02.689 [272/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack_lf.c.o 00:02:02.689 [273/710] Linking static target lib/librte_stack.a 00:02:02.689 [274/710] Compiling C object lib/librte_member.a.p/member_rte_member_ht.c.o 00:02:02.689 [275/710] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:02:02.689 [276/710] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm6.c.o 00:02:02.689 [277/710] Linking static target lib/librte_lpm.a 00:02:02.951 [278/710] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:02:02.951 [279/710] Generating lib/efd.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.951 [280/710] Compiling C object lib/librte_rib.a.p/rib_rte_rib.c.o 00:02:02.951 [281/710] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:02:02.951 [282/710] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:02:02.951 [283/710] Generating lib/pcapng.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.951 [284/710] Generating lib/rawdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.951 [285/710] Generating lib/stack.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.951 [286/710] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:02:02.951 [287/710] Linking static target lib/librte_hash.a 00:02:03.241 [288/710] Compiling C object lib/acl/libavx512_tmp.a.p/acl_run_avx512.c.o 00:02:03.241 [289/710] Linking static target lib/acl/libavx512_tmp.a 00:02:03.241 [290/710] Linking static target lib/librte_acl.a 00:02:03.241 [291/710] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:02:03.241 [292/710] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:02:03.241 [293/710] Linking static target lib/librte_power.a 00:02:03.241 [294/710] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:02:03.241 [295/710] Linking static target lib/librte_reorder.a 00:02:03.241 [296/710] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:02:03.241 [297/710] Generating lib/regexdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.529 [298/710] Generating lib/lpm.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.529 [299/710] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:02:03.529 [300/710] Linking static target lib/librte_security.a 00:02:03.529 [301/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ses.c.o 00:02:03.529 [302/710] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:02:03.529 [303/710] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:02:03.529 [304/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:02:03.529 [305/710] Generating lib/acl.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.852 [306/710] Linking static target lib/librte_mbuf.a 00:02:03.852 [307/710] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:02:03.852 [308/710] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.852 [309/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_telemetry.c.o 00:02:03.852 [310/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_crypto.c.o 00:02:03.852 [311/710] Compiling C object lib/librte_rib.a.p/rib_rte_rib6.c.o 00:02:03.853 [312/710] Linking static target lib/librte_rib.a 00:02:03.853 [313/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_ctrl_pdu.c.o 00:02:03.853 [314/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_reorder.c.o 00:02:03.853 [315/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_cnt.c.o 00:02:03.853 [316/710] Compiling C object lib/librte_ipsec.a.p/ipsec_sa.c.o 00:02:03.853 [317/710] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:02:04.147 [318/710] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:02:04.147 [319/710] Compiling C object lib/librte_table.a.p/table_rte_swx_keycmp.c.o 00:02:04.147 [320/710] Compiling C object lib/fib/libdir24_8_avx512_tmp.a.p/dir24_8_avx512.c.o 00:02:04.148 [321/710] Linking static target lib/fib/libdir24_8_avx512_tmp.a 00:02:04.148 [322/710] Compiling C object lib/librte_fib.a.p/fib_rte_fib.c.o 00:02:04.148 [323/710] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:02:04.148 [324/710] Compiling C object lib/fib/libtrie_avx512_tmp.a.p/trie_avx512.c.o 00:02:04.148 [325/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:02:04.148 [326/710] Linking static target lib/fib/libtrie_avx512_tmp.a 00:02:04.148 [327/710] Compiling C object lib/librte_fib.a.p/fib_rte_fib6.c.o 00:02:04.407 [328/710] Generating lib/mldev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:04.407 [329/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_rx_adapter.c.o 00:02:04.407 [330/710] Generating lib/rib.sym_chk with a custom command (wrapped by meson to capture output) 00:02:04.407 [331/710] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:02:04.669 [332/710] Compiling C object lib/librte_port.a.p/port_rte_port_sched.c.o 00:02:04.669 [333/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_timer_adapter.c.o 00:02:04.669 [334/710] Compiling C object lib/librte_pdcp.a.p/pdcp_rte_pdcp.c.o 00:02:04.669 [335/710] Linking static target lib/librte_eventdev.a 00:02:04.931 [336/710] Compiling C object lib/librte_member.a.p/member_rte_member_sketch.c.o 00:02:04.931 [337/710] Linking static target lib/librte_member.a 00:02:04.931 [338/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_sad.c.o 00:02:04.931 [339/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:02:05.195 [340/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:02:05.195 [341/710] Linking static target lib/librte_cryptodev.a 00:02:05.195 [342/710] Compiling C object lib/librte_port.a.p/port_rte_port_frag.c.o 00:02:05.195 [343/710] Compiling C object lib/librte_port.a.p/port_rte_port_fd.c.o 00:02:05.195 [344/710] Compiling C object lib/librte_port.a.p/port_rte_port_ethdev.c.o 00:02:05.195 [345/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_selector.c.o 00:02:05.195 [346/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_wm.c.o 00:02:05.457 [347/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:02:05.457 [348/710] Compiling C object lib/librte_fib.a.p/fib_trie.c.o 00:02:05.457 [349/710] Compiling C object lib/librte_table.a.p/table_rte_table_array.c.o 00:02:05.457 [350/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_learner.c.o 00:02:05.457 [351/710] Generating lib/member.sym_chk with a custom command (wrapped by meson to capture output) 00:02:05.457 [352/710] Linking static target lib/librte_ethdev.a 00:02:05.457 [353/710] Compiling C object lib/librte_port.a.p/port_rte_port_ras.c.o 00:02:05.457 [354/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_em.c.o 00:02:05.457 [355/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_cuckoo.c.o 00:02:05.457 [356/710] Compiling C object lib/librte_sched.a.p/sched_rte_sched.c.o 00:02:05.457 [357/710] Linking static target lib/librte_sched.a 00:02:05.457 [358/710] Compiling C object lib/librte_fib.a.p/fib_dir24_8.c.o 00:02:05.457 [359/710] Linking static target lib/librte_fib.a 00:02:05.457 [360/710] Compiling C object lib/librte_table.a.p/table_rte_table_lpm.c.o 00:02:05.457 [361/710] Compiling C object lib/librte_table.a.p/table_rte_table_acl.c.o 00:02:05.719 [362/710] Compiling C object lib/librte_table.a.p/table_rte_table_stub.c.o 00:02:05.719 [363/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ethdev.c.o 00:02:05.719 [364/710] Compiling C object lib/librte_table.a.p/table_rte_table_lpm_ipv6.c.o 00:02:05.719 [365/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_fd.c.o 00:02:05.983 [366/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_port_in_action.c.o 00:02:05.983 [367/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:02:05.983 [368/710] Compiling C object lib/librte_port.a.p/port_rte_port_sym_crypto.c.o 00:02:05.983 [369/710] Compiling C object lib/librte_port.a.p/port_rte_port_eventdev.c.o 00:02:05.983 [370/710] Generating lib/fib.sym_chk with a custom command (wrapped by meson to capture output) 00:02:05.983 [371/710] Generating lib/sched.sym_chk with a custom command (wrapped by meson to capture output) 00:02:06.242 [372/710] Compiling C object lib/librte_node.a.p/node_null.c.o 00:02:06.242 [373/710] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_outb.c.o 00:02:06.505 [374/710] Compiling C object lib/librte_pdump.a.p/pdump_rte_pdump.c.o 00:02:06.505 [375/710] Linking static target lib/librte_pdump.a 00:02:06.505 [376/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ring.c.o 00:02:06.505 [377/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key8.c.o 00:02:06.505 [378/710] Compiling C object lib/librte_graph.a.p/graph_rte_graph_worker.c.o 00:02:06.505 [379/710] Compiling C object lib/librte_graph.a.p/graph_graph_ops.c.o 00:02:06.505 [380/710] Compiling C object lib/librte_graph.a.p/graph_graph_debug.c.o 00:02:06.505 [381/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:02:06.769 [382/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_ext.c.o 00:02:06.769 [383/710] Compiling C object lib/librte_graph.a.p/graph_node.c.o 00:02:06.769 [384/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key16.c.o 00:02:06.769 [385/710] Compiling C object lib/librte_graph.a.p/graph_graph_populate.c.o 00:02:06.769 [386/710] Compiling C object lib/librte_graph.a.p/graph_graph_pcap.c.o 00:02:06.769 [387/710] Compiling C object lib/librte_node.a.p/node_ethdev_ctrl.c.o 00:02:06.769 [388/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_lru.c.o 00:02:06.769 [389/710] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:02:06.769 [390/710] Generating lib/pdump.sym_chk with a custom command (wrapped by meson to capture output) 00:02:06.769 [391/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_pipeline.c.o 00:02:07.028 [392/710] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_inb.c.o 00:02:07.028 [393/710] Linking static target lib/librte_ipsec.a 00:02:07.028 [394/710] Compiling C object lib/librte_graph.a.p/graph_graph.c.o 00:02:07.028 [395/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key32.c.o 00:02:07.028 [396/710] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.028 [397/710] Linking static target lib/librte_table.a 00:02:07.287 [398/710] Compiling C object lib/librte_node.a.p/node_log.c.o 00:02:07.287 [399/710] Compiling C object lib/librte_node.a.p/node_pkt_drop.c.o 00:02:07.287 [400/710] Compiling C object lib/librte_node.a.p/node_kernel_tx.c.o 00:02:07.552 [401/710] Generating lib/ipsec.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.552 [402/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_source_sink.c.o 00:02:07.813 [403/710] Compiling C object lib/librte_node.a.p/node_ethdev_tx.c.o 00:02:07.813 [404/710] Compiling C object lib/librte_node.a.p/node_ethdev_rx.c.o 00:02:07.813 [405/710] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.813 [406/710] Compiling C object lib/librte_graph.a.p/graph_graph_stats.c.o 00:02:07.813 [407/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:02:08.074 [408/710] Linking target lib/librte_eal.so.24.0 00:02:08.074 [409/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_diag.c.o 00:02:08.074 [410/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:02:08.074 [411/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:02:08.074 [412/710] Generating lib/eventdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.074 [413/710] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:02:08.074 [414/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:02:08.074 [415/710] Linking static target drivers/libtmp_rte_bus_vdev.a 00:02:08.074 [416/710] Compiling C object lib/librte_port.a.p/port_rte_port_ring.c.o 00:02:08.074 [417/710] Generating lib/table.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.074 [418/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ipsec.c.o 00:02:08.336 [419/710] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:02:08.336 [420/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_hmc.c.o 00:02:08.336 [421/710] Linking target lib/librte_ring.so.24.0 00:02:08.336 [422/710] Linking target lib/librte_meter.so.24.0 00:02:08.336 [423/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:02:08.600 [424/710] Linking target lib/librte_pci.so.24.0 00:02:08.600 [425/710] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:02:08.600 [426/710] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:02:08.600 [427/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_dcb.c.o 00:02:08.600 [428/710] Linking target lib/librte_rcu.so.24.0 00:02:08.600 [429/710] Linking target lib/librte_mempool.so.24.0 00:02:08.600 [430/710] Linking target lib/librte_timer.so.24.0 00:02:08.600 [431/710] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:02:08.600 [432/710] Compiling C object lib/librte_port.a.p/port_rte_port_source_sink.c.o 00:02:08.600 [433/710] Linking target lib/librte_acl.so.24.0 00:02:08.863 [434/710] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:02:08.863 [435/710] Linking target lib/librte_cfgfile.so.24.0 00:02:08.863 [436/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ctl.c.o 00:02:08.863 [437/710] Linking target lib/librte_dmadev.so.24.0 00:02:08.863 [438/710] Linking target lib/librte_jobstats.so.24.0 00:02:08.863 [439/710] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:02:08.863 [440/710] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:02:08.863 [441/710] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:02:08.863 [442/710] Linking target lib/librte_rawdev.so.24.0 00:02:08.863 [443/710] Linking static target drivers/libtmp_rte_bus_pci.a 00:02:08.863 [444/710] Linking static target lib/librte_port.a 00:02:08.863 [445/710] Linking target lib/librte_stack.so.24.0 00:02:08.863 [446/710] Compiling C object lib/librte_graph.a.p/graph_rte_graph_model_mcore_dispatch.c.o 00:02:08.863 [447/710] Linking target lib/librte_mbuf.so.24.0 00:02:08.863 [448/710] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:08.863 [449/710] Linking target lib/librte_rib.so.24.0 00:02:08.863 [450/710] Linking static target lib/librte_graph.a 00:02:08.863 [451/710] Linking static target drivers/librte_bus_vdev.a 00:02:08.863 [452/710] Generating symbol file lib/librte_acl.so.24.0.p/librte_acl.so.24.0.symbols 00:02:08.863 [453/710] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:09.128 [454/710] Compiling C object lib/librte_node.a.p/node_ip4_reassembly.c.o 00:02:09.128 [455/710] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:02:09.128 [456/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_lan_hmc.c.o 00:02:09.128 [457/710] Compiling C object lib/librte_node.a.p/node_kernel_rx.c.o 00:02:09.128 [458/710] Generating symbol file lib/librte_rib.so.24.0.p/librte_rib.so.24.0.symbols 00:02:09.128 [459/710] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:02:09.128 [460/710] Linking target lib/librte_net.so.24.0 00:02:09.390 [461/710] Linking target lib/librte_fib.so.24.0 00:02:09.390 [462/710] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:02:09.390 [463/710] Linking target lib/librte_bbdev.so.24.0 00:02:09.390 [464/710] Compiling C object app/dpdk-graph.p/graph_cli.c.o 00:02:09.390 [465/710] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:09.390 [466/710] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:02:09.390 [467/710] Linking target lib/librte_compressdev.so.24.0 00:02:09.390 [468/710] Linking target lib/librte_distributor.so.24.0 00:02:09.390 [469/710] Linking target lib/librte_cryptodev.so.24.0 00:02:09.390 [470/710] Linking target lib/librte_gpudev.so.24.0 00:02:09.390 [471/710] Linking target lib/librte_regexdev.so.24.0 00:02:09.390 [472/710] Compiling C object app/dpdk-graph.p/graph_conn.c.o 00:02:09.390 [473/710] Linking target lib/librte_mldev.so.24.0 00:02:09.390 [474/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_vf_representor.c.o 00:02:09.390 [475/710] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:09.390 [476/710] Compiling C object app/dpdk-graph.p/graph_ethdev_rx.c.o 00:02:09.390 [477/710] Linking static target drivers/libtmp_rte_mempool_ring.a 00:02:09.390 [478/710] Linking target lib/librte_reorder.so.24.0 00:02:09.390 [479/710] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:09.390 [480/710] Linking static target drivers/librte_bus_pci.a 00:02:09.390 [481/710] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:02:09.653 [482/710] Linking target lib/librte_sched.so.24.0 00:02:09.654 [483/710] Linking target drivers/librte_bus_vdev.so.24.0 00:02:09.654 [484/710] Linking target lib/librte_cmdline.so.24.0 00:02:09.654 [485/710] Linking target lib/librte_hash.so.24.0 00:02:09.654 [486/710] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:02:09.654 [487/710] Generating lib/port.sym_chk with a custom command (wrapped by meson to capture output) 00:02:09.654 [488/710] Generating symbol file lib/librte_reorder.so.24.0.p/librte_reorder.so.24.0.symbols 00:02:09.654 [489/710] Linking target lib/librte_security.so.24.0 00:02:09.654 [490/710] Compiling C object app/dpdk-graph.p/graph_graph.c.o 00:02:09.913 [491/710] Generating symbol file lib/librte_sched.so.24.0.p/librte_sched.so.24.0.symbols 00:02:09.913 [492/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_tm.c.o 00:02:09.913 [493/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_hash.c.o 00:02:09.913 [494/710] Generating symbol file drivers/librte_bus_vdev.so.24.0.p/librte_bus_vdev.so.24.0.symbols 00:02:09.913 [495/710] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:02:09.913 [496/710] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:02:09.913 [497/710] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:09.913 [498/710] Generating lib/graph.sym_chk with a custom command (wrapped by meson to capture output) 00:02:09.913 [499/710] Linking target lib/librte_efd.so.24.0 00:02:09.913 [500/710] Compiling C object app/dpdk-graph.p/graph_ethdev.c.o 00:02:09.913 [501/710] Linking static target drivers/librte_mempool_ring.a 00:02:09.913 [502/710] Linking target lib/librte_lpm.so.24.0 00:02:09.913 [503/710] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:09.913 [504/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_pf.c.o 00:02:09.913 [505/710] Linking target lib/librte_member.so.24.0 00:02:09.913 [506/710] Generating symbol file lib/librte_security.so.24.0.p/librte_security.so.24.0.symbols 00:02:09.913 [507/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_recycle_mbufs_vec_common.c.o 00:02:09.913 [508/710] Linking target drivers/librte_mempool_ring.so.24.0 00:02:10.176 [509/710] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_commands.c.o 00:02:10.176 [510/710] Linking target lib/librte_ipsec.so.24.0 00:02:10.176 [511/710] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_cmdline_test.c.o 00:02:10.176 [512/710] Compiling C object app/dpdk-dumpcap.p/dumpcap_main.c.o 00:02:10.176 [513/710] Compiling C object lib/librte_node.a.p/node_ip4_local.c.o 00:02:10.176 [514/710] Generating symbol file lib/librte_lpm.so.24.0.p/librte_lpm.so.24.0.symbols 00:02:10.176 [515/710] Compiling C object app/dpdk-graph.p/graph_ip4_route.c.o 00:02:10.176 [516/710] Compiling C object app/dpdk-graph.p/graph_ip6_route.c.o 00:02:10.176 [517/710] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:10.443 [518/710] Compiling C object app/dpdk-graph.p/graph_mempool.c.o 00:02:10.443 [519/710] Generating symbol file lib/librte_ipsec.so.24.0.p/librte_ipsec.so.24.0.symbols 00:02:10.443 [520/710] Linking target drivers/librte_bus_pci.so.24.0 00:02:10.443 [521/710] Compiling C object app/dpdk-graph.p/graph_main.c.o 00:02:10.443 [522/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline_spec.c.o 00:02:10.443 [523/710] Compiling C object app/dpdk-graph.p/graph_l3fwd.c.o 00:02:10.702 [524/710] Generating symbol file drivers/librte_bus_pci.so.24.0.p/librte_bus_pci.so.24.0.symbols 00:02:10.702 [525/710] Compiling C object app/dpdk-graph.p/graph_utils.c.o 00:02:10.962 [526/710] Compiling C object lib/librte_node.a.p/node_udp4_input.c.o 00:02:10.962 [527/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_fdir.c.o 00:02:10.962 [528/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_main.c.o 00:02:11.221 [529/710] Compiling C object drivers/net/i40e/libi40e_avx512_lib.a.p/i40e_rxtx_vec_avx512.c.o 00:02:11.221 [530/710] Linking static target drivers/net/i40e/libi40e_avx512_lib.a 00:02:11.221 [531/710] Compiling C object app/dpdk-graph.p/graph_neigh.c.o 00:02:11.221 [532/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_test.c.o 00:02:11.221 [533/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_adminq.c.o 00:02:11.481 [534/710] Compiling C object drivers/net/i40e/libi40e_avx2_lib.a.p/i40e_rxtx_vec_avx2.c.o 00:02:11.481 [535/710] Linking static target drivers/net/i40e/libi40e_avx2_lib.a 00:02:11.481 [536/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_options_parse.c.o 00:02:11.481 [537/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_parser.c.o 00:02:11.481 [538/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_common.c.o 00:02:11.481 [539/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_main.c.o 00:02:11.744 [540/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_common.c.o 00:02:11.744 [541/710] Compiling C object app/dpdk-test-acl.p/test-acl_main.c.o 00:02:11.744 [542/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vectors.c.o 00:02:12.006 [543/710] Compiling C object lib/librte_node.a.p/node_pkt_cls.c.o 00:02:12.006 [544/710] Compiling C object lib/librte_node.a.p/node_ip6_lookup.c.o 00:02:12.006 [545/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vector_parsing.c.o 00:02:12.266 [546/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_nvm.c.o 00:02:12.266 [547/710] Linking static target drivers/net/i40e/base/libi40e_base.a 00:02:12.266 [548/710] Compiling C object app/dpdk-pdump.p/pdump_main.c.o 00:02:12.266 [549/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_ops.c.o 00:02:12.266 [550/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_flow.c.o 00:02:12.266 [551/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_options_parsing.c.o 00:02:12.266 [552/710] Compiling C object app/dpdk-test-dma-perf.p/test-dma-perf_main.c.o 00:02:12.266 [553/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_main.c.o 00:02:12.267 [554/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_test.c.o 00:02:12.528 [555/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_main.c.o 00:02:12.528 [556/710] Compiling C object app/dpdk-proc-info.p/proc-info_main.c.o 00:02:12.528 [557/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_vector.c.o 00:02:12.528 [558/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_parser.c.o 00:02:12.791 [559/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_options.c.o 00:02:13.052 [560/710] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:13.052 [561/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_common.c.o 00:02:13.052 [562/710] Linking target lib/librte_ethdev.so.24.0 00:02:13.312 [563/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_rte_pmd_i40e.c.o 00:02:13.312 [564/710] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:02:13.312 [565/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_flow_gen.c.o 00:02:13.312 [566/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_atq.c.o 00:02:13.312 [567/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_main.c.o 00:02:13.312 [568/710] Linking target lib/librte_metrics.so.24.0 00:02:13.574 [569/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_items_gen.c.o 00:02:13.574 [570/710] Linking target lib/librte_bpf.so.24.0 00:02:13.574 [571/710] Linking target lib/librte_gro.so.24.0 00:02:13.574 [572/710] Linking target lib/librte_eventdev.so.24.0 00:02:13.574 [573/710] Linking target lib/librte_gso.so.24.0 00:02:13.574 [574/710] Linking target lib/librte_ip_frag.so.24.0 00:02:13.574 [575/710] Compiling C object app/dpdk-test-gpudev.p/test-gpudev_main.c.o 00:02:13.574 [576/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_options.c.o 00:02:13.574 [577/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_device_ops.c.o 00:02:13.574 [578/710] Linking target lib/librte_pcapng.so.24.0 00:02:13.574 [579/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_queue.c.o 00:02:13.574 [580/710] Generating symbol file lib/librte_metrics.so.24.0.p/librte_metrics.so.24.0.symbols 00:02:13.574 [581/710] Linking target lib/librte_power.so.24.0 00:02:13.838 [582/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_model_common.c.o 00:02:13.838 [583/710] Generating symbol file lib/librte_bpf.so.24.0.p/librte_bpf.so.24.0.symbols 00:02:13.838 [584/710] Generating symbol file lib/librte_eventdev.so.24.0.p/librte_eventdev.so.24.0.symbols 00:02:13.838 [585/710] Linking target lib/librte_bitratestats.so.24.0 00:02:13.838 [586/710] Linking target lib/librte_latencystats.so.24.0 00:02:13.838 [587/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_ordered.c.o 00:02:13.838 [588/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_actions_gen.c.o 00:02:13.838 [589/710] Generating symbol file lib/librte_ip_frag.so.24.0.p/librte_ip_frag.so.24.0.symbols 00:02:13.838 [590/710] Linking target lib/librte_dispatcher.so.24.0 00:02:13.838 [591/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_sse.c.o 00:02:13.838 [592/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_interleave.c.o 00:02:13.838 [593/710] Generating symbol file lib/librte_pcapng.so.24.0.p/librte_pcapng.so.24.0.symbols 00:02:13.838 [594/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_model_ops.c.o 00:02:13.838 [595/710] Linking target lib/librte_port.so.24.0 00:02:13.838 [596/710] Linking target lib/librte_pdump.so.24.0 00:02:14.105 [597/710] Compiling C object lib/librte_node.a.p/node_ip4_lookup.c.o 00:02:14.105 [598/710] Compiling C object app/dpdk-test-dma-perf.p/test-dma-perf_benchmark.c.o 00:02:14.105 [599/710] Linking target lib/librte_graph.so.24.0 00:02:14.105 [600/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_atq.c.o 00:02:14.105 [601/710] Compiling C object app/dpdk-test-fib.p/test-fib_main.c.o 00:02:14.105 [602/710] Generating symbol file lib/librte_port.so.24.0.p/librte_port.so.24.0.symbols 00:02:14.105 [603/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_queue.c.o 00:02:14.105 [604/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_process.c.o 00:02:14.367 [605/710] Linking static target lib/librte_pdcp.a 00:02:14.367 [606/710] Generating symbol file lib/librte_graph.so.24.0.p/librte_graph.so.24.0.symbols 00:02:14.367 [607/710] Linking target lib/librte_table.so.24.0 00:02:14.367 [608/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_stats.c.o 00:02:14.367 [609/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_common.c.o 00:02:14.627 [610/710] Generating symbol file lib/librte_table.so.24.0.p/librte_table.so.24.0.symbols 00:02:14.627 [611/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_common.c.o 00:02:14.628 [612/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_config.c.o 00:02:14.889 [613/710] Generating lib/pdcp.sym_chk with a custom command (wrapped by meson to capture output) 00:02:14.889 [614/710] Linking target lib/librte_pdcp.so.24.0 00:02:14.889 [615/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_verify.c.o 00:02:14.889 [616/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev.c.o 00:02:14.889 [617/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_init.c.o 00:02:15.151 [618/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_throughput.c.o 00:02:15.151 [619/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_main.c.o 00:02:15.151 [620/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_acl.c.o 00:02:15.151 [621/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_stub.c.o 00:02:15.151 [622/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm_ipv6.c.o 00:02:15.151 [623/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm.c.o 00:02:15.151 [624/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_cman.c.o 00:02:15.151 [625/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_pmd_cyclecount.c.o 00:02:15.415 [626/710] Compiling C object app/dpdk-testpmd.p/test-pmd_5tswap.c.o 00:02:15.415 [627/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_main.c.o 00:02:15.415 [628/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmd_flex_item.c.o 00:02:15.415 [629/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_hash.c.o 00:02:15.674 [630/710] Compiling C object app/dpdk-testpmd.p/test-pmd_flowgen.c.o 00:02:15.933 [631/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx.c.o 00:02:15.933 [632/710] Compiling C object app/dpdk-testpmd.p/test-pmd_iofwd.c.o 00:02:15.933 [633/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_tm.c.o 00:02:15.933 [634/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_mtr.c.o 00:02:15.933 [635/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_runtime.c.o 00:02:15.933 [636/710] Compiling C object app/dpdk-testpmd.p/test-pmd_macfwd.c.o 00:02:15.933 [637/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_throughput.c.o 00:02:16.192 [638/710] Compiling C object app/dpdk-testpmd.p/test-pmd_shared_rxq_fwd.c.o 00:02:16.192 [639/710] Compiling C object app/dpdk-testpmd.p/test-pmd_macswap.c.o 00:02:16.192 [640/710] Compiling C object app/dpdk-testpmd.p/test-pmd_ieee1588fwd.c.o 00:02:16.192 [641/710] Compiling C object app/dpdk-testpmd.p/test-pmd_recycle_mbufs.c.o 00:02:16.192 [642/710] Compiling C object app/dpdk-testpmd.p/test-pmd_rxonly.c.o 00:02:16.451 [643/710] Compiling C object app/dpdk-testpmd.p/test-pmd_icmpecho.c.o 00:02:16.451 [644/710] Compiling C object app/dpdk-testpmd.p/test-pmd_bpf_cmd.c.o 00:02:16.451 [645/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_latency.c.o 00:02:16.451 [646/710] Compiling C object app/dpdk-test-sad.p/test-sad_main.c.o 00:02:16.709 [647/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_atq.c.o 00:02:16.709 [648/710] Compiling C object app/dpdk-testpmd.p/test-pmd_util.c.o 00:02:16.709 [649/710] Compiling C object app/dpdk-test-security-perf.p/test-security-perf_test_security_perf.c.o 00:02:16.709 [650/710] Compiling C object app/dpdk-testpmd.p/.._drivers_net_i40e_i40e_testpmd.c.o 00:02:16.968 [651/710] Compiling C object app/dpdk-testpmd.p/test-pmd_csumonly.c.o 00:02:17.226 [652/710] Compiling C object app/dpdk-testpmd.p/test-pmd_parameters.c.o 00:02:17.226 [653/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_queue.c.o 00:02:17.226 [654/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_cyclecount.c.o 00:02:17.226 [655/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_ethdev.c.o 00:02:17.226 [656/710] Linking static target drivers/libtmp_rte_net_i40e.a 00:02:17.226 [657/710] Compiling C object app/dpdk-test-security-perf.p/test_test_cryptodev_security_ipsec.c.o 00:02:17.226 [658/710] Compiling C object app/dpdk-test-regex.p/test-regex_main.c.o 00:02:17.484 [659/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_common.c.o 00:02:17.742 [660/710] Generating drivers/rte_net_i40e.pmd.c with a custom command 00:02:17.742 [661/710] Compiling C object drivers/librte_net_i40e.so.24.0.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:02:17.742 [662/710] Compiling C object drivers/librte_net_i40e.a.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:02:17.742 [663/710] Linking static target drivers/librte_net_i40e.a 00:02:18.000 [664/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline.c.o 00:02:18.000 [665/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_verify.c.o 00:02:18.000 [666/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline.c.o 00:02:18.000 [667/710] Compiling C object app/dpdk-testpmd.p/test-pmd_testpmd.c.o 00:02:18.259 [668/710] Generating drivers/rte_net_i40e.sym_chk with a custom command (wrapped by meson to capture output) 00:02:18.517 [669/710] Compiling C object app/dpdk-testpmd.p/test-pmd_noisy_vnf.c.o 00:02:18.517 [670/710] Linking target drivers/librte_net_i40e.so.24.0 00:02:18.774 [671/710] Compiling C object lib/librte_node.a.p/node_ip4_rewrite.c.o 00:02:18.774 [672/710] Compiling C object lib/librte_node.a.p/node_ip6_rewrite.c.o 00:02:18.775 [673/710] Linking static target lib/librte_node.a 00:02:19.033 [674/710] Compiling C object app/dpdk-testpmd.p/test-pmd_txonly.c.o 00:02:19.033 [675/710] Generating lib/node.sym_chk with a custom command (wrapped by meson to capture output) 00:02:19.292 [676/710] Linking target lib/librte_node.so.24.0 00:02:20.226 [677/710] Compiling C object app/dpdk-testpmd.p/test-pmd_config.c.o 00:02:20.484 [678/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_common.c.o 00:02:20.484 [679/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_common.c.o 00:02:22.383 [680/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_flow.c.o 00:02:22.640 [681/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_perf.c.o 00:02:27.906 [682/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:59.977 [683/710] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:59.977 [684/710] Linking static target lib/librte_vhost.a 00:02:59.977 [685/710] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:59.977 [686/710] Linking target lib/librte_vhost.so.24.0 00:03:12.245 [687/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_table_action.c.o 00:03:12.245 [688/710] Linking static target lib/librte_pipeline.a 00:03:12.811 [689/710] Linking target app/dpdk-dumpcap 00:03:12.811 [690/710] Linking target app/dpdk-proc-info 00:03:12.811 [691/710] Linking target app/dpdk-pdump 00:03:12.811 [692/710] Linking target app/dpdk-test-sad 00:03:12.811 [693/710] Linking target app/dpdk-test-gpudev 00:03:12.811 [694/710] Linking target app/dpdk-test-regex 00:03:12.811 [695/710] Linking target app/dpdk-test-dma-perf 00:03:12.811 [696/710] Linking target app/dpdk-test-acl 00:03:12.811 [697/710] Linking target app/dpdk-test-fib 00:03:12.811 [698/710] Linking target app/dpdk-test-security-perf 00:03:12.811 [699/710] Linking target app/dpdk-test-cmdline 00:03:12.811 [700/710] Linking target app/dpdk-test-pipeline 00:03:12.811 [701/710] Linking target app/dpdk-test-flow-perf 00:03:12.811 [702/710] Linking target app/dpdk-graph 00:03:12.811 [703/710] Linking target app/dpdk-test-compress-perf 00:03:12.811 [704/710] Linking target app/dpdk-test-mldev 00:03:12.811 [705/710] Linking target app/dpdk-test-crypto-perf 00:03:12.811 [706/710] Linking target app/dpdk-test-bbdev 00:03:12.811 [707/710] Linking target app/dpdk-test-eventdev 00:03:13.070 [708/710] Linking target app/dpdk-testpmd 00:03:14.975 [709/710] Generating lib/pipeline.sym_chk with a custom command (wrapped by meson to capture output) 00:03:15.233 [710/710] Linking target lib/librte_pipeline.so.24.0 00:03:15.234 00:57:29 -- common/autobuild_common.sh@190 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 install 00:03:15.234 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:03:15.234 [0/1] Installing files. 00:03:15.495 Installing subdir /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples 00:03:15.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:03:15.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:03:15.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool 00:03:15.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:03:15.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:03:15.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:03:15.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:03:15.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:03:15.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:03:15.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:03:15.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.495 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/rt.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep0.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep1.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp6.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_process.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp4.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/run_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/bypass_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/linux_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/load_env.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_ipv6opts.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs_secgw.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_null_header_reconstruct.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/data_rxtx.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/ptpclient.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.496 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_fib.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_route.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_sequential.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/l2fwd-cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_aes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ecdsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ccm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_xts.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_cmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_tdes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_rsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_sha.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_gcm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_hmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/dmafwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:15.497 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/pkt_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/altivec/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/altivec 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/sse/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/sse 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/neon/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/neon 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/basicfwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_tx.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_group_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec_sa.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/pcap.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/packet.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_routing_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ethdev.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.498 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/rss.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_node/node.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_node 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_node/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_node 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/shared 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-macsec/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-macsec 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-macsec/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-macsec 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/vdpa_blk_compact.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:03:15.499 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/shared 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/client.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk_spec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk_compat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/flow_blocks.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:03:15.760 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/virtio_net.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/app_thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_pie.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cmdline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_red.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_ov.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/stats.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route_ecmp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/firewall.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow_crypto.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/tap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_x86.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:15.761 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_nop.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/ntb_fwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t2.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/README to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/dummy.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t3.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t1.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:03:15.762 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:03:15.762 Installing lib/librte_log.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_log.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_kvargs.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_kvargs.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_telemetry.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_telemetry.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_eal.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_eal.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_rcu.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_rcu.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_mempool.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_mempool.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_mbuf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_mbuf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_net.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_net.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_meter.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_meter.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_ethdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_ethdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_cmdline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_cmdline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_metrics.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_metrics.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_hash.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_hash.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_timer.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_timer.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_acl.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_acl.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_bbdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_bbdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_bitratestats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_bitratestats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_bpf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_bpf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_cfgfile.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_cfgfile.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_compressdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_compressdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_cryptodev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_cryptodev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_distributor.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_distributor.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_dmadev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_dmadev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_efd.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_efd.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_eventdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_eventdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_dispatcher.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_dispatcher.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_gpudev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_gpudev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_gro.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_gro.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_gso.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_gso.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_ip_frag.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_ip_frag.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_jobstats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_jobstats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_latencystats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_latencystats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_lpm.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_lpm.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.762 Installing lib/librte_member.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.763 Installing lib/librte_member.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.763 Installing lib/librte_pcapng.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.763 Installing lib/librte_pcapng.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.763 Installing lib/librte_power.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.763 Installing lib/librte_power.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.763 Installing lib/librte_rawdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.763 Installing lib/librte_rawdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.763 Installing lib/librte_regexdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.763 Installing lib/librte_regexdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.763 Installing lib/librte_mldev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.763 Installing lib/librte_mldev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.763 Installing lib/librte_rib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.763 Installing lib/librte_rib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.763 Installing lib/librte_reorder.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.763 Installing lib/librte_reorder.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.763 Installing lib/librte_sched.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.763 Installing lib/librte_sched.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.763 Installing lib/librte_security.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:15.763 Installing lib/librte_security.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_stack.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_stack.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_vhost.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_vhost.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_ipsec.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_ipsec.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_pdcp.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_pdcp.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_fib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_fib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_port.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_port.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_pdump.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_pdump.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_table.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_table.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_pipeline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_pipeline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_graph.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_graph.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_node.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.335 Installing lib/librte_node.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.336 Installing drivers/librte_bus_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.336 Installing drivers/librte_bus_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:03:16.336 Installing drivers/librte_bus_vdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.336 Installing drivers/librte_bus_vdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:03:16.336 Installing drivers/librte_mempool_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.336 Installing drivers/librte_mempool_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:03:16.336 Installing drivers/librte_net_i40e.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.336 Installing drivers/librte_net_i40e.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:03:16.336 Installing app/dpdk-dumpcap to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.336 Installing app/dpdk-graph to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.336 Installing app/dpdk-pdump to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.336 Installing app/dpdk-proc-info to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.336 Installing app/dpdk-test-acl to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.336 Installing app/dpdk-test-bbdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.336 Installing app/dpdk-test-cmdline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.336 Installing app/dpdk-test-compress-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.336 Installing app/dpdk-test-crypto-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.336 Installing app/dpdk-test-dma-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.336 Installing app/dpdk-test-eventdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.336 Installing app/dpdk-test-fib to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.336 Installing app/dpdk-test-flow-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.336 Installing app/dpdk-test-gpudev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.336 Installing app/dpdk-test-mldev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.336 Installing app/dpdk-test-pipeline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.336 Installing app/dpdk-testpmd to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.336 Installing app/dpdk-test-regex to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.336 Installing app/dpdk-test-sad to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.336 Installing app/dpdk-test-security-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/rte_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/log/rte_log.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/kvargs/rte_kvargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/telemetry/rte_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rtm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_alarm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitmap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_branch_prediction.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bus.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_class.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_compat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_debug.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_dev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_devargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_memconfig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_errno.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_epoll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_fbarray.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hexdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hypervisor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_interrupts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_keepalive.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_launch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lock_annotations.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_malloc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.336 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_mcslock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memory.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memzone.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_feature_defs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_features.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_per_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pflock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_random.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_reciprocal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqcount.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service_component.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_stdatomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_string_fns.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_tailq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_ticketlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_time.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point_register.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_uuid.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_version.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_vfio.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/linux/include/rte_os.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_c11_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_generic_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_zc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rcu/rte_rcu_qsbr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_ptype.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_pool_ops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_dyn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_udp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_dtls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_sctp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_icmp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_arp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ether.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_macsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_vxlan.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gre.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gtp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_mpls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_higig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ecpri.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_pdcp_hdr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_geneve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_l2tpv2.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ppp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/meter/rte_meter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_cman.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_dev_info.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.337 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_eth_ctrl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pci/rte_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_num.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_ipaddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_etheraddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_string.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_rdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_vt100.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_socket.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_cirbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_portlist.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_fbk_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_jhash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_sw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_x86_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/timer/rte_timer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl_osdep.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_op.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bitratestats/rte_bitrate.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/bpf_def.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cfgfile/rte_cfgfile.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_compressdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_comp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_sym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_asym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/distributor/rte_distributor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/efd/rte_efd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_crypto_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_dma_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_rx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_tx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_timer_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dispatcher/rte_dispatcher.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gpudev/rte_gpudev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gro/rte_gro.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gso/rte_gso.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ip_frag/rte_ip_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/jobstats/rte_jobstats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/latencystats/rte_latencystats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/member/rte_member.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pcapng/rte_pcapng.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_guest_channel.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_pmd_mgmt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_uncore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.338 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mldev/rte_mldev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mldev/rte_mldev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/reorder/rte_reorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_approx.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_red.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_pie.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_std.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_c11.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_stubs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vdpa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_async.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdcp/rte_pdcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdcp/rte_pdcp_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ras.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sym_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdump/rte_pdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_learner.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_selector.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_wm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_array.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_cuckoo.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm_ipv6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_stub.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_port_in_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_table_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_extern.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ctl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_model_mcore_dispatch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_model_rtc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_eth_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip4_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip6_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_udp4_input_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.339 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/pci/rte_bus_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.340 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/vdev/rte_bus_vdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.340 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/net/i40e/rte_pmd_i40e.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.340 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/dpdk-cmdline-gen.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.340 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-devbind.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.340 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-pmdinfo.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.340 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-telemetry.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.340 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-hugepages.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.340 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-rss-flows.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:16.340 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/rte_build_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.340 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk-libs.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:03:16.340 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:03:16.340 Installing symlink pointing to librte_log.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_log.so.24 00:03:16.340 Installing symlink pointing to librte_log.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_log.so 00:03:16.340 Installing symlink pointing to librte_kvargs.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so.24 00:03:16.340 Installing symlink pointing to librte_kvargs.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so 00:03:16.340 Installing symlink pointing to librte_telemetry.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so.24 00:03:16.340 Installing symlink pointing to librte_telemetry.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so 00:03:16.340 Installing symlink pointing to librte_eal.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so.24 00:03:16.340 Installing symlink pointing to librte_eal.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so 00:03:16.340 Installing symlink pointing to librte_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so.24 00:03:16.340 Installing symlink pointing to librte_ring.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so 00:03:16.340 Installing symlink pointing to librte_rcu.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so.24 00:03:16.340 Installing symlink pointing to librte_rcu.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so 00:03:16.340 Installing symlink pointing to librte_mempool.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so.24 00:03:16.340 Installing symlink pointing to librte_mempool.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so 00:03:16.340 Installing symlink pointing to librte_mbuf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so.24 00:03:16.340 Installing symlink pointing to librte_mbuf.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so 00:03:16.340 Installing symlink pointing to librte_net.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so.24 00:03:16.340 Installing symlink pointing to librte_net.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so 00:03:16.340 Installing symlink pointing to librte_meter.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so.24 00:03:16.340 Installing symlink pointing to librte_meter.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so 00:03:16.340 Installing symlink pointing to librte_ethdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so.24 00:03:16.340 Installing symlink pointing to librte_ethdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so 00:03:16.340 Installing symlink pointing to librte_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so.24 00:03:16.340 Installing symlink pointing to librte_pci.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so 00:03:16.340 Installing symlink pointing to librte_cmdline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so.24 00:03:16.340 Installing symlink pointing to librte_cmdline.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so 00:03:16.340 Installing symlink pointing to librte_metrics.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so.24 00:03:16.340 Installing symlink pointing to librte_metrics.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so 00:03:16.340 Installing symlink pointing to librte_hash.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so.24 00:03:16.340 Installing symlink pointing to librte_hash.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so 00:03:16.340 Installing symlink pointing to librte_timer.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so.24 00:03:16.340 Installing symlink pointing to librte_timer.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so 00:03:16.340 Installing symlink pointing to librte_acl.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so.24 00:03:16.340 Installing symlink pointing to librte_acl.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so 00:03:16.340 Installing symlink pointing to librte_bbdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so.24 00:03:16.340 Installing symlink pointing to librte_bbdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so 00:03:16.340 Installing symlink pointing to librte_bitratestats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so.24 00:03:16.340 Installing symlink pointing to librte_bitratestats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so 00:03:16.340 Installing symlink pointing to librte_bpf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so.24 00:03:16.340 Installing symlink pointing to librte_bpf.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so 00:03:16.340 Installing symlink pointing to librte_cfgfile.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so.24 00:03:16.340 Installing symlink pointing to librte_cfgfile.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so 00:03:16.340 Installing symlink pointing to librte_compressdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so.24 00:03:16.340 Installing symlink pointing to librte_compressdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so 00:03:16.340 Installing symlink pointing to librte_cryptodev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so.24 00:03:16.340 Installing symlink pointing to librte_cryptodev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so 00:03:16.340 Installing symlink pointing to librte_distributor.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so.24 00:03:16.340 Installing symlink pointing to librte_distributor.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so 00:03:16.340 Installing symlink pointing to librte_dmadev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so.24 00:03:16.340 Installing symlink pointing to librte_dmadev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so 00:03:16.340 Installing symlink pointing to librte_efd.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so.24 00:03:16.340 Installing symlink pointing to librte_efd.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so 00:03:16.340 Installing symlink pointing to librte_eventdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so.24 00:03:16.340 Installing symlink pointing to librte_eventdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so 00:03:16.340 Installing symlink pointing to librte_dispatcher.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dispatcher.so.24 00:03:16.340 Installing symlink pointing to librte_dispatcher.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dispatcher.so 00:03:16.340 Installing symlink pointing to librte_gpudev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so.24 00:03:16.340 Installing symlink pointing to librte_gpudev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so 00:03:16.340 Installing symlink pointing to librte_gro.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so.24 00:03:16.340 Installing symlink pointing to librte_gro.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so 00:03:16.340 Installing symlink pointing to librte_gso.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so.24 00:03:16.340 Installing symlink pointing to librte_gso.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so 00:03:16.340 Installing symlink pointing to librte_ip_frag.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so.24 00:03:16.340 Installing symlink pointing to librte_ip_frag.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so 00:03:16.341 Installing symlink pointing to librte_jobstats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so.24 00:03:16.341 Installing symlink pointing to librte_jobstats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so 00:03:16.341 Installing symlink pointing to librte_latencystats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so.24 00:03:16.341 Installing symlink pointing to librte_latencystats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so 00:03:16.341 Installing symlink pointing to librte_lpm.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so.24 00:03:16.341 Installing symlink pointing to librte_lpm.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so 00:03:16.341 Installing symlink pointing to librte_member.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so.24 00:03:16.341 Installing symlink pointing to librte_member.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so 00:03:16.341 Installing symlink pointing to librte_pcapng.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so.24 00:03:16.341 Installing symlink pointing to librte_pcapng.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so 00:03:16.341 Installing symlink pointing to librte_power.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so.24 00:03:16.341 Installing symlink pointing to librte_power.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so 00:03:16.341 Installing symlink pointing to librte_rawdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so.24 00:03:16.341 Installing symlink pointing to librte_rawdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so 00:03:16.341 Installing symlink pointing to librte_regexdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so.24 00:03:16.341 Installing symlink pointing to librte_regexdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so 00:03:16.341 './librte_bus_pci.so' -> 'dpdk/pmds-24.0/librte_bus_pci.so' 00:03:16.341 './librte_bus_pci.so.24' -> 'dpdk/pmds-24.0/librte_bus_pci.so.24' 00:03:16.341 './librte_bus_pci.so.24.0' -> 'dpdk/pmds-24.0/librte_bus_pci.so.24.0' 00:03:16.341 './librte_bus_vdev.so' -> 'dpdk/pmds-24.0/librte_bus_vdev.so' 00:03:16.341 './librte_bus_vdev.so.24' -> 'dpdk/pmds-24.0/librte_bus_vdev.so.24' 00:03:16.341 './librte_bus_vdev.so.24.0' -> 'dpdk/pmds-24.0/librte_bus_vdev.so.24.0' 00:03:16.341 './librte_mempool_ring.so' -> 'dpdk/pmds-24.0/librte_mempool_ring.so' 00:03:16.341 './librte_mempool_ring.so.24' -> 'dpdk/pmds-24.0/librte_mempool_ring.so.24' 00:03:16.341 './librte_mempool_ring.so.24.0' -> 'dpdk/pmds-24.0/librte_mempool_ring.so.24.0' 00:03:16.341 './librte_net_i40e.so' -> 'dpdk/pmds-24.0/librte_net_i40e.so' 00:03:16.341 './librte_net_i40e.so.24' -> 'dpdk/pmds-24.0/librte_net_i40e.so.24' 00:03:16.341 './librte_net_i40e.so.24.0' -> 'dpdk/pmds-24.0/librte_net_i40e.so.24.0' 00:03:16.341 Installing symlink pointing to librte_mldev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mldev.so.24 00:03:16.341 Installing symlink pointing to librte_mldev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mldev.so 00:03:16.341 Installing symlink pointing to librte_rib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so.24 00:03:16.341 Installing symlink pointing to librte_rib.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so 00:03:16.341 Installing symlink pointing to librte_reorder.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so.24 00:03:16.341 Installing symlink pointing to librte_reorder.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so 00:03:16.341 Installing symlink pointing to librte_sched.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so.24 00:03:16.341 Installing symlink pointing to librte_sched.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so 00:03:16.341 Installing symlink pointing to librte_security.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so.24 00:03:16.341 Installing symlink pointing to librte_security.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so 00:03:16.341 Installing symlink pointing to librte_stack.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so.24 00:03:16.341 Installing symlink pointing to librte_stack.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so 00:03:16.341 Installing symlink pointing to librte_vhost.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so.24 00:03:16.341 Installing symlink pointing to librte_vhost.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so 00:03:16.341 Installing symlink pointing to librte_ipsec.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so.24 00:03:16.341 Installing symlink pointing to librte_ipsec.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so 00:03:16.341 Installing symlink pointing to librte_pdcp.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdcp.so.24 00:03:16.341 Installing symlink pointing to librte_pdcp.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdcp.so 00:03:16.341 Installing symlink pointing to librte_fib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so.24 00:03:16.341 Installing symlink pointing to librte_fib.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so 00:03:16.341 Installing symlink pointing to librte_port.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so.24 00:03:16.341 Installing symlink pointing to librte_port.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so 00:03:16.341 Installing symlink pointing to librte_pdump.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so.24 00:03:16.341 Installing symlink pointing to librte_pdump.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so 00:03:16.341 Installing symlink pointing to librte_table.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so.24 00:03:16.341 Installing symlink pointing to librte_table.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so 00:03:16.341 Installing symlink pointing to librte_pipeline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so.24 00:03:16.341 Installing symlink pointing to librte_pipeline.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so 00:03:16.341 Installing symlink pointing to librte_graph.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so.24 00:03:16.341 Installing symlink pointing to librte_graph.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so 00:03:16.341 Installing symlink pointing to librte_node.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so.24 00:03:16.341 Installing symlink pointing to librte_node.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so 00:03:16.341 Installing symlink pointing to librte_bus_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so.24 00:03:16.341 Installing symlink pointing to librte_bus_pci.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so 00:03:16.341 Installing symlink pointing to librte_bus_vdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so.24 00:03:16.341 Installing symlink pointing to librte_bus_vdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so 00:03:16.341 Installing symlink pointing to librte_mempool_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so.24 00:03:16.341 Installing symlink pointing to librte_mempool_ring.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so 00:03:16.341 Installing symlink pointing to librte_net_i40e.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so.24 00:03:16.341 Installing symlink pointing to librte_net_i40e.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so 00:03:16.341 Running custom install script '/bin/sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/../buildtools/symlink-drivers-solibs.sh lib dpdk/pmds-24.0' 00:03:16.600 00:57:30 -- common/autobuild_common.sh@192 -- $ uname -s 00:03:16.600 00:57:30 -- common/autobuild_common.sh@192 -- $ [[ Linux == \F\r\e\e\B\S\D ]] 00:03:16.600 00:57:30 -- common/autobuild_common.sh@203 -- $ cat 00:03:16.600 00:57:30 -- common/autobuild_common.sh@208 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:16.600 00:03:16.600 real 1m28.170s 00:03:16.600 user 17m59.538s 00:03:16.600 sys 2m9.982s 00:03:16.600 00:57:30 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:03:16.600 00:57:30 -- common/autotest_common.sh@10 -- $ set +x 00:03:16.600 ************************************ 00:03:16.600 END TEST build_native_dpdk 00:03:16.600 ************************************ 00:03:16.600 00:57:30 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:03:16.600 00:57:30 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:03:16.600 00:57:30 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:03:16.600 00:57:30 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:03:16.600 00:57:30 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:03:16.600 00:57:30 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:03:16.600 00:57:30 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:03:16.601 00:57:30 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --with-shared 00:03:16.601 Using /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig for additional libs... 00:03:16.601 DPDK libraries: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:16.601 DPDK includes: //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:16.601 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:03:16.860 Using 'verbs' RDMA provider 00:03:27.408 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:03:35.523 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:03:35.523 Creating mk/config.mk...done. 00:03:35.523 Creating mk/cc.flags.mk...done. 00:03:35.523 Type 'make' to build. 00:03:35.523 00:57:49 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:03:35.523 00:57:49 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:03:35.523 00:57:49 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:03:35.523 00:57:49 -- common/autotest_common.sh@10 -- $ set +x 00:03:35.523 ************************************ 00:03:35.523 START TEST make 00:03:35.523 ************************************ 00:03:35.523 00:57:49 -- common/autotest_common.sh@1114 -- $ make -j48 00:03:35.783 make[1]: Nothing to be done for 'all'. 00:03:37.708 The Meson build system 00:03:37.708 Version: 1.5.0 00:03:37.708 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:03:37.708 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:37.708 Build type: native build 00:03:37.708 Project name: libvfio-user 00:03:37.708 Project version: 0.0.1 00:03:37.708 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:03:37.708 C linker for the host machine: gcc ld.bfd 2.40-14 00:03:37.708 Host machine cpu family: x86_64 00:03:37.708 Host machine cpu: x86_64 00:03:37.708 Run-time dependency threads found: YES 00:03:37.708 Library dl found: YES 00:03:37.708 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:03:37.708 Run-time dependency json-c found: YES 0.17 00:03:37.708 Run-time dependency cmocka found: YES 1.1.7 00:03:37.708 Program pytest-3 found: NO 00:03:37.708 Program flake8 found: NO 00:03:37.708 Program misspell-fixer found: NO 00:03:37.708 Program restructuredtext-lint found: NO 00:03:37.708 Program valgrind found: YES (/usr/bin/valgrind) 00:03:37.708 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:03:37.708 Compiler for C supports arguments -Wmissing-declarations: YES 00:03:37.708 Compiler for C supports arguments -Wwrite-strings: YES 00:03:37.708 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:37.708 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:03:37.708 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:03:37.708 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:37.708 Build targets in project: 8 00:03:37.708 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:03:37.708 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:03:37.708 00:03:37.708 libvfio-user 0.0.1 00:03:37.708 00:03:37.708 User defined options 00:03:37.708 buildtype : debug 00:03:37.708 default_library: shared 00:03:37.708 libdir : /usr/local/lib 00:03:37.708 00:03:37.708 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:03:38.285 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:38.546 [1/37] Compiling C object samples/null.p/null.c.o 00:03:38.546 [2/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:03:38.546 [3/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:03:38.546 [4/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:03:38.546 [5/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:03:38.546 [6/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:03:38.546 [7/37] Compiling C object samples/lspci.p/lspci.c.o 00:03:38.546 [8/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:03:38.546 [9/37] Compiling C object samples/server.p/server.c.o 00:03:38.546 [10/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:03:38.546 [11/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:03:38.546 [12/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:03:38.546 [13/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:03:38.546 [14/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:03:38.546 [15/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:03:38.546 [16/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:03:38.546 [17/37] Compiling C object test/unit_tests.p/mocks.c.o 00:03:38.546 [18/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:03:38.546 [19/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:03:38.546 [20/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:03:38.811 [21/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:03:38.811 [22/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:03:38.811 [23/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:03:38.811 [24/37] Compiling C object samples/client.p/client.c.o 00:03:38.811 [25/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:03:38.811 [26/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:03:38.811 [27/37] Linking target samples/client 00:03:38.811 [28/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:03:38.811 [29/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:03:39.074 [30/37] Linking target test/unit_tests 00:03:39.074 [31/37] Linking target lib/libvfio-user.so.0.0.1 00:03:39.074 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:03:39.343 [33/37] Linking target samples/gpio-pci-idio-16 00:03:39.343 [34/37] Linking target samples/null 00:03:39.343 [35/37] Linking target samples/lspci 00:03:39.343 [36/37] Linking target samples/shadow_ioeventfd_server 00:03:39.343 [37/37] Linking target samples/server 00:03:39.343 INFO: autodetecting backend as ninja 00:03:39.343 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:39.343 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:40.282 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:40.282 ninja: no work to do. 00:03:52.479 CC lib/log/log.o 00:03:52.479 CC lib/log/log_flags.o 00:03:52.479 CC lib/ut/ut.o 00:03:52.479 CC lib/log/log_deprecated.o 00:03:52.479 CC lib/ut_mock/mock.o 00:03:52.479 LIB libspdk_ut_mock.a 00:03:52.479 SO libspdk_ut_mock.so.5.0 00:03:52.479 LIB libspdk_log.a 00:03:52.479 LIB libspdk_ut.a 00:03:52.479 SO libspdk_log.so.6.1 00:03:52.479 SO libspdk_ut.so.1.0 00:03:52.479 SYMLINK libspdk_ut_mock.so 00:03:52.479 SYMLINK libspdk_ut.so 00:03:52.479 SYMLINK libspdk_log.so 00:03:52.479 CXX lib/trace_parser/trace.o 00:03:52.479 CC lib/ioat/ioat.o 00:03:52.479 CC lib/dma/dma.o 00:03:52.479 CC lib/util/base64.o 00:03:52.479 CC lib/util/bit_array.o 00:03:52.479 CC lib/util/cpuset.o 00:03:52.479 CC lib/util/crc16.o 00:03:52.479 CC lib/util/crc32.o 00:03:52.479 CC lib/util/crc32c.o 00:03:52.479 CC lib/util/crc32_ieee.o 00:03:52.479 CC lib/util/crc64.o 00:03:52.479 CC lib/util/dif.o 00:03:52.479 CC lib/util/fd.o 00:03:52.479 CC lib/util/file.o 00:03:52.479 CC lib/util/hexlify.o 00:03:52.479 CC lib/util/iov.o 00:03:52.479 CC lib/util/math.o 00:03:52.479 CC lib/util/pipe.o 00:03:52.479 CC lib/util/strerror_tls.o 00:03:52.479 CC lib/util/string.o 00:03:52.479 CC lib/util/uuid.o 00:03:52.479 CC lib/util/fd_group.o 00:03:52.479 CC lib/util/xor.o 00:03:52.479 CC lib/util/zipf.o 00:03:52.479 CC lib/vfio_user/host/vfio_user_pci.o 00:03:52.479 CC lib/vfio_user/host/vfio_user.o 00:03:52.479 LIB libspdk_dma.a 00:03:52.479 SO libspdk_dma.so.3.0 00:03:52.479 SYMLINK libspdk_dma.so 00:03:52.479 LIB libspdk_ioat.a 00:03:52.479 SO libspdk_ioat.so.6.0 00:03:52.479 LIB libspdk_vfio_user.a 00:03:52.479 SO libspdk_vfio_user.so.4.0 00:03:52.479 SYMLINK libspdk_ioat.so 00:03:52.479 SYMLINK libspdk_vfio_user.so 00:03:52.479 LIB libspdk_util.a 00:03:52.479 SO libspdk_util.so.8.0 00:03:52.479 SYMLINK libspdk_util.so 00:03:52.479 CC lib/conf/conf.o 00:03:52.479 CC lib/rdma/common.o 00:03:52.479 CC lib/json/json_parse.o 00:03:52.479 CC lib/env_dpdk/env.o 00:03:52.479 CC lib/vmd/vmd.o 00:03:52.479 CC lib/json/json_util.o 00:03:52.479 CC lib/env_dpdk/memory.o 00:03:52.479 CC lib/rdma/rdma_verbs.o 00:03:52.479 CC lib/vmd/led.o 00:03:52.479 CC lib/idxd/idxd.o 00:03:52.479 CC lib/json/json_write.o 00:03:52.479 CC lib/env_dpdk/pci.o 00:03:52.479 CC lib/idxd/idxd_user.o 00:03:52.479 CC lib/env_dpdk/init.o 00:03:52.479 CC lib/env_dpdk/threads.o 00:03:52.479 CC lib/idxd/idxd_kernel.o 00:03:52.479 CC lib/env_dpdk/pci_ioat.o 00:03:52.479 CC lib/env_dpdk/pci_virtio.o 00:03:52.479 CC lib/env_dpdk/pci_vmd.o 00:03:52.479 CC lib/env_dpdk/pci_idxd.o 00:03:52.479 CC lib/env_dpdk/pci_event.o 00:03:52.479 CC lib/env_dpdk/sigbus_handler.o 00:03:52.479 CC lib/env_dpdk/pci_dpdk.o 00:03:52.479 CC lib/env_dpdk/pci_dpdk_2211.o 00:03:52.479 CC lib/env_dpdk/pci_dpdk_2207.o 00:03:52.479 LIB libspdk_trace_parser.a 00:03:52.479 SO libspdk_trace_parser.so.4.0 00:03:52.479 SYMLINK libspdk_trace_parser.so 00:03:52.479 LIB libspdk_conf.a 00:03:52.479 SO libspdk_conf.so.5.0 00:03:52.479 SYMLINK libspdk_conf.so 00:03:52.479 LIB libspdk_json.a 00:03:52.479 SO libspdk_json.so.5.1 00:03:52.736 SYMLINK libspdk_json.so 00:03:52.736 LIB libspdk_rdma.a 00:03:52.736 SO libspdk_rdma.so.5.0 00:03:52.736 SYMLINK libspdk_rdma.so 00:03:52.736 CC lib/jsonrpc/jsonrpc_server.o 00:03:52.736 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:03:52.736 CC lib/jsonrpc/jsonrpc_client.o 00:03:52.736 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:03:52.736 LIB libspdk_idxd.a 00:03:52.736 SO libspdk_idxd.so.11.0 00:03:52.994 SYMLINK libspdk_idxd.so 00:03:52.994 LIB libspdk_vmd.a 00:03:52.994 SO libspdk_vmd.so.5.0 00:03:52.994 SYMLINK libspdk_vmd.so 00:03:52.994 LIB libspdk_jsonrpc.a 00:03:52.994 SO libspdk_jsonrpc.so.5.1 00:03:52.994 SYMLINK libspdk_jsonrpc.so 00:03:53.251 CC lib/rpc/rpc.o 00:03:53.508 LIB libspdk_rpc.a 00:03:53.508 SO libspdk_rpc.so.5.0 00:03:53.508 SYMLINK libspdk_rpc.so 00:03:53.508 CC lib/sock/sock.o 00:03:53.508 CC lib/sock/sock_rpc.o 00:03:53.508 CC lib/trace/trace.o 00:03:53.508 CC lib/notify/notify.o 00:03:53.508 CC lib/trace/trace_flags.o 00:03:53.508 CC lib/notify/notify_rpc.o 00:03:53.508 CC lib/trace/trace_rpc.o 00:03:53.766 LIB libspdk_notify.a 00:03:53.766 SO libspdk_notify.so.5.0 00:03:53.766 LIB libspdk_trace.a 00:03:53.766 SYMLINK libspdk_notify.so 00:03:53.766 SO libspdk_trace.so.9.0 00:03:54.025 SYMLINK libspdk_trace.so 00:03:54.025 LIB libspdk_sock.a 00:03:54.025 SO libspdk_sock.so.8.0 00:03:54.025 CC lib/thread/thread.o 00:03:54.025 CC lib/thread/iobuf.o 00:03:54.025 SYMLINK libspdk_sock.so 00:03:54.283 CC lib/nvme/nvme_ctrlr_cmd.o 00:03:54.283 CC lib/nvme/nvme_ctrlr.o 00:03:54.283 CC lib/nvme/nvme_fabric.o 00:03:54.283 CC lib/nvme/nvme_ns_cmd.o 00:03:54.283 CC lib/nvme/nvme_ns.o 00:03:54.283 CC lib/nvme/nvme_pcie_common.o 00:03:54.283 CC lib/nvme/nvme_pcie.o 00:03:54.283 CC lib/nvme/nvme_qpair.o 00:03:54.283 CC lib/nvme/nvme.o 00:03:54.283 CC lib/nvme/nvme_quirks.o 00:03:54.283 CC lib/nvme/nvme_transport.o 00:03:54.283 CC lib/nvme/nvme_discovery.o 00:03:54.283 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:03:54.283 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:03:54.283 CC lib/nvme/nvme_tcp.o 00:03:54.283 CC lib/nvme/nvme_opal.o 00:03:54.283 CC lib/nvme/nvme_io_msg.o 00:03:54.283 CC lib/nvme/nvme_poll_group.o 00:03:54.283 CC lib/nvme/nvme_cuse.o 00:03:54.283 CC lib/nvme/nvme_zns.o 00:03:54.283 CC lib/nvme/nvme_vfio_user.o 00:03:54.283 CC lib/nvme/nvme_rdma.o 00:03:54.283 LIB libspdk_env_dpdk.a 00:03:54.283 SO libspdk_env_dpdk.so.13.0 00:03:54.542 SYMLINK libspdk_env_dpdk.so 00:03:55.916 LIB libspdk_thread.a 00:03:55.916 SO libspdk_thread.so.9.0 00:03:55.916 SYMLINK libspdk_thread.so 00:03:55.916 CC lib/blob/blobstore.o 00:03:55.916 CC lib/init/json_config.o 00:03:55.916 CC lib/blob/request.o 00:03:55.916 CC lib/accel/accel.o 00:03:55.916 CC lib/init/subsystem.o 00:03:55.916 CC lib/vfu_tgt/tgt_endpoint.o 00:03:55.916 CC lib/blob/zeroes.o 00:03:55.916 CC lib/virtio/virtio.o 00:03:55.916 CC lib/init/subsystem_rpc.o 00:03:55.916 CC lib/vfu_tgt/tgt_rpc.o 00:03:55.916 CC lib/blob/blob_bs_dev.o 00:03:55.916 CC lib/accel/accel_rpc.o 00:03:55.916 CC lib/init/rpc.o 00:03:55.916 CC lib/virtio/virtio_vhost_user.o 00:03:55.916 CC lib/accel/accel_sw.o 00:03:55.916 CC lib/virtio/virtio_vfio_user.o 00:03:55.916 CC lib/virtio/virtio_pci.o 00:03:56.174 LIB libspdk_init.a 00:03:56.174 SO libspdk_init.so.4.0 00:03:56.174 SYMLINK libspdk_init.so 00:03:56.174 LIB libspdk_virtio.a 00:03:56.174 LIB libspdk_vfu_tgt.a 00:03:56.174 SO libspdk_vfu_tgt.so.2.0 00:03:56.174 SO libspdk_virtio.so.6.0 00:03:56.174 SYMLINK libspdk_vfu_tgt.so 00:03:56.174 CC lib/event/app.o 00:03:56.174 CC lib/event/reactor.o 00:03:56.174 CC lib/event/log_rpc.o 00:03:56.174 CC lib/event/app_rpc.o 00:03:56.174 CC lib/event/scheduler_static.o 00:03:56.432 SYMLINK libspdk_virtio.so 00:03:56.432 LIB libspdk_nvme.a 00:03:56.690 SO libspdk_nvme.so.12.0 00:03:56.690 LIB libspdk_event.a 00:03:56.690 SO libspdk_event.so.12.0 00:03:56.690 SYMLINK libspdk_event.so 00:03:56.949 SYMLINK libspdk_nvme.so 00:03:56.949 LIB libspdk_accel.a 00:03:56.949 SO libspdk_accel.so.14.0 00:03:56.949 SYMLINK libspdk_accel.so 00:03:57.208 CC lib/bdev/bdev.o 00:03:57.208 CC lib/bdev/bdev_rpc.o 00:03:57.208 CC lib/bdev/bdev_zone.o 00:03:57.208 CC lib/bdev/part.o 00:03:57.208 CC lib/bdev/scsi_nvme.o 00:03:58.582 LIB libspdk_blob.a 00:03:58.582 SO libspdk_blob.so.10.1 00:03:58.841 SYMLINK libspdk_blob.so 00:03:58.841 CC lib/blobfs/blobfs.o 00:03:58.841 CC lib/blobfs/tree.o 00:03:58.841 CC lib/lvol/lvol.o 00:03:59.775 LIB libspdk_blobfs.a 00:03:59.775 SO libspdk_blobfs.so.9.0 00:03:59.775 LIB libspdk_lvol.a 00:03:59.775 SYMLINK libspdk_blobfs.so 00:03:59.775 SO libspdk_lvol.so.9.1 00:03:59.775 LIB libspdk_bdev.a 00:03:59.775 SYMLINK libspdk_lvol.so 00:03:59.775 SO libspdk_bdev.so.14.0 00:03:59.775 SYMLINK libspdk_bdev.so 00:04:00.042 CC lib/ublk/ublk.o 00:04:00.042 CC lib/nvmf/ctrlr.o 00:04:00.042 CC lib/scsi/dev.o 00:04:00.042 CC lib/ublk/ublk_rpc.o 00:04:00.042 CC lib/scsi/lun.o 00:04:00.042 CC lib/nvmf/ctrlr_discovery.o 00:04:00.042 CC lib/scsi/port.o 00:04:00.042 CC lib/nvmf/ctrlr_bdev.o 00:04:00.042 CC lib/scsi/scsi.o 00:04:00.042 CC lib/nvmf/subsystem.o 00:04:00.042 CC lib/scsi/scsi_bdev.o 00:04:00.042 CC lib/nvmf/nvmf.o 00:04:00.042 CC lib/scsi/scsi_pr.o 00:04:00.042 CC lib/scsi/scsi_rpc.o 00:04:00.042 CC lib/nbd/nbd.o 00:04:00.042 CC lib/nvmf/nvmf_rpc.o 00:04:00.042 CC lib/ftl/ftl_core.o 00:04:00.042 CC lib/scsi/task.o 00:04:00.042 CC lib/ftl/ftl_init.o 00:04:00.042 CC lib/nvmf/transport.o 00:04:00.042 CC lib/ftl/ftl_layout.o 00:04:00.042 CC lib/nbd/nbd_rpc.o 00:04:00.042 CC lib/nvmf/tcp.o 00:04:00.042 CC lib/ftl/ftl_debug.o 00:04:00.042 CC lib/nvmf/vfio_user.o 00:04:00.042 CC lib/ftl/ftl_io.o 00:04:00.042 CC lib/nvmf/rdma.o 00:04:00.042 CC lib/ftl/ftl_sb.o 00:04:00.042 CC lib/ftl/ftl_l2p.o 00:04:00.042 CC lib/ftl/ftl_nv_cache.o 00:04:00.042 CC lib/ftl/ftl_l2p_flat.o 00:04:00.042 CC lib/ftl/ftl_band_ops.o 00:04:00.042 CC lib/ftl/ftl_band.o 00:04:00.042 CC lib/ftl/ftl_writer.o 00:04:00.042 CC lib/ftl/ftl_rq.o 00:04:00.042 CC lib/ftl/ftl_reloc.o 00:04:00.042 CC lib/ftl/ftl_l2p_cache.o 00:04:00.042 CC lib/ftl/ftl_p2l.o 00:04:00.042 CC lib/ftl/mngt/ftl_mngt.o 00:04:00.042 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:04:00.042 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:04:00.042 CC lib/ftl/mngt/ftl_mngt_startup.o 00:04:00.042 CC lib/ftl/mngt/ftl_mngt_md.o 00:04:00.042 CC lib/ftl/mngt/ftl_mngt_misc.o 00:04:00.042 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:04:00.042 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:04:00.042 CC lib/ftl/mngt/ftl_mngt_band.o 00:04:00.042 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:04:00.304 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:04:00.304 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:04:00.304 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:04:00.304 CC lib/ftl/utils/ftl_conf.o 00:04:00.304 CC lib/ftl/utils/ftl_md.o 00:04:00.304 CC lib/ftl/utils/ftl_mempool.o 00:04:00.304 CC lib/ftl/utils/ftl_bitmap.o 00:04:00.304 CC lib/ftl/utils/ftl_property.o 00:04:00.304 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:04:00.304 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:04:00.304 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:04:00.304 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:04:00.304 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:04:00.304 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:04:00.304 CC lib/ftl/upgrade/ftl_sb_v3.o 00:04:00.304 CC lib/ftl/upgrade/ftl_sb_v5.o 00:04:00.304 CC lib/ftl/nvc/ftl_nvc_dev.o 00:04:00.564 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:04:00.564 CC lib/ftl/base/ftl_base_dev.o 00:04:00.564 CC lib/ftl/base/ftl_base_bdev.o 00:04:00.564 CC lib/ftl/ftl_trace.o 00:04:00.822 LIB libspdk_nbd.a 00:04:00.822 SO libspdk_nbd.so.6.0 00:04:00.822 SYMLINK libspdk_nbd.so 00:04:00.822 LIB libspdk_scsi.a 00:04:00.822 SO libspdk_scsi.so.8.0 00:04:00.822 SYMLINK libspdk_scsi.so 00:04:01.078 LIB libspdk_ublk.a 00:04:01.078 SO libspdk_ublk.so.2.0 00:04:01.078 CC lib/iscsi/conn.o 00:04:01.078 CC lib/iscsi/init_grp.o 00:04:01.078 CC lib/vhost/vhost.o 00:04:01.078 CC lib/iscsi/iscsi.o 00:04:01.078 CC lib/vhost/vhost_rpc.o 00:04:01.078 CC lib/iscsi/md5.o 00:04:01.078 CC lib/vhost/vhost_scsi.o 00:04:01.078 CC lib/iscsi/param.o 00:04:01.078 CC lib/vhost/vhost_blk.o 00:04:01.078 CC lib/iscsi/portal_grp.o 00:04:01.078 CC lib/vhost/rte_vhost_user.o 00:04:01.078 CC lib/iscsi/tgt_node.o 00:04:01.078 CC lib/iscsi/iscsi_subsystem.o 00:04:01.078 CC lib/iscsi/iscsi_rpc.o 00:04:01.078 CC lib/iscsi/task.o 00:04:01.078 SYMLINK libspdk_ublk.so 00:04:01.390 LIB libspdk_ftl.a 00:04:01.390 SO libspdk_ftl.so.8.0 00:04:01.688 SYMLINK libspdk_ftl.so 00:04:02.254 LIB libspdk_vhost.a 00:04:02.254 SO libspdk_vhost.so.7.1 00:04:02.254 SYMLINK libspdk_vhost.so 00:04:02.512 LIB libspdk_nvmf.a 00:04:02.512 SO libspdk_nvmf.so.17.0 00:04:02.512 LIB libspdk_iscsi.a 00:04:02.512 SO libspdk_iscsi.so.7.0 00:04:02.771 SYMLINK libspdk_nvmf.so 00:04:02.771 SYMLINK libspdk_iscsi.so 00:04:02.771 CC module/env_dpdk/env_dpdk_rpc.o 00:04:02.771 CC module/vfu_device/vfu_virtio.o 00:04:03.029 CC module/vfu_device/vfu_virtio_scsi.o 00:04:03.029 CC module/vfu_device/vfu_virtio_blk.o 00:04:03.029 CC module/vfu_device/vfu_virtio_rpc.o 00:04:03.029 CC module/accel/error/accel_error.o 00:04:03.029 CC module/accel/error/accel_error_rpc.o 00:04:03.029 CC module/scheduler/dynamic/scheduler_dynamic.o 00:04:03.029 CC module/blob/bdev/blob_bdev.o 00:04:03.029 CC module/accel/iaa/accel_iaa.o 00:04:03.029 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:04:03.029 CC module/scheduler/gscheduler/gscheduler.o 00:04:03.029 CC module/accel/dsa/accel_dsa.o 00:04:03.029 CC module/accel/iaa/accel_iaa_rpc.o 00:04:03.029 CC module/sock/posix/posix.o 00:04:03.029 CC module/accel/dsa/accel_dsa_rpc.o 00:04:03.029 CC module/accel/ioat/accel_ioat.o 00:04:03.029 CC module/accel/ioat/accel_ioat_rpc.o 00:04:03.029 LIB libspdk_env_dpdk_rpc.a 00:04:03.029 SO libspdk_env_dpdk_rpc.so.5.0 00:04:03.029 LIB libspdk_scheduler_gscheduler.a 00:04:03.029 SYMLINK libspdk_env_dpdk_rpc.so 00:04:03.029 LIB libspdk_scheduler_dpdk_governor.a 00:04:03.029 SO libspdk_scheduler_gscheduler.so.3.0 00:04:03.029 SO libspdk_scheduler_dpdk_governor.so.3.0 00:04:03.029 LIB libspdk_accel_error.a 00:04:03.288 LIB libspdk_accel_ioat.a 00:04:03.288 LIB libspdk_scheduler_dynamic.a 00:04:03.288 SO libspdk_accel_error.so.1.0 00:04:03.288 LIB libspdk_accel_iaa.a 00:04:03.288 SYMLINK libspdk_scheduler_gscheduler.so 00:04:03.288 SO libspdk_scheduler_dynamic.so.3.0 00:04:03.288 SO libspdk_accel_ioat.so.5.0 00:04:03.288 SYMLINK libspdk_scheduler_dpdk_governor.so 00:04:03.288 SO libspdk_accel_iaa.so.2.0 00:04:03.288 LIB libspdk_accel_dsa.a 00:04:03.288 SYMLINK libspdk_accel_error.so 00:04:03.288 SYMLINK libspdk_scheduler_dynamic.so 00:04:03.288 SYMLINK libspdk_accel_ioat.so 00:04:03.288 SO libspdk_accel_dsa.so.4.0 00:04:03.288 LIB libspdk_blob_bdev.a 00:04:03.288 SYMLINK libspdk_accel_iaa.so 00:04:03.288 SO libspdk_blob_bdev.so.10.1 00:04:03.288 SYMLINK libspdk_accel_dsa.so 00:04:03.288 SYMLINK libspdk_blob_bdev.so 00:04:03.547 CC module/bdev/null/bdev_null.o 00:04:03.547 CC module/bdev/gpt/gpt.o 00:04:03.547 CC module/bdev/aio/bdev_aio.o 00:04:03.547 CC module/bdev/nvme/bdev_nvme.o 00:04:03.547 CC module/bdev/error/vbdev_error.o 00:04:03.547 CC module/bdev/null/bdev_null_rpc.o 00:04:03.547 CC module/bdev/iscsi/bdev_iscsi.o 00:04:03.547 CC module/bdev/aio/bdev_aio_rpc.o 00:04:03.547 CC module/bdev/nvme/bdev_nvme_rpc.o 00:04:03.547 CC module/bdev/lvol/vbdev_lvol.o 00:04:03.547 CC module/bdev/error/vbdev_error_rpc.o 00:04:03.547 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:04:03.547 CC module/bdev/gpt/vbdev_gpt.o 00:04:03.547 CC module/bdev/delay/vbdev_delay.o 00:04:03.547 CC module/bdev/ftl/bdev_ftl.o 00:04:03.547 CC module/blobfs/bdev/blobfs_bdev.o 00:04:03.547 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:04:03.547 CC module/bdev/nvme/nvme_rpc.o 00:04:03.547 CC module/bdev/split/vbdev_split.o 00:04:03.547 CC module/bdev/ftl/bdev_ftl_rpc.o 00:04:03.547 CC module/bdev/malloc/bdev_malloc.o 00:04:03.547 CC module/bdev/nvme/bdev_mdns_client.o 00:04:03.547 CC module/bdev/zone_block/vbdev_zone_block.o 00:04:03.547 CC module/bdev/delay/vbdev_delay_rpc.o 00:04:03.547 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:04:03.547 CC module/bdev/split/vbdev_split_rpc.o 00:04:03.547 CC module/bdev/nvme/vbdev_opal.o 00:04:03.547 CC module/bdev/raid/bdev_raid.o 00:04:03.547 CC module/bdev/malloc/bdev_malloc_rpc.o 00:04:03.547 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:04:03.547 CC module/bdev/passthru/vbdev_passthru.o 00:04:03.547 CC module/bdev/raid/bdev_raid_rpc.o 00:04:03.547 CC module/bdev/nvme/vbdev_opal_rpc.o 00:04:03.547 CC module/bdev/virtio/bdev_virtio_scsi.o 00:04:03.547 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:04:03.547 CC module/bdev/raid/bdev_raid_sb.o 00:04:03.547 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:04:03.547 CC module/bdev/virtio/bdev_virtio_blk.o 00:04:03.547 CC module/bdev/raid/raid0.o 00:04:03.547 CC module/bdev/virtio/bdev_virtio_rpc.o 00:04:03.547 CC module/bdev/raid/raid1.o 00:04:03.547 CC module/bdev/raid/concat.o 00:04:03.547 LIB libspdk_vfu_device.a 00:04:03.806 SO libspdk_vfu_device.so.2.0 00:04:03.806 SYMLINK libspdk_vfu_device.so 00:04:03.806 LIB libspdk_blobfs_bdev.a 00:04:03.806 LIB libspdk_bdev_null.a 00:04:03.806 SO libspdk_bdev_null.so.5.0 00:04:03.806 SO libspdk_blobfs_bdev.so.5.0 00:04:03.806 LIB libspdk_sock_posix.a 00:04:03.806 LIB libspdk_bdev_split.a 00:04:03.806 SYMLINK libspdk_blobfs_bdev.so 00:04:03.806 SO libspdk_sock_posix.so.5.0 00:04:04.065 SYMLINK libspdk_bdev_null.so 00:04:04.065 SO libspdk_bdev_split.so.5.0 00:04:04.065 LIB libspdk_bdev_error.a 00:04:04.065 LIB libspdk_bdev_ftl.a 00:04:04.065 SO libspdk_bdev_error.so.5.0 00:04:04.065 SO libspdk_bdev_ftl.so.5.0 00:04:04.065 LIB libspdk_bdev_passthru.a 00:04:04.065 SYMLINK libspdk_sock_posix.so 00:04:04.065 SYMLINK libspdk_bdev_split.so 00:04:04.065 LIB libspdk_bdev_gpt.a 00:04:04.065 LIB libspdk_bdev_zone_block.a 00:04:04.065 SO libspdk_bdev_passthru.so.5.0 00:04:04.065 SYMLINK libspdk_bdev_error.so 00:04:04.065 SO libspdk_bdev_gpt.so.5.0 00:04:04.065 SO libspdk_bdev_zone_block.so.5.0 00:04:04.065 LIB libspdk_bdev_delay.a 00:04:04.065 SYMLINK libspdk_bdev_ftl.so 00:04:04.065 SO libspdk_bdev_delay.so.5.0 00:04:04.065 LIB libspdk_bdev_aio.a 00:04:04.065 SYMLINK libspdk_bdev_passthru.so 00:04:04.065 SYMLINK libspdk_bdev_zone_block.so 00:04:04.065 SYMLINK libspdk_bdev_gpt.so 00:04:04.065 SO libspdk_bdev_aio.so.5.0 00:04:04.065 LIB libspdk_bdev_iscsi.a 00:04:04.065 SYMLINK libspdk_bdev_delay.so 00:04:04.065 LIB libspdk_bdev_malloc.a 00:04:04.065 SO libspdk_bdev_iscsi.so.5.0 00:04:04.065 SYMLINK libspdk_bdev_aio.so 00:04:04.065 SO libspdk_bdev_malloc.so.5.0 00:04:04.324 LIB libspdk_bdev_virtio.a 00:04:04.324 SYMLINK libspdk_bdev_iscsi.so 00:04:04.324 SYMLINK libspdk_bdev_malloc.so 00:04:04.324 SO libspdk_bdev_virtio.so.5.0 00:04:04.324 LIB libspdk_bdev_lvol.a 00:04:04.324 SO libspdk_bdev_lvol.so.5.0 00:04:04.324 SYMLINK libspdk_bdev_virtio.so 00:04:04.324 SYMLINK libspdk_bdev_lvol.so 00:04:04.582 LIB libspdk_bdev_raid.a 00:04:04.582 SO libspdk_bdev_raid.so.5.0 00:04:04.582 SYMLINK libspdk_bdev_raid.so 00:04:05.956 LIB libspdk_bdev_nvme.a 00:04:05.956 SO libspdk_bdev_nvme.so.6.0 00:04:05.956 SYMLINK libspdk_bdev_nvme.so 00:04:06.215 CC module/event/subsystems/vmd/vmd.o 00:04:06.215 CC module/event/subsystems/iobuf/iobuf.o 00:04:06.215 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:04:06.215 CC module/event/subsystems/vmd/vmd_rpc.o 00:04:06.215 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:04:06.215 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:04:06.215 CC module/event/subsystems/sock/sock.o 00:04:06.215 CC module/event/subsystems/scheduler/scheduler.o 00:04:06.473 LIB libspdk_event_sock.a 00:04:06.473 LIB libspdk_event_vhost_blk.a 00:04:06.473 LIB libspdk_event_scheduler.a 00:04:06.473 LIB libspdk_event_vfu_tgt.a 00:04:06.473 LIB libspdk_event_vmd.a 00:04:06.473 SO libspdk_event_sock.so.4.0 00:04:06.473 LIB libspdk_event_iobuf.a 00:04:06.473 SO libspdk_event_vhost_blk.so.2.0 00:04:06.473 SO libspdk_event_scheduler.so.3.0 00:04:06.473 SO libspdk_event_vfu_tgt.so.2.0 00:04:06.473 SO libspdk_event_vmd.so.5.0 00:04:06.473 SO libspdk_event_iobuf.so.2.0 00:04:06.473 SYMLINK libspdk_event_sock.so 00:04:06.473 SYMLINK libspdk_event_vhost_blk.so 00:04:06.473 SYMLINK libspdk_event_scheduler.so 00:04:06.473 SYMLINK libspdk_event_vfu_tgt.so 00:04:06.473 SYMLINK libspdk_event_vmd.so 00:04:06.473 SYMLINK libspdk_event_iobuf.so 00:04:06.473 CC module/event/subsystems/accel/accel.o 00:04:06.731 LIB libspdk_event_accel.a 00:04:06.731 SO libspdk_event_accel.so.5.0 00:04:06.731 SYMLINK libspdk_event_accel.so 00:04:06.988 CC module/event/subsystems/bdev/bdev.o 00:04:06.988 LIB libspdk_event_bdev.a 00:04:07.246 SO libspdk_event_bdev.so.5.0 00:04:07.246 SYMLINK libspdk_event_bdev.so 00:04:07.246 CC module/event/subsystems/scsi/scsi.o 00:04:07.246 CC module/event/subsystems/nbd/nbd.o 00:04:07.247 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:04:07.247 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:04:07.247 CC module/event/subsystems/ublk/ublk.o 00:04:07.505 LIB libspdk_event_ublk.a 00:04:07.505 LIB libspdk_event_nbd.a 00:04:07.505 SO libspdk_event_ublk.so.2.0 00:04:07.505 LIB libspdk_event_scsi.a 00:04:07.505 SO libspdk_event_nbd.so.5.0 00:04:07.505 SO libspdk_event_scsi.so.5.0 00:04:07.505 SYMLINK libspdk_event_ublk.so 00:04:07.505 SYMLINK libspdk_event_nbd.so 00:04:07.505 SYMLINK libspdk_event_scsi.so 00:04:07.505 LIB libspdk_event_nvmf.a 00:04:07.505 SO libspdk_event_nvmf.so.5.0 00:04:07.505 SYMLINK libspdk_event_nvmf.so 00:04:07.505 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:04:07.505 CC module/event/subsystems/iscsi/iscsi.o 00:04:07.763 LIB libspdk_event_vhost_scsi.a 00:04:07.763 LIB libspdk_event_iscsi.a 00:04:07.763 SO libspdk_event_vhost_scsi.so.2.0 00:04:07.763 SO libspdk_event_iscsi.so.5.0 00:04:07.763 SYMLINK libspdk_event_vhost_scsi.so 00:04:07.763 SYMLINK libspdk_event_iscsi.so 00:04:08.023 SO libspdk.so.5.0 00:04:08.023 SYMLINK libspdk.so 00:04:08.023 CXX app/trace/trace.o 00:04:08.023 CC app/spdk_nvme_discover/discovery_aer.o 00:04:08.023 CC app/spdk_nvme_perf/perf.o 00:04:08.023 CC app/trace_record/trace_record.o 00:04:08.023 CC app/spdk_lspci/spdk_lspci.o 00:04:08.023 CC app/spdk_top/spdk_top.o 00:04:08.023 CC app/spdk_nvme_identify/identify.o 00:04:08.023 CC test/rpc_client/rpc_client_test.o 00:04:08.023 TEST_HEADER include/spdk/accel.h 00:04:08.023 TEST_HEADER include/spdk/accel_module.h 00:04:08.023 TEST_HEADER include/spdk/assert.h 00:04:08.023 TEST_HEADER include/spdk/barrier.h 00:04:08.023 TEST_HEADER include/spdk/base64.h 00:04:08.023 TEST_HEADER include/spdk/bdev.h 00:04:08.023 TEST_HEADER include/spdk/bdev_module.h 00:04:08.023 TEST_HEADER include/spdk/bdev_zone.h 00:04:08.023 TEST_HEADER include/spdk/bit_array.h 00:04:08.023 TEST_HEADER include/spdk/bit_pool.h 00:04:08.023 TEST_HEADER include/spdk/blob_bdev.h 00:04:08.023 TEST_HEADER include/spdk/blobfs_bdev.h 00:04:08.291 TEST_HEADER include/spdk/blobfs.h 00:04:08.291 TEST_HEADER include/spdk/blob.h 00:04:08.291 TEST_HEADER include/spdk/conf.h 00:04:08.291 CC app/spdk_dd/spdk_dd.o 00:04:08.291 TEST_HEADER include/spdk/config.h 00:04:08.291 CC examples/interrupt_tgt/interrupt_tgt.o 00:04:08.291 TEST_HEADER include/spdk/cpuset.h 00:04:08.291 CC app/nvmf_tgt/nvmf_main.o 00:04:08.291 TEST_HEADER include/spdk/crc16.h 00:04:08.291 CC app/iscsi_tgt/iscsi_tgt.o 00:04:08.291 TEST_HEADER include/spdk/crc32.h 00:04:08.291 TEST_HEADER include/spdk/crc64.h 00:04:08.291 CC app/vhost/vhost.o 00:04:08.291 CC examples/nvme/hello_world/hello_world.o 00:04:08.291 CC examples/ioat/perf/perf.o 00:04:08.291 TEST_HEADER include/spdk/dif.h 00:04:08.291 CC examples/idxd/perf/perf.o 00:04:08.291 TEST_HEADER include/spdk/dma.h 00:04:08.291 CC examples/nvme/cmb_copy/cmb_copy.o 00:04:08.291 CC examples/accel/perf/accel_perf.o 00:04:08.291 CC examples/ioat/verify/verify.o 00:04:08.291 CC examples/nvme/hotplug/hotplug.o 00:04:08.291 CC test/app/jsoncat/jsoncat.o 00:04:08.291 CC examples/nvme/arbitration/arbitration.o 00:04:08.291 TEST_HEADER include/spdk/endian.h 00:04:08.291 CC test/app/histogram_perf/histogram_perf.o 00:04:08.291 CC examples/nvme/reconnect/reconnect.o 00:04:08.291 CC examples/nvme/nvme_manage/nvme_manage.o 00:04:08.291 CC examples/sock/hello_world/hello_sock.o 00:04:08.291 CC examples/vmd/lsvmd/lsvmd.o 00:04:08.291 TEST_HEADER include/spdk/env_dpdk.h 00:04:08.291 CC examples/util/zipf/zipf.o 00:04:08.291 TEST_HEADER include/spdk/env.h 00:04:08.291 TEST_HEADER include/spdk/event.h 00:04:08.291 CC test/event/event_perf/event_perf.o 00:04:08.291 CC examples/nvme/abort/abort.o 00:04:08.291 CC test/thread/poller_perf/poller_perf.o 00:04:08.291 TEST_HEADER include/spdk/fd_group.h 00:04:08.291 CC test/nvme/aer/aer.o 00:04:08.291 CC app/fio/nvme/fio_plugin.o 00:04:08.291 CC app/spdk_tgt/spdk_tgt.o 00:04:08.291 TEST_HEADER include/spdk/fd.h 00:04:08.291 TEST_HEADER include/spdk/file.h 00:04:08.291 TEST_HEADER include/spdk/ftl.h 00:04:08.291 TEST_HEADER include/spdk/gpt_spec.h 00:04:08.291 TEST_HEADER include/spdk/hexlify.h 00:04:08.291 TEST_HEADER include/spdk/histogram_data.h 00:04:08.291 TEST_HEADER include/spdk/idxd.h 00:04:08.291 TEST_HEADER include/spdk/idxd_spec.h 00:04:08.291 TEST_HEADER include/spdk/init.h 00:04:08.291 TEST_HEADER include/spdk/ioat.h 00:04:08.291 TEST_HEADER include/spdk/ioat_spec.h 00:04:08.291 TEST_HEADER include/spdk/iscsi_spec.h 00:04:08.291 TEST_HEADER include/spdk/json.h 00:04:08.291 CC examples/bdev/hello_world/hello_bdev.o 00:04:08.291 TEST_HEADER include/spdk/jsonrpc.h 00:04:08.291 CC examples/blob/hello_world/hello_blob.o 00:04:08.291 CC test/accel/dif/dif.o 00:04:08.291 TEST_HEADER include/spdk/likely.h 00:04:08.291 CC examples/blob/cli/blobcli.o 00:04:08.291 CC examples/thread/thread/thread_ex.o 00:04:08.291 CC test/app/bdev_svc/bdev_svc.o 00:04:08.291 CC test/bdev/bdevio/bdevio.o 00:04:08.291 TEST_HEADER include/spdk/log.h 00:04:08.291 CC test/dma/test_dma/test_dma.o 00:04:08.291 TEST_HEADER include/spdk/lvol.h 00:04:08.291 CC examples/nvmf/nvmf/nvmf.o 00:04:08.291 TEST_HEADER include/spdk/memory.h 00:04:08.291 TEST_HEADER include/spdk/mmio.h 00:04:08.291 CC test/blobfs/mkfs/mkfs.o 00:04:08.291 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:04:08.291 TEST_HEADER include/spdk/nbd.h 00:04:08.291 TEST_HEADER include/spdk/notify.h 00:04:08.291 TEST_HEADER include/spdk/nvme.h 00:04:08.291 TEST_HEADER include/spdk/nvme_intel.h 00:04:08.291 TEST_HEADER include/spdk/nvme_ocssd.h 00:04:08.291 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:04:08.291 TEST_HEADER include/spdk/nvme_spec.h 00:04:08.291 CC test/env/mem_callbacks/mem_callbacks.o 00:04:08.291 CC test/lvol/esnap/esnap.o 00:04:08.291 TEST_HEADER include/spdk/nvme_zns.h 00:04:08.291 TEST_HEADER include/spdk/nvmf_cmd.h 00:04:08.291 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:04:08.291 TEST_HEADER include/spdk/nvmf.h 00:04:08.291 TEST_HEADER include/spdk/nvmf_spec.h 00:04:08.291 TEST_HEADER include/spdk/nvmf_transport.h 00:04:08.291 TEST_HEADER include/spdk/opal.h 00:04:08.291 TEST_HEADER include/spdk/opal_spec.h 00:04:08.291 TEST_HEADER include/spdk/pci_ids.h 00:04:08.291 TEST_HEADER include/spdk/pipe.h 00:04:08.291 TEST_HEADER include/spdk/queue.h 00:04:08.291 TEST_HEADER include/spdk/reduce.h 00:04:08.291 TEST_HEADER include/spdk/rpc.h 00:04:08.291 TEST_HEADER include/spdk/scheduler.h 00:04:08.291 TEST_HEADER include/spdk/scsi.h 00:04:08.291 TEST_HEADER include/spdk/scsi_spec.h 00:04:08.291 TEST_HEADER include/spdk/sock.h 00:04:08.291 LINK spdk_lspci 00:04:08.291 TEST_HEADER include/spdk/stdinc.h 00:04:08.291 TEST_HEADER include/spdk/string.h 00:04:08.291 TEST_HEADER include/spdk/thread.h 00:04:08.291 TEST_HEADER include/spdk/trace.h 00:04:08.291 TEST_HEADER include/spdk/trace_parser.h 00:04:08.291 TEST_HEADER include/spdk/tree.h 00:04:08.291 TEST_HEADER include/spdk/ublk.h 00:04:08.291 TEST_HEADER include/spdk/util.h 00:04:08.291 TEST_HEADER include/spdk/uuid.h 00:04:08.291 TEST_HEADER include/spdk/version.h 00:04:08.550 TEST_HEADER include/spdk/vfio_user_pci.h 00:04:08.550 TEST_HEADER include/spdk/vfio_user_spec.h 00:04:08.550 TEST_HEADER include/spdk/vhost.h 00:04:08.550 TEST_HEADER include/spdk/vmd.h 00:04:08.550 TEST_HEADER include/spdk/xor.h 00:04:08.550 TEST_HEADER include/spdk/zipf.h 00:04:08.550 CXX test/cpp_headers/accel.o 00:04:08.550 LINK spdk_nvme_discover 00:04:08.550 LINK rpc_client_test 00:04:08.550 LINK lsvmd 00:04:08.550 LINK jsoncat 00:04:08.550 LINK histogram_perf 00:04:08.550 LINK event_perf 00:04:08.550 LINK zipf 00:04:08.550 LINK poller_perf 00:04:08.550 LINK interrupt_tgt 00:04:08.550 LINK nvmf_tgt 00:04:08.550 LINK vhost 00:04:08.550 LINK cmb_copy 00:04:08.550 LINK spdk_trace_record 00:04:08.550 LINK iscsi_tgt 00:04:08.550 LINK hello_world 00:04:08.550 LINK ioat_perf 00:04:08.550 LINK spdk_tgt 00:04:08.550 LINK verify 00:04:08.550 LINK bdev_svc 00:04:08.550 LINK hotplug 00:04:08.817 LINK hello_sock 00:04:08.817 LINK mkfs 00:04:08.817 LINK hello_bdev 00:04:08.817 LINK hello_blob 00:04:08.817 LINK thread 00:04:08.817 LINK aer 00:04:08.817 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:04:08.817 CXX test/cpp_headers/accel_module.o 00:04:08.817 LINK arbitration 00:04:08.817 CXX test/cpp_headers/assert.o 00:04:08.817 LINK idxd_perf 00:04:08.817 LINK spdk_dd 00:04:08.817 LINK nvmf 00:04:08.817 LINK reconnect 00:04:08.817 CC test/app/stub/stub.o 00:04:08.817 CC test/event/reactor/reactor.o 00:04:08.817 CC examples/vmd/led/led.o 00:04:08.817 CC test/nvme/reset/reset.o 00:04:08.817 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:04:08.817 LINK spdk_trace 00:04:08.817 CXX test/cpp_headers/barrier.o 00:04:08.817 CC app/fio/bdev/fio_plugin.o 00:04:09.078 LINK abort 00:04:09.078 CXX test/cpp_headers/base64.o 00:04:09.078 CC examples/bdev/bdevperf/bdevperf.o 00:04:09.078 CC test/env/vtophys/vtophys.o 00:04:09.078 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:04:09.078 LINK bdevio 00:04:09.078 CC test/event/reactor_perf/reactor_perf.o 00:04:09.078 LINK dif 00:04:09.078 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:04:09.078 CC test/nvme/sgl/sgl.o 00:04:09.078 LINK test_dma 00:04:09.078 CXX test/cpp_headers/bdev.o 00:04:09.078 LINK accel_perf 00:04:09.078 LINK nvme_fuzz 00:04:09.078 CC test/env/memory/memory_ut.o 00:04:09.078 CC test/nvme/e2edp/nvme_dp.o 00:04:09.078 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:04:09.078 CC test/event/app_repeat/app_repeat.o 00:04:09.078 CXX test/cpp_headers/bdev_module.o 00:04:09.078 LINK pmr_persistence 00:04:09.078 LINK nvme_manage 00:04:09.078 CC test/nvme/overhead/overhead.o 00:04:09.078 CC test/env/pci/pci_ut.o 00:04:09.078 CXX test/cpp_headers/bdev_zone.o 00:04:09.078 CC test/event/scheduler/scheduler.o 00:04:09.078 CXX test/cpp_headers/bit_array.o 00:04:09.340 LINK reactor 00:04:09.340 LINK led 00:04:09.340 LINK stub 00:04:09.340 LINK blobcli 00:04:09.340 CC test/nvme/err_injection/err_injection.o 00:04:09.340 CC test/nvme/startup/startup.o 00:04:09.340 LINK spdk_nvme 00:04:09.340 CXX test/cpp_headers/bit_pool.o 00:04:09.340 CC test/nvme/reserve/reserve.o 00:04:09.340 CC test/nvme/simple_copy/simple_copy.o 00:04:09.340 CC test/nvme/connect_stress/connect_stress.o 00:04:09.340 LINK vtophys 00:04:09.340 CXX test/cpp_headers/blob_bdev.o 00:04:09.340 LINK reactor_perf 00:04:09.340 CXX test/cpp_headers/blobfs_bdev.o 00:04:09.340 LINK env_dpdk_post_init 00:04:09.340 CC test/nvme/boot_partition/boot_partition.o 00:04:09.340 CC test/nvme/compliance/nvme_compliance.o 00:04:09.340 CXX test/cpp_headers/blobfs.o 00:04:09.340 CXX test/cpp_headers/blob.o 00:04:09.340 CC test/nvme/fused_ordering/fused_ordering.o 00:04:09.340 CC test/nvme/doorbell_aers/doorbell_aers.o 00:04:09.340 CXX test/cpp_headers/conf.o 00:04:09.340 CXX test/cpp_headers/config.o 00:04:09.340 LINK app_repeat 00:04:09.340 CXX test/cpp_headers/cpuset.o 00:04:09.340 CXX test/cpp_headers/crc16.o 00:04:09.340 LINK reset 00:04:09.604 LINK mem_callbacks 00:04:09.604 CXX test/cpp_headers/crc32.o 00:04:09.604 CXX test/cpp_headers/crc64.o 00:04:09.604 CXX test/cpp_headers/dif.o 00:04:09.604 CC test/nvme/fdp/fdp.o 00:04:09.604 CXX test/cpp_headers/dma.o 00:04:09.604 CC test/nvme/cuse/cuse.o 00:04:09.604 CXX test/cpp_headers/endian.o 00:04:09.604 CXX test/cpp_headers/env_dpdk.o 00:04:09.604 LINK sgl 00:04:09.604 LINK startup 00:04:09.604 CXX test/cpp_headers/env.o 00:04:09.604 CXX test/cpp_headers/event.o 00:04:09.604 CXX test/cpp_headers/fd_group.o 00:04:09.604 CXX test/cpp_headers/fd.o 00:04:09.604 CXX test/cpp_headers/file.o 00:04:09.604 LINK err_injection 00:04:09.604 CXX test/cpp_headers/ftl.o 00:04:09.604 LINK nvme_dp 00:04:09.604 LINK scheduler 00:04:09.604 CXX test/cpp_headers/gpt_spec.o 00:04:09.604 LINK spdk_nvme_perf 00:04:09.604 LINK connect_stress 00:04:09.604 CXX test/cpp_headers/hexlify.o 00:04:09.604 LINK reserve 00:04:09.604 LINK spdk_nvme_identify 00:04:09.604 CXX test/cpp_headers/histogram_data.o 00:04:09.604 LINK boot_partition 00:04:09.865 CXX test/cpp_headers/idxd.o 00:04:09.865 LINK overhead 00:04:09.865 LINK simple_copy 00:04:09.865 LINK spdk_top 00:04:09.865 CXX test/cpp_headers/idxd_spec.o 00:04:09.865 CXX test/cpp_headers/init.o 00:04:09.865 CXX test/cpp_headers/ioat.o 00:04:09.865 CXX test/cpp_headers/ioat_spec.o 00:04:09.865 CXX test/cpp_headers/iscsi_spec.o 00:04:09.865 LINK fused_ordering 00:04:09.865 CXX test/cpp_headers/json.o 00:04:09.865 CXX test/cpp_headers/jsonrpc.o 00:04:09.865 LINK doorbell_aers 00:04:09.865 CXX test/cpp_headers/likely.o 00:04:09.865 CXX test/cpp_headers/log.o 00:04:09.865 CXX test/cpp_headers/lvol.o 00:04:09.865 CXX test/cpp_headers/memory.o 00:04:09.865 LINK pci_ut 00:04:09.865 CXX test/cpp_headers/mmio.o 00:04:09.865 LINK spdk_bdev 00:04:09.865 CXX test/cpp_headers/nbd.o 00:04:09.865 CXX test/cpp_headers/notify.o 00:04:09.865 LINK vhost_fuzz 00:04:09.865 CXX test/cpp_headers/nvme.o 00:04:09.865 CXX test/cpp_headers/nvme_intel.o 00:04:09.865 CXX test/cpp_headers/nvme_ocssd.o 00:04:09.865 CXX test/cpp_headers/nvme_ocssd_spec.o 00:04:09.865 CXX test/cpp_headers/nvme_spec.o 00:04:09.865 CXX test/cpp_headers/nvme_zns.o 00:04:09.865 CXX test/cpp_headers/nvmf_cmd.o 00:04:09.865 CXX test/cpp_headers/nvmf_fc_spec.o 00:04:09.865 CXX test/cpp_headers/nvmf.o 00:04:09.865 CXX test/cpp_headers/nvmf_spec.o 00:04:10.125 CXX test/cpp_headers/nvmf_transport.o 00:04:10.125 CXX test/cpp_headers/opal.o 00:04:10.125 CXX test/cpp_headers/opal_spec.o 00:04:10.125 CXX test/cpp_headers/pci_ids.o 00:04:10.125 CXX test/cpp_headers/pipe.o 00:04:10.125 LINK nvme_compliance 00:04:10.125 CXX test/cpp_headers/queue.o 00:04:10.125 CXX test/cpp_headers/reduce.o 00:04:10.125 CXX test/cpp_headers/rpc.o 00:04:10.125 CXX test/cpp_headers/scheduler.o 00:04:10.125 CXX test/cpp_headers/scsi_spec.o 00:04:10.125 CXX test/cpp_headers/scsi.o 00:04:10.125 CXX test/cpp_headers/sock.o 00:04:10.125 CXX test/cpp_headers/stdinc.o 00:04:10.125 CXX test/cpp_headers/string.o 00:04:10.125 CXX test/cpp_headers/thread.o 00:04:10.125 CXX test/cpp_headers/trace.o 00:04:10.125 CXX test/cpp_headers/trace_parser.o 00:04:10.125 LINK fdp 00:04:10.125 CXX test/cpp_headers/tree.o 00:04:10.125 CXX test/cpp_headers/util.o 00:04:10.125 CXX test/cpp_headers/ublk.o 00:04:10.125 CXX test/cpp_headers/uuid.o 00:04:10.125 CXX test/cpp_headers/version.o 00:04:10.125 CXX test/cpp_headers/vfio_user_pci.o 00:04:10.125 CXX test/cpp_headers/vfio_user_spec.o 00:04:10.125 CXX test/cpp_headers/vhost.o 00:04:10.125 CXX test/cpp_headers/vmd.o 00:04:10.125 CXX test/cpp_headers/xor.o 00:04:10.125 CXX test/cpp_headers/zipf.o 00:04:10.391 LINK bdevperf 00:04:10.666 LINK memory_ut 00:04:10.923 LINK cuse 00:04:11.180 LINK iscsi_fuzz 00:04:13.710 LINK esnap 00:04:13.968 00:04:13.968 real 0m38.478s 00:04:13.968 user 7m15.797s 00:04:13.968 sys 1m38.140s 00:04:13.968 00:58:28 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:04:13.968 00:58:28 -- common/autotest_common.sh@10 -- $ set +x 00:04:13.968 ************************************ 00:04:13.968 END TEST make 00:04:13.968 ************************************ 00:04:13.968 00:58:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:13.968 00:58:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:13.968 00:58:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:14.226 00:58:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:14.226 00:58:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:14.226 00:58:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:14.226 00:58:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:14.226 00:58:28 -- scripts/common.sh@335 -- # IFS=.-: 00:04:14.226 00:58:28 -- scripts/common.sh@335 -- # read -ra ver1 00:04:14.226 00:58:28 -- scripts/common.sh@336 -- # IFS=.-: 00:04:14.226 00:58:28 -- scripts/common.sh@336 -- # read -ra ver2 00:04:14.226 00:58:28 -- scripts/common.sh@337 -- # local 'op=<' 00:04:14.226 00:58:28 -- scripts/common.sh@339 -- # ver1_l=2 00:04:14.226 00:58:28 -- scripts/common.sh@340 -- # ver2_l=1 00:04:14.226 00:58:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:14.226 00:58:28 -- scripts/common.sh@343 -- # case "$op" in 00:04:14.226 00:58:28 -- scripts/common.sh@344 -- # : 1 00:04:14.226 00:58:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:14.226 00:58:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:14.226 00:58:28 -- scripts/common.sh@364 -- # decimal 1 00:04:14.226 00:58:28 -- scripts/common.sh@352 -- # local d=1 00:04:14.226 00:58:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:14.226 00:58:28 -- scripts/common.sh@354 -- # echo 1 00:04:14.226 00:58:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:14.226 00:58:28 -- scripts/common.sh@365 -- # decimal 2 00:04:14.226 00:58:28 -- scripts/common.sh@352 -- # local d=2 00:04:14.226 00:58:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:14.226 00:58:28 -- scripts/common.sh@354 -- # echo 2 00:04:14.226 00:58:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:14.226 00:58:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:14.226 00:58:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:14.226 00:58:28 -- scripts/common.sh@367 -- # return 0 00:04:14.226 00:58:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:14.227 00:58:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:14.227 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:14.227 --rc genhtml_branch_coverage=1 00:04:14.227 --rc genhtml_function_coverage=1 00:04:14.227 --rc genhtml_legend=1 00:04:14.227 --rc geninfo_all_blocks=1 00:04:14.227 --rc geninfo_unexecuted_blocks=1 00:04:14.227 00:04:14.227 ' 00:04:14.227 00:58:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:14.227 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:14.227 --rc genhtml_branch_coverage=1 00:04:14.227 --rc genhtml_function_coverage=1 00:04:14.227 --rc genhtml_legend=1 00:04:14.227 --rc geninfo_all_blocks=1 00:04:14.227 --rc geninfo_unexecuted_blocks=1 00:04:14.227 00:04:14.227 ' 00:04:14.227 00:58:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:14.227 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:14.227 --rc genhtml_branch_coverage=1 00:04:14.227 --rc genhtml_function_coverage=1 00:04:14.227 --rc genhtml_legend=1 00:04:14.227 --rc geninfo_all_blocks=1 00:04:14.227 --rc geninfo_unexecuted_blocks=1 00:04:14.227 00:04:14.227 ' 00:04:14.227 00:58:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:14.227 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:14.227 --rc genhtml_branch_coverage=1 00:04:14.227 --rc genhtml_function_coverage=1 00:04:14.227 --rc genhtml_legend=1 00:04:14.227 --rc geninfo_all_blocks=1 00:04:14.227 --rc geninfo_unexecuted_blocks=1 00:04:14.227 00:04:14.227 ' 00:04:14.227 00:58:28 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:14.227 00:58:28 -- nvmf/common.sh@7 -- # uname -s 00:04:14.227 00:58:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:14.227 00:58:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:14.227 00:58:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:14.227 00:58:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:14.227 00:58:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:14.227 00:58:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:14.227 00:58:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:14.227 00:58:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:14.227 00:58:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:14.227 00:58:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:14.227 00:58:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:14.227 00:58:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:14.227 00:58:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:14.227 00:58:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:14.227 00:58:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:04:14.227 00:58:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:14.227 00:58:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:14.227 00:58:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:14.227 00:58:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:14.227 00:58:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:14.227 00:58:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:14.227 00:58:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:14.227 00:58:28 -- paths/export.sh@5 -- # export PATH 00:04:14.227 00:58:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:14.227 00:58:28 -- nvmf/common.sh@46 -- # : 0 00:04:14.227 00:58:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:14.227 00:58:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:14.227 00:58:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:14.227 00:58:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:14.227 00:58:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:14.227 00:58:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:14.227 00:58:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:14.227 00:58:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:14.227 00:58:28 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:04:14.227 00:58:28 -- spdk/autotest.sh@32 -- # uname -s 00:04:14.227 00:58:28 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:04:14.227 00:58:28 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:04:14.227 00:58:28 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:04:14.227 00:58:28 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:04:14.227 00:58:28 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:04:14.227 00:58:28 -- spdk/autotest.sh@44 -- # modprobe nbd 00:04:14.227 00:58:28 -- spdk/autotest.sh@46 -- # type -P udevadm 00:04:14.227 00:58:28 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:04:14.227 00:58:28 -- spdk/autotest.sh@48 -- # udevadm_pid=1880180 00:04:14.227 00:58:28 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:04:14.227 00:58:28 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:04:14.227 00:58:28 -- spdk/autotest.sh@54 -- # echo 1880182 00:04:14.227 00:58:28 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:04:14.227 00:58:28 -- spdk/autotest.sh@56 -- # echo 1880183 00:04:14.227 00:58:28 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:04:14.227 00:58:28 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:04:14.227 00:58:28 -- spdk/autotest.sh@60 -- # echo 1880184 00:04:14.227 00:58:28 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:04:14.227 00:58:28 -- spdk/autotest.sh@62 -- # echo 1880185 00:04:14.227 00:58:28 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:04:14.227 00:58:28 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:04:14.227 00:58:28 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:04:14.227 00:58:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:14.227 00:58:28 -- common/autotest_common.sh@10 -- # set +x 00:04:14.227 00:58:28 -- spdk/autotest.sh@70 -- # create_test_list 00:04:14.227 00:58:28 -- common/autotest_common.sh@746 -- # xtrace_disable 00:04:14.227 00:58:28 -- common/autotest_common.sh@10 -- # set +x 00:04:14.227 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:04:14.227 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:04:14.227 00:58:28 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:04:14.227 00:58:28 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:14.227 00:58:28 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:14.227 00:58:28 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:04:14.227 00:58:28 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:14.227 00:58:28 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:04:14.227 00:58:28 -- common/autotest_common.sh@1450 -- # uname 00:04:14.227 00:58:28 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:04:14.227 00:58:28 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:04:14.227 00:58:28 -- common/autotest_common.sh@1470 -- # uname 00:04:14.227 00:58:28 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:04:14.227 00:58:28 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:04:14.227 00:58:28 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:04:14.227 lcov: LCOV version 1.15 00:04:14.227 00:58:28 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:04:17.512 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:04:17.512 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:04:17.512 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:04:17.512 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:04:17.512 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:04:17.512 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:04:49.586 00:59:01 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:04:49.586 00:59:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:49.586 00:59:01 -- common/autotest_common.sh@10 -- # set +x 00:04:49.586 00:59:01 -- spdk/autotest.sh@89 -- # rm -f 00:04:49.586 00:59:01 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:49.586 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:04:49.586 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:04:49.586 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:04:49.586 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:04:49.586 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:04:49.586 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:04:49.586 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:04:49.586 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:04:49.586 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:04:49.586 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:04:49.586 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:04:49.586 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:04:49.586 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:04:49.586 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:04:49.586 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:04:49.586 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:04:49.586 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:04:49.586 00:59:03 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:04:49.586 00:59:03 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:49.586 00:59:03 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:49.586 00:59:03 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:49.586 00:59:03 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:49.586 00:59:03 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:49.586 00:59:03 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:49.586 00:59:03 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:49.586 00:59:03 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:49.586 00:59:03 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:04:49.586 00:59:03 -- spdk/autotest.sh@108 -- # grep -v p 00:04:49.586 00:59:03 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:04:49.586 00:59:03 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:04:49.586 00:59:03 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:04:49.586 00:59:03 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:04:49.586 00:59:03 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:04:49.586 00:59:03 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:04:49.586 No valid GPT data, bailing 00:04:49.587 00:59:03 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:49.587 00:59:03 -- scripts/common.sh@393 -- # pt= 00:04:49.587 00:59:03 -- scripts/common.sh@394 -- # return 1 00:04:49.587 00:59:03 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:04:49.587 1+0 records in 00:04:49.587 1+0 records out 00:04:49.587 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00217054 s, 483 MB/s 00:04:49.587 00:59:03 -- spdk/autotest.sh@116 -- # sync 00:04:49.587 00:59:03 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:04:49.587 00:59:03 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:04:49.587 00:59:03 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:04:50.962 00:59:05 -- spdk/autotest.sh@122 -- # uname -s 00:04:50.962 00:59:05 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:04:50.962 00:59:05 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:50.962 00:59:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:50.962 00:59:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:50.962 00:59:05 -- common/autotest_common.sh@10 -- # set +x 00:04:50.962 ************************************ 00:04:50.962 START TEST setup.sh 00:04:50.962 ************************************ 00:04:50.962 00:59:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:50.962 * Looking for test storage... 00:04:50.962 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:50.962 00:59:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:50.962 00:59:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:50.962 00:59:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:50.962 00:59:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:50.962 00:59:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:50.962 00:59:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:50.962 00:59:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:50.962 00:59:05 -- scripts/common.sh@335 -- # IFS=.-: 00:04:50.962 00:59:05 -- scripts/common.sh@335 -- # read -ra ver1 00:04:50.962 00:59:05 -- scripts/common.sh@336 -- # IFS=.-: 00:04:50.962 00:59:05 -- scripts/common.sh@336 -- # read -ra ver2 00:04:50.962 00:59:05 -- scripts/common.sh@337 -- # local 'op=<' 00:04:50.962 00:59:05 -- scripts/common.sh@339 -- # ver1_l=2 00:04:50.962 00:59:05 -- scripts/common.sh@340 -- # ver2_l=1 00:04:50.962 00:59:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:50.962 00:59:05 -- scripts/common.sh@343 -- # case "$op" in 00:04:50.962 00:59:05 -- scripts/common.sh@344 -- # : 1 00:04:50.962 00:59:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:50.962 00:59:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:50.962 00:59:05 -- scripts/common.sh@364 -- # decimal 1 00:04:50.962 00:59:05 -- scripts/common.sh@352 -- # local d=1 00:04:50.962 00:59:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:50.962 00:59:05 -- scripts/common.sh@354 -- # echo 1 00:04:50.962 00:59:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:50.962 00:59:05 -- scripts/common.sh@365 -- # decimal 2 00:04:50.962 00:59:05 -- scripts/common.sh@352 -- # local d=2 00:04:50.962 00:59:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:50.962 00:59:05 -- scripts/common.sh@354 -- # echo 2 00:04:50.962 00:59:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:50.962 00:59:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:50.962 00:59:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:50.962 00:59:05 -- scripts/common.sh@367 -- # return 0 00:04:50.962 00:59:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:50.962 00:59:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:50.962 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:50.962 --rc genhtml_branch_coverage=1 00:04:50.962 --rc genhtml_function_coverage=1 00:04:50.962 --rc genhtml_legend=1 00:04:50.962 --rc geninfo_all_blocks=1 00:04:50.962 --rc geninfo_unexecuted_blocks=1 00:04:50.962 00:04:50.962 ' 00:04:50.962 00:59:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:50.962 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:50.962 --rc genhtml_branch_coverage=1 00:04:50.962 --rc genhtml_function_coverage=1 00:04:50.962 --rc genhtml_legend=1 00:04:50.962 --rc geninfo_all_blocks=1 00:04:50.962 --rc geninfo_unexecuted_blocks=1 00:04:50.962 00:04:50.962 ' 00:04:50.962 00:59:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:50.962 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:50.962 --rc genhtml_branch_coverage=1 00:04:50.962 --rc genhtml_function_coverage=1 00:04:50.962 --rc genhtml_legend=1 00:04:50.962 --rc geninfo_all_blocks=1 00:04:50.962 --rc geninfo_unexecuted_blocks=1 00:04:50.962 00:04:50.962 ' 00:04:50.962 00:59:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:50.962 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:50.962 --rc genhtml_branch_coverage=1 00:04:50.962 --rc genhtml_function_coverage=1 00:04:50.962 --rc genhtml_legend=1 00:04:50.962 --rc geninfo_all_blocks=1 00:04:50.962 --rc geninfo_unexecuted_blocks=1 00:04:50.962 00:04:50.962 ' 00:04:50.962 00:59:05 -- setup/test-setup.sh@10 -- # uname -s 00:04:50.962 00:59:05 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:04:50.962 00:59:05 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:50.962 00:59:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:50.962 00:59:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:50.962 00:59:05 -- common/autotest_common.sh@10 -- # set +x 00:04:50.962 ************************************ 00:04:50.962 START TEST acl 00:04:50.962 ************************************ 00:04:50.962 00:59:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:50.962 * Looking for test storage... 00:04:50.962 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:50.962 00:59:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:50.962 00:59:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:50.962 00:59:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:50.962 00:59:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:50.962 00:59:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:50.962 00:59:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:50.962 00:59:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:50.962 00:59:05 -- scripts/common.sh@335 -- # IFS=.-: 00:04:50.962 00:59:05 -- scripts/common.sh@335 -- # read -ra ver1 00:04:50.962 00:59:05 -- scripts/common.sh@336 -- # IFS=.-: 00:04:50.962 00:59:05 -- scripts/common.sh@336 -- # read -ra ver2 00:04:50.962 00:59:05 -- scripts/common.sh@337 -- # local 'op=<' 00:04:50.962 00:59:05 -- scripts/common.sh@339 -- # ver1_l=2 00:04:50.963 00:59:05 -- scripts/common.sh@340 -- # ver2_l=1 00:04:50.963 00:59:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:50.963 00:59:05 -- scripts/common.sh@343 -- # case "$op" in 00:04:50.963 00:59:05 -- scripts/common.sh@344 -- # : 1 00:04:50.963 00:59:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:50.963 00:59:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:50.963 00:59:05 -- scripts/common.sh@364 -- # decimal 1 00:04:50.963 00:59:05 -- scripts/common.sh@352 -- # local d=1 00:04:50.963 00:59:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:50.963 00:59:05 -- scripts/common.sh@354 -- # echo 1 00:04:50.963 00:59:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:50.963 00:59:05 -- scripts/common.sh@365 -- # decimal 2 00:04:50.963 00:59:05 -- scripts/common.sh@352 -- # local d=2 00:04:50.963 00:59:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:50.963 00:59:05 -- scripts/common.sh@354 -- # echo 2 00:04:50.963 00:59:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:50.963 00:59:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:50.963 00:59:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:50.963 00:59:05 -- scripts/common.sh@367 -- # return 0 00:04:50.963 00:59:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:50.963 00:59:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:50.963 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:50.963 --rc genhtml_branch_coverage=1 00:04:50.963 --rc genhtml_function_coverage=1 00:04:50.963 --rc genhtml_legend=1 00:04:50.963 --rc geninfo_all_blocks=1 00:04:50.963 --rc geninfo_unexecuted_blocks=1 00:04:50.963 00:04:50.963 ' 00:04:50.963 00:59:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:50.963 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:50.963 --rc genhtml_branch_coverage=1 00:04:50.963 --rc genhtml_function_coverage=1 00:04:50.963 --rc genhtml_legend=1 00:04:50.963 --rc geninfo_all_blocks=1 00:04:50.963 --rc geninfo_unexecuted_blocks=1 00:04:50.963 00:04:50.963 ' 00:04:50.963 00:59:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:50.963 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:50.963 --rc genhtml_branch_coverage=1 00:04:50.963 --rc genhtml_function_coverage=1 00:04:50.963 --rc genhtml_legend=1 00:04:50.963 --rc geninfo_all_blocks=1 00:04:50.963 --rc geninfo_unexecuted_blocks=1 00:04:50.963 00:04:50.963 ' 00:04:50.963 00:59:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:50.963 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:50.963 --rc genhtml_branch_coverage=1 00:04:50.963 --rc genhtml_function_coverage=1 00:04:50.963 --rc genhtml_legend=1 00:04:50.963 --rc geninfo_all_blocks=1 00:04:50.963 --rc geninfo_unexecuted_blocks=1 00:04:50.963 00:04:50.963 ' 00:04:50.963 00:59:05 -- setup/acl.sh@10 -- # get_zoned_devs 00:04:50.963 00:59:05 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:50.963 00:59:05 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:50.963 00:59:05 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:50.963 00:59:05 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:50.963 00:59:05 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:50.963 00:59:05 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:50.963 00:59:05 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:50.963 00:59:05 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:50.963 00:59:05 -- setup/acl.sh@12 -- # devs=() 00:04:50.963 00:59:05 -- setup/acl.sh@12 -- # declare -a devs 00:04:50.963 00:59:05 -- setup/acl.sh@13 -- # drivers=() 00:04:50.963 00:59:05 -- setup/acl.sh@13 -- # declare -A drivers 00:04:50.963 00:59:05 -- setup/acl.sh@51 -- # setup reset 00:04:50.963 00:59:05 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:50.963 00:59:05 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:52.337 00:59:06 -- setup/acl.sh@52 -- # collect_setup_devs 00:04:52.337 00:59:06 -- setup/acl.sh@16 -- # local dev driver 00:04:52.337 00:59:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:52.337 00:59:06 -- setup/acl.sh@15 -- # setup output status 00:04:52.337 00:59:06 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:52.337 00:59:06 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:53.715 Hugepages 00:04:53.715 node hugesize free / total 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # continue 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # continue 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # continue 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:04:53.715 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # continue 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # continue 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # continue 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # continue 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # continue 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # continue 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # continue 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # continue 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # continue 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # continue 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # continue 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # continue 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # continue 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # continue 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # continue 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # continue 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # continue 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:59:08 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:04:53.715 00:59:08 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:53.715 00:59:08 -- setup/acl.sh@22 -- # devs+=("$dev") 00:04:53.715 00:59:08 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:04:53.715 00:59:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:53.715 00:59:08 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:04:53.715 00:59:08 -- setup/acl.sh@54 -- # run_test denied denied 00:04:53.715 00:59:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:53.715 00:59:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:53.715 00:59:08 -- common/autotest_common.sh@10 -- # set +x 00:04:53.715 ************************************ 00:04:53.715 START TEST denied 00:04:53.715 ************************************ 00:04:53.715 00:59:08 -- common/autotest_common.sh@1114 -- # denied 00:04:53.715 00:59:08 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:04:53.715 00:59:08 -- setup/acl.sh@38 -- # setup output config 00:04:53.715 00:59:08 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:04:53.715 00:59:08 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:53.715 00:59:08 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:55.090 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:04:55.090 00:59:09 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:04:55.090 00:59:09 -- setup/acl.sh@28 -- # local dev driver 00:04:55.090 00:59:09 -- setup/acl.sh@30 -- # for dev in "$@" 00:04:55.090 00:59:09 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:04:55.090 00:59:09 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:04:55.090 00:59:09 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:04:55.090 00:59:09 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:04:55.090 00:59:09 -- setup/acl.sh@41 -- # setup reset 00:04:55.090 00:59:09 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:55.090 00:59:09 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:57.617 00:04:57.617 real 0m3.832s 00:04:57.617 user 0m1.181s 00:04:57.617 sys 0m1.781s 00:04:57.617 00:59:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:57.617 00:59:11 -- common/autotest_common.sh@10 -- # set +x 00:04:57.617 ************************************ 00:04:57.617 END TEST denied 00:04:57.617 ************************************ 00:04:57.617 00:59:11 -- setup/acl.sh@55 -- # run_test allowed allowed 00:04:57.617 00:59:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:57.617 00:59:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:57.617 00:59:11 -- common/autotest_common.sh@10 -- # set +x 00:04:57.617 ************************************ 00:04:57.617 START TEST allowed 00:04:57.617 ************************************ 00:04:57.617 00:59:11 -- common/autotest_common.sh@1114 -- # allowed 00:04:57.617 00:59:11 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:04:57.617 00:59:11 -- setup/acl.sh@45 -- # setup output config 00:04:57.618 00:59:11 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:04:57.618 00:59:11 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:57.618 00:59:11 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:00.143 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:00.143 00:59:14 -- setup/acl.sh@47 -- # verify 00:05:00.144 00:59:14 -- setup/acl.sh@28 -- # local dev driver 00:05:00.144 00:59:14 -- setup/acl.sh@48 -- # setup reset 00:05:00.144 00:59:14 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:00.144 00:59:14 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:01.517 00:05:01.517 real 0m3.880s 00:05:01.517 user 0m0.980s 00:05:01.517 sys 0m1.769s 00:05:01.517 00:59:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:01.517 00:59:15 -- common/autotest_common.sh@10 -- # set +x 00:05:01.517 ************************************ 00:05:01.517 END TEST allowed 00:05:01.517 ************************************ 00:05:01.517 00:05:01.517 real 0m10.603s 00:05:01.517 user 0m3.282s 00:05:01.517 sys 0m5.411s 00:05:01.517 00:59:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:01.517 00:59:15 -- common/autotest_common.sh@10 -- # set +x 00:05:01.517 ************************************ 00:05:01.517 END TEST acl 00:05:01.517 ************************************ 00:05:01.517 00:59:15 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:05:01.517 00:59:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:01.517 00:59:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:01.517 00:59:15 -- common/autotest_common.sh@10 -- # set +x 00:05:01.517 ************************************ 00:05:01.517 START TEST hugepages 00:05:01.517 ************************************ 00:05:01.517 00:59:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:05:01.517 * Looking for test storage... 00:05:01.517 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:05:01.517 00:59:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:01.517 00:59:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:01.517 00:59:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:01.518 00:59:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:01.518 00:59:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:01.518 00:59:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:01.518 00:59:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:01.518 00:59:16 -- scripts/common.sh@335 -- # IFS=.-: 00:05:01.518 00:59:16 -- scripts/common.sh@335 -- # read -ra ver1 00:05:01.518 00:59:16 -- scripts/common.sh@336 -- # IFS=.-: 00:05:01.518 00:59:16 -- scripts/common.sh@336 -- # read -ra ver2 00:05:01.518 00:59:16 -- scripts/common.sh@337 -- # local 'op=<' 00:05:01.518 00:59:16 -- scripts/common.sh@339 -- # ver1_l=2 00:05:01.518 00:59:16 -- scripts/common.sh@340 -- # ver2_l=1 00:05:01.518 00:59:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:01.518 00:59:16 -- scripts/common.sh@343 -- # case "$op" in 00:05:01.518 00:59:16 -- scripts/common.sh@344 -- # : 1 00:05:01.518 00:59:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:01.518 00:59:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:01.518 00:59:16 -- scripts/common.sh@364 -- # decimal 1 00:05:01.518 00:59:16 -- scripts/common.sh@352 -- # local d=1 00:05:01.518 00:59:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:01.518 00:59:16 -- scripts/common.sh@354 -- # echo 1 00:05:01.518 00:59:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:01.518 00:59:16 -- scripts/common.sh@365 -- # decimal 2 00:05:01.518 00:59:16 -- scripts/common.sh@352 -- # local d=2 00:05:01.518 00:59:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:01.518 00:59:16 -- scripts/common.sh@354 -- # echo 2 00:05:01.518 00:59:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:01.518 00:59:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:01.518 00:59:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:01.518 00:59:16 -- scripts/common.sh@367 -- # return 0 00:05:01.518 00:59:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:01.518 00:59:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:01.518 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:01.518 --rc genhtml_branch_coverage=1 00:05:01.518 --rc genhtml_function_coverage=1 00:05:01.518 --rc genhtml_legend=1 00:05:01.518 --rc geninfo_all_blocks=1 00:05:01.518 --rc geninfo_unexecuted_blocks=1 00:05:01.518 00:05:01.518 ' 00:05:01.518 00:59:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:01.518 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:01.518 --rc genhtml_branch_coverage=1 00:05:01.518 --rc genhtml_function_coverage=1 00:05:01.518 --rc genhtml_legend=1 00:05:01.518 --rc geninfo_all_blocks=1 00:05:01.518 --rc geninfo_unexecuted_blocks=1 00:05:01.518 00:05:01.518 ' 00:05:01.518 00:59:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:01.518 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:01.518 --rc genhtml_branch_coverage=1 00:05:01.518 --rc genhtml_function_coverage=1 00:05:01.518 --rc genhtml_legend=1 00:05:01.518 --rc geninfo_all_blocks=1 00:05:01.518 --rc geninfo_unexecuted_blocks=1 00:05:01.518 00:05:01.518 ' 00:05:01.518 00:59:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:01.518 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:01.518 --rc genhtml_branch_coverage=1 00:05:01.518 --rc genhtml_function_coverage=1 00:05:01.518 --rc genhtml_legend=1 00:05:01.518 --rc geninfo_all_blocks=1 00:05:01.518 --rc geninfo_unexecuted_blocks=1 00:05:01.518 00:05:01.518 ' 00:05:01.518 00:59:16 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:05:01.518 00:59:16 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:05:01.518 00:59:16 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:05:01.518 00:59:16 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:05:01.518 00:59:16 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:05:01.518 00:59:16 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:05:01.518 00:59:16 -- setup/common.sh@17 -- # local get=Hugepagesize 00:05:01.518 00:59:16 -- setup/common.sh@18 -- # local node= 00:05:01.518 00:59:16 -- setup/common.sh@19 -- # local var val 00:05:01.518 00:59:16 -- setup/common.sh@20 -- # local mem_f mem 00:05:01.518 00:59:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:01.518 00:59:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:01.518 00:59:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:01.518 00:59:16 -- setup/common.sh@28 -- # mapfile -t mem 00:05:01.518 00:59:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.518 00:59:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 40556372 kB' 'MemAvailable: 44331160 kB' 'Buffers: 2708 kB' 'Cached: 13206568 kB' 'SwapCached: 0 kB' 'Active: 9920520 kB' 'Inactive: 3764112 kB' 'Active(anon): 9520040 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479340 kB' 'Mapped: 186444 kB' 'Shmem: 9044684 kB' 'KReclaimable: 207552 kB' 'Slab: 746872 kB' 'SReclaimable: 207552 kB' 'SUnreclaim: 539320 kB' 'KernelStack: 12784 kB' 'PageTables: 8136 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559276 kB' 'Committed_AS: 10591628 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198232 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.518 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.518 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # continue 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.519 00:59:16 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.519 00:59:16 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:05:01.519 00:59:16 -- setup/common.sh@33 -- # echo 2048 00:05:01.519 00:59:16 -- setup/common.sh@33 -- # return 0 00:05:01.519 00:59:16 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:05:01.519 00:59:16 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:05:01.519 00:59:16 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:05:01.519 00:59:16 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:05:01.519 00:59:16 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:05:01.519 00:59:16 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:05:01.519 00:59:16 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:05:01.519 00:59:16 -- setup/hugepages.sh@207 -- # get_nodes 00:05:01.519 00:59:16 -- setup/hugepages.sh@27 -- # local node 00:05:01.519 00:59:16 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:01.519 00:59:16 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:05:01.519 00:59:16 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:01.519 00:59:16 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:05:01.519 00:59:16 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:01.519 00:59:16 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:01.519 00:59:16 -- setup/hugepages.sh@208 -- # clear_hp 00:05:01.519 00:59:16 -- setup/hugepages.sh@37 -- # local node hp 00:05:01.520 00:59:16 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:05:01.520 00:59:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:01.520 00:59:16 -- setup/hugepages.sh@41 -- # echo 0 00:05:01.520 00:59:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:01.520 00:59:16 -- setup/hugepages.sh@41 -- # echo 0 00:05:01.520 00:59:16 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:05:01.520 00:59:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:01.520 00:59:16 -- setup/hugepages.sh@41 -- # echo 0 00:05:01.520 00:59:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:01.520 00:59:16 -- setup/hugepages.sh@41 -- # echo 0 00:05:01.520 00:59:16 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:05:01.520 00:59:16 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:05:01.520 00:59:16 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:05:01.520 00:59:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:01.520 00:59:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:01.520 00:59:16 -- common/autotest_common.sh@10 -- # set +x 00:05:01.778 ************************************ 00:05:01.778 START TEST default_setup 00:05:01.778 ************************************ 00:05:01.778 00:59:16 -- common/autotest_common.sh@1114 -- # default_setup 00:05:01.778 00:59:16 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:05:01.778 00:59:16 -- setup/hugepages.sh@49 -- # local size=2097152 00:05:01.778 00:59:16 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:05:01.778 00:59:16 -- setup/hugepages.sh@51 -- # shift 00:05:01.778 00:59:16 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:05:01.778 00:59:16 -- setup/hugepages.sh@52 -- # local node_ids 00:05:01.778 00:59:16 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:05:01.778 00:59:16 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:05:01.778 00:59:16 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:05:01.778 00:59:16 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:05:01.778 00:59:16 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:01.778 00:59:16 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:05:01.778 00:59:16 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:01.778 00:59:16 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:01.778 00:59:16 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:01.778 00:59:16 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:05:01.778 00:59:16 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:05:01.778 00:59:16 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:05:01.778 00:59:16 -- setup/hugepages.sh@73 -- # return 0 00:05:01.778 00:59:16 -- setup/hugepages.sh@137 -- # setup output 00:05:01.778 00:59:16 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:01.778 00:59:16 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:03.155 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:03.155 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:03.155 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:03.155 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:03.155 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:03.155 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:03.155 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:03.155 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:03.155 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:03.155 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:03.155 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:03.155 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:03.155 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:03.155 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:03.155 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:03.155 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:03.829 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:04.091 00:59:18 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:05:04.091 00:59:18 -- setup/hugepages.sh@89 -- # local node 00:05:04.091 00:59:18 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:04.091 00:59:18 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:04.091 00:59:18 -- setup/hugepages.sh@92 -- # local surp 00:05:04.091 00:59:18 -- setup/hugepages.sh@93 -- # local resv 00:05:04.091 00:59:18 -- setup/hugepages.sh@94 -- # local anon 00:05:04.091 00:59:18 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:04.091 00:59:18 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:04.091 00:59:18 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:04.091 00:59:18 -- setup/common.sh@18 -- # local node= 00:05:04.091 00:59:18 -- setup/common.sh@19 -- # local var val 00:05:04.091 00:59:18 -- setup/common.sh@20 -- # local mem_f mem 00:05:04.091 00:59:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:04.091 00:59:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:04.091 00:59:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:04.091 00:59:18 -- setup/common.sh@28 -- # mapfile -t mem 00:05:04.091 00:59:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:04.091 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.091 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.091 00:59:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42671708 kB' 'MemAvailable: 46446504 kB' 'Buffers: 2708 kB' 'Cached: 13206660 kB' 'SwapCached: 0 kB' 'Active: 9923060 kB' 'Inactive: 3764112 kB' 'Active(anon): 9522580 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481444 kB' 'Mapped: 186196 kB' 'Shmem: 9044776 kB' 'KReclaimable: 207568 kB' 'Slab: 746452 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 538884 kB' 'KernelStack: 12896 kB' 'PageTables: 7916 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10597792 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:04.091 00:59:18 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.092 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.092 00:59:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.092 00:59:18 -- setup/common.sh@33 -- # echo 0 00:05:04.092 00:59:18 -- setup/common.sh@33 -- # return 0 00:05:04.092 00:59:18 -- setup/hugepages.sh@97 -- # anon=0 00:05:04.092 00:59:18 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:04.093 00:59:18 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:04.093 00:59:18 -- setup/common.sh@18 -- # local node= 00:05:04.093 00:59:18 -- setup/common.sh@19 -- # local var val 00:05:04.093 00:59:18 -- setup/common.sh@20 -- # local mem_f mem 00:05:04.093 00:59:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:04.093 00:59:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:04.093 00:59:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:04.093 00:59:18 -- setup/common.sh@28 -- # mapfile -t mem 00:05:04.093 00:59:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42679804 kB' 'MemAvailable: 46454600 kB' 'Buffers: 2708 kB' 'Cached: 13206664 kB' 'SwapCached: 0 kB' 'Active: 9923260 kB' 'Inactive: 3764112 kB' 'Active(anon): 9522780 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481240 kB' 'Mapped: 186260 kB' 'Shmem: 9044780 kB' 'KReclaimable: 207568 kB' 'Slab: 746548 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 538980 kB' 'KernelStack: 12784 kB' 'PageTables: 8096 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10597804 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.093 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.093 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.094 00:59:18 -- setup/common.sh@33 -- # echo 0 00:05:04.094 00:59:18 -- setup/common.sh@33 -- # return 0 00:05:04.094 00:59:18 -- setup/hugepages.sh@99 -- # surp=0 00:05:04.094 00:59:18 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:04.094 00:59:18 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:04.094 00:59:18 -- setup/common.sh@18 -- # local node= 00:05:04.094 00:59:18 -- setup/common.sh@19 -- # local var val 00:05:04.094 00:59:18 -- setup/common.sh@20 -- # local mem_f mem 00:05:04.094 00:59:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:04.094 00:59:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:04.094 00:59:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:04.094 00:59:18 -- setup/common.sh@28 -- # mapfile -t mem 00:05:04.094 00:59:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42680596 kB' 'MemAvailable: 46455392 kB' 'Buffers: 2708 kB' 'Cached: 13206664 kB' 'SwapCached: 0 kB' 'Active: 9922048 kB' 'Inactive: 3764112 kB' 'Active(anon): 9521568 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480004 kB' 'Mapped: 186100 kB' 'Shmem: 9044780 kB' 'KReclaimable: 207568 kB' 'Slab: 746660 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 539092 kB' 'KernelStack: 12784 kB' 'PageTables: 8076 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10597816 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.094 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.094 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.095 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.095 00:59:18 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.095 00:59:18 -- setup/common.sh@33 -- # echo 0 00:05:04.095 00:59:18 -- setup/common.sh@33 -- # return 0 00:05:04.095 00:59:18 -- setup/hugepages.sh@100 -- # resv=0 00:05:04.095 00:59:18 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:05:04.095 nr_hugepages=1024 00:05:04.095 00:59:18 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:04.095 resv_hugepages=0 00:05:04.095 00:59:18 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:04.095 surplus_hugepages=0 00:05:04.095 00:59:18 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:04.095 anon_hugepages=0 00:05:04.095 00:59:18 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:04.095 00:59:18 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:05:04.095 00:59:18 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:04.095 00:59:18 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:04.095 00:59:18 -- setup/common.sh@18 -- # local node= 00:05:04.095 00:59:18 -- setup/common.sh@19 -- # local var val 00:05:04.095 00:59:18 -- setup/common.sh@20 -- # local mem_f mem 00:05:04.095 00:59:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:04.095 00:59:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:04.095 00:59:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:04.095 00:59:18 -- setup/common.sh@28 -- # mapfile -t mem 00:05:04.095 00:59:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42680596 kB' 'MemAvailable: 46455392 kB' 'Buffers: 2708 kB' 'Cached: 13206692 kB' 'SwapCached: 0 kB' 'Active: 9922376 kB' 'Inactive: 3764112 kB' 'Active(anon): 9521896 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480304 kB' 'Mapped: 186100 kB' 'Shmem: 9044808 kB' 'KReclaimable: 207568 kB' 'Slab: 746660 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 539092 kB' 'KernelStack: 12784 kB' 'PageTables: 8076 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10597832 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.096 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.096 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.097 00:59:18 -- setup/common.sh@33 -- # echo 1024 00:05:04.097 00:59:18 -- setup/common.sh@33 -- # return 0 00:05:04.097 00:59:18 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:04.097 00:59:18 -- setup/hugepages.sh@112 -- # get_nodes 00:05:04.097 00:59:18 -- setup/hugepages.sh@27 -- # local node 00:05:04.097 00:59:18 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:04.097 00:59:18 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:05:04.097 00:59:18 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:04.097 00:59:18 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:05:04.097 00:59:18 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:04.097 00:59:18 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:04.097 00:59:18 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:04.097 00:59:18 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:04.097 00:59:18 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:04.097 00:59:18 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:04.097 00:59:18 -- setup/common.sh@18 -- # local node=0 00:05:04.097 00:59:18 -- setup/common.sh@19 -- # local var val 00:05:04.097 00:59:18 -- setup/common.sh@20 -- # local mem_f mem 00:05:04.097 00:59:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:04.097 00:59:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:04.097 00:59:18 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:04.097 00:59:18 -- setup/common.sh@28 -- # mapfile -t mem 00:05:04.097 00:59:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 25934464 kB' 'MemUsed: 6891392 kB' 'SwapCached: 0 kB' 'Active: 3322108 kB' 'Inactive: 178300 kB' 'Active(anon): 3165384 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 178300 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3171248 kB' 'Mapped: 62608 kB' 'AnonPages: 332276 kB' 'Shmem: 2836224 kB' 'KernelStack: 7624 kB' 'PageTables: 4972 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123000 kB' 'Slab: 445784 kB' 'SReclaimable: 123000 kB' 'SUnreclaim: 322784 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.097 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.097 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # continue 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.098 00:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.098 00:59:18 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.098 00:59:18 -- setup/common.sh@33 -- # echo 0 00:05:04.098 00:59:18 -- setup/common.sh@33 -- # return 0 00:05:04.098 00:59:18 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:04.098 00:59:18 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:04.098 00:59:18 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:04.098 00:59:18 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:04.098 00:59:18 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:05:04.098 node0=1024 expecting 1024 00:05:04.098 00:59:18 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:05:04.098 00:05:04.098 real 0m2.524s 00:05:04.098 user 0m0.683s 00:05:04.098 sys 0m1.007s 00:05:04.098 00:59:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:04.098 00:59:18 -- common/autotest_common.sh@10 -- # set +x 00:05:04.098 ************************************ 00:05:04.098 END TEST default_setup 00:05:04.098 ************************************ 00:05:04.098 00:59:18 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:05:04.098 00:59:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:04.098 00:59:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:04.098 00:59:18 -- common/autotest_common.sh@10 -- # set +x 00:05:04.098 ************************************ 00:05:04.098 START TEST per_node_1G_alloc 00:05:04.098 ************************************ 00:05:04.098 00:59:18 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:05:04.098 00:59:18 -- setup/hugepages.sh@143 -- # local IFS=, 00:05:04.098 00:59:18 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:05:04.098 00:59:18 -- setup/hugepages.sh@49 -- # local size=1048576 00:05:04.098 00:59:18 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:05:04.098 00:59:18 -- setup/hugepages.sh@51 -- # shift 00:05:04.098 00:59:18 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:05:04.098 00:59:18 -- setup/hugepages.sh@52 -- # local node_ids 00:05:04.098 00:59:18 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:05:04.098 00:59:18 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:05:04.098 00:59:18 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:05:04.098 00:59:18 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:05:04.098 00:59:18 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:04.098 00:59:18 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:05:04.098 00:59:18 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:04.098 00:59:18 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:04.098 00:59:18 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:04.098 00:59:18 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:05:04.098 00:59:18 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:05:04.098 00:59:18 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:05:04.098 00:59:18 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:05:04.098 00:59:18 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:05:04.098 00:59:18 -- setup/hugepages.sh@73 -- # return 0 00:05:04.098 00:59:18 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:05:04.098 00:59:18 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:05:04.098 00:59:18 -- setup/hugepages.sh@146 -- # setup output 00:05:04.098 00:59:18 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:04.098 00:59:18 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:05.481 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:05.481 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:05:05.481 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:05.481 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:05.481 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:05.481 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:05.481 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:05.481 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:05.481 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:05.481 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:05.481 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:05.481 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:05.481 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:05.481 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:05.481 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:05.481 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:05.481 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:05.481 00:59:19 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:05:05.481 00:59:19 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:05:05.481 00:59:19 -- setup/hugepages.sh@89 -- # local node 00:05:05.481 00:59:19 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:05.481 00:59:19 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:05.481 00:59:19 -- setup/hugepages.sh@92 -- # local surp 00:05:05.481 00:59:19 -- setup/hugepages.sh@93 -- # local resv 00:05:05.481 00:59:19 -- setup/hugepages.sh@94 -- # local anon 00:05:05.481 00:59:19 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:05.481 00:59:19 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:05.481 00:59:19 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:05.481 00:59:19 -- setup/common.sh@18 -- # local node= 00:05:05.481 00:59:19 -- setup/common.sh@19 -- # local var val 00:05:05.481 00:59:19 -- setup/common.sh@20 -- # local mem_f mem 00:05:05.481 00:59:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:05.481 00:59:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:05.481 00:59:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:05.481 00:59:19 -- setup/common.sh@28 -- # mapfile -t mem 00:05:05.481 00:59:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:05.481 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.481 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.481 00:59:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42686332 kB' 'MemAvailable: 46461128 kB' 'Buffers: 2708 kB' 'Cached: 13206752 kB' 'SwapCached: 0 kB' 'Active: 9925096 kB' 'Inactive: 3764112 kB' 'Active(anon): 9524616 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 482924 kB' 'Mapped: 186576 kB' 'Shmem: 9044868 kB' 'KReclaimable: 207568 kB' 'Slab: 746640 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 539072 kB' 'KernelStack: 12752 kB' 'PageTables: 7900 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10600980 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:05.481 00:59:19 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.481 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.481 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.481 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.481 00:59:19 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.481 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.481 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.481 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.481 00:59:19 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.481 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.481 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.481 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.481 00:59:19 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.481 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.481 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.481 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.481 00:59:19 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.481 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.481 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.481 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.481 00:59:19 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.481 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.481 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.481 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.481 00:59:19 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.481 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.481 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.481 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.482 00:59:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:05.482 00:59:19 -- setup/common.sh@33 -- # echo 0 00:05:05.482 00:59:19 -- setup/common.sh@33 -- # return 0 00:05:05.482 00:59:19 -- setup/hugepages.sh@97 -- # anon=0 00:05:05.482 00:59:19 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:05.482 00:59:19 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:05.482 00:59:19 -- setup/common.sh@18 -- # local node= 00:05:05.482 00:59:19 -- setup/common.sh@19 -- # local var val 00:05:05.482 00:59:19 -- setup/common.sh@20 -- # local mem_f mem 00:05:05.482 00:59:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:05.482 00:59:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:05.482 00:59:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:05.482 00:59:19 -- setup/common.sh@28 -- # mapfile -t mem 00:05:05.482 00:59:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.482 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42692380 kB' 'MemAvailable: 46467176 kB' 'Buffers: 2708 kB' 'Cached: 13206756 kB' 'SwapCached: 0 kB' 'Active: 9928320 kB' 'Inactive: 3764112 kB' 'Active(anon): 9527840 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 486168 kB' 'Mapped: 186576 kB' 'Shmem: 9044872 kB' 'KReclaimable: 207568 kB' 'Slab: 746596 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 539028 kB' 'KernelStack: 12688 kB' 'PageTables: 7708 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10603776 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198252 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.483 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.483 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.484 00:59:19 -- setup/common.sh@33 -- # echo 0 00:05:05.484 00:59:19 -- setup/common.sh@33 -- # return 0 00:05:05.484 00:59:19 -- setup/hugepages.sh@99 -- # surp=0 00:05:05.484 00:59:19 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:05.484 00:59:19 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:05.484 00:59:19 -- setup/common.sh@18 -- # local node= 00:05:05.484 00:59:19 -- setup/common.sh@19 -- # local var val 00:05:05.484 00:59:19 -- setup/common.sh@20 -- # local mem_f mem 00:05:05.484 00:59:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:05.484 00:59:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:05.484 00:59:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:05.484 00:59:19 -- setup/common.sh@28 -- # mapfile -t mem 00:05:05.484 00:59:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42693416 kB' 'MemAvailable: 46468212 kB' 'Buffers: 2708 kB' 'Cached: 13206756 kB' 'SwapCached: 0 kB' 'Active: 9923016 kB' 'Inactive: 3764112 kB' 'Active(anon): 9522536 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480832 kB' 'Mapped: 186544 kB' 'Shmem: 9044872 kB' 'KReclaimable: 207568 kB' 'Slab: 746592 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 539024 kB' 'KernelStack: 12736 kB' 'PageTables: 7924 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10598040 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.484 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.484 00:59:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:19 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:19 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:19 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:05.485 00:59:20 -- setup/common.sh@33 -- # echo 0 00:05:05.485 00:59:20 -- setup/common.sh@33 -- # return 0 00:05:05.485 00:59:20 -- setup/hugepages.sh@100 -- # resv=0 00:05:05.485 00:59:20 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:05:05.485 nr_hugepages=1024 00:05:05.485 00:59:20 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:05.485 resv_hugepages=0 00:05:05.485 00:59:20 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:05.485 surplus_hugepages=0 00:05:05.485 00:59:20 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:05.485 anon_hugepages=0 00:05:05.485 00:59:20 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:05.485 00:59:20 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:05:05.485 00:59:20 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:05.485 00:59:20 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:05.485 00:59:20 -- setup/common.sh@18 -- # local node= 00:05:05.485 00:59:20 -- setup/common.sh@19 -- # local var val 00:05:05.485 00:59:20 -- setup/common.sh@20 -- # local mem_f mem 00:05:05.485 00:59:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:05.485 00:59:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:05.485 00:59:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:05.485 00:59:20 -- setup/common.sh@28 -- # mapfile -t mem 00:05:05.485 00:59:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.485 00:59:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42697760 kB' 'MemAvailable: 46472556 kB' 'Buffers: 2708 kB' 'Cached: 13206780 kB' 'SwapCached: 0 kB' 'Active: 9923368 kB' 'Inactive: 3764112 kB' 'Active(anon): 9522888 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481380 kB' 'Mapped: 186104 kB' 'Shmem: 9044896 kB' 'KReclaimable: 207568 kB' 'Slab: 746592 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 539024 kB' 'KernelStack: 12752 kB' 'PageTables: 7864 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10598052 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.485 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.485 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.486 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.486 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:05.487 00:59:20 -- setup/common.sh@33 -- # echo 1024 00:05:05.487 00:59:20 -- setup/common.sh@33 -- # return 0 00:05:05.487 00:59:20 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:05.487 00:59:20 -- setup/hugepages.sh@112 -- # get_nodes 00:05:05.487 00:59:20 -- setup/hugepages.sh@27 -- # local node 00:05:05.487 00:59:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:05.487 00:59:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:05:05.487 00:59:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:05.487 00:59:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:05:05.487 00:59:20 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:05.487 00:59:20 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:05.487 00:59:20 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:05.487 00:59:20 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:05.487 00:59:20 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:05.487 00:59:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:05.487 00:59:20 -- setup/common.sh@18 -- # local node=0 00:05:05.487 00:59:20 -- setup/common.sh@19 -- # local var val 00:05:05.487 00:59:20 -- setup/common.sh@20 -- # local mem_f mem 00:05:05.487 00:59:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:05.487 00:59:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:05.487 00:59:20 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:05.487 00:59:20 -- setup/common.sh@28 -- # mapfile -t mem 00:05:05.487 00:59:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26999056 kB' 'MemUsed: 5826800 kB' 'SwapCached: 0 kB' 'Active: 3323828 kB' 'Inactive: 178300 kB' 'Active(anon): 3167104 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 178300 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3171272 kB' 'Mapped: 62608 kB' 'AnonPages: 334284 kB' 'Shmem: 2836248 kB' 'KernelStack: 7608 kB' 'PageTables: 4964 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123000 kB' 'Slab: 445784 kB' 'SReclaimable: 123000 kB' 'SUnreclaim: 322784 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.487 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.487 00:59:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@33 -- # echo 0 00:05:05.488 00:59:20 -- setup/common.sh@33 -- # return 0 00:05:05.488 00:59:20 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:05.488 00:59:20 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:05.488 00:59:20 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:05.488 00:59:20 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:05:05.488 00:59:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:05.488 00:59:20 -- setup/common.sh@18 -- # local node=1 00:05:05.488 00:59:20 -- setup/common.sh@19 -- # local var val 00:05:05.488 00:59:20 -- setup/common.sh@20 -- # local mem_f mem 00:05:05.488 00:59:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:05.488 00:59:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:05:05.488 00:59:20 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:05:05.488 00:59:20 -- setup/common.sh@28 -- # mapfile -t mem 00:05:05.488 00:59:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 15702884 kB' 'MemUsed: 12006908 kB' 'SwapCached: 0 kB' 'Active: 6601360 kB' 'Inactive: 3585812 kB' 'Active(anon): 6357604 kB' 'Inactive(anon): 0 kB' 'Active(file): 243756 kB' 'Inactive(file): 3585812 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10038232 kB' 'Mapped: 123496 kB' 'AnonPages: 149184 kB' 'Shmem: 6208664 kB' 'KernelStack: 5224 kB' 'PageTables: 3108 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84568 kB' 'Slab: 300808 kB' 'SReclaimable: 84568 kB' 'SUnreclaim: 216240 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.488 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.488 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.489 00:59:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.489 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.489 00:59:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.489 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.489 00:59:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.489 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.489 00:59:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.489 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.489 00:59:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.489 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.489 00:59:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.489 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.489 00:59:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.489 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.489 00:59:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.489 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.489 00:59:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.489 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.489 00:59:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.489 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.489 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.747 00:59:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.747 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.747 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.747 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.747 00:59:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.747 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.747 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.747 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.747 00:59:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.747 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.747 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.747 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.748 00:59:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.748 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.748 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.748 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.748 00:59:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.748 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.748 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.748 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.748 00:59:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.748 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.748 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.748 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.748 00:59:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.748 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.748 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.748 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.748 00:59:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.748 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.748 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.748 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.748 00:59:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.748 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.748 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.748 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.748 00:59:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.748 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.748 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.748 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.748 00:59:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.748 00:59:20 -- setup/common.sh@32 -- # continue 00:05:05.748 00:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:05:05.748 00:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:05:05.748 00:59:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:05.748 00:59:20 -- setup/common.sh@33 -- # echo 0 00:05:05.748 00:59:20 -- setup/common.sh@33 -- # return 0 00:05:05.748 00:59:20 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:05.748 00:59:20 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:05.748 00:59:20 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:05.748 00:59:20 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:05.748 00:59:20 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:05:05.748 node0=512 expecting 512 00:05:05.748 00:59:20 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:05.748 00:59:20 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:05.748 00:59:20 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:05.748 00:59:20 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:05:05.748 node1=512 expecting 512 00:05:05.748 00:59:20 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:05:05.748 00:05:05.748 real 0m1.414s 00:05:05.748 user 0m0.585s 00:05:05.748 sys 0m0.793s 00:05:05.748 00:59:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:05.748 00:59:20 -- common/autotest_common.sh@10 -- # set +x 00:05:05.748 ************************************ 00:05:05.748 END TEST per_node_1G_alloc 00:05:05.748 ************************************ 00:05:05.748 00:59:20 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:05:05.748 00:59:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:05.748 00:59:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.748 00:59:20 -- common/autotest_common.sh@10 -- # set +x 00:05:05.748 ************************************ 00:05:05.748 START TEST even_2G_alloc 00:05:05.748 ************************************ 00:05:05.748 00:59:20 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:05:05.748 00:59:20 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:05:05.748 00:59:20 -- setup/hugepages.sh@49 -- # local size=2097152 00:05:05.748 00:59:20 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:05:05.748 00:59:20 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:05:05.748 00:59:20 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:05:05.748 00:59:20 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:05:05.748 00:59:20 -- setup/hugepages.sh@62 -- # user_nodes=() 00:05:05.748 00:59:20 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:05.748 00:59:20 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:05:05.748 00:59:20 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:05.748 00:59:20 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:05.748 00:59:20 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:05.748 00:59:20 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:05:05.748 00:59:20 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:05:05.748 00:59:20 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:05.748 00:59:20 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:05:05.748 00:59:20 -- setup/hugepages.sh@83 -- # : 512 00:05:05.748 00:59:20 -- setup/hugepages.sh@84 -- # : 1 00:05:05.748 00:59:20 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:05.748 00:59:20 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:05:05.748 00:59:20 -- setup/hugepages.sh@83 -- # : 0 00:05:05.748 00:59:20 -- setup/hugepages.sh@84 -- # : 0 00:05:05.748 00:59:20 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:05.748 00:59:20 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:05:05.748 00:59:20 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:05:05.748 00:59:20 -- setup/hugepages.sh@153 -- # setup output 00:05:05.748 00:59:20 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:05.748 00:59:20 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:06.683 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:06.683 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:05:06.683 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:06.683 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:06.683 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:06.683 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:06.683 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:06.683 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:06.683 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:06.683 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:06.683 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:06.683 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:06.683 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:06.683 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:06.683 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:06.683 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:06.683 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:06.944 00:59:21 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:05:06.944 00:59:21 -- setup/hugepages.sh@89 -- # local node 00:05:06.944 00:59:21 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:06.944 00:59:21 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:06.944 00:59:21 -- setup/hugepages.sh@92 -- # local surp 00:05:06.944 00:59:21 -- setup/hugepages.sh@93 -- # local resv 00:05:06.944 00:59:21 -- setup/hugepages.sh@94 -- # local anon 00:05:06.944 00:59:21 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:06.944 00:59:21 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:06.944 00:59:21 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:06.944 00:59:21 -- setup/common.sh@18 -- # local node= 00:05:06.944 00:59:21 -- setup/common.sh@19 -- # local var val 00:05:06.944 00:59:21 -- setup/common.sh@20 -- # local mem_f mem 00:05:06.944 00:59:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:06.945 00:59:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:06.945 00:59:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:06.945 00:59:21 -- setup/common.sh@28 -- # mapfile -t mem 00:05:06.945 00:59:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42701588 kB' 'MemAvailable: 46476384 kB' 'Buffers: 2708 kB' 'Cached: 13206840 kB' 'SwapCached: 0 kB' 'Active: 9922228 kB' 'Inactive: 3764112 kB' 'Active(anon): 9521748 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480084 kB' 'Mapped: 186120 kB' 'Shmem: 9044956 kB' 'KReclaimable: 207568 kB' 'Slab: 746720 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 539152 kB' 'KernelStack: 12800 kB' 'PageTables: 8024 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10598232 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.945 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.945 00:59:21 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:06.946 00:59:21 -- setup/common.sh@33 -- # echo 0 00:05:06.946 00:59:21 -- setup/common.sh@33 -- # return 0 00:05:06.946 00:59:21 -- setup/hugepages.sh@97 -- # anon=0 00:05:06.946 00:59:21 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:06.946 00:59:21 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:06.946 00:59:21 -- setup/common.sh@18 -- # local node= 00:05:06.946 00:59:21 -- setup/common.sh@19 -- # local var val 00:05:06.946 00:59:21 -- setup/common.sh@20 -- # local mem_f mem 00:05:06.946 00:59:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:06.946 00:59:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:06.946 00:59:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:06.946 00:59:21 -- setup/common.sh@28 -- # mapfile -t mem 00:05:06.946 00:59:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42701600 kB' 'MemAvailable: 46476396 kB' 'Buffers: 2708 kB' 'Cached: 13206844 kB' 'SwapCached: 0 kB' 'Active: 9922572 kB' 'Inactive: 3764112 kB' 'Active(anon): 9522092 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480416 kB' 'Mapped: 186204 kB' 'Shmem: 9044960 kB' 'KReclaimable: 207568 kB' 'Slab: 746848 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 539280 kB' 'KernelStack: 12784 kB' 'PageTables: 7976 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10598244 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.946 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.946 00:59:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.947 00:59:21 -- setup/common.sh@33 -- # echo 0 00:05:06.947 00:59:21 -- setup/common.sh@33 -- # return 0 00:05:06.947 00:59:21 -- setup/hugepages.sh@99 -- # surp=0 00:05:06.947 00:59:21 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:06.947 00:59:21 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:06.947 00:59:21 -- setup/common.sh@18 -- # local node= 00:05:06.947 00:59:21 -- setup/common.sh@19 -- # local var val 00:05:06.947 00:59:21 -- setup/common.sh@20 -- # local mem_f mem 00:05:06.947 00:59:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:06.947 00:59:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:06.947 00:59:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:06.947 00:59:21 -- setup/common.sh@28 -- # mapfile -t mem 00:05:06.947 00:59:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42701600 kB' 'MemAvailable: 46476396 kB' 'Buffers: 2708 kB' 'Cached: 13206852 kB' 'SwapCached: 0 kB' 'Active: 9922368 kB' 'Inactive: 3764112 kB' 'Active(anon): 9521888 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480212 kB' 'Mapped: 186112 kB' 'Shmem: 9044968 kB' 'KReclaimable: 207568 kB' 'Slab: 746856 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 539288 kB' 'KernelStack: 12832 kB' 'PageTables: 8124 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10598260 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.947 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.947 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.948 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.948 00:59:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:06.949 00:59:21 -- setup/common.sh@33 -- # echo 0 00:05:06.949 00:59:21 -- setup/common.sh@33 -- # return 0 00:05:06.949 00:59:21 -- setup/hugepages.sh@100 -- # resv=0 00:05:06.949 00:59:21 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:05:06.949 nr_hugepages=1024 00:05:06.949 00:59:21 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:06.949 resv_hugepages=0 00:05:06.949 00:59:21 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:06.949 surplus_hugepages=0 00:05:06.949 00:59:21 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:06.949 anon_hugepages=0 00:05:06.949 00:59:21 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:06.949 00:59:21 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:05:06.949 00:59:21 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:06.949 00:59:21 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:06.949 00:59:21 -- setup/common.sh@18 -- # local node= 00:05:06.949 00:59:21 -- setup/common.sh@19 -- # local var val 00:05:06.949 00:59:21 -- setup/common.sh@20 -- # local mem_f mem 00:05:06.949 00:59:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:06.949 00:59:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:06.949 00:59:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:06.949 00:59:21 -- setup/common.sh@28 -- # mapfile -t mem 00:05:06.949 00:59:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42701600 kB' 'MemAvailable: 46476396 kB' 'Buffers: 2708 kB' 'Cached: 13206856 kB' 'SwapCached: 0 kB' 'Active: 9921756 kB' 'Inactive: 3764112 kB' 'Active(anon): 9521276 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479600 kB' 'Mapped: 186112 kB' 'Shmem: 9044972 kB' 'KReclaimable: 207568 kB' 'Slab: 746844 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 539276 kB' 'KernelStack: 12816 kB' 'PageTables: 8072 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10598276 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.949 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.949 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:06.950 00:59:21 -- setup/common.sh@33 -- # echo 1024 00:05:06.950 00:59:21 -- setup/common.sh@33 -- # return 0 00:05:06.950 00:59:21 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:06.950 00:59:21 -- setup/hugepages.sh@112 -- # get_nodes 00:05:06.950 00:59:21 -- setup/hugepages.sh@27 -- # local node 00:05:06.950 00:59:21 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:06.950 00:59:21 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:05:06.950 00:59:21 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:06.950 00:59:21 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:05:06.950 00:59:21 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:06.950 00:59:21 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:06.950 00:59:21 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:06.950 00:59:21 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:06.950 00:59:21 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:06.950 00:59:21 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:06.950 00:59:21 -- setup/common.sh@18 -- # local node=0 00:05:06.950 00:59:21 -- setup/common.sh@19 -- # local var val 00:05:06.950 00:59:21 -- setup/common.sh@20 -- # local mem_f mem 00:05:06.950 00:59:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:06.950 00:59:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:06.950 00:59:21 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:06.950 00:59:21 -- setup/common.sh@28 -- # mapfile -t mem 00:05:06.950 00:59:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.950 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.950 00:59:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26996496 kB' 'MemUsed: 5829360 kB' 'SwapCached: 0 kB' 'Active: 3321940 kB' 'Inactive: 178300 kB' 'Active(anon): 3165216 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 178300 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3171296 kB' 'Mapped: 62608 kB' 'AnonPages: 332132 kB' 'Shmem: 2836272 kB' 'KernelStack: 7624 kB' 'PageTables: 5020 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123000 kB' 'Slab: 445924 kB' 'SReclaimable: 123000 kB' 'SUnreclaim: 322924 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:05:06.950 00:59:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:06.951 00:59:21 -- setup/common.sh@32 -- # continue 00:05:06.951 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.210 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.210 00:59:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.210 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.210 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.210 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.210 00:59:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.210 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.210 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.210 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.210 00:59:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.210 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.210 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.210 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.210 00:59:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.210 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.210 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.210 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@33 -- # echo 0 00:05:07.211 00:59:21 -- setup/common.sh@33 -- # return 0 00:05:07.211 00:59:21 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:07.211 00:59:21 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:07.211 00:59:21 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:07.211 00:59:21 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:05:07.211 00:59:21 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:07.211 00:59:21 -- setup/common.sh@18 -- # local node=1 00:05:07.211 00:59:21 -- setup/common.sh@19 -- # local var val 00:05:07.211 00:59:21 -- setup/common.sh@20 -- # local mem_f mem 00:05:07.211 00:59:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:07.211 00:59:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:05:07.211 00:59:21 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:05:07.211 00:59:21 -- setup/common.sh@28 -- # mapfile -t mem 00:05:07.211 00:59:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 15705104 kB' 'MemUsed: 12004688 kB' 'SwapCached: 0 kB' 'Active: 6599968 kB' 'Inactive: 3585812 kB' 'Active(anon): 6356212 kB' 'Inactive(anon): 0 kB' 'Active(file): 243756 kB' 'Inactive(file): 3585812 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10038268 kB' 'Mapped: 123504 kB' 'AnonPages: 147616 kB' 'Shmem: 6208700 kB' 'KernelStack: 5192 kB' 'PageTables: 3052 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84568 kB' 'Slab: 300920 kB' 'SReclaimable: 84568 kB' 'SUnreclaim: 216352 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.211 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.211 00:59:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # continue 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:05:07.212 00:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:05:07.212 00:59:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:07.212 00:59:21 -- setup/common.sh@33 -- # echo 0 00:05:07.212 00:59:21 -- setup/common.sh@33 -- # return 0 00:05:07.212 00:59:21 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:07.212 00:59:21 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:07.212 00:59:21 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:07.212 00:59:21 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:07.212 00:59:21 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:05:07.212 node0=512 expecting 512 00:05:07.212 00:59:21 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:07.212 00:59:21 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:07.212 00:59:21 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:07.212 00:59:21 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:05:07.212 node1=512 expecting 512 00:05:07.212 00:59:21 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:05:07.212 00:05:07.212 real 0m1.457s 00:05:07.212 user 0m0.632s 00:05:07.212 sys 0m0.791s 00:05:07.212 00:59:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:07.212 00:59:21 -- common/autotest_common.sh@10 -- # set +x 00:05:07.212 ************************************ 00:05:07.212 END TEST even_2G_alloc 00:05:07.212 ************************************ 00:05:07.212 00:59:21 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:05:07.212 00:59:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:07.212 00:59:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:07.212 00:59:21 -- common/autotest_common.sh@10 -- # set +x 00:05:07.212 ************************************ 00:05:07.212 START TEST odd_alloc 00:05:07.212 ************************************ 00:05:07.212 00:59:21 -- common/autotest_common.sh@1114 -- # odd_alloc 00:05:07.212 00:59:21 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:05:07.212 00:59:21 -- setup/hugepages.sh@49 -- # local size=2098176 00:05:07.212 00:59:21 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:05:07.212 00:59:21 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:05:07.212 00:59:21 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:05:07.212 00:59:21 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:05:07.212 00:59:21 -- setup/hugepages.sh@62 -- # user_nodes=() 00:05:07.212 00:59:21 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:07.212 00:59:21 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:05:07.212 00:59:21 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:07.212 00:59:21 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:07.212 00:59:21 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:07.212 00:59:21 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:05:07.212 00:59:21 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:05:07.212 00:59:21 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:07.212 00:59:21 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:05:07.212 00:59:21 -- setup/hugepages.sh@83 -- # : 513 00:05:07.212 00:59:21 -- setup/hugepages.sh@84 -- # : 1 00:05:07.212 00:59:21 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:07.212 00:59:21 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:05:07.212 00:59:21 -- setup/hugepages.sh@83 -- # : 0 00:05:07.212 00:59:21 -- setup/hugepages.sh@84 -- # : 0 00:05:07.212 00:59:21 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:07.212 00:59:21 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:05:07.212 00:59:21 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:05:07.212 00:59:21 -- setup/hugepages.sh@160 -- # setup output 00:05:07.212 00:59:21 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:07.212 00:59:21 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:08.148 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:08.148 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:05:08.148 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:08.148 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:08.148 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:08.148 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:08.148 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:08.148 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:08.148 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:08.148 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:08.148 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:08.148 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:08.148 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:08.148 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:08.148 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:08.148 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:08.148 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:08.410 00:59:22 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:05:08.410 00:59:22 -- setup/hugepages.sh@89 -- # local node 00:05:08.410 00:59:22 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:08.410 00:59:22 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:08.410 00:59:22 -- setup/hugepages.sh@92 -- # local surp 00:05:08.410 00:59:22 -- setup/hugepages.sh@93 -- # local resv 00:05:08.411 00:59:22 -- setup/hugepages.sh@94 -- # local anon 00:05:08.411 00:59:22 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:08.411 00:59:22 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:08.411 00:59:22 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:08.411 00:59:22 -- setup/common.sh@18 -- # local node= 00:05:08.411 00:59:22 -- setup/common.sh@19 -- # local var val 00:05:08.411 00:59:22 -- setup/common.sh@20 -- # local mem_f mem 00:05:08.411 00:59:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:08.411 00:59:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:08.411 00:59:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:08.411 00:59:22 -- setup/common.sh@28 -- # mapfile -t mem 00:05:08.411 00:59:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42692104 kB' 'MemAvailable: 46466900 kB' 'Buffers: 2708 kB' 'Cached: 13206928 kB' 'SwapCached: 0 kB' 'Active: 9919976 kB' 'Inactive: 3764112 kB' 'Active(anon): 9519496 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477596 kB' 'Mapped: 185060 kB' 'Shmem: 9045044 kB' 'KReclaimable: 207568 kB' 'Slab: 746552 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 538984 kB' 'KernelStack: 12736 kB' 'PageTables: 7660 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 10584884 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.411 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.411 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:08.412 00:59:22 -- setup/common.sh@33 -- # echo 0 00:05:08.412 00:59:22 -- setup/common.sh@33 -- # return 0 00:05:08.412 00:59:22 -- setup/hugepages.sh@97 -- # anon=0 00:05:08.412 00:59:22 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:08.412 00:59:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:08.412 00:59:22 -- setup/common.sh@18 -- # local node= 00:05:08.412 00:59:22 -- setup/common.sh@19 -- # local var val 00:05:08.412 00:59:22 -- setup/common.sh@20 -- # local mem_f mem 00:05:08.412 00:59:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:08.412 00:59:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:08.412 00:59:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:08.412 00:59:22 -- setup/common.sh@28 -- # mapfile -t mem 00:05:08.412 00:59:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42693412 kB' 'MemAvailable: 46468208 kB' 'Buffers: 2708 kB' 'Cached: 13206928 kB' 'SwapCached: 0 kB' 'Active: 9920428 kB' 'Inactive: 3764112 kB' 'Active(anon): 9519948 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478064 kB' 'Mapped: 185136 kB' 'Shmem: 9045044 kB' 'KReclaimable: 207568 kB' 'Slab: 746592 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 539024 kB' 'KernelStack: 12768 kB' 'PageTables: 7772 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 10584892 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.412 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.412 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.413 00:59:22 -- setup/common.sh@33 -- # echo 0 00:05:08.413 00:59:22 -- setup/common.sh@33 -- # return 0 00:05:08.413 00:59:22 -- setup/hugepages.sh@99 -- # surp=0 00:05:08.413 00:59:22 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:08.413 00:59:22 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:08.413 00:59:22 -- setup/common.sh@18 -- # local node= 00:05:08.413 00:59:22 -- setup/common.sh@19 -- # local var val 00:05:08.413 00:59:22 -- setup/common.sh@20 -- # local mem_f mem 00:05:08.413 00:59:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:08.413 00:59:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:08.413 00:59:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:08.413 00:59:22 -- setup/common.sh@28 -- # mapfile -t mem 00:05:08.413 00:59:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42694344 kB' 'MemAvailable: 46469140 kB' 'Buffers: 2708 kB' 'Cached: 13206928 kB' 'SwapCached: 0 kB' 'Active: 9920344 kB' 'Inactive: 3764112 kB' 'Active(anon): 9519864 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477984 kB' 'Mapped: 185104 kB' 'Shmem: 9045044 kB' 'KReclaimable: 207568 kB' 'Slab: 746592 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 539024 kB' 'KernelStack: 12768 kB' 'PageTables: 7764 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 10587444 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.413 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.413 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.414 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.414 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:08.415 00:59:22 -- setup/common.sh@33 -- # echo 0 00:05:08.415 00:59:22 -- setup/common.sh@33 -- # return 0 00:05:08.415 00:59:22 -- setup/hugepages.sh@100 -- # resv=0 00:05:08.415 00:59:22 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:05:08.415 nr_hugepages=1025 00:05:08.415 00:59:22 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:08.415 resv_hugepages=0 00:05:08.415 00:59:22 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:08.415 surplus_hugepages=0 00:05:08.415 00:59:22 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:08.415 anon_hugepages=0 00:05:08.415 00:59:22 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:05:08.415 00:59:22 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:05:08.415 00:59:22 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:08.415 00:59:22 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:08.415 00:59:22 -- setup/common.sh@18 -- # local node= 00:05:08.415 00:59:22 -- setup/common.sh@19 -- # local var val 00:05:08.415 00:59:22 -- setup/common.sh@20 -- # local mem_f mem 00:05:08.415 00:59:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:08.415 00:59:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:08.415 00:59:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:08.415 00:59:22 -- setup/common.sh@28 -- # mapfile -t mem 00:05:08.415 00:59:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42698244 kB' 'MemAvailable: 46473040 kB' 'Buffers: 2708 kB' 'Cached: 13206960 kB' 'SwapCached: 0 kB' 'Active: 9920908 kB' 'Inactive: 3764112 kB' 'Active(anon): 9520428 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478556 kB' 'Mapped: 185028 kB' 'Shmem: 9045076 kB' 'KReclaimable: 207568 kB' 'Slab: 746560 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 538992 kB' 'KernelStack: 12848 kB' 'PageTables: 7664 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 10587576 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.415 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.415 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:08.416 00:59:22 -- setup/common.sh@33 -- # echo 1025 00:05:08.416 00:59:22 -- setup/common.sh@33 -- # return 0 00:05:08.416 00:59:22 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:05:08.416 00:59:22 -- setup/hugepages.sh@112 -- # get_nodes 00:05:08.416 00:59:22 -- setup/hugepages.sh@27 -- # local node 00:05:08.416 00:59:22 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:08.416 00:59:22 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:05:08.416 00:59:22 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:08.416 00:59:22 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:05:08.416 00:59:22 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:08.416 00:59:22 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:08.416 00:59:22 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:08.416 00:59:22 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:08.416 00:59:22 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:08.416 00:59:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:08.416 00:59:22 -- setup/common.sh@18 -- # local node=0 00:05:08.416 00:59:22 -- setup/common.sh@19 -- # local var val 00:05:08.416 00:59:22 -- setup/common.sh@20 -- # local mem_f mem 00:05:08.416 00:59:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:08.416 00:59:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:08.416 00:59:22 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:08.416 00:59:22 -- setup/common.sh@28 -- # mapfile -t mem 00:05:08.416 00:59:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.416 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.416 00:59:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26986416 kB' 'MemUsed: 5839440 kB' 'SwapCached: 0 kB' 'Active: 3319796 kB' 'Inactive: 178300 kB' 'Active(anon): 3163072 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 178300 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3171400 kB' 'Mapped: 61612 kB' 'AnonPages: 329796 kB' 'Shmem: 2836376 kB' 'KernelStack: 7480 kB' 'PageTables: 4448 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123000 kB' 'Slab: 445792 kB' 'SReclaimable: 123000 kB' 'SUnreclaim: 322792 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:05:08.416 00:59:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:22 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.417 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.417 00:59:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.417 00:59:23 -- setup/common.sh@33 -- # echo 0 00:05:08.417 00:59:23 -- setup/common.sh@33 -- # return 0 00:05:08.677 00:59:23 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:08.677 00:59:23 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:08.677 00:59:23 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:08.677 00:59:23 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:05:08.677 00:59:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:08.677 00:59:23 -- setup/common.sh@18 -- # local node=1 00:05:08.677 00:59:23 -- setup/common.sh@19 -- # local var val 00:05:08.677 00:59:23 -- setup/common.sh@20 -- # local mem_f mem 00:05:08.677 00:59:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:08.677 00:59:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:05:08.677 00:59:23 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:05:08.677 00:59:23 -- setup/common.sh@28 -- # mapfile -t mem 00:05:08.677 00:59:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 15710028 kB' 'MemUsed: 11999764 kB' 'SwapCached: 0 kB' 'Active: 6601872 kB' 'Inactive: 3585812 kB' 'Active(anon): 6358116 kB' 'Inactive(anon): 0 kB' 'Active(file): 243756 kB' 'Inactive(file): 3585812 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10038276 kB' 'Mapped: 123432 kB' 'AnonPages: 149472 kB' 'Shmem: 6208708 kB' 'KernelStack: 5624 kB' 'PageTables: 5160 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84568 kB' 'Slab: 300768 kB' 'SReclaimable: 84568 kB' 'SUnreclaim: 216200 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.677 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.677 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.678 00:59:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.678 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.678 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.678 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.678 00:59:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.678 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.678 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.678 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.678 00:59:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.678 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.678 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.678 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.678 00:59:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.678 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.678 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.678 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.678 00:59:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.678 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.678 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.678 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.678 00:59:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.678 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.678 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.678 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.678 00:59:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.678 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.678 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.678 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.678 00:59:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.678 00:59:23 -- setup/common.sh@32 -- # continue 00:05:08.678 00:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:05:08.678 00:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:05:08.678 00:59:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:08.678 00:59:23 -- setup/common.sh@33 -- # echo 0 00:05:08.678 00:59:23 -- setup/common.sh@33 -- # return 0 00:05:08.678 00:59:23 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:08.678 00:59:23 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:08.678 00:59:23 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:08.678 00:59:23 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:08.678 00:59:23 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:05:08.678 node0=512 expecting 513 00:05:08.678 00:59:23 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:08.678 00:59:23 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:08.678 00:59:23 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:08.678 00:59:23 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:05:08.678 node1=513 expecting 512 00:05:08.678 00:59:23 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:05:08.678 00:05:08.678 real 0m1.434s 00:05:08.678 user 0m0.594s 00:05:08.678 sys 0m0.805s 00:05:08.678 00:59:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:08.678 00:59:23 -- common/autotest_common.sh@10 -- # set +x 00:05:08.678 ************************************ 00:05:08.678 END TEST odd_alloc 00:05:08.678 ************************************ 00:05:08.678 00:59:23 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:05:08.678 00:59:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:08.678 00:59:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:08.678 00:59:23 -- common/autotest_common.sh@10 -- # set +x 00:05:08.678 ************************************ 00:05:08.678 START TEST custom_alloc 00:05:08.678 ************************************ 00:05:08.678 00:59:23 -- common/autotest_common.sh@1114 -- # custom_alloc 00:05:08.678 00:59:23 -- setup/hugepages.sh@167 -- # local IFS=, 00:05:08.678 00:59:23 -- setup/hugepages.sh@169 -- # local node 00:05:08.678 00:59:23 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:05:08.678 00:59:23 -- setup/hugepages.sh@170 -- # local nodes_hp 00:05:08.678 00:59:23 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:05:08.678 00:59:23 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:05:08.678 00:59:23 -- setup/hugepages.sh@49 -- # local size=1048576 00:05:08.678 00:59:23 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:05:08.678 00:59:23 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:05:08.678 00:59:23 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:05:08.678 00:59:23 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:05:08.678 00:59:23 -- setup/hugepages.sh@62 -- # user_nodes=() 00:05:08.678 00:59:23 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:08.678 00:59:23 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:05:08.678 00:59:23 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:08.678 00:59:23 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:08.678 00:59:23 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:08.678 00:59:23 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:05:08.678 00:59:23 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:05:08.678 00:59:23 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:08.678 00:59:23 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:05:08.678 00:59:23 -- setup/hugepages.sh@83 -- # : 256 00:05:08.678 00:59:23 -- setup/hugepages.sh@84 -- # : 1 00:05:08.678 00:59:23 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:08.678 00:59:23 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:05:08.678 00:59:23 -- setup/hugepages.sh@83 -- # : 0 00:05:08.678 00:59:23 -- setup/hugepages.sh@84 -- # : 0 00:05:08.678 00:59:23 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:05:08.678 00:59:23 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:05:08.678 00:59:23 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:05:08.678 00:59:23 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:05:08.678 00:59:23 -- setup/hugepages.sh@49 -- # local size=2097152 00:05:08.678 00:59:23 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:05:08.678 00:59:23 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:05:08.678 00:59:23 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:05:08.678 00:59:23 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:05:08.678 00:59:23 -- setup/hugepages.sh@62 -- # user_nodes=() 00:05:08.678 00:59:23 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:08.678 00:59:23 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:05:08.678 00:59:23 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:08.678 00:59:23 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:08.678 00:59:23 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:08.678 00:59:23 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:05:08.678 00:59:23 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:05:08.678 00:59:23 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:05:08.678 00:59:23 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:05:08.678 00:59:23 -- setup/hugepages.sh@78 -- # return 0 00:05:08.678 00:59:23 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:05:08.678 00:59:23 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:05:08.678 00:59:23 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:05:08.678 00:59:23 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:05:08.678 00:59:23 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:05:08.678 00:59:23 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:05:08.678 00:59:23 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:05:08.678 00:59:23 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:05:08.678 00:59:23 -- setup/hugepages.sh@62 -- # user_nodes=() 00:05:08.678 00:59:23 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:08.678 00:59:23 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:05:08.678 00:59:23 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:08.678 00:59:23 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:08.678 00:59:23 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:08.678 00:59:23 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:05:08.678 00:59:23 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:05:08.678 00:59:23 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:05:08.678 00:59:23 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:05:08.678 00:59:23 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:05:08.678 00:59:23 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:05:08.678 00:59:23 -- setup/hugepages.sh@78 -- # return 0 00:05:08.678 00:59:23 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:05:08.678 00:59:23 -- setup/hugepages.sh@187 -- # setup output 00:05:08.678 00:59:23 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:08.678 00:59:23 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:10.058 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:10.059 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:05:10.059 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:10.059 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:10.059 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:10.059 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:10.059 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:10.059 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:10.059 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:10.059 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:10.059 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:10.059 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:10.059 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:10.059 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:10.059 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:10.059 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:10.059 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:10.059 00:59:24 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:05:10.059 00:59:24 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:05:10.059 00:59:24 -- setup/hugepages.sh@89 -- # local node 00:05:10.059 00:59:24 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:10.059 00:59:24 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:10.059 00:59:24 -- setup/hugepages.sh@92 -- # local surp 00:05:10.059 00:59:24 -- setup/hugepages.sh@93 -- # local resv 00:05:10.059 00:59:24 -- setup/hugepages.sh@94 -- # local anon 00:05:10.059 00:59:24 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:10.059 00:59:24 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:10.059 00:59:24 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:10.059 00:59:24 -- setup/common.sh@18 -- # local node= 00:05:10.059 00:59:24 -- setup/common.sh@19 -- # local var val 00:05:10.059 00:59:24 -- setup/common.sh@20 -- # local mem_f mem 00:05:10.059 00:59:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:10.059 00:59:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:10.059 00:59:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:10.059 00:59:24 -- setup/common.sh@28 -- # mapfile -t mem 00:05:10.059 00:59:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.059 00:59:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 41657008 kB' 'MemAvailable: 45431804 kB' 'Buffers: 2708 kB' 'Cached: 13207036 kB' 'SwapCached: 0 kB' 'Active: 9921628 kB' 'Inactive: 3764112 kB' 'Active(anon): 9521148 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479328 kB' 'Mapped: 185084 kB' 'Shmem: 9045152 kB' 'KReclaimable: 207568 kB' 'Slab: 746672 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 539104 kB' 'KernelStack: 12800 kB' 'PageTables: 7852 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 10585120 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.059 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.059 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.060 00:59:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:10.060 00:59:24 -- setup/common.sh@33 -- # echo 0 00:05:10.060 00:59:24 -- setup/common.sh@33 -- # return 0 00:05:10.060 00:59:24 -- setup/hugepages.sh@97 -- # anon=0 00:05:10.060 00:59:24 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:10.060 00:59:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:10.060 00:59:24 -- setup/common.sh@18 -- # local node= 00:05:10.060 00:59:24 -- setup/common.sh@19 -- # local var val 00:05:10.060 00:59:24 -- setup/common.sh@20 -- # local mem_f mem 00:05:10.060 00:59:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:10.060 00:59:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:10.060 00:59:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:10.060 00:59:24 -- setup/common.sh@28 -- # mapfile -t mem 00:05:10.060 00:59:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.060 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 41660760 kB' 'MemAvailable: 45435556 kB' 'Buffers: 2708 kB' 'Cached: 13207040 kB' 'SwapCached: 0 kB' 'Active: 9921768 kB' 'Inactive: 3764112 kB' 'Active(anon): 9521288 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479456 kB' 'Mapped: 185136 kB' 'Shmem: 9045156 kB' 'KReclaimable: 207568 kB' 'Slab: 746668 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 539100 kB' 'KernelStack: 12752 kB' 'PageTables: 7708 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 10585132 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.061 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.061 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.062 00:59:24 -- setup/common.sh@33 -- # echo 0 00:05:10.062 00:59:24 -- setup/common.sh@33 -- # return 0 00:05:10.062 00:59:24 -- setup/hugepages.sh@99 -- # surp=0 00:05:10.062 00:59:24 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:10.062 00:59:24 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:10.062 00:59:24 -- setup/common.sh@18 -- # local node= 00:05:10.062 00:59:24 -- setup/common.sh@19 -- # local var val 00:05:10.062 00:59:24 -- setup/common.sh@20 -- # local mem_f mem 00:05:10.062 00:59:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:10.062 00:59:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:10.062 00:59:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:10.062 00:59:24 -- setup/common.sh@28 -- # mapfile -t mem 00:05:10.062 00:59:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.062 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.062 00:59:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 41660760 kB' 'MemAvailable: 45435556 kB' 'Buffers: 2708 kB' 'Cached: 13207044 kB' 'SwapCached: 0 kB' 'Active: 9920520 kB' 'Inactive: 3764112 kB' 'Active(anon): 9520040 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478120 kB' 'Mapped: 185088 kB' 'Shmem: 9045160 kB' 'KReclaimable: 207568 kB' 'Slab: 746664 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 539096 kB' 'KernelStack: 12800 kB' 'PageTables: 7764 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 10585148 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:10.062 00:59:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.063 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.063 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.064 00:59:24 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:10.064 00:59:24 -- setup/common.sh@33 -- # echo 0 00:05:10.064 00:59:24 -- setup/common.sh@33 -- # return 0 00:05:10.064 00:59:24 -- setup/hugepages.sh@100 -- # resv=0 00:05:10.064 00:59:24 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:05:10.064 nr_hugepages=1536 00:05:10.064 00:59:24 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:10.064 resv_hugepages=0 00:05:10.064 00:59:24 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:10.064 surplus_hugepages=0 00:05:10.064 00:59:24 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:10.064 anon_hugepages=0 00:05:10.064 00:59:24 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:05:10.064 00:59:24 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:05:10.064 00:59:24 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:10.064 00:59:24 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:10.064 00:59:24 -- setup/common.sh@18 -- # local node= 00:05:10.064 00:59:24 -- setup/common.sh@19 -- # local var val 00:05:10.064 00:59:24 -- setup/common.sh@20 -- # local mem_f mem 00:05:10.064 00:59:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:10.064 00:59:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:10.064 00:59:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:10.064 00:59:24 -- setup/common.sh@28 -- # mapfile -t mem 00:05:10.064 00:59:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.064 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 41661336 kB' 'MemAvailable: 45436132 kB' 'Buffers: 2708 kB' 'Cached: 13207064 kB' 'SwapCached: 0 kB' 'Active: 9920632 kB' 'Inactive: 3764112 kB' 'Active(anon): 9520152 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478204 kB' 'Mapped: 185036 kB' 'Shmem: 9045180 kB' 'KReclaimable: 207568 kB' 'Slab: 746684 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 539116 kB' 'KernelStack: 12752 kB' 'PageTables: 7644 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 10585164 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.065 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.065 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.066 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.066 00:59:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:10.066 00:59:24 -- setup/common.sh@33 -- # echo 1536 00:05:10.066 00:59:24 -- setup/common.sh@33 -- # return 0 00:05:10.066 00:59:24 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:05:10.066 00:59:24 -- setup/hugepages.sh@112 -- # get_nodes 00:05:10.066 00:59:24 -- setup/hugepages.sh@27 -- # local node 00:05:10.066 00:59:24 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:10.066 00:59:24 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:05:10.066 00:59:24 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:10.066 00:59:24 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:05:10.066 00:59:24 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:10.066 00:59:24 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:10.066 00:59:24 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:10.066 00:59:24 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:10.066 00:59:24 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:10.066 00:59:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:10.066 00:59:24 -- setup/common.sh@18 -- # local node=0 00:05:10.066 00:59:24 -- setup/common.sh@19 -- # local var val 00:05:10.067 00:59:24 -- setup/common.sh@20 -- # local mem_f mem 00:05:10.067 00:59:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:10.067 00:59:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:10.067 00:59:24 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:10.067 00:59:24 -- setup/common.sh@28 -- # mapfile -t mem 00:05:10.067 00:59:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26989488 kB' 'MemUsed: 5836368 kB' 'SwapCached: 0 kB' 'Active: 3320700 kB' 'Inactive: 178300 kB' 'Active(anon): 3163976 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 178300 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3171492 kB' 'Mapped: 61596 kB' 'AnonPages: 330696 kB' 'Shmem: 2836468 kB' 'KernelStack: 7576 kB' 'PageTables: 4668 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123000 kB' 'Slab: 445732 kB' 'SReclaimable: 123000 kB' 'SUnreclaim: 322732 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.067 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.067 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@33 -- # echo 0 00:05:10.068 00:59:24 -- setup/common.sh@33 -- # return 0 00:05:10.068 00:59:24 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:10.068 00:59:24 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:10.068 00:59:24 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:10.068 00:59:24 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:05:10.068 00:59:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:10.068 00:59:24 -- setup/common.sh@18 -- # local node=1 00:05:10.068 00:59:24 -- setup/common.sh@19 -- # local var val 00:05:10.068 00:59:24 -- setup/common.sh@20 -- # local mem_f mem 00:05:10.068 00:59:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:10.068 00:59:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:05:10.068 00:59:24 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:05:10.068 00:59:24 -- setup/common.sh@28 -- # mapfile -t mem 00:05:10.068 00:59:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 14672232 kB' 'MemUsed: 13037560 kB' 'SwapCached: 0 kB' 'Active: 6605272 kB' 'Inactive: 3585812 kB' 'Active(anon): 6361516 kB' 'Inactive(anon): 0 kB' 'Active(file): 243756 kB' 'Inactive(file): 3585812 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10038296 kB' 'Mapped: 123876 kB' 'AnonPages: 152860 kB' 'Shmem: 6208728 kB' 'KernelStack: 5208 kB' 'PageTables: 3084 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84568 kB' 'Slab: 300952 kB' 'SReclaimable: 84568 kB' 'SUnreclaim: 216384 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.068 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.068 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # continue 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:05:10.069 00:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:05:10.069 00:59:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:10.069 00:59:24 -- setup/common.sh@33 -- # echo 0 00:05:10.069 00:59:24 -- setup/common.sh@33 -- # return 0 00:05:10.069 00:59:24 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:10.069 00:59:24 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:10.069 00:59:24 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:10.069 00:59:24 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:10.069 00:59:24 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:05:10.069 node0=512 expecting 512 00:05:10.069 00:59:24 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:10.069 00:59:24 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:10.069 00:59:24 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:10.069 00:59:24 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:05:10.069 node1=1024 expecting 1024 00:05:10.069 00:59:24 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:05:10.069 00:05:10.069 real 0m1.487s 00:05:10.069 user 0m0.638s 00:05:10.069 sys 0m0.813s 00:05:10.069 00:59:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:10.069 00:59:24 -- common/autotest_common.sh@10 -- # set +x 00:05:10.069 ************************************ 00:05:10.069 END TEST custom_alloc 00:05:10.069 ************************************ 00:05:10.069 00:59:24 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:05:10.069 00:59:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:10.069 00:59:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:10.069 00:59:24 -- common/autotest_common.sh@10 -- # set +x 00:05:10.069 ************************************ 00:05:10.069 START TEST no_shrink_alloc 00:05:10.069 ************************************ 00:05:10.069 00:59:24 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:05:10.069 00:59:24 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:05:10.070 00:59:24 -- setup/hugepages.sh@49 -- # local size=2097152 00:05:10.070 00:59:24 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:05:10.070 00:59:24 -- setup/hugepages.sh@51 -- # shift 00:05:10.070 00:59:24 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:05:10.070 00:59:24 -- setup/hugepages.sh@52 -- # local node_ids 00:05:10.070 00:59:24 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:05:10.070 00:59:24 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:05:10.070 00:59:24 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:05:10.070 00:59:24 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:05:10.070 00:59:24 -- setup/hugepages.sh@62 -- # local user_nodes 00:05:10.070 00:59:24 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:05:10.070 00:59:24 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:05:10.070 00:59:24 -- setup/hugepages.sh@67 -- # nodes_test=() 00:05:10.070 00:59:24 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:05:10.070 00:59:24 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:05:10.070 00:59:24 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:05:10.070 00:59:24 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:05:10.070 00:59:24 -- setup/hugepages.sh@73 -- # return 0 00:05:10.070 00:59:24 -- setup/hugepages.sh@198 -- # setup output 00:05:10.070 00:59:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:10.070 00:59:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:11.448 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:11.448 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:05:11.448 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:11.448 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:11.448 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:11.448 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:11.448 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:11.448 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:11.448 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:11.448 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:11.448 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:11.448 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:11.448 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:11.448 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:11.448 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:11.448 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:11.448 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:11.448 00:59:25 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:05:11.448 00:59:25 -- setup/hugepages.sh@89 -- # local node 00:05:11.448 00:59:25 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:11.448 00:59:25 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:11.448 00:59:25 -- setup/hugepages.sh@92 -- # local surp 00:05:11.448 00:59:25 -- setup/hugepages.sh@93 -- # local resv 00:05:11.448 00:59:25 -- setup/hugepages.sh@94 -- # local anon 00:05:11.448 00:59:25 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:11.448 00:59:25 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:11.448 00:59:25 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:11.448 00:59:25 -- setup/common.sh@18 -- # local node= 00:05:11.448 00:59:25 -- setup/common.sh@19 -- # local var val 00:05:11.448 00:59:25 -- setup/common.sh@20 -- # local mem_f mem 00:05:11.448 00:59:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:11.448 00:59:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:11.448 00:59:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:11.448 00:59:25 -- setup/common.sh@28 -- # mapfile -t mem 00:05:11.448 00:59:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42690240 kB' 'MemAvailable: 46465036 kB' 'Buffers: 2708 kB' 'Cached: 13207120 kB' 'SwapCached: 0 kB' 'Active: 9921084 kB' 'Inactive: 3764112 kB' 'Active(anon): 9520604 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478556 kB' 'Mapped: 185044 kB' 'Shmem: 9045236 kB' 'KReclaimable: 207568 kB' 'Slab: 746368 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 538800 kB' 'KernelStack: 12768 kB' 'PageTables: 7688 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10585208 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198456 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.448 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.448 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:11.449 00:59:25 -- setup/common.sh@33 -- # echo 0 00:05:11.449 00:59:25 -- setup/common.sh@33 -- # return 0 00:05:11.449 00:59:25 -- setup/hugepages.sh@97 -- # anon=0 00:05:11.449 00:59:25 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:11.449 00:59:25 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:11.449 00:59:25 -- setup/common.sh@18 -- # local node= 00:05:11.449 00:59:25 -- setup/common.sh@19 -- # local var val 00:05:11.449 00:59:25 -- setup/common.sh@20 -- # local mem_f mem 00:05:11.449 00:59:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:11.449 00:59:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:11.449 00:59:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:11.449 00:59:25 -- setup/common.sh@28 -- # mapfile -t mem 00:05:11.449 00:59:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42691048 kB' 'MemAvailable: 46465844 kB' 'Buffers: 2708 kB' 'Cached: 13207124 kB' 'SwapCached: 0 kB' 'Active: 9921420 kB' 'Inactive: 3764112 kB' 'Active(anon): 9520940 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478900 kB' 'Mapped: 185044 kB' 'Shmem: 9045240 kB' 'KReclaimable: 207568 kB' 'Slab: 746340 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 538772 kB' 'KernelStack: 12752 kB' 'PageTables: 7628 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10585216 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.449 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.449 00:59:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.450 00:59:25 -- setup/common.sh@33 -- # echo 0 00:05:11.450 00:59:25 -- setup/common.sh@33 -- # return 0 00:05:11.450 00:59:25 -- setup/hugepages.sh@99 -- # surp=0 00:05:11.450 00:59:25 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:11.450 00:59:25 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:11.450 00:59:25 -- setup/common.sh@18 -- # local node= 00:05:11.450 00:59:25 -- setup/common.sh@19 -- # local var val 00:05:11.450 00:59:25 -- setup/common.sh@20 -- # local mem_f mem 00:05:11.450 00:59:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:11.450 00:59:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:11.450 00:59:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:11.450 00:59:25 -- setup/common.sh@28 -- # mapfile -t mem 00:05:11.450 00:59:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42691236 kB' 'MemAvailable: 46466032 kB' 'Buffers: 2708 kB' 'Cached: 13207128 kB' 'SwapCached: 0 kB' 'Active: 9921292 kB' 'Inactive: 3764112 kB' 'Active(anon): 9520812 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478812 kB' 'Mapped: 185040 kB' 'Shmem: 9045244 kB' 'KReclaimable: 207568 kB' 'Slab: 746340 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 538772 kB' 'KernelStack: 12784 kB' 'PageTables: 7704 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10585232 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.450 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.450 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.451 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.451 00:59:25 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:11.451 00:59:25 -- setup/common.sh@33 -- # echo 0 00:05:11.451 00:59:25 -- setup/common.sh@33 -- # return 0 00:05:11.451 00:59:25 -- setup/hugepages.sh@100 -- # resv=0 00:05:11.451 00:59:25 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:05:11.451 nr_hugepages=1024 00:05:11.451 00:59:25 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:11.451 resv_hugepages=0 00:05:11.451 00:59:25 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:11.451 surplus_hugepages=0 00:05:11.451 00:59:25 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:11.451 anon_hugepages=0 00:05:11.451 00:59:25 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:11.452 00:59:25 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:05:11.452 00:59:25 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:11.452 00:59:25 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:11.452 00:59:25 -- setup/common.sh@18 -- # local node= 00:05:11.452 00:59:25 -- setup/common.sh@19 -- # local var val 00:05:11.452 00:59:25 -- setup/common.sh@20 -- # local mem_f mem 00:05:11.452 00:59:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:11.452 00:59:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:11.452 00:59:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:11.452 00:59:25 -- setup/common.sh@28 -- # mapfile -t mem 00:05:11.452 00:59:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42691284 kB' 'MemAvailable: 46466080 kB' 'Buffers: 2708 kB' 'Cached: 13207152 kB' 'SwapCached: 0 kB' 'Active: 9920936 kB' 'Inactive: 3764112 kB' 'Active(anon): 9520456 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478376 kB' 'Mapped: 185040 kB' 'Shmem: 9045268 kB' 'KReclaimable: 207568 kB' 'Slab: 746400 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 538832 kB' 'KernelStack: 12784 kB' 'PageTables: 7736 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10585248 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.452 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.452 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:11.453 00:59:25 -- setup/common.sh@33 -- # echo 1024 00:05:11.453 00:59:25 -- setup/common.sh@33 -- # return 0 00:05:11.453 00:59:25 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:11.453 00:59:25 -- setup/hugepages.sh@112 -- # get_nodes 00:05:11.453 00:59:25 -- setup/hugepages.sh@27 -- # local node 00:05:11.453 00:59:25 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:11.453 00:59:25 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:05:11.453 00:59:25 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:11.453 00:59:25 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:05:11.453 00:59:25 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:11.453 00:59:25 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:11.453 00:59:25 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:11.453 00:59:25 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:11.453 00:59:25 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:11.453 00:59:25 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:11.453 00:59:25 -- setup/common.sh@18 -- # local node=0 00:05:11.453 00:59:25 -- setup/common.sh@19 -- # local var val 00:05:11.453 00:59:25 -- setup/common.sh@20 -- # local mem_f mem 00:05:11.453 00:59:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:11.453 00:59:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:11.453 00:59:25 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:11.453 00:59:25 -- setup/common.sh@28 -- # mapfile -t mem 00:05:11.453 00:59:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 25928488 kB' 'MemUsed: 6897368 kB' 'SwapCached: 0 kB' 'Active: 3320940 kB' 'Inactive: 178300 kB' 'Active(anon): 3164216 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 178300 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3171576 kB' 'Mapped: 61596 kB' 'AnonPages: 330816 kB' 'Shmem: 2836552 kB' 'KernelStack: 7576 kB' 'PageTables: 4656 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123000 kB' 'Slab: 445644 kB' 'SReclaimable: 123000 kB' 'SUnreclaim: 322644 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.453 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.453 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # continue 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:05:11.454 00:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:05:11.454 00:59:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:11.454 00:59:25 -- setup/common.sh@33 -- # echo 0 00:05:11.454 00:59:25 -- setup/common.sh@33 -- # return 0 00:05:11.454 00:59:25 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:11.454 00:59:25 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:11.454 00:59:25 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:11.454 00:59:25 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:11.454 00:59:25 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:05:11.454 node0=1024 expecting 1024 00:05:11.454 00:59:25 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:05:11.454 00:59:25 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:05:11.454 00:59:25 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:05:11.454 00:59:25 -- setup/hugepages.sh@202 -- # setup output 00:05:11.454 00:59:25 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:11.454 00:59:25 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:12.834 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:12.834 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:05:12.834 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:12.834 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:12.834 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:12.834 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:12.834 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:12.834 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:12.834 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:12.834 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:05:12.834 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:05:12.834 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:05:12.834 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:05:12.834 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:05:12.834 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:05:12.834 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:05:12.834 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:05:12.834 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:05:12.834 00:59:27 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:05:12.834 00:59:27 -- setup/hugepages.sh@89 -- # local node 00:05:12.834 00:59:27 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:12.834 00:59:27 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:12.834 00:59:27 -- setup/hugepages.sh@92 -- # local surp 00:05:12.834 00:59:27 -- setup/hugepages.sh@93 -- # local resv 00:05:12.834 00:59:27 -- setup/hugepages.sh@94 -- # local anon 00:05:12.834 00:59:27 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:12.834 00:59:27 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:12.834 00:59:27 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:12.834 00:59:27 -- setup/common.sh@18 -- # local node= 00:05:12.834 00:59:27 -- setup/common.sh@19 -- # local var val 00:05:12.834 00:59:27 -- setup/common.sh@20 -- # local mem_f mem 00:05:12.834 00:59:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:12.834 00:59:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:12.834 00:59:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:12.834 00:59:27 -- setup/common.sh@28 -- # mapfile -t mem 00:05:12.834 00:59:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:12.834 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.834 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.834 00:59:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42686244 kB' 'MemAvailable: 46461040 kB' 'Buffers: 2708 kB' 'Cached: 13207196 kB' 'SwapCached: 0 kB' 'Active: 9921608 kB' 'Inactive: 3764112 kB' 'Active(anon): 9521128 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478960 kB' 'Mapped: 185048 kB' 'Shmem: 9045312 kB' 'KReclaimable: 207568 kB' 'Slab: 746192 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 538624 kB' 'KernelStack: 12784 kB' 'PageTables: 7716 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10585416 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:12.834 00:59:27 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.834 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.834 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.834 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.834 00:59:27 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.834 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.834 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.834 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.834 00:59:27 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.834 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.834 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.834 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.834 00:59:27 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.834 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.834 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.834 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.834 00:59:27 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.834 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.834 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.834 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.834 00:59:27 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.834 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.834 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.834 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.834 00:59:27 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.834 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.834 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.834 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.834 00:59:27 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.834 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.834 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.834 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.835 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.835 00:59:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:12.835 00:59:27 -- setup/common.sh@33 -- # echo 0 00:05:12.835 00:59:27 -- setup/common.sh@33 -- # return 0 00:05:12.835 00:59:27 -- setup/hugepages.sh@97 -- # anon=0 00:05:12.835 00:59:27 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:12.835 00:59:27 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:12.835 00:59:27 -- setup/common.sh@18 -- # local node= 00:05:12.835 00:59:27 -- setup/common.sh@19 -- # local var val 00:05:12.835 00:59:27 -- setup/common.sh@20 -- # local mem_f mem 00:05:12.835 00:59:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:12.835 00:59:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:12.835 00:59:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:12.836 00:59:27 -- setup/common.sh@28 -- # mapfile -t mem 00:05:12.836 00:59:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42686476 kB' 'MemAvailable: 46461272 kB' 'Buffers: 2708 kB' 'Cached: 13207200 kB' 'SwapCached: 0 kB' 'Active: 9921860 kB' 'Inactive: 3764112 kB' 'Active(anon): 9521380 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479204 kB' 'Mapped: 185048 kB' 'Shmem: 9045316 kB' 'KReclaimable: 207568 kB' 'Slab: 746192 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 538624 kB' 'KernelStack: 12768 kB' 'PageTables: 7652 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10585428 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.836 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.836 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.837 00:59:27 -- setup/common.sh@33 -- # echo 0 00:05:12.837 00:59:27 -- setup/common.sh@33 -- # return 0 00:05:12.837 00:59:27 -- setup/hugepages.sh@99 -- # surp=0 00:05:12.837 00:59:27 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:12.837 00:59:27 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:12.837 00:59:27 -- setup/common.sh@18 -- # local node= 00:05:12.837 00:59:27 -- setup/common.sh@19 -- # local var val 00:05:12.837 00:59:27 -- setup/common.sh@20 -- # local mem_f mem 00:05:12.837 00:59:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:12.837 00:59:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:12.837 00:59:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:12.837 00:59:27 -- setup/common.sh@28 -- # mapfile -t mem 00:05:12.837 00:59:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42689092 kB' 'MemAvailable: 46463888 kB' 'Buffers: 2708 kB' 'Cached: 13207200 kB' 'SwapCached: 0 kB' 'Active: 9921144 kB' 'Inactive: 3764112 kB' 'Active(anon): 9520664 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478480 kB' 'Mapped: 185044 kB' 'Shmem: 9045316 kB' 'KReclaimable: 207568 kB' 'Slab: 746192 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 538624 kB' 'KernelStack: 12800 kB' 'PageTables: 7716 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10585440 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.837 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.837 00:59:27 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.838 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.838 00:59:27 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:12.838 00:59:27 -- setup/common.sh@33 -- # echo 0 00:05:12.838 00:59:27 -- setup/common.sh@33 -- # return 0 00:05:12.838 00:59:27 -- setup/hugepages.sh@100 -- # resv=0 00:05:12.838 00:59:27 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:05:12.838 nr_hugepages=1024 00:05:12.838 00:59:27 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:12.838 resv_hugepages=0 00:05:12.838 00:59:27 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:12.838 surplus_hugepages=0 00:05:12.838 00:59:27 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:12.838 anon_hugepages=0 00:05:12.838 00:59:27 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:12.838 00:59:27 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:05:12.838 00:59:27 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:12.838 00:59:27 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:12.838 00:59:27 -- setup/common.sh@18 -- # local node= 00:05:12.838 00:59:27 -- setup/common.sh@19 -- # local var val 00:05:12.838 00:59:27 -- setup/common.sh@20 -- # local mem_f mem 00:05:12.839 00:59:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:12.839 00:59:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:12.839 00:59:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:12.839 00:59:27 -- setup/common.sh@28 -- # mapfile -t mem 00:05:12.839 00:59:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42689268 kB' 'MemAvailable: 46464064 kB' 'Buffers: 2708 kB' 'Cached: 13207228 kB' 'SwapCached: 0 kB' 'Active: 9921152 kB' 'Inactive: 3764112 kB' 'Active(anon): 9520672 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478456 kB' 'Mapped: 185044 kB' 'Shmem: 9045344 kB' 'KReclaimable: 207568 kB' 'Slab: 746216 kB' 'SReclaimable: 207568 kB' 'SUnreclaim: 538648 kB' 'KernelStack: 12800 kB' 'PageTables: 7748 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10585456 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2092636 kB' 'DirectMap2M: 15652864 kB' 'DirectMap1G: 52428800 kB' 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.839 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.839 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:12.840 00:59:27 -- setup/common.sh@33 -- # echo 1024 00:05:12.840 00:59:27 -- setup/common.sh@33 -- # return 0 00:05:12.840 00:59:27 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:12.840 00:59:27 -- setup/hugepages.sh@112 -- # get_nodes 00:05:12.840 00:59:27 -- setup/hugepages.sh@27 -- # local node 00:05:12.840 00:59:27 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:12.840 00:59:27 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:05:12.840 00:59:27 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:12.840 00:59:27 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:05:12.840 00:59:27 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:12.840 00:59:27 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:12.840 00:59:27 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:12.840 00:59:27 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:12.840 00:59:27 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:12.840 00:59:27 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:12.840 00:59:27 -- setup/common.sh@18 -- # local node=0 00:05:12.840 00:59:27 -- setup/common.sh@19 -- # local var val 00:05:12.840 00:59:27 -- setup/common.sh@20 -- # local mem_f mem 00:05:12.840 00:59:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:12.840 00:59:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:12.840 00:59:27 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:12.840 00:59:27 -- setup/common.sh@28 -- # mapfile -t mem 00:05:12.840 00:59:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 25931700 kB' 'MemUsed: 6894156 kB' 'SwapCached: 0 kB' 'Active: 3321148 kB' 'Inactive: 178300 kB' 'Active(anon): 3164424 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 178300 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3171640 kB' 'Mapped: 61596 kB' 'AnonPages: 330888 kB' 'Shmem: 2836616 kB' 'KernelStack: 7560 kB' 'PageTables: 4712 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123000 kB' 'Slab: 445488 kB' 'SReclaimable: 123000 kB' 'SUnreclaim: 322488 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:12.840 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:12.840 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.100 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.100 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # continue 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:05:13.101 00:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:05:13.101 00:59:27 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:13.101 00:59:27 -- setup/common.sh@33 -- # echo 0 00:05:13.101 00:59:27 -- setup/common.sh@33 -- # return 0 00:05:13.101 00:59:27 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:13.101 00:59:27 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:13.101 00:59:27 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:13.101 00:59:27 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:13.101 00:59:27 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:05:13.101 node0=1024 expecting 1024 00:05:13.101 00:59:27 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:05:13.101 00:05:13.101 real 0m2.880s 00:05:13.101 user 0m1.204s 00:05:13.101 sys 0m1.606s 00:05:13.101 00:59:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:13.101 00:59:27 -- common/autotest_common.sh@10 -- # set +x 00:05:13.101 ************************************ 00:05:13.101 END TEST no_shrink_alloc 00:05:13.101 ************************************ 00:05:13.101 00:59:27 -- setup/hugepages.sh@217 -- # clear_hp 00:05:13.101 00:59:27 -- setup/hugepages.sh@37 -- # local node hp 00:05:13.101 00:59:27 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:05:13.101 00:59:27 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:13.101 00:59:27 -- setup/hugepages.sh@41 -- # echo 0 00:05:13.101 00:59:27 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:13.101 00:59:27 -- setup/hugepages.sh@41 -- # echo 0 00:05:13.101 00:59:27 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:05:13.101 00:59:27 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:13.101 00:59:27 -- setup/hugepages.sh@41 -- # echo 0 00:05:13.101 00:59:27 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:13.101 00:59:27 -- setup/hugepages.sh@41 -- # echo 0 00:05:13.101 00:59:27 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:05:13.101 00:59:27 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:05:13.101 00:05:13.101 real 0m11.559s 00:05:13.101 user 0m4.539s 00:05:13.101 sys 0m6.009s 00:05:13.101 00:59:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:13.101 00:59:27 -- common/autotest_common.sh@10 -- # set +x 00:05:13.101 ************************************ 00:05:13.101 END TEST hugepages 00:05:13.101 ************************************ 00:05:13.101 00:59:27 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:05:13.101 00:59:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:13.101 00:59:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:13.101 00:59:27 -- common/autotest_common.sh@10 -- # set +x 00:05:13.101 ************************************ 00:05:13.101 START TEST driver 00:05:13.101 ************************************ 00:05:13.101 00:59:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:05:13.101 * Looking for test storage... 00:05:13.101 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:05:13.101 00:59:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:13.101 00:59:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:13.101 00:59:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:13.101 00:59:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:13.101 00:59:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:13.101 00:59:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:13.101 00:59:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:13.101 00:59:27 -- scripts/common.sh@335 -- # IFS=.-: 00:05:13.101 00:59:27 -- scripts/common.sh@335 -- # read -ra ver1 00:05:13.101 00:59:27 -- scripts/common.sh@336 -- # IFS=.-: 00:05:13.101 00:59:27 -- scripts/common.sh@336 -- # read -ra ver2 00:05:13.101 00:59:27 -- scripts/common.sh@337 -- # local 'op=<' 00:05:13.101 00:59:27 -- scripts/common.sh@339 -- # ver1_l=2 00:05:13.101 00:59:27 -- scripts/common.sh@340 -- # ver2_l=1 00:05:13.101 00:59:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:13.101 00:59:27 -- scripts/common.sh@343 -- # case "$op" in 00:05:13.101 00:59:27 -- scripts/common.sh@344 -- # : 1 00:05:13.101 00:59:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:13.101 00:59:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:13.101 00:59:27 -- scripts/common.sh@364 -- # decimal 1 00:05:13.101 00:59:27 -- scripts/common.sh@352 -- # local d=1 00:05:13.101 00:59:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:13.101 00:59:27 -- scripts/common.sh@354 -- # echo 1 00:05:13.101 00:59:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:13.101 00:59:27 -- scripts/common.sh@365 -- # decimal 2 00:05:13.101 00:59:27 -- scripts/common.sh@352 -- # local d=2 00:05:13.101 00:59:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:13.101 00:59:27 -- scripts/common.sh@354 -- # echo 2 00:05:13.101 00:59:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:13.101 00:59:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:13.101 00:59:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:13.101 00:59:27 -- scripts/common.sh@367 -- # return 0 00:05:13.101 00:59:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:13.101 00:59:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:13.101 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:13.101 --rc genhtml_branch_coverage=1 00:05:13.101 --rc genhtml_function_coverage=1 00:05:13.101 --rc genhtml_legend=1 00:05:13.101 --rc geninfo_all_blocks=1 00:05:13.101 --rc geninfo_unexecuted_blocks=1 00:05:13.101 00:05:13.101 ' 00:05:13.101 00:59:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:13.101 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:13.102 --rc genhtml_branch_coverage=1 00:05:13.102 --rc genhtml_function_coverage=1 00:05:13.102 --rc genhtml_legend=1 00:05:13.102 --rc geninfo_all_blocks=1 00:05:13.102 --rc geninfo_unexecuted_blocks=1 00:05:13.102 00:05:13.102 ' 00:05:13.102 00:59:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:13.102 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:13.102 --rc genhtml_branch_coverage=1 00:05:13.102 --rc genhtml_function_coverage=1 00:05:13.102 --rc genhtml_legend=1 00:05:13.102 --rc geninfo_all_blocks=1 00:05:13.102 --rc geninfo_unexecuted_blocks=1 00:05:13.102 00:05:13.102 ' 00:05:13.102 00:59:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:13.102 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:13.102 --rc genhtml_branch_coverage=1 00:05:13.102 --rc genhtml_function_coverage=1 00:05:13.102 --rc genhtml_legend=1 00:05:13.102 --rc geninfo_all_blocks=1 00:05:13.102 --rc geninfo_unexecuted_blocks=1 00:05:13.102 00:05:13.102 ' 00:05:13.102 00:59:27 -- setup/driver.sh@68 -- # setup reset 00:05:13.102 00:59:27 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:13.102 00:59:27 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:15.635 00:59:30 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:05:15.635 00:59:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:15.635 00:59:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:15.635 00:59:30 -- common/autotest_common.sh@10 -- # set +x 00:05:15.635 ************************************ 00:05:15.635 START TEST guess_driver 00:05:15.635 ************************************ 00:05:15.635 00:59:30 -- common/autotest_common.sh@1114 -- # guess_driver 00:05:15.635 00:59:30 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:05:15.635 00:59:30 -- setup/driver.sh@47 -- # local fail=0 00:05:15.635 00:59:30 -- setup/driver.sh@49 -- # pick_driver 00:05:15.635 00:59:30 -- setup/driver.sh@36 -- # vfio 00:05:15.635 00:59:30 -- setup/driver.sh@21 -- # local iommu_grups 00:05:15.635 00:59:30 -- setup/driver.sh@22 -- # local unsafe_vfio 00:05:15.635 00:59:30 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:05:15.635 00:59:30 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:05:15.635 00:59:30 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:05:15.635 00:59:30 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:05:15.635 00:59:30 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:05:15.635 00:59:30 -- setup/driver.sh@14 -- # mod vfio_pci 00:05:15.635 00:59:30 -- setup/driver.sh@12 -- # dep vfio_pci 00:05:15.635 00:59:30 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:05:15.635 00:59:30 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:05:15.636 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:05:15.636 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:05:15.636 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:05:15.636 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:05:15.636 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:05:15.636 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:05:15.636 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:05:15.636 00:59:30 -- setup/driver.sh@30 -- # return 0 00:05:15.636 00:59:30 -- setup/driver.sh@37 -- # echo vfio-pci 00:05:15.636 00:59:30 -- setup/driver.sh@49 -- # driver=vfio-pci 00:05:15.636 00:59:30 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:05:15.636 00:59:30 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:05:15.636 Looking for driver=vfio-pci 00:05:15.636 00:59:30 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:15.636 00:59:30 -- setup/driver.sh@45 -- # setup output config 00:05:15.636 00:59:30 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:15.636 00:59:30 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:17.015 00:59:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:17.015 00:59:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:17.015 00:59:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:17.015 00:59:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:17.015 00:59:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:17.015 00:59:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:17.015 00:59:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:17.015 00:59:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:17.015 00:59:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:17.015 00:59:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:17.015 00:59:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:17.015 00:59:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:17.015 00:59:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:17.015 00:59:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:17.015 00:59:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:17.015 00:59:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:17.015 00:59:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:17.015 00:59:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:17.015 00:59:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:17.015 00:59:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:17.015 00:59:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:17.015 00:59:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:17.015 00:59:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:17.015 00:59:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:17.015 00:59:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:17.015 00:59:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:17.015 00:59:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:17.015 00:59:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:17.015 00:59:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:17.015 00:59:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:17.015 00:59:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:17.015 00:59:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:17.015 00:59:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:17.015 00:59:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:17.015 00:59:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:17.015 00:59:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:17.015 00:59:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:17.015 00:59:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:17.015 00:59:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:17.015 00:59:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:17.015 00:59:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:17.015 00:59:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:17.015 00:59:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:17.015 00:59:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:17.015 00:59:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:17.015 00:59:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:17.015 00:59:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:17.015 00:59:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:17.984 00:59:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:17.984 00:59:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:17.984 00:59:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:17.984 00:59:32 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:05:17.984 00:59:32 -- setup/driver.sh@65 -- # setup reset 00:05:17.984 00:59:32 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:17.984 00:59:32 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:20.517 00:05:20.517 real 0m4.835s 00:05:20.517 user 0m1.100s 00:05:20.517 sys 0m1.911s 00:05:20.517 00:59:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:20.517 00:59:34 -- common/autotest_common.sh@10 -- # set +x 00:05:20.517 ************************************ 00:05:20.517 END TEST guess_driver 00:05:20.517 ************************************ 00:05:20.517 00:05:20.517 real 0m7.381s 00:05:20.517 user 0m1.745s 00:05:20.517 sys 0m2.924s 00:05:20.517 00:59:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:20.517 00:59:34 -- common/autotest_common.sh@10 -- # set +x 00:05:20.517 ************************************ 00:05:20.517 END TEST driver 00:05:20.517 ************************************ 00:05:20.517 00:59:34 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:05:20.517 00:59:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:20.517 00:59:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:20.517 00:59:34 -- common/autotest_common.sh@10 -- # set +x 00:05:20.517 ************************************ 00:05:20.517 START TEST devices 00:05:20.517 ************************************ 00:05:20.517 00:59:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:05:20.517 * Looking for test storage... 00:05:20.517 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:05:20.517 00:59:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:20.517 00:59:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:20.517 00:59:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:20.517 00:59:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:20.517 00:59:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:20.517 00:59:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:20.517 00:59:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:20.517 00:59:35 -- scripts/common.sh@335 -- # IFS=.-: 00:05:20.517 00:59:35 -- scripts/common.sh@335 -- # read -ra ver1 00:05:20.517 00:59:35 -- scripts/common.sh@336 -- # IFS=.-: 00:05:20.517 00:59:35 -- scripts/common.sh@336 -- # read -ra ver2 00:05:20.517 00:59:35 -- scripts/common.sh@337 -- # local 'op=<' 00:05:20.517 00:59:35 -- scripts/common.sh@339 -- # ver1_l=2 00:05:20.517 00:59:35 -- scripts/common.sh@340 -- # ver2_l=1 00:05:20.517 00:59:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:20.517 00:59:35 -- scripts/common.sh@343 -- # case "$op" in 00:05:20.517 00:59:35 -- scripts/common.sh@344 -- # : 1 00:05:20.517 00:59:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:20.517 00:59:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:20.517 00:59:35 -- scripts/common.sh@364 -- # decimal 1 00:05:20.517 00:59:35 -- scripts/common.sh@352 -- # local d=1 00:05:20.517 00:59:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:20.517 00:59:35 -- scripts/common.sh@354 -- # echo 1 00:05:20.517 00:59:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:20.517 00:59:35 -- scripts/common.sh@365 -- # decimal 2 00:05:20.517 00:59:35 -- scripts/common.sh@352 -- # local d=2 00:05:20.517 00:59:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:20.517 00:59:35 -- scripts/common.sh@354 -- # echo 2 00:05:20.517 00:59:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:20.517 00:59:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:20.517 00:59:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:20.517 00:59:35 -- scripts/common.sh@367 -- # return 0 00:05:20.517 00:59:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:20.517 00:59:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:20.517 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:20.517 --rc genhtml_branch_coverage=1 00:05:20.517 --rc genhtml_function_coverage=1 00:05:20.517 --rc genhtml_legend=1 00:05:20.517 --rc geninfo_all_blocks=1 00:05:20.517 --rc geninfo_unexecuted_blocks=1 00:05:20.517 00:05:20.517 ' 00:05:20.518 00:59:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:20.518 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:20.518 --rc genhtml_branch_coverage=1 00:05:20.518 --rc genhtml_function_coverage=1 00:05:20.518 --rc genhtml_legend=1 00:05:20.518 --rc geninfo_all_blocks=1 00:05:20.518 --rc geninfo_unexecuted_blocks=1 00:05:20.518 00:05:20.518 ' 00:05:20.518 00:59:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:20.518 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:20.518 --rc genhtml_branch_coverage=1 00:05:20.518 --rc genhtml_function_coverage=1 00:05:20.518 --rc genhtml_legend=1 00:05:20.518 --rc geninfo_all_blocks=1 00:05:20.518 --rc geninfo_unexecuted_blocks=1 00:05:20.518 00:05:20.518 ' 00:05:20.518 00:59:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:20.518 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:20.518 --rc genhtml_branch_coverage=1 00:05:20.518 --rc genhtml_function_coverage=1 00:05:20.518 --rc genhtml_legend=1 00:05:20.518 --rc geninfo_all_blocks=1 00:05:20.518 --rc geninfo_unexecuted_blocks=1 00:05:20.518 00:05:20.518 ' 00:05:20.518 00:59:35 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:05:20.518 00:59:35 -- setup/devices.sh@192 -- # setup reset 00:05:20.518 00:59:35 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:20.518 00:59:35 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:21.892 00:59:36 -- setup/devices.sh@194 -- # get_zoned_devs 00:05:21.892 00:59:36 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:05:21.892 00:59:36 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:05:21.892 00:59:36 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:05:21.892 00:59:36 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:05:21.892 00:59:36 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:05:21.892 00:59:36 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:05:21.892 00:59:36 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:05:21.892 00:59:36 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:05:21.892 00:59:36 -- setup/devices.sh@196 -- # blocks=() 00:05:21.892 00:59:36 -- setup/devices.sh@196 -- # declare -a blocks 00:05:21.892 00:59:36 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:05:21.892 00:59:36 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:05:21.892 00:59:36 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:05:21.892 00:59:36 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:05:21.892 00:59:36 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:05:21.892 00:59:36 -- setup/devices.sh@201 -- # ctrl=nvme0 00:05:21.892 00:59:36 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:05:21.892 00:59:36 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:05:21.892 00:59:36 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:05:21.892 00:59:36 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:05:21.892 00:59:36 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:05:22.151 No valid GPT data, bailing 00:05:22.151 00:59:36 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:05:22.151 00:59:36 -- scripts/common.sh@393 -- # pt= 00:05:22.151 00:59:36 -- scripts/common.sh@394 -- # return 1 00:05:22.151 00:59:36 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:05:22.151 00:59:36 -- setup/common.sh@76 -- # local dev=nvme0n1 00:05:22.151 00:59:36 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:05:22.151 00:59:36 -- setup/common.sh@80 -- # echo 1000204886016 00:05:22.151 00:59:36 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:05:22.151 00:59:36 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:05:22.151 00:59:36 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:05:22.151 00:59:36 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:05:22.151 00:59:36 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:05:22.151 00:59:36 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:05:22.151 00:59:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:22.151 00:59:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:22.151 00:59:36 -- common/autotest_common.sh@10 -- # set +x 00:05:22.151 ************************************ 00:05:22.151 START TEST nvme_mount 00:05:22.151 ************************************ 00:05:22.151 00:59:36 -- common/autotest_common.sh@1114 -- # nvme_mount 00:05:22.151 00:59:36 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:05:22.151 00:59:36 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:05:22.151 00:59:36 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:22.151 00:59:36 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:22.151 00:59:36 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:05:22.151 00:59:36 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:22.151 00:59:36 -- setup/common.sh@40 -- # local part_no=1 00:05:22.151 00:59:36 -- setup/common.sh@41 -- # local size=1073741824 00:05:22.151 00:59:36 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:22.151 00:59:36 -- setup/common.sh@44 -- # parts=() 00:05:22.151 00:59:36 -- setup/common.sh@44 -- # local parts 00:05:22.151 00:59:36 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:22.151 00:59:36 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:22.151 00:59:36 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:22.151 00:59:36 -- setup/common.sh@46 -- # (( part++ )) 00:05:22.151 00:59:36 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:22.151 00:59:36 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:22.151 00:59:36 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:22.151 00:59:36 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:05:23.088 Creating new GPT entries in memory. 00:05:23.088 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:23.088 other utilities. 00:05:23.088 00:59:37 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:23.088 00:59:37 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:23.088 00:59:37 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:23.088 00:59:37 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:23.088 00:59:37 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:24.025 Creating new GPT entries in memory. 00:05:24.025 The operation has completed successfully. 00:05:24.025 00:59:38 -- setup/common.sh@57 -- # (( part++ )) 00:05:24.025 00:59:38 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:24.025 00:59:38 -- setup/common.sh@62 -- # wait 1900233 00:05:24.025 00:59:38 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:24.025 00:59:38 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:05:24.025 00:59:38 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:24.025 00:59:38 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:05:24.025 00:59:38 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:05:24.284 00:59:38 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:24.284 00:59:38 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:24.284 00:59:38 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:24.284 00:59:38 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:05:24.284 00:59:38 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:24.284 00:59:38 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:24.284 00:59:38 -- setup/devices.sh@53 -- # local found=0 00:05:24.284 00:59:38 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:24.284 00:59:38 -- setup/devices.sh@56 -- # : 00:05:24.284 00:59:38 -- setup/devices.sh@59 -- # local pci status 00:05:24.284 00:59:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:24.284 00:59:38 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:24.284 00:59:38 -- setup/devices.sh@47 -- # setup output config 00:05:24.284 00:59:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:24.284 00:59:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:25.219 00:59:39 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:25.219 00:59:39 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:05:25.219 00:59:39 -- setup/devices.sh@63 -- # found=1 00:05:25.219 00:59:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:25.219 00:59:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:25.219 00:59:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:25.219 00:59:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:25.219 00:59:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:25.219 00:59:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:25.219 00:59:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:25.219 00:59:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:25.219 00:59:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:25.219 00:59:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:25.219 00:59:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:25.219 00:59:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:25.219 00:59:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:25.219 00:59:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:25.219 00:59:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:25.219 00:59:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:25.219 00:59:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:25.219 00:59:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:25.219 00:59:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:25.219 00:59:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:25.219 00:59:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:25.219 00:59:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:25.219 00:59:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:25.219 00:59:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:25.219 00:59:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:25.219 00:59:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:25.219 00:59:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:25.219 00:59:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:25.220 00:59:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:25.479 00:59:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:25.479 00:59:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:25.479 00:59:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:25.479 00:59:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:25.479 00:59:40 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:25.479 00:59:40 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:25.479 00:59:40 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:25.479 00:59:40 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:25.479 00:59:40 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:25.479 00:59:40 -- setup/devices.sh@110 -- # cleanup_nvme 00:05:25.479 00:59:40 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:25.479 00:59:40 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:25.479 00:59:40 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:25.479 00:59:40 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:25.479 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:25.479 00:59:40 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:25.479 00:59:40 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:25.738 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:25.738 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:25.738 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:25.738 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:25.738 00:59:40 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:05:25.738 00:59:40 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:05:25.738 00:59:40 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:25.738 00:59:40 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:05:25.738 00:59:40 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:05:25.738 00:59:40 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:25.997 00:59:40 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:25.997 00:59:40 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:25.997 00:59:40 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:05:25.997 00:59:40 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:25.997 00:59:40 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:25.997 00:59:40 -- setup/devices.sh@53 -- # local found=0 00:05:25.997 00:59:40 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:25.997 00:59:40 -- setup/devices.sh@56 -- # : 00:05:25.997 00:59:40 -- setup/devices.sh@59 -- # local pci status 00:05:25.997 00:59:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:25.997 00:59:40 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:25.997 00:59:40 -- setup/devices.sh@47 -- # setup output config 00:05:25.997 00:59:40 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:25.997 00:59:40 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:26.933 00:59:41 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.933 00:59:41 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:05:26.933 00:59:41 -- setup/devices.sh@63 -- # found=1 00:05:26.933 00:59:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.933 00:59:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.933 00:59:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.933 00:59:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.933 00:59:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.933 00:59:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.933 00:59:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.933 00:59:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.933 00:59:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.933 00:59:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.933 00:59:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.933 00:59:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.933 00:59:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.933 00:59:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.933 00:59:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.933 00:59:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.933 00:59:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.933 00:59:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.933 00:59:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.933 00:59:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.933 00:59:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.933 00:59:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.933 00:59:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.933 00:59:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.933 00:59:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.933 00:59:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.933 00:59:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.933 00:59:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.933 00:59:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.933 00:59:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.933 00:59:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.933 00:59:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:26.933 00:59:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:27.192 00:59:41 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:27.192 00:59:41 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:27.192 00:59:41 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:27.192 00:59:41 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:27.192 00:59:41 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:27.192 00:59:41 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:27.192 00:59:41 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:05:27.192 00:59:41 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:27.192 00:59:41 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:05:27.192 00:59:41 -- setup/devices.sh@50 -- # local mount_point= 00:05:27.192 00:59:41 -- setup/devices.sh@51 -- # local test_file= 00:05:27.192 00:59:41 -- setup/devices.sh@53 -- # local found=0 00:05:27.192 00:59:41 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:27.192 00:59:41 -- setup/devices.sh@59 -- # local pci status 00:05:27.192 00:59:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:27.192 00:59:41 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:27.192 00:59:41 -- setup/devices.sh@47 -- # setup output config 00:05:27.192 00:59:41 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:27.192 00:59:41 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:28.128 00:59:42 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:28.129 00:59:42 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:05:28.129 00:59:42 -- setup/devices.sh@63 -- # found=1 00:05:28.129 00:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:28.129 00:59:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:28.129 00:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:28.129 00:59:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:28.129 00:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:28.129 00:59:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:28.129 00:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:28.129 00:59:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:28.129 00:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:28.129 00:59:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:28.129 00:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:28.129 00:59:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:28.129 00:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:28.388 00:59:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:28.388 00:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:28.388 00:59:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:28.388 00:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:28.388 00:59:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:28.388 00:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:28.388 00:59:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:28.388 00:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:28.388 00:59:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:28.388 00:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:28.388 00:59:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:28.388 00:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:28.388 00:59:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:28.388 00:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:28.388 00:59:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:28.388 00:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:28.388 00:59:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:28.388 00:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:28.388 00:59:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:28.388 00:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:28.388 00:59:42 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:28.388 00:59:42 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:28.388 00:59:42 -- setup/devices.sh@68 -- # return 0 00:05:28.388 00:59:42 -- setup/devices.sh@128 -- # cleanup_nvme 00:05:28.388 00:59:42 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:28.388 00:59:42 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:28.388 00:59:42 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:28.388 00:59:42 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:28.388 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:28.388 00:05:28.388 real 0m6.408s 00:05:28.388 user 0m1.530s 00:05:28.388 sys 0m2.467s 00:05:28.388 00:59:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.388 00:59:42 -- common/autotest_common.sh@10 -- # set +x 00:05:28.388 ************************************ 00:05:28.388 END TEST nvme_mount 00:05:28.388 ************************************ 00:05:28.388 00:59:42 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:05:28.388 00:59:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:28.388 00:59:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.388 00:59:42 -- common/autotest_common.sh@10 -- # set +x 00:05:28.388 ************************************ 00:05:28.388 START TEST dm_mount 00:05:28.388 ************************************ 00:05:28.388 00:59:42 -- common/autotest_common.sh@1114 -- # dm_mount 00:05:28.388 00:59:42 -- setup/devices.sh@144 -- # pv=nvme0n1 00:05:28.388 00:59:42 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:05:28.388 00:59:42 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:05:28.388 00:59:42 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:05:28.388 00:59:42 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:28.388 00:59:42 -- setup/common.sh@40 -- # local part_no=2 00:05:28.388 00:59:42 -- setup/common.sh@41 -- # local size=1073741824 00:05:28.388 00:59:42 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:28.388 00:59:42 -- setup/common.sh@44 -- # parts=() 00:05:28.388 00:59:42 -- setup/common.sh@44 -- # local parts 00:05:28.388 00:59:42 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:28.388 00:59:42 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:28.388 00:59:42 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:28.388 00:59:42 -- setup/common.sh@46 -- # (( part++ )) 00:05:28.388 00:59:42 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:28.388 00:59:42 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:28.388 00:59:42 -- setup/common.sh@46 -- # (( part++ )) 00:05:28.388 00:59:42 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:28.388 00:59:42 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:28.388 00:59:42 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:28.388 00:59:42 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:05:29.768 Creating new GPT entries in memory. 00:05:29.768 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:29.768 other utilities. 00:05:29.768 00:59:43 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:29.768 00:59:43 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:29.768 00:59:43 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:29.768 00:59:43 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:29.768 00:59:43 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:30.705 Creating new GPT entries in memory. 00:05:30.705 The operation has completed successfully. 00:05:30.705 00:59:44 -- setup/common.sh@57 -- # (( part++ )) 00:05:30.705 00:59:44 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:30.705 00:59:44 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:30.705 00:59:44 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:30.705 00:59:44 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:05:31.642 The operation has completed successfully. 00:05:31.642 00:59:46 -- setup/common.sh@57 -- # (( part++ )) 00:05:31.642 00:59:46 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:31.642 00:59:46 -- setup/common.sh@62 -- # wait 1902701 00:05:31.642 00:59:46 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:05:31.642 00:59:46 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:31.642 00:59:46 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:31.642 00:59:46 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:05:31.642 00:59:46 -- setup/devices.sh@160 -- # for t in {1..5} 00:05:31.642 00:59:46 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:31.642 00:59:46 -- setup/devices.sh@161 -- # break 00:05:31.642 00:59:46 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:31.642 00:59:46 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:05:31.642 00:59:46 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:05:31.642 00:59:46 -- setup/devices.sh@166 -- # dm=dm-0 00:05:31.642 00:59:46 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:05:31.642 00:59:46 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:05:31.642 00:59:46 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:31.642 00:59:46 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:05:31.642 00:59:46 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:31.642 00:59:46 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:31.642 00:59:46 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:05:31.642 00:59:46 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:31.642 00:59:46 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:31.642 00:59:46 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:31.642 00:59:46 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:05:31.642 00:59:46 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:31.642 00:59:46 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:31.642 00:59:46 -- setup/devices.sh@53 -- # local found=0 00:05:31.642 00:59:46 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:31.642 00:59:46 -- setup/devices.sh@56 -- # : 00:05:31.642 00:59:46 -- setup/devices.sh@59 -- # local pci status 00:05:31.642 00:59:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:31.642 00:59:46 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:31.642 00:59:46 -- setup/devices.sh@47 -- # setup output config 00:05:31.642 00:59:46 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:31.642 00:59:46 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:32.578 00:59:47 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:32.578 00:59:47 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:05:32.578 00:59:47 -- setup/devices.sh@63 -- # found=1 00:05:32.578 00:59:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.578 00:59:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:32.578 00:59:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.578 00:59:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:32.578 00:59:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.578 00:59:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:32.578 00:59:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.578 00:59:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:32.578 00:59:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.578 00:59:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:32.578 00:59:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.837 00:59:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:32.837 00:59:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.837 00:59:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:32.837 00:59:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.837 00:59:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:32.837 00:59:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.837 00:59:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:32.837 00:59:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.837 00:59:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:32.837 00:59:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.837 00:59:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:32.837 00:59:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.837 00:59:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:32.837 00:59:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.837 00:59:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:32.837 00:59:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.837 00:59:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:32.837 00:59:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.837 00:59:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:32.837 00:59:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.837 00:59:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:32.837 00:59:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.837 00:59:47 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:32.838 00:59:47 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:05:32.838 00:59:47 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:32.838 00:59:47 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:32.838 00:59:47 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:32.838 00:59:47 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:32.838 00:59:47 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:05:32.838 00:59:47 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:32.838 00:59:47 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:05:32.838 00:59:47 -- setup/devices.sh@50 -- # local mount_point= 00:05:32.838 00:59:47 -- setup/devices.sh@51 -- # local test_file= 00:05:32.838 00:59:47 -- setup/devices.sh@53 -- # local found=0 00:05:32.838 00:59:47 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:32.838 00:59:47 -- setup/devices.sh@59 -- # local pci status 00:05:32.838 00:59:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.838 00:59:47 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:32.838 00:59:47 -- setup/devices.sh@47 -- # setup output config 00:05:32.838 00:59:47 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:32.838 00:59:47 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:34.213 00:59:48 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:34.213 00:59:48 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:05:34.213 00:59:48 -- setup/devices.sh@63 -- # found=1 00:05:34.213 00:59:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:34.213 00:59:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:34.213 00:59:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:34.213 00:59:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:34.213 00:59:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:34.213 00:59:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:34.213 00:59:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:34.213 00:59:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:34.213 00:59:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:34.213 00:59:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:34.213 00:59:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:34.213 00:59:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:34.213 00:59:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:34.213 00:59:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:34.213 00:59:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:34.213 00:59:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:34.213 00:59:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:34.214 00:59:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:34.214 00:59:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:34.214 00:59:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:34.214 00:59:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:34.214 00:59:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:34.214 00:59:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:34.214 00:59:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:34.214 00:59:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:34.214 00:59:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:34.214 00:59:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:34.214 00:59:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:34.214 00:59:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:34.214 00:59:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:34.214 00:59:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:34.214 00:59:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:34.214 00:59:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:34.214 00:59:48 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:34.214 00:59:48 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:34.214 00:59:48 -- setup/devices.sh@68 -- # return 0 00:05:34.214 00:59:48 -- setup/devices.sh@187 -- # cleanup_dm 00:05:34.214 00:59:48 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:34.214 00:59:48 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:34.214 00:59:48 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:05:34.214 00:59:48 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:34.214 00:59:48 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:05:34.214 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:34.214 00:59:48 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:34.214 00:59:48 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:05:34.214 00:05:34.214 real 0m5.799s 00:05:34.214 user 0m0.929s 00:05:34.214 sys 0m1.733s 00:05:34.214 00:59:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.214 00:59:48 -- common/autotest_common.sh@10 -- # set +x 00:05:34.214 ************************************ 00:05:34.214 END TEST dm_mount 00:05:34.214 ************************************ 00:05:34.214 00:59:48 -- setup/devices.sh@1 -- # cleanup 00:05:34.214 00:59:48 -- setup/devices.sh@11 -- # cleanup_nvme 00:05:34.214 00:59:48 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:34.214 00:59:48 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:34.214 00:59:48 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:34.214 00:59:48 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:34.214 00:59:48 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:34.470 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:34.470 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:34.470 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:34.470 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:34.470 00:59:49 -- setup/devices.sh@12 -- # cleanup_dm 00:05:34.470 00:59:49 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:34.470 00:59:49 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:34.470 00:59:49 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:34.470 00:59:49 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:34.470 00:59:49 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:05:34.470 00:59:49 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:05:34.470 00:05:34.470 real 0m14.161s 00:05:34.470 user 0m3.162s 00:05:34.470 sys 0m5.224s 00:05:34.471 00:59:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.471 00:59:49 -- common/autotest_common.sh@10 -- # set +x 00:05:34.471 ************************************ 00:05:34.471 END TEST devices 00:05:34.471 ************************************ 00:05:34.729 00:05:34.729 real 0m43.949s 00:05:34.729 user 0m12.858s 00:05:34.729 sys 0m19.707s 00:05:34.729 00:59:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.729 00:59:49 -- common/autotest_common.sh@10 -- # set +x 00:05:34.729 ************************************ 00:05:34.729 END TEST setup.sh 00:05:34.729 ************************************ 00:05:34.729 00:59:49 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:05:35.662 Hugepages 00:05:35.662 node hugesize free / total 00:05:35.662 node0 1048576kB 0 / 0 00:05:35.662 node0 2048kB 2048 / 2048 00:05:35.662 node1 1048576kB 0 / 0 00:05:35.662 node1 2048kB 0 / 0 00:05:35.662 00:05:35.662 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:35.662 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:05:35.662 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:05:35.662 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:05:35.662 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:05:35.662 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:05:35.662 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:05:35.662 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:05:35.662 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:05:35.662 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:05:35.662 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:05:35.662 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:05:35.662 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:05:35.662 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:05:35.662 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:05:35.662 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:05:35.662 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:05:35.662 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:05:35.662 00:59:50 -- spdk/autotest.sh@128 -- # uname -s 00:05:35.662 00:59:50 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:05:35.662 00:59:50 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:05:35.663 00:59:50 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:37.103 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:37.103 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:37.103 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:37.103 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:37.103 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:37.103 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:37.103 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:37.103 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:37.103 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:37.103 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:37.103 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:37.103 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:37.103 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:37.103 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:37.103 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:37.103 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:38.038 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:38.297 00:59:52 -- common/autotest_common.sh@1527 -- # sleep 1 00:05:39.231 00:59:53 -- common/autotest_common.sh@1528 -- # bdfs=() 00:05:39.231 00:59:53 -- common/autotest_common.sh@1528 -- # local bdfs 00:05:39.231 00:59:53 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:05:39.231 00:59:53 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:05:39.231 00:59:53 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:39.231 00:59:53 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:39.231 00:59:53 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:39.231 00:59:53 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:39.231 00:59:53 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:39.231 00:59:53 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:39.231 00:59:53 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:39.231 00:59:53 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:40.617 Waiting for block devices as requested 00:05:40.617 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:05:40.617 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:40.617 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:40.617 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:40.875 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:40.875 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:40.875 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:40.875 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:40.875 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:41.132 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:41.132 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:41.132 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:41.390 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:41.390 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:41.390 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:41.390 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:41.648 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:41.648 00:59:56 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:05:41.648 00:59:56 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:05:41.648 00:59:56 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:05:41.648 00:59:56 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:05:41.648 00:59:56 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:41.648 00:59:56 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:05:41.648 00:59:56 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:41.648 00:59:56 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:05:41.648 00:59:56 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:05:41.648 00:59:56 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:05:41.648 00:59:56 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:05:41.648 00:59:56 -- common/autotest_common.sh@1540 -- # grep oacs 00:05:41.648 00:59:56 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:05:41.648 00:59:56 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:05:41.648 00:59:56 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:05:41.648 00:59:56 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:05:41.648 00:59:56 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:05:41.648 00:59:56 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:05:41.648 00:59:56 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:05:41.648 00:59:56 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:05:41.648 00:59:56 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:05:41.648 00:59:56 -- common/autotest_common.sh@1552 -- # continue 00:05:41.648 00:59:56 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:05:41.648 00:59:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:41.648 00:59:56 -- common/autotest_common.sh@10 -- # set +x 00:05:41.648 00:59:56 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:05:41.648 00:59:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:41.648 00:59:56 -- common/autotest_common.sh@10 -- # set +x 00:05:41.648 00:59:56 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:43.021 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:43.021 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:43.021 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:43.021 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:43.021 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:43.021 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:43.021 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:43.021 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:43.021 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:43.021 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:43.021 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:43.021 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:43.021 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:43.021 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:43.021 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:43.021 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:43.956 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:43.956 00:59:58 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:05:43.956 00:59:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:43.956 00:59:58 -- common/autotest_common.sh@10 -- # set +x 00:05:44.215 00:59:58 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:05:44.215 00:59:58 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:05:44.215 00:59:58 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:05:44.215 00:59:58 -- common/autotest_common.sh@1572 -- # bdfs=() 00:05:44.215 00:59:58 -- common/autotest_common.sh@1572 -- # local bdfs 00:05:44.215 00:59:58 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:05:44.215 00:59:58 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:44.215 00:59:58 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:44.215 00:59:58 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:44.215 00:59:58 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:44.215 00:59:58 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:44.215 00:59:58 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:44.215 00:59:58 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:44.215 00:59:58 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:05:44.215 00:59:58 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:05:44.215 00:59:58 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:05:44.215 00:59:58 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:05:44.215 00:59:58 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:05:44.215 00:59:58 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:05:44.215 00:59:58 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:05:44.215 00:59:58 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=1908002 00:05:44.215 00:59:58 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:44.215 00:59:58 -- common/autotest_common.sh@1593 -- # waitforlisten 1908002 00:05:44.215 00:59:58 -- common/autotest_common.sh@829 -- # '[' -z 1908002 ']' 00:05:44.215 00:59:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:44.215 00:59:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:44.215 00:59:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:44.215 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:44.215 00:59:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:44.215 00:59:58 -- common/autotest_common.sh@10 -- # set +x 00:05:44.215 [2024-11-28 00:59:58.710605] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:44.215 [2024-11-28 00:59:58.710681] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1908002 ] 00:05:44.215 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.215 [2024-11-28 00:59:58.774214] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.474 [2024-11-28 00:59:58.865700] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:44.474 [2024-11-28 00:59:58.865870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.408 00:59:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:45.408 00:59:59 -- common/autotest_common.sh@862 -- # return 0 00:05:45.408 00:59:59 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:05:45.408 00:59:59 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:05:45.408 00:59:59 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:05:48.691 nvme0n1 00:05:48.691 01:00:02 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:48.691 [2024-11-28 01:00:03.006010] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:05:48.691 [2024-11-28 01:00:03.006058] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:05:48.691 request: 00:05:48.691 { 00:05:48.691 "nvme_ctrlr_name": "nvme0", 00:05:48.691 "password": "test", 00:05:48.691 "method": "bdev_nvme_opal_revert", 00:05:48.691 "req_id": 1 00:05:48.691 } 00:05:48.691 Got JSON-RPC error response 00:05:48.691 response: 00:05:48.691 { 00:05:48.691 "code": -32603, 00:05:48.691 "message": "Internal error" 00:05:48.692 } 00:05:48.692 01:00:03 -- common/autotest_common.sh@1599 -- # true 00:05:48.692 01:00:03 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:05:48.692 01:00:03 -- common/autotest_common.sh@1603 -- # killprocess 1908002 00:05:48.692 01:00:03 -- common/autotest_common.sh@936 -- # '[' -z 1908002 ']' 00:05:48.692 01:00:03 -- common/autotest_common.sh@940 -- # kill -0 1908002 00:05:48.692 01:00:03 -- common/autotest_common.sh@941 -- # uname 00:05:48.692 01:00:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:48.692 01:00:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1908002 00:05:48.692 01:00:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:48.692 01:00:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:48.692 01:00:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1908002' 00:05:48.692 killing process with pid 1908002 00:05:48.692 01:00:03 -- common/autotest_common.sh@955 -- # kill 1908002 00:05:48.692 01:00:03 -- common/autotest_common.sh@960 -- # wait 1908002 00:05:50.591 01:00:04 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:05:50.591 01:00:04 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:05:50.591 01:00:04 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:50.591 01:00:04 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:50.591 01:00:04 -- spdk/autotest.sh@160 -- # timing_enter lib 00:05:50.591 01:00:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:50.591 01:00:04 -- common/autotest_common.sh@10 -- # set +x 00:05:50.591 01:00:04 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:50.591 01:00:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:50.591 01:00:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:50.591 01:00:04 -- common/autotest_common.sh@10 -- # set +x 00:05:50.592 ************************************ 00:05:50.592 START TEST env 00:05:50.592 ************************************ 00:05:50.592 01:00:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:50.592 * Looking for test storage... 00:05:50.592 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:50.592 01:00:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:50.592 01:00:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:50.592 01:00:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:50.592 01:00:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:50.592 01:00:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:50.592 01:00:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:50.592 01:00:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:50.592 01:00:04 -- scripts/common.sh@335 -- # IFS=.-: 00:05:50.592 01:00:04 -- scripts/common.sh@335 -- # read -ra ver1 00:05:50.592 01:00:04 -- scripts/common.sh@336 -- # IFS=.-: 00:05:50.592 01:00:04 -- scripts/common.sh@336 -- # read -ra ver2 00:05:50.592 01:00:04 -- scripts/common.sh@337 -- # local 'op=<' 00:05:50.592 01:00:04 -- scripts/common.sh@339 -- # ver1_l=2 00:05:50.592 01:00:04 -- scripts/common.sh@340 -- # ver2_l=1 00:05:50.592 01:00:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:50.592 01:00:04 -- scripts/common.sh@343 -- # case "$op" in 00:05:50.592 01:00:04 -- scripts/common.sh@344 -- # : 1 00:05:50.592 01:00:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:50.592 01:00:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:50.592 01:00:04 -- scripts/common.sh@364 -- # decimal 1 00:05:50.592 01:00:04 -- scripts/common.sh@352 -- # local d=1 00:05:50.592 01:00:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:50.592 01:00:04 -- scripts/common.sh@354 -- # echo 1 00:05:50.592 01:00:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:50.592 01:00:04 -- scripts/common.sh@365 -- # decimal 2 00:05:50.592 01:00:04 -- scripts/common.sh@352 -- # local d=2 00:05:50.592 01:00:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:50.592 01:00:04 -- scripts/common.sh@354 -- # echo 2 00:05:50.592 01:00:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:50.592 01:00:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:50.592 01:00:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:50.592 01:00:04 -- scripts/common.sh@367 -- # return 0 00:05:50.592 01:00:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:50.592 01:00:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:50.592 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.592 --rc genhtml_branch_coverage=1 00:05:50.592 --rc genhtml_function_coverage=1 00:05:50.592 --rc genhtml_legend=1 00:05:50.592 --rc geninfo_all_blocks=1 00:05:50.592 --rc geninfo_unexecuted_blocks=1 00:05:50.592 00:05:50.592 ' 00:05:50.592 01:00:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:50.592 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.592 --rc genhtml_branch_coverage=1 00:05:50.592 --rc genhtml_function_coverage=1 00:05:50.592 --rc genhtml_legend=1 00:05:50.592 --rc geninfo_all_blocks=1 00:05:50.592 --rc geninfo_unexecuted_blocks=1 00:05:50.592 00:05:50.592 ' 00:05:50.592 01:00:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:50.592 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.592 --rc genhtml_branch_coverage=1 00:05:50.592 --rc genhtml_function_coverage=1 00:05:50.592 --rc genhtml_legend=1 00:05:50.592 --rc geninfo_all_blocks=1 00:05:50.592 --rc geninfo_unexecuted_blocks=1 00:05:50.592 00:05:50.592 ' 00:05:50.592 01:00:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:50.592 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.592 --rc genhtml_branch_coverage=1 00:05:50.592 --rc genhtml_function_coverage=1 00:05:50.592 --rc genhtml_legend=1 00:05:50.592 --rc geninfo_all_blocks=1 00:05:50.592 --rc geninfo_unexecuted_blocks=1 00:05:50.592 00:05:50.592 ' 00:05:50.592 01:00:04 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:50.592 01:00:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:50.592 01:00:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:50.592 01:00:04 -- common/autotest_common.sh@10 -- # set +x 00:05:50.592 ************************************ 00:05:50.592 START TEST env_memory 00:05:50.592 ************************************ 00:05:50.592 01:00:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:50.592 00:05:50.592 00:05:50.592 CUnit - A unit testing framework for C - Version 2.1-3 00:05:50.592 http://cunit.sourceforge.net/ 00:05:50.592 00:05:50.592 00:05:50.592 Suite: memory 00:05:50.592 Test: alloc and free memory map ...[2024-11-28 01:00:04.997121] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:50.592 passed 00:05:50.592 Test: mem map translation ...[2024-11-28 01:00:05.017672] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:50.592 [2024-11-28 01:00:05.017694] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:50.592 [2024-11-28 01:00:05.017750] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:50.592 [2024-11-28 01:00:05.017763] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:50.592 passed 00:05:50.592 Test: mem map registration ...[2024-11-28 01:00:05.059622] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:50.592 [2024-11-28 01:00:05.059641] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:50.592 passed 00:05:50.592 Test: mem map adjacent registrations ...passed 00:05:50.592 00:05:50.592 Run Summary: Type Total Ran Passed Failed Inactive 00:05:50.592 suites 1 1 n/a 0 0 00:05:50.592 tests 4 4 4 0 0 00:05:50.592 asserts 152 152 152 0 n/a 00:05:50.592 00:05:50.592 Elapsed time = 0.145 seconds 00:05:50.592 00:05:50.592 real 0m0.153s 00:05:50.592 user 0m0.145s 00:05:50.592 sys 0m0.008s 00:05:50.592 01:00:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:50.592 01:00:05 -- common/autotest_common.sh@10 -- # set +x 00:05:50.592 ************************************ 00:05:50.592 END TEST env_memory 00:05:50.592 ************************************ 00:05:50.592 01:00:05 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:50.592 01:00:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:50.592 01:00:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:50.592 01:00:05 -- common/autotest_common.sh@10 -- # set +x 00:05:50.593 ************************************ 00:05:50.593 START TEST env_vtophys 00:05:50.593 ************************************ 00:05:50.593 01:00:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:50.593 EAL: lib.eal log level changed from notice to debug 00:05:50.593 EAL: Detected lcore 0 as core 0 on socket 0 00:05:50.593 EAL: Detected lcore 1 as core 1 on socket 0 00:05:50.593 EAL: Detected lcore 2 as core 2 on socket 0 00:05:50.593 EAL: Detected lcore 3 as core 3 on socket 0 00:05:50.593 EAL: Detected lcore 4 as core 4 on socket 0 00:05:50.593 EAL: Detected lcore 5 as core 5 on socket 0 00:05:50.593 EAL: Detected lcore 6 as core 8 on socket 0 00:05:50.593 EAL: Detected lcore 7 as core 9 on socket 0 00:05:50.593 EAL: Detected lcore 8 as core 10 on socket 0 00:05:50.593 EAL: Detected lcore 9 as core 11 on socket 0 00:05:50.593 EAL: Detected lcore 10 as core 12 on socket 0 00:05:50.593 EAL: Detected lcore 11 as core 13 on socket 0 00:05:50.593 EAL: Detected lcore 12 as core 0 on socket 1 00:05:50.593 EAL: Detected lcore 13 as core 1 on socket 1 00:05:50.593 EAL: Detected lcore 14 as core 2 on socket 1 00:05:50.593 EAL: Detected lcore 15 as core 3 on socket 1 00:05:50.593 EAL: Detected lcore 16 as core 4 on socket 1 00:05:50.593 EAL: Detected lcore 17 as core 5 on socket 1 00:05:50.593 EAL: Detected lcore 18 as core 8 on socket 1 00:05:50.593 EAL: Detected lcore 19 as core 9 on socket 1 00:05:50.593 EAL: Detected lcore 20 as core 10 on socket 1 00:05:50.593 EAL: Detected lcore 21 as core 11 on socket 1 00:05:50.593 EAL: Detected lcore 22 as core 12 on socket 1 00:05:50.593 EAL: Detected lcore 23 as core 13 on socket 1 00:05:50.593 EAL: Detected lcore 24 as core 0 on socket 0 00:05:50.593 EAL: Detected lcore 25 as core 1 on socket 0 00:05:50.593 EAL: Detected lcore 26 as core 2 on socket 0 00:05:50.593 EAL: Detected lcore 27 as core 3 on socket 0 00:05:50.593 EAL: Detected lcore 28 as core 4 on socket 0 00:05:50.593 EAL: Detected lcore 29 as core 5 on socket 0 00:05:50.593 EAL: Detected lcore 30 as core 8 on socket 0 00:05:50.593 EAL: Detected lcore 31 as core 9 on socket 0 00:05:50.593 EAL: Detected lcore 32 as core 10 on socket 0 00:05:50.593 EAL: Detected lcore 33 as core 11 on socket 0 00:05:50.593 EAL: Detected lcore 34 as core 12 on socket 0 00:05:50.593 EAL: Detected lcore 35 as core 13 on socket 0 00:05:50.593 EAL: Detected lcore 36 as core 0 on socket 1 00:05:50.593 EAL: Detected lcore 37 as core 1 on socket 1 00:05:50.593 EAL: Detected lcore 38 as core 2 on socket 1 00:05:50.593 EAL: Detected lcore 39 as core 3 on socket 1 00:05:50.593 EAL: Detected lcore 40 as core 4 on socket 1 00:05:50.593 EAL: Detected lcore 41 as core 5 on socket 1 00:05:50.593 EAL: Detected lcore 42 as core 8 on socket 1 00:05:50.593 EAL: Detected lcore 43 as core 9 on socket 1 00:05:50.593 EAL: Detected lcore 44 as core 10 on socket 1 00:05:50.593 EAL: Detected lcore 45 as core 11 on socket 1 00:05:50.593 EAL: Detected lcore 46 as core 12 on socket 1 00:05:50.593 EAL: Detected lcore 47 as core 13 on socket 1 00:05:50.593 EAL: Maximum logical cores by configuration: 128 00:05:50.593 EAL: Detected CPU lcores: 48 00:05:50.593 EAL: Detected NUMA nodes: 2 00:05:50.593 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:05:50.593 EAL: Detected shared linkage of DPDK 00:05:50.593 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so.24.0 00:05:50.593 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so.24.0 00:05:50.593 EAL: Registered [vdev] bus. 00:05:50.593 EAL: bus.vdev log level changed from disabled to notice 00:05:50.593 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so.24.0 00:05:50.593 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so.24.0 00:05:50.593 EAL: pmd.net.i40e.init log level changed from disabled to notice 00:05:50.593 EAL: pmd.net.i40e.driver log level changed from disabled to notice 00:05:50.593 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so 00:05:50.593 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so 00:05:50.593 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so 00:05:50.593 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so 00:05:50.593 EAL: No shared files mode enabled, IPC will be disabled 00:05:50.593 EAL: No shared files mode enabled, IPC is disabled 00:05:50.593 EAL: Bus pci wants IOVA as 'DC' 00:05:50.593 EAL: Bus vdev wants IOVA as 'DC' 00:05:50.593 EAL: Buses did not request a specific IOVA mode. 00:05:50.593 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:50.593 EAL: Selected IOVA mode 'VA' 00:05:50.593 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.593 EAL: Probing VFIO support... 00:05:50.593 EAL: IOMMU type 1 (Type 1) is supported 00:05:50.593 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:50.593 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:50.593 EAL: VFIO support initialized 00:05:50.593 EAL: Ask a virtual area of 0x2e000 bytes 00:05:50.593 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:50.593 EAL: Setting up physically contiguous memory... 00:05:50.593 EAL: Setting maximum number of open files to 524288 00:05:50.593 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:50.593 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:50.593 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:50.593 EAL: Ask a virtual area of 0x61000 bytes 00:05:50.593 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:50.593 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:50.593 EAL: Ask a virtual area of 0x400000000 bytes 00:05:50.593 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:50.593 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:50.593 EAL: Ask a virtual area of 0x61000 bytes 00:05:50.593 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:50.593 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:50.593 EAL: Ask a virtual area of 0x400000000 bytes 00:05:50.593 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:50.593 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:50.593 EAL: Ask a virtual area of 0x61000 bytes 00:05:50.593 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:50.593 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:50.593 EAL: Ask a virtual area of 0x400000000 bytes 00:05:50.593 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:50.593 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:50.593 EAL: Ask a virtual area of 0x61000 bytes 00:05:50.593 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:50.593 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:50.593 EAL: Ask a virtual area of 0x400000000 bytes 00:05:50.593 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:50.593 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:50.593 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:50.593 EAL: Ask a virtual area of 0x61000 bytes 00:05:50.593 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:50.593 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:50.593 EAL: Ask a virtual area of 0x400000000 bytes 00:05:50.593 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:50.594 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:50.594 EAL: Ask a virtual area of 0x61000 bytes 00:05:50.594 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:50.594 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:50.594 EAL: Ask a virtual area of 0x400000000 bytes 00:05:50.594 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:50.594 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:50.594 EAL: Ask a virtual area of 0x61000 bytes 00:05:50.594 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:50.594 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:50.594 EAL: Ask a virtual area of 0x400000000 bytes 00:05:50.594 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:50.594 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:50.594 EAL: Ask a virtual area of 0x61000 bytes 00:05:50.594 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:50.594 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:50.594 EAL: Ask a virtual area of 0x400000000 bytes 00:05:50.594 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:50.594 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:50.594 EAL: Hugepages will be freed exactly as allocated. 00:05:50.594 EAL: No shared files mode enabled, IPC is disabled 00:05:50.594 EAL: No shared files mode enabled, IPC is disabled 00:05:50.594 EAL: TSC frequency is ~2700000 KHz 00:05:50.594 EAL: Main lcore 0 is ready (tid=7fef1be61a00;cpuset=[0]) 00:05:50.594 EAL: Trying to obtain current memory policy. 00:05:50.594 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:50.594 EAL: Restoring previous memory policy: 0 00:05:50.594 EAL: request: mp_malloc_sync 00:05:50.594 EAL: No shared files mode enabled, IPC is disabled 00:05:50.594 EAL: Heap on socket 0 was expanded by 2MB 00:05:50.594 EAL: No shared files mode enabled, IPC is disabled 00:05:50.852 EAL: No shared files mode enabled, IPC is disabled 00:05:50.852 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:50.852 EAL: Mem event callback 'spdk:(nil)' registered 00:05:50.852 00:05:50.852 00:05:50.852 CUnit - A unit testing framework for C - Version 2.1-3 00:05:50.852 http://cunit.sourceforge.net/ 00:05:50.852 00:05:50.852 00:05:50.852 Suite: components_suite 00:05:50.852 Test: vtophys_malloc_test ...passed 00:05:50.852 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:50.852 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:50.852 EAL: Restoring previous memory policy: 4 00:05:50.852 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.852 EAL: request: mp_malloc_sync 00:05:50.852 EAL: No shared files mode enabled, IPC is disabled 00:05:50.852 EAL: Heap on socket 0 was expanded by 4MB 00:05:50.852 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.852 EAL: request: mp_malloc_sync 00:05:50.852 EAL: No shared files mode enabled, IPC is disabled 00:05:50.852 EAL: Heap on socket 0 was shrunk by 4MB 00:05:50.852 EAL: Trying to obtain current memory policy. 00:05:50.852 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:50.852 EAL: Restoring previous memory policy: 4 00:05:50.852 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.852 EAL: request: mp_malloc_sync 00:05:50.852 EAL: No shared files mode enabled, IPC is disabled 00:05:50.852 EAL: Heap on socket 0 was expanded by 6MB 00:05:50.852 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.852 EAL: request: mp_malloc_sync 00:05:50.852 EAL: No shared files mode enabled, IPC is disabled 00:05:50.852 EAL: Heap on socket 0 was shrunk by 6MB 00:05:50.852 EAL: Trying to obtain current memory policy. 00:05:50.852 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:50.852 EAL: Restoring previous memory policy: 4 00:05:50.852 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.852 EAL: request: mp_malloc_sync 00:05:50.852 EAL: No shared files mode enabled, IPC is disabled 00:05:50.852 EAL: Heap on socket 0 was expanded by 10MB 00:05:50.852 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.852 EAL: request: mp_malloc_sync 00:05:50.852 EAL: No shared files mode enabled, IPC is disabled 00:05:50.852 EAL: Heap on socket 0 was shrunk by 10MB 00:05:50.852 EAL: Trying to obtain current memory policy. 00:05:50.852 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:50.852 EAL: Restoring previous memory policy: 4 00:05:50.852 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.852 EAL: request: mp_malloc_sync 00:05:50.852 EAL: No shared files mode enabled, IPC is disabled 00:05:50.852 EAL: Heap on socket 0 was expanded by 18MB 00:05:50.852 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.852 EAL: request: mp_malloc_sync 00:05:50.852 EAL: No shared files mode enabled, IPC is disabled 00:05:50.852 EAL: Heap on socket 0 was shrunk by 18MB 00:05:50.852 EAL: Trying to obtain current memory policy. 00:05:50.852 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:50.852 EAL: Restoring previous memory policy: 4 00:05:50.852 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.852 EAL: request: mp_malloc_sync 00:05:50.852 EAL: No shared files mode enabled, IPC is disabled 00:05:50.852 EAL: Heap on socket 0 was expanded by 34MB 00:05:50.852 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.852 EAL: request: mp_malloc_sync 00:05:50.852 EAL: No shared files mode enabled, IPC is disabled 00:05:50.852 EAL: Heap on socket 0 was shrunk by 34MB 00:05:50.852 EAL: Trying to obtain current memory policy. 00:05:50.852 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:50.852 EAL: Restoring previous memory policy: 4 00:05:50.852 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.852 EAL: request: mp_malloc_sync 00:05:50.852 EAL: No shared files mode enabled, IPC is disabled 00:05:50.852 EAL: Heap on socket 0 was expanded by 66MB 00:05:50.852 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.852 EAL: request: mp_malloc_sync 00:05:50.852 EAL: No shared files mode enabled, IPC is disabled 00:05:50.852 EAL: Heap on socket 0 was shrunk by 66MB 00:05:50.852 EAL: Trying to obtain current memory policy. 00:05:50.852 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:50.852 EAL: Restoring previous memory policy: 4 00:05:50.852 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.852 EAL: request: mp_malloc_sync 00:05:50.852 EAL: No shared files mode enabled, IPC is disabled 00:05:50.852 EAL: Heap on socket 0 was expanded by 130MB 00:05:50.852 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.852 EAL: request: mp_malloc_sync 00:05:50.852 EAL: No shared files mode enabled, IPC is disabled 00:05:50.852 EAL: Heap on socket 0 was shrunk by 130MB 00:05:50.852 EAL: Trying to obtain current memory policy. 00:05:50.852 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:50.852 EAL: Restoring previous memory policy: 4 00:05:50.852 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.852 EAL: request: mp_malloc_sync 00:05:50.852 EAL: No shared files mode enabled, IPC is disabled 00:05:50.852 EAL: Heap on socket 0 was expanded by 258MB 00:05:51.110 EAL: Calling mem event callback 'spdk:(nil)' 00:05:51.110 EAL: request: mp_malloc_sync 00:05:51.110 EAL: No shared files mode enabled, IPC is disabled 00:05:51.110 EAL: Heap on socket 0 was shrunk by 258MB 00:05:51.110 EAL: Trying to obtain current memory policy. 00:05:51.110 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:51.110 EAL: Restoring previous memory policy: 4 00:05:51.110 EAL: Calling mem event callback 'spdk:(nil)' 00:05:51.110 EAL: request: mp_malloc_sync 00:05:51.110 EAL: No shared files mode enabled, IPC is disabled 00:05:51.110 EAL: Heap on socket 0 was expanded by 514MB 00:05:51.368 EAL: Calling mem event callback 'spdk:(nil)' 00:05:51.368 EAL: request: mp_malloc_sync 00:05:51.368 EAL: No shared files mode enabled, IPC is disabled 00:05:51.368 EAL: Heap on socket 0 was shrunk by 514MB 00:05:51.368 EAL: Trying to obtain current memory policy. 00:05:51.368 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:51.626 EAL: Restoring previous memory policy: 4 00:05:51.626 EAL: Calling mem event callback 'spdk:(nil)' 00:05:51.626 EAL: request: mp_malloc_sync 00:05:51.626 EAL: No shared files mode enabled, IPC is disabled 00:05:51.626 EAL: Heap on socket 0 was expanded by 1026MB 00:05:51.884 EAL: Calling mem event callback 'spdk:(nil)' 00:05:52.142 EAL: request: mp_malloc_sync 00:05:52.142 EAL: No shared files mode enabled, IPC is disabled 00:05:52.142 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:52.142 passed 00:05:52.142 00:05:52.142 Run Summary: Type Total Ran Passed Failed Inactive 00:05:52.142 suites 1 1 n/a 0 0 00:05:52.143 tests 2 2 2 0 0 00:05:52.143 asserts 497 497 497 0 n/a 00:05:52.143 00:05:52.143 Elapsed time = 1.385 seconds 00:05:52.143 EAL: Calling mem event callback 'spdk:(nil)' 00:05:52.143 EAL: request: mp_malloc_sync 00:05:52.143 EAL: No shared files mode enabled, IPC is disabled 00:05:52.143 EAL: Heap on socket 0 was shrunk by 2MB 00:05:52.143 EAL: No shared files mode enabled, IPC is disabled 00:05:52.143 EAL: No shared files mode enabled, IPC is disabled 00:05:52.143 EAL: No shared files mode enabled, IPC is disabled 00:05:52.143 00:05:52.143 real 0m1.497s 00:05:52.143 user 0m0.866s 00:05:52.143 sys 0m0.600s 00:05:52.143 01:00:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:52.143 01:00:06 -- common/autotest_common.sh@10 -- # set +x 00:05:52.143 ************************************ 00:05:52.143 END TEST env_vtophys 00:05:52.143 ************************************ 00:05:52.143 01:00:06 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:52.143 01:00:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:52.143 01:00:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.143 01:00:06 -- common/autotest_common.sh@10 -- # set +x 00:05:52.143 ************************************ 00:05:52.143 START TEST env_pci 00:05:52.143 ************************************ 00:05:52.143 01:00:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:52.143 00:05:52.143 00:05:52.143 CUnit - A unit testing framework for C - Version 2.1-3 00:05:52.143 http://cunit.sourceforge.net/ 00:05:52.143 00:05:52.143 00:05:52.143 Suite: pci 00:05:52.143 Test: pci_hook ...[2024-11-28 01:00:06.675742] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 1909158 has claimed it 00:05:52.143 EAL: Cannot find device (10000:00:01.0) 00:05:52.143 EAL: Failed to attach device on primary process 00:05:52.143 passed 00:05:52.143 00:05:52.143 Run Summary: Type Total Ran Passed Failed Inactive 00:05:52.143 suites 1 1 n/a 0 0 00:05:52.143 tests 1 1 1 0 0 00:05:52.143 asserts 25 25 25 0 n/a 00:05:52.143 00:05:52.143 Elapsed time = 0.019 seconds 00:05:52.143 00:05:52.143 real 0m0.029s 00:05:52.143 user 0m0.009s 00:05:52.143 sys 0m0.020s 00:05:52.143 01:00:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:52.143 01:00:06 -- common/autotest_common.sh@10 -- # set +x 00:05:52.143 ************************************ 00:05:52.143 END TEST env_pci 00:05:52.143 ************************************ 00:05:52.143 01:00:06 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:52.143 01:00:06 -- env/env.sh@15 -- # uname 00:05:52.143 01:00:06 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:52.143 01:00:06 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:52.143 01:00:06 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:52.143 01:00:06 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:05:52.143 01:00:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.143 01:00:06 -- common/autotest_common.sh@10 -- # set +x 00:05:52.143 ************************************ 00:05:52.143 START TEST env_dpdk_post_init 00:05:52.143 ************************************ 00:05:52.143 01:00:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:52.402 EAL: Detected CPU lcores: 48 00:05:52.402 EAL: Detected NUMA nodes: 2 00:05:52.402 EAL: Detected shared linkage of DPDK 00:05:52.402 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:52.402 EAL: Selected IOVA mode 'VA' 00:05:52.402 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.402 EAL: VFIO support initialized 00:05:52.402 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:52.402 EAL: Using IOMMU type 1 (Type 1) 00:05:52.402 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:05:52.402 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:05:52.402 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:05:52.402 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:05:52.402 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:05:52.402 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:05:52.402 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:05:52.402 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:05:52.402 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:05:52.402 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:05:52.402 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:05:52.402 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:05:52.402 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:05:52.402 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:05:52.662 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:05:52.662 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:05:53.227 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:05:56.507 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:05:56.507 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:05:56.507 Starting DPDK initialization... 00:05:56.507 Starting SPDK post initialization... 00:05:56.507 SPDK NVMe probe 00:05:56.507 Attaching to 0000:88:00.0 00:05:56.507 Attached to 0000:88:00.0 00:05:56.507 Cleaning up... 00:05:56.507 00:05:56.507 real 0m4.384s 00:05:56.507 user 0m3.271s 00:05:56.507 sys 0m0.172s 00:05:56.507 01:00:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:56.507 01:00:11 -- common/autotest_common.sh@10 -- # set +x 00:05:56.507 ************************************ 00:05:56.507 END TEST env_dpdk_post_init 00:05:56.507 ************************************ 00:05:56.766 01:00:11 -- env/env.sh@26 -- # uname 00:05:56.766 01:00:11 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:56.766 01:00:11 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:56.766 01:00:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:56.766 01:00:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:56.766 01:00:11 -- common/autotest_common.sh@10 -- # set +x 00:05:56.766 ************************************ 00:05:56.766 START TEST env_mem_callbacks 00:05:56.766 ************************************ 00:05:56.766 01:00:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:56.766 EAL: Detected CPU lcores: 48 00:05:56.766 EAL: Detected NUMA nodes: 2 00:05:56.766 EAL: Detected shared linkage of DPDK 00:05:56.766 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:56.766 EAL: Selected IOVA mode 'VA' 00:05:56.766 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.766 EAL: VFIO support initialized 00:05:56.766 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:56.766 00:05:56.766 00:05:56.766 CUnit - A unit testing framework for C - Version 2.1-3 00:05:56.766 http://cunit.sourceforge.net/ 00:05:56.766 00:05:56.766 00:05:56.766 Suite: memory 00:05:56.766 Test: test ... 00:05:56.766 register 0x200000200000 2097152 00:05:56.766 malloc 3145728 00:05:56.766 register 0x200000400000 4194304 00:05:56.766 buf 0x200000500000 len 3145728 PASSED 00:05:56.766 malloc 64 00:05:56.766 buf 0x2000004fff40 len 64 PASSED 00:05:56.766 malloc 4194304 00:05:56.766 register 0x200000800000 6291456 00:05:56.766 buf 0x200000a00000 len 4194304 PASSED 00:05:56.766 free 0x200000500000 3145728 00:05:56.766 free 0x2000004fff40 64 00:05:56.766 unregister 0x200000400000 4194304 PASSED 00:05:56.766 free 0x200000a00000 4194304 00:05:56.766 unregister 0x200000800000 6291456 PASSED 00:05:56.766 malloc 8388608 00:05:56.766 register 0x200000400000 10485760 00:05:56.766 buf 0x200000600000 len 8388608 PASSED 00:05:56.766 free 0x200000600000 8388608 00:05:56.766 unregister 0x200000400000 10485760 PASSED 00:05:56.766 passed 00:05:56.766 00:05:56.766 Run Summary: Type Total Ran Passed Failed Inactive 00:05:56.766 suites 1 1 n/a 0 0 00:05:56.766 tests 1 1 1 0 0 00:05:56.766 asserts 15 15 15 0 n/a 00:05:56.766 00:05:56.766 Elapsed time = 0.005 seconds 00:05:56.766 00:05:56.766 real 0m0.050s 00:05:56.766 user 0m0.012s 00:05:56.766 sys 0m0.038s 00:05:56.766 01:00:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:56.766 01:00:11 -- common/autotest_common.sh@10 -- # set +x 00:05:56.766 ************************************ 00:05:56.766 END TEST env_mem_callbacks 00:05:56.766 ************************************ 00:05:56.766 00:05:56.766 real 0m6.393s 00:05:56.766 user 0m4.464s 00:05:56.766 sys 0m0.986s 00:05:56.766 01:00:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:56.766 01:00:11 -- common/autotest_common.sh@10 -- # set +x 00:05:56.766 ************************************ 00:05:56.766 END TEST env 00:05:56.766 ************************************ 00:05:56.766 01:00:11 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:56.766 01:00:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:56.766 01:00:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:56.766 01:00:11 -- common/autotest_common.sh@10 -- # set +x 00:05:56.766 ************************************ 00:05:56.766 START TEST rpc 00:05:56.766 ************************************ 00:05:56.767 01:00:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:56.767 * Looking for test storage... 00:05:56.767 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:56.767 01:00:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:56.767 01:00:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:56.767 01:00:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:56.767 01:00:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:56.767 01:00:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:56.767 01:00:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:56.767 01:00:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:56.767 01:00:11 -- scripts/common.sh@335 -- # IFS=.-: 00:05:56.767 01:00:11 -- scripts/common.sh@335 -- # read -ra ver1 00:05:56.767 01:00:11 -- scripts/common.sh@336 -- # IFS=.-: 00:05:56.767 01:00:11 -- scripts/common.sh@336 -- # read -ra ver2 00:05:56.767 01:00:11 -- scripts/common.sh@337 -- # local 'op=<' 00:05:56.767 01:00:11 -- scripts/common.sh@339 -- # ver1_l=2 00:05:56.767 01:00:11 -- scripts/common.sh@340 -- # ver2_l=1 00:05:56.767 01:00:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:56.767 01:00:11 -- scripts/common.sh@343 -- # case "$op" in 00:05:56.767 01:00:11 -- scripts/common.sh@344 -- # : 1 00:05:56.767 01:00:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:56.767 01:00:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:56.767 01:00:11 -- scripts/common.sh@364 -- # decimal 1 00:05:56.767 01:00:11 -- scripts/common.sh@352 -- # local d=1 00:05:56.767 01:00:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:56.767 01:00:11 -- scripts/common.sh@354 -- # echo 1 00:05:56.767 01:00:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:56.767 01:00:11 -- scripts/common.sh@365 -- # decimal 2 00:05:56.767 01:00:11 -- scripts/common.sh@352 -- # local d=2 00:05:56.767 01:00:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:56.767 01:00:11 -- scripts/common.sh@354 -- # echo 2 00:05:56.767 01:00:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:56.767 01:00:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:56.767 01:00:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:56.767 01:00:11 -- scripts/common.sh@367 -- # return 0 00:05:56.767 01:00:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:56.767 01:00:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:56.767 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.767 --rc genhtml_branch_coverage=1 00:05:56.767 --rc genhtml_function_coverage=1 00:05:56.767 --rc genhtml_legend=1 00:05:56.767 --rc geninfo_all_blocks=1 00:05:56.767 --rc geninfo_unexecuted_blocks=1 00:05:56.767 00:05:56.767 ' 00:05:56.767 01:00:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:56.767 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.767 --rc genhtml_branch_coverage=1 00:05:56.767 --rc genhtml_function_coverage=1 00:05:56.767 --rc genhtml_legend=1 00:05:56.767 --rc geninfo_all_blocks=1 00:05:56.767 --rc geninfo_unexecuted_blocks=1 00:05:56.767 00:05:56.767 ' 00:05:56.767 01:00:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:56.767 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.767 --rc genhtml_branch_coverage=1 00:05:56.767 --rc genhtml_function_coverage=1 00:05:56.767 --rc genhtml_legend=1 00:05:56.767 --rc geninfo_all_blocks=1 00:05:56.767 --rc geninfo_unexecuted_blocks=1 00:05:56.767 00:05:56.767 ' 00:05:56.767 01:00:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:56.767 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.767 --rc genhtml_branch_coverage=1 00:05:56.767 --rc genhtml_function_coverage=1 00:05:56.767 --rc genhtml_legend=1 00:05:56.767 --rc geninfo_all_blocks=1 00:05:56.767 --rc geninfo_unexecuted_blocks=1 00:05:56.767 00:05:56.767 ' 00:05:56.767 01:00:11 -- rpc/rpc.sh@65 -- # spdk_pid=1910342 00:05:56.767 01:00:11 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:56.767 01:00:11 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:56.767 01:00:11 -- rpc/rpc.sh@67 -- # waitforlisten 1910342 00:05:56.767 01:00:11 -- common/autotest_common.sh@829 -- # '[' -z 1910342 ']' 00:05:56.767 01:00:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:56.767 01:00:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:56.767 01:00:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:56.767 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:56.767 01:00:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:56.767 01:00:11 -- common/autotest_common.sh@10 -- # set +x 00:05:57.025 [2024-11-28 01:00:11.415149] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:57.025 [2024-11-28 01:00:11.415232] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1910342 ] 00:05:57.025 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.025 [2024-11-28 01:00:11.474718] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.025 [2024-11-28 01:00:11.563312] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:57.025 [2024-11-28 01:00:11.563482] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:57.025 [2024-11-28 01:00:11.563498] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 1910342' to capture a snapshot of events at runtime. 00:05:57.025 [2024-11-28 01:00:11.563535] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid1910342 for offline analysis/debug. 00:05:57.025 [2024-11-28 01:00:11.563578] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.961 01:00:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:57.961 01:00:12 -- common/autotest_common.sh@862 -- # return 0 00:05:57.961 01:00:12 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:57.961 01:00:12 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:57.961 01:00:12 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:57.961 01:00:12 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:57.961 01:00:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:57.961 01:00:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:57.961 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:57.961 ************************************ 00:05:57.961 START TEST rpc_integrity 00:05:57.961 ************************************ 00:05:57.961 01:00:12 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:57.961 01:00:12 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:57.961 01:00:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.961 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:57.961 01:00:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.961 01:00:12 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:57.961 01:00:12 -- rpc/rpc.sh@13 -- # jq length 00:05:57.961 01:00:12 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:57.961 01:00:12 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:57.961 01:00:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.961 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:57.961 01:00:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.961 01:00:12 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:57.961 01:00:12 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:57.961 01:00:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.961 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:57.961 01:00:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.961 01:00:12 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:57.961 { 00:05:57.961 "name": "Malloc0", 00:05:57.961 "aliases": [ 00:05:57.961 "721a377f-5cfe-4635-810e-b081da2473fd" 00:05:57.961 ], 00:05:57.961 "product_name": "Malloc disk", 00:05:57.961 "block_size": 512, 00:05:57.961 "num_blocks": 16384, 00:05:57.961 "uuid": "721a377f-5cfe-4635-810e-b081da2473fd", 00:05:57.961 "assigned_rate_limits": { 00:05:57.961 "rw_ios_per_sec": 0, 00:05:57.961 "rw_mbytes_per_sec": 0, 00:05:57.961 "r_mbytes_per_sec": 0, 00:05:57.961 "w_mbytes_per_sec": 0 00:05:57.961 }, 00:05:57.961 "claimed": false, 00:05:57.961 "zoned": false, 00:05:57.961 "supported_io_types": { 00:05:57.961 "read": true, 00:05:57.961 "write": true, 00:05:57.961 "unmap": true, 00:05:57.961 "write_zeroes": true, 00:05:57.961 "flush": true, 00:05:57.961 "reset": true, 00:05:57.961 "compare": false, 00:05:57.961 "compare_and_write": false, 00:05:57.961 "abort": true, 00:05:57.961 "nvme_admin": false, 00:05:57.961 "nvme_io": false 00:05:57.961 }, 00:05:57.961 "memory_domains": [ 00:05:57.961 { 00:05:57.961 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:57.961 "dma_device_type": 2 00:05:57.961 } 00:05:57.961 ], 00:05:57.961 "driver_specific": {} 00:05:57.961 } 00:05:57.961 ]' 00:05:57.961 01:00:12 -- rpc/rpc.sh@17 -- # jq length 00:05:57.961 01:00:12 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:57.961 01:00:12 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:57.961 01:00:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.961 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:57.961 [2024-11-28 01:00:12.482627] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:57.961 [2024-11-28 01:00:12.482674] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:57.961 [2024-11-28 01:00:12.482697] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x83ebf0 00:05:57.961 [2024-11-28 01:00:12.482711] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:57.961 [2024-11-28 01:00:12.484204] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:57.961 [2024-11-28 01:00:12.484232] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:57.961 Passthru0 00:05:57.961 01:00:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.961 01:00:12 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:57.961 01:00:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.961 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:57.961 01:00:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.961 01:00:12 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:57.961 { 00:05:57.961 "name": "Malloc0", 00:05:57.961 "aliases": [ 00:05:57.961 "721a377f-5cfe-4635-810e-b081da2473fd" 00:05:57.961 ], 00:05:57.961 "product_name": "Malloc disk", 00:05:57.961 "block_size": 512, 00:05:57.961 "num_blocks": 16384, 00:05:57.961 "uuid": "721a377f-5cfe-4635-810e-b081da2473fd", 00:05:57.961 "assigned_rate_limits": { 00:05:57.961 "rw_ios_per_sec": 0, 00:05:57.961 "rw_mbytes_per_sec": 0, 00:05:57.961 "r_mbytes_per_sec": 0, 00:05:57.961 "w_mbytes_per_sec": 0 00:05:57.961 }, 00:05:57.961 "claimed": true, 00:05:57.961 "claim_type": "exclusive_write", 00:05:57.961 "zoned": false, 00:05:57.961 "supported_io_types": { 00:05:57.961 "read": true, 00:05:57.961 "write": true, 00:05:57.961 "unmap": true, 00:05:57.961 "write_zeroes": true, 00:05:57.961 "flush": true, 00:05:57.961 "reset": true, 00:05:57.961 "compare": false, 00:05:57.961 "compare_and_write": false, 00:05:57.961 "abort": true, 00:05:57.961 "nvme_admin": false, 00:05:57.961 "nvme_io": false 00:05:57.961 }, 00:05:57.961 "memory_domains": [ 00:05:57.961 { 00:05:57.961 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:57.961 "dma_device_type": 2 00:05:57.961 } 00:05:57.961 ], 00:05:57.961 "driver_specific": {} 00:05:57.961 }, 00:05:57.961 { 00:05:57.961 "name": "Passthru0", 00:05:57.961 "aliases": [ 00:05:57.961 "844f9d9c-1184-5bee-9acb-39168cf3ca61" 00:05:57.961 ], 00:05:57.961 "product_name": "passthru", 00:05:57.961 "block_size": 512, 00:05:57.961 "num_blocks": 16384, 00:05:57.961 "uuid": "844f9d9c-1184-5bee-9acb-39168cf3ca61", 00:05:57.962 "assigned_rate_limits": { 00:05:57.962 "rw_ios_per_sec": 0, 00:05:57.962 "rw_mbytes_per_sec": 0, 00:05:57.962 "r_mbytes_per_sec": 0, 00:05:57.962 "w_mbytes_per_sec": 0 00:05:57.962 }, 00:05:57.962 "claimed": false, 00:05:57.962 "zoned": false, 00:05:57.962 "supported_io_types": { 00:05:57.962 "read": true, 00:05:57.962 "write": true, 00:05:57.962 "unmap": true, 00:05:57.962 "write_zeroes": true, 00:05:57.962 "flush": true, 00:05:57.962 "reset": true, 00:05:57.962 "compare": false, 00:05:57.962 "compare_and_write": false, 00:05:57.962 "abort": true, 00:05:57.962 "nvme_admin": false, 00:05:57.962 "nvme_io": false 00:05:57.962 }, 00:05:57.962 "memory_domains": [ 00:05:57.962 { 00:05:57.962 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:57.962 "dma_device_type": 2 00:05:57.962 } 00:05:57.962 ], 00:05:57.962 "driver_specific": { 00:05:57.962 "passthru": { 00:05:57.962 "name": "Passthru0", 00:05:57.962 "base_bdev_name": "Malloc0" 00:05:57.962 } 00:05:57.962 } 00:05:57.962 } 00:05:57.962 ]' 00:05:57.962 01:00:12 -- rpc/rpc.sh@21 -- # jq length 00:05:57.962 01:00:12 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:57.962 01:00:12 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:57.962 01:00:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.962 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:57.962 01:00:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.962 01:00:12 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:57.962 01:00:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.962 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:57.962 01:00:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.962 01:00:12 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:57.962 01:00:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.962 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:58.220 01:00:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:58.220 01:00:12 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:58.220 01:00:12 -- rpc/rpc.sh@26 -- # jq length 00:05:58.220 01:00:12 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:58.220 00:05:58.220 real 0m0.228s 00:05:58.220 user 0m0.143s 00:05:58.220 sys 0m0.024s 00:05:58.220 01:00:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:58.220 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:58.220 ************************************ 00:05:58.220 END TEST rpc_integrity 00:05:58.220 ************************************ 00:05:58.220 01:00:12 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:58.220 01:00:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:58.220 01:00:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:58.220 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:58.220 ************************************ 00:05:58.220 START TEST rpc_plugins 00:05:58.220 ************************************ 00:05:58.220 01:00:12 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:05:58.220 01:00:12 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:58.220 01:00:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:58.220 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:58.220 01:00:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:58.220 01:00:12 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:58.220 01:00:12 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:58.220 01:00:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:58.220 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:58.220 01:00:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:58.220 01:00:12 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:58.220 { 00:05:58.220 "name": "Malloc1", 00:05:58.220 "aliases": [ 00:05:58.220 "e029e906-af3a-4778-a9be-f2f1df1c15a2" 00:05:58.220 ], 00:05:58.220 "product_name": "Malloc disk", 00:05:58.220 "block_size": 4096, 00:05:58.220 "num_blocks": 256, 00:05:58.220 "uuid": "e029e906-af3a-4778-a9be-f2f1df1c15a2", 00:05:58.220 "assigned_rate_limits": { 00:05:58.220 "rw_ios_per_sec": 0, 00:05:58.220 "rw_mbytes_per_sec": 0, 00:05:58.220 "r_mbytes_per_sec": 0, 00:05:58.220 "w_mbytes_per_sec": 0 00:05:58.220 }, 00:05:58.220 "claimed": false, 00:05:58.220 "zoned": false, 00:05:58.220 "supported_io_types": { 00:05:58.220 "read": true, 00:05:58.220 "write": true, 00:05:58.220 "unmap": true, 00:05:58.220 "write_zeroes": true, 00:05:58.220 "flush": true, 00:05:58.220 "reset": true, 00:05:58.220 "compare": false, 00:05:58.220 "compare_and_write": false, 00:05:58.220 "abort": true, 00:05:58.220 "nvme_admin": false, 00:05:58.220 "nvme_io": false 00:05:58.220 }, 00:05:58.220 "memory_domains": [ 00:05:58.220 { 00:05:58.220 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:58.220 "dma_device_type": 2 00:05:58.220 } 00:05:58.220 ], 00:05:58.220 "driver_specific": {} 00:05:58.220 } 00:05:58.220 ]' 00:05:58.220 01:00:12 -- rpc/rpc.sh@32 -- # jq length 00:05:58.220 01:00:12 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:58.220 01:00:12 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:58.220 01:00:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:58.220 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:58.220 01:00:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:58.220 01:00:12 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:58.220 01:00:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:58.220 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:58.220 01:00:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:58.220 01:00:12 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:58.220 01:00:12 -- rpc/rpc.sh@36 -- # jq length 00:05:58.220 01:00:12 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:58.220 00:05:58.220 real 0m0.113s 00:05:58.220 user 0m0.078s 00:05:58.220 sys 0m0.007s 00:05:58.220 01:00:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:58.221 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:58.221 ************************************ 00:05:58.221 END TEST rpc_plugins 00:05:58.221 ************************************ 00:05:58.221 01:00:12 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:58.221 01:00:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:58.221 01:00:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:58.221 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:58.221 ************************************ 00:05:58.221 START TEST rpc_trace_cmd_test 00:05:58.221 ************************************ 00:05:58.221 01:00:12 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:05:58.221 01:00:12 -- rpc/rpc.sh@40 -- # local info 00:05:58.221 01:00:12 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:58.221 01:00:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:58.221 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:58.221 01:00:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:58.221 01:00:12 -- rpc/rpc.sh@42 -- # info='{ 00:05:58.221 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid1910342", 00:05:58.221 "tpoint_group_mask": "0x8", 00:05:58.221 "iscsi_conn": { 00:05:58.221 "mask": "0x2", 00:05:58.221 "tpoint_mask": "0x0" 00:05:58.221 }, 00:05:58.221 "scsi": { 00:05:58.221 "mask": "0x4", 00:05:58.221 "tpoint_mask": "0x0" 00:05:58.221 }, 00:05:58.221 "bdev": { 00:05:58.221 "mask": "0x8", 00:05:58.221 "tpoint_mask": "0xffffffffffffffff" 00:05:58.221 }, 00:05:58.221 "nvmf_rdma": { 00:05:58.221 "mask": "0x10", 00:05:58.221 "tpoint_mask": "0x0" 00:05:58.221 }, 00:05:58.221 "nvmf_tcp": { 00:05:58.221 "mask": "0x20", 00:05:58.221 "tpoint_mask": "0x0" 00:05:58.221 }, 00:05:58.221 "ftl": { 00:05:58.221 "mask": "0x40", 00:05:58.221 "tpoint_mask": "0x0" 00:05:58.221 }, 00:05:58.221 "blobfs": { 00:05:58.221 "mask": "0x80", 00:05:58.221 "tpoint_mask": "0x0" 00:05:58.221 }, 00:05:58.221 "dsa": { 00:05:58.221 "mask": "0x200", 00:05:58.221 "tpoint_mask": "0x0" 00:05:58.221 }, 00:05:58.221 "thread": { 00:05:58.221 "mask": "0x400", 00:05:58.221 "tpoint_mask": "0x0" 00:05:58.221 }, 00:05:58.221 "nvme_pcie": { 00:05:58.221 "mask": "0x800", 00:05:58.221 "tpoint_mask": "0x0" 00:05:58.221 }, 00:05:58.221 "iaa": { 00:05:58.221 "mask": "0x1000", 00:05:58.221 "tpoint_mask": "0x0" 00:05:58.221 }, 00:05:58.221 "nvme_tcp": { 00:05:58.221 "mask": "0x2000", 00:05:58.221 "tpoint_mask": "0x0" 00:05:58.221 }, 00:05:58.221 "bdev_nvme": { 00:05:58.221 "mask": "0x4000", 00:05:58.221 "tpoint_mask": "0x0" 00:05:58.221 } 00:05:58.221 }' 00:05:58.221 01:00:12 -- rpc/rpc.sh@43 -- # jq length 00:05:58.221 01:00:12 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:05:58.221 01:00:12 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:58.479 01:00:12 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:58.479 01:00:12 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:58.479 01:00:12 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:58.479 01:00:12 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:58.479 01:00:12 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:58.479 01:00:12 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:58.479 01:00:12 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:58.479 00:05:58.479 real 0m0.187s 00:05:58.479 user 0m0.164s 00:05:58.479 sys 0m0.018s 00:05:58.479 01:00:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:58.479 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:58.479 ************************************ 00:05:58.479 END TEST rpc_trace_cmd_test 00:05:58.479 ************************************ 00:05:58.479 01:00:12 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:58.480 01:00:12 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:58.480 01:00:12 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:58.480 01:00:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:58.480 01:00:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:58.480 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:58.480 ************************************ 00:05:58.480 START TEST rpc_daemon_integrity 00:05:58.480 ************************************ 00:05:58.480 01:00:12 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:58.480 01:00:12 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:58.480 01:00:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:58.480 01:00:12 -- common/autotest_common.sh@10 -- # set +x 00:05:58.480 01:00:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:58.480 01:00:12 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:58.480 01:00:12 -- rpc/rpc.sh@13 -- # jq length 00:05:58.480 01:00:13 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:58.480 01:00:13 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:58.480 01:00:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:58.480 01:00:13 -- common/autotest_common.sh@10 -- # set +x 00:05:58.480 01:00:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:58.480 01:00:13 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:58.480 01:00:13 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:58.480 01:00:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:58.480 01:00:13 -- common/autotest_common.sh@10 -- # set +x 00:05:58.480 01:00:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:58.480 01:00:13 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:58.480 { 00:05:58.480 "name": "Malloc2", 00:05:58.480 "aliases": [ 00:05:58.480 "ac3e3e87-adee-494e-8b77-b27b4d9dceee" 00:05:58.480 ], 00:05:58.480 "product_name": "Malloc disk", 00:05:58.480 "block_size": 512, 00:05:58.480 "num_blocks": 16384, 00:05:58.480 "uuid": "ac3e3e87-adee-494e-8b77-b27b4d9dceee", 00:05:58.480 "assigned_rate_limits": { 00:05:58.480 "rw_ios_per_sec": 0, 00:05:58.480 "rw_mbytes_per_sec": 0, 00:05:58.480 "r_mbytes_per_sec": 0, 00:05:58.480 "w_mbytes_per_sec": 0 00:05:58.480 }, 00:05:58.480 "claimed": false, 00:05:58.480 "zoned": false, 00:05:58.480 "supported_io_types": { 00:05:58.480 "read": true, 00:05:58.480 "write": true, 00:05:58.480 "unmap": true, 00:05:58.480 "write_zeroes": true, 00:05:58.480 "flush": true, 00:05:58.480 "reset": true, 00:05:58.480 "compare": false, 00:05:58.480 "compare_and_write": false, 00:05:58.480 "abort": true, 00:05:58.480 "nvme_admin": false, 00:05:58.480 "nvme_io": false 00:05:58.480 }, 00:05:58.480 "memory_domains": [ 00:05:58.480 { 00:05:58.480 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:58.480 "dma_device_type": 2 00:05:58.480 } 00:05:58.480 ], 00:05:58.480 "driver_specific": {} 00:05:58.480 } 00:05:58.480 ]' 00:05:58.480 01:00:13 -- rpc/rpc.sh@17 -- # jq length 00:05:58.738 01:00:13 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:58.738 01:00:13 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:58.738 01:00:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:58.738 01:00:13 -- common/autotest_common.sh@10 -- # set +x 00:05:58.738 [2024-11-28 01:00:13.088349] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:58.738 [2024-11-28 01:00:13.088397] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:58.738 [2024-11-28 01:00:13.088422] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x9de940 00:05:58.738 [2024-11-28 01:00:13.088438] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:58.738 [2024-11-28 01:00:13.089796] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:58.738 [2024-11-28 01:00:13.089838] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:58.738 Passthru0 00:05:58.738 01:00:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:58.738 01:00:13 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:58.738 01:00:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:58.738 01:00:13 -- common/autotest_common.sh@10 -- # set +x 00:05:58.738 01:00:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:58.738 01:00:13 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:58.738 { 00:05:58.738 "name": "Malloc2", 00:05:58.738 "aliases": [ 00:05:58.738 "ac3e3e87-adee-494e-8b77-b27b4d9dceee" 00:05:58.738 ], 00:05:58.738 "product_name": "Malloc disk", 00:05:58.738 "block_size": 512, 00:05:58.738 "num_blocks": 16384, 00:05:58.738 "uuid": "ac3e3e87-adee-494e-8b77-b27b4d9dceee", 00:05:58.738 "assigned_rate_limits": { 00:05:58.738 "rw_ios_per_sec": 0, 00:05:58.738 "rw_mbytes_per_sec": 0, 00:05:58.738 "r_mbytes_per_sec": 0, 00:05:58.738 "w_mbytes_per_sec": 0 00:05:58.738 }, 00:05:58.738 "claimed": true, 00:05:58.738 "claim_type": "exclusive_write", 00:05:58.738 "zoned": false, 00:05:58.739 "supported_io_types": { 00:05:58.739 "read": true, 00:05:58.739 "write": true, 00:05:58.739 "unmap": true, 00:05:58.739 "write_zeroes": true, 00:05:58.739 "flush": true, 00:05:58.739 "reset": true, 00:05:58.739 "compare": false, 00:05:58.739 "compare_and_write": false, 00:05:58.739 "abort": true, 00:05:58.739 "nvme_admin": false, 00:05:58.739 "nvme_io": false 00:05:58.739 }, 00:05:58.739 "memory_domains": [ 00:05:58.739 { 00:05:58.739 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:58.739 "dma_device_type": 2 00:05:58.739 } 00:05:58.739 ], 00:05:58.739 "driver_specific": {} 00:05:58.739 }, 00:05:58.739 { 00:05:58.739 "name": "Passthru0", 00:05:58.739 "aliases": [ 00:05:58.739 "9a8d1815-74b9-513e-b3b8-f6b90a95ddf3" 00:05:58.739 ], 00:05:58.739 "product_name": "passthru", 00:05:58.739 "block_size": 512, 00:05:58.739 "num_blocks": 16384, 00:05:58.739 "uuid": "9a8d1815-74b9-513e-b3b8-f6b90a95ddf3", 00:05:58.739 "assigned_rate_limits": { 00:05:58.739 "rw_ios_per_sec": 0, 00:05:58.739 "rw_mbytes_per_sec": 0, 00:05:58.739 "r_mbytes_per_sec": 0, 00:05:58.739 "w_mbytes_per_sec": 0 00:05:58.739 }, 00:05:58.739 "claimed": false, 00:05:58.739 "zoned": false, 00:05:58.739 "supported_io_types": { 00:05:58.739 "read": true, 00:05:58.739 "write": true, 00:05:58.739 "unmap": true, 00:05:58.739 "write_zeroes": true, 00:05:58.739 "flush": true, 00:05:58.739 "reset": true, 00:05:58.739 "compare": false, 00:05:58.739 "compare_and_write": false, 00:05:58.739 "abort": true, 00:05:58.739 "nvme_admin": false, 00:05:58.739 "nvme_io": false 00:05:58.739 }, 00:05:58.739 "memory_domains": [ 00:05:58.739 { 00:05:58.739 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:58.739 "dma_device_type": 2 00:05:58.739 } 00:05:58.739 ], 00:05:58.739 "driver_specific": { 00:05:58.739 "passthru": { 00:05:58.739 "name": "Passthru0", 00:05:58.739 "base_bdev_name": "Malloc2" 00:05:58.739 } 00:05:58.739 } 00:05:58.739 } 00:05:58.739 ]' 00:05:58.739 01:00:13 -- rpc/rpc.sh@21 -- # jq length 00:05:58.739 01:00:13 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:58.739 01:00:13 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:58.739 01:00:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:58.739 01:00:13 -- common/autotest_common.sh@10 -- # set +x 00:05:58.739 01:00:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:58.739 01:00:13 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:58.739 01:00:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:58.739 01:00:13 -- common/autotest_common.sh@10 -- # set +x 00:05:58.739 01:00:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:58.739 01:00:13 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:58.739 01:00:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:58.739 01:00:13 -- common/autotest_common.sh@10 -- # set +x 00:05:58.739 01:00:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:58.739 01:00:13 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:58.739 01:00:13 -- rpc/rpc.sh@26 -- # jq length 00:05:58.739 01:00:13 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:58.739 00:05:58.739 real 0m0.224s 00:05:58.739 user 0m0.153s 00:05:58.739 sys 0m0.014s 00:05:58.739 01:00:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:58.739 01:00:13 -- common/autotest_common.sh@10 -- # set +x 00:05:58.739 ************************************ 00:05:58.739 END TEST rpc_daemon_integrity 00:05:58.739 ************************************ 00:05:58.739 01:00:13 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:58.739 01:00:13 -- rpc/rpc.sh@84 -- # killprocess 1910342 00:05:58.739 01:00:13 -- common/autotest_common.sh@936 -- # '[' -z 1910342 ']' 00:05:58.739 01:00:13 -- common/autotest_common.sh@940 -- # kill -0 1910342 00:05:58.739 01:00:13 -- common/autotest_common.sh@941 -- # uname 00:05:58.739 01:00:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:58.739 01:00:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1910342 00:05:58.739 01:00:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:58.739 01:00:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:58.739 01:00:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1910342' 00:05:58.739 killing process with pid 1910342 00:05:58.739 01:00:13 -- common/autotest_common.sh@955 -- # kill 1910342 00:05:58.739 01:00:13 -- common/autotest_common.sh@960 -- # wait 1910342 00:05:59.306 00:05:59.306 real 0m2.445s 00:05:59.306 user 0m3.076s 00:05:59.306 sys 0m0.611s 00:05:59.306 01:00:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:59.306 01:00:13 -- common/autotest_common.sh@10 -- # set +x 00:05:59.307 ************************************ 00:05:59.307 END TEST rpc 00:05:59.307 ************************************ 00:05:59.307 01:00:13 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:59.307 01:00:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:59.307 01:00:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:59.307 01:00:13 -- common/autotest_common.sh@10 -- # set +x 00:05:59.307 ************************************ 00:05:59.307 START TEST rpc_client 00:05:59.307 ************************************ 00:05:59.307 01:00:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:59.307 * Looking for test storage... 00:05:59.307 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:05:59.307 01:00:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:59.307 01:00:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:59.307 01:00:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:59.307 01:00:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:59.307 01:00:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:59.307 01:00:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:59.307 01:00:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:59.307 01:00:13 -- scripts/common.sh@335 -- # IFS=.-: 00:05:59.307 01:00:13 -- scripts/common.sh@335 -- # read -ra ver1 00:05:59.307 01:00:13 -- scripts/common.sh@336 -- # IFS=.-: 00:05:59.307 01:00:13 -- scripts/common.sh@336 -- # read -ra ver2 00:05:59.307 01:00:13 -- scripts/common.sh@337 -- # local 'op=<' 00:05:59.307 01:00:13 -- scripts/common.sh@339 -- # ver1_l=2 00:05:59.307 01:00:13 -- scripts/common.sh@340 -- # ver2_l=1 00:05:59.307 01:00:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:59.307 01:00:13 -- scripts/common.sh@343 -- # case "$op" in 00:05:59.307 01:00:13 -- scripts/common.sh@344 -- # : 1 00:05:59.307 01:00:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:59.307 01:00:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:59.307 01:00:13 -- scripts/common.sh@364 -- # decimal 1 00:05:59.307 01:00:13 -- scripts/common.sh@352 -- # local d=1 00:05:59.307 01:00:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:59.307 01:00:13 -- scripts/common.sh@354 -- # echo 1 00:05:59.307 01:00:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:59.307 01:00:13 -- scripts/common.sh@365 -- # decimal 2 00:05:59.307 01:00:13 -- scripts/common.sh@352 -- # local d=2 00:05:59.307 01:00:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:59.307 01:00:13 -- scripts/common.sh@354 -- # echo 2 00:05:59.307 01:00:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:59.307 01:00:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:59.307 01:00:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:59.307 01:00:13 -- scripts/common.sh@367 -- # return 0 00:05:59.307 01:00:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:59.307 01:00:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:59.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.307 --rc genhtml_branch_coverage=1 00:05:59.307 --rc genhtml_function_coverage=1 00:05:59.307 --rc genhtml_legend=1 00:05:59.307 --rc geninfo_all_blocks=1 00:05:59.307 --rc geninfo_unexecuted_blocks=1 00:05:59.307 00:05:59.307 ' 00:05:59.307 01:00:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:59.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.307 --rc genhtml_branch_coverage=1 00:05:59.307 --rc genhtml_function_coverage=1 00:05:59.307 --rc genhtml_legend=1 00:05:59.307 --rc geninfo_all_blocks=1 00:05:59.307 --rc geninfo_unexecuted_blocks=1 00:05:59.307 00:05:59.307 ' 00:05:59.307 01:00:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:59.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.307 --rc genhtml_branch_coverage=1 00:05:59.307 --rc genhtml_function_coverage=1 00:05:59.307 --rc genhtml_legend=1 00:05:59.307 --rc geninfo_all_blocks=1 00:05:59.307 --rc geninfo_unexecuted_blocks=1 00:05:59.307 00:05:59.307 ' 00:05:59.307 01:00:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:59.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.307 --rc genhtml_branch_coverage=1 00:05:59.307 --rc genhtml_function_coverage=1 00:05:59.307 --rc genhtml_legend=1 00:05:59.307 --rc geninfo_all_blocks=1 00:05:59.307 --rc geninfo_unexecuted_blocks=1 00:05:59.307 00:05:59.307 ' 00:05:59.307 01:00:13 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:59.307 OK 00:05:59.307 01:00:13 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:59.307 00:05:59.307 real 0m0.154s 00:05:59.307 user 0m0.103s 00:05:59.307 sys 0m0.059s 00:05:59.307 01:00:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:59.307 01:00:13 -- common/autotest_common.sh@10 -- # set +x 00:05:59.307 ************************************ 00:05:59.307 END TEST rpc_client 00:05:59.307 ************************************ 00:05:59.307 01:00:13 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:59.307 01:00:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:59.307 01:00:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:59.307 01:00:13 -- common/autotest_common.sh@10 -- # set +x 00:05:59.307 ************************************ 00:05:59.307 START TEST json_config 00:05:59.307 ************************************ 00:05:59.307 01:00:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:59.566 01:00:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:59.566 01:00:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:59.566 01:00:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:59.566 01:00:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:59.566 01:00:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:59.566 01:00:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:59.566 01:00:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:59.566 01:00:13 -- scripts/common.sh@335 -- # IFS=.-: 00:05:59.566 01:00:13 -- scripts/common.sh@335 -- # read -ra ver1 00:05:59.566 01:00:13 -- scripts/common.sh@336 -- # IFS=.-: 00:05:59.567 01:00:13 -- scripts/common.sh@336 -- # read -ra ver2 00:05:59.567 01:00:13 -- scripts/common.sh@337 -- # local 'op=<' 00:05:59.567 01:00:13 -- scripts/common.sh@339 -- # ver1_l=2 00:05:59.567 01:00:13 -- scripts/common.sh@340 -- # ver2_l=1 00:05:59.567 01:00:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:59.567 01:00:13 -- scripts/common.sh@343 -- # case "$op" in 00:05:59.567 01:00:13 -- scripts/common.sh@344 -- # : 1 00:05:59.567 01:00:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:59.567 01:00:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:59.567 01:00:13 -- scripts/common.sh@364 -- # decimal 1 00:05:59.567 01:00:13 -- scripts/common.sh@352 -- # local d=1 00:05:59.567 01:00:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:59.567 01:00:13 -- scripts/common.sh@354 -- # echo 1 00:05:59.567 01:00:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:59.567 01:00:14 -- scripts/common.sh@365 -- # decimal 2 00:05:59.567 01:00:14 -- scripts/common.sh@352 -- # local d=2 00:05:59.567 01:00:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:59.567 01:00:14 -- scripts/common.sh@354 -- # echo 2 00:05:59.567 01:00:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:59.567 01:00:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:59.567 01:00:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:59.567 01:00:14 -- scripts/common.sh@367 -- # return 0 00:05:59.567 01:00:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:59.567 01:00:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:59.567 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.567 --rc genhtml_branch_coverage=1 00:05:59.567 --rc genhtml_function_coverage=1 00:05:59.567 --rc genhtml_legend=1 00:05:59.567 --rc geninfo_all_blocks=1 00:05:59.567 --rc geninfo_unexecuted_blocks=1 00:05:59.567 00:05:59.567 ' 00:05:59.567 01:00:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:59.567 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.567 --rc genhtml_branch_coverage=1 00:05:59.567 --rc genhtml_function_coverage=1 00:05:59.567 --rc genhtml_legend=1 00:05:59.567 --rc geninfo_all_blocks=1 00:05:59.567 --rc geninfo_unexecuted_blocks=1 00:05:59.567 00:05:59.567 ' 00:05:59.567 01:00:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:59.567 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.567 --rc genhtml_branch_coverage=1 00:05:59.567 --rc genhtml_function_coverage=1 00:05:59.567 --rc genhtml_legend=1 00:05:59.567 --rc geninfo_all_blocks=1 00:05:59.567 --rc geninfo_unexecuted_blocks=1 00:05:59.567 00:05:59.567 ' 00:05:59.567 01:00:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:59.567 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.567 --rc genhtml_branch_coverage=1 00:05:59.567 --rc genhtml_function_coverage=1 00:05:59.567 --rc genhtml_legend=1 00:05:59.567 --rc geninfo_all_blocks=1 00:05:59.567 --rc geninfo_unexecuted_blocks=1 00:05:59.567 00:05:59.567 ' 00:05:59.567 01:00:14 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:59.567 01:00:14 -- nvmf/common.sh@7 -- # uname -s 00:05:59.567 01:00:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:59.567 01:00:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:59.567 01:00:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:59.567 01:00:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:59.567 01:00:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:59.567 01:00:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:59.567 01:00:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:59.567 01:00:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:59.567 01:00:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:59.567 01:00:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:59.567 01:00:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:59.567 01:00:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:59.567 01:00:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:59.567 01:00:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:59.567 01:00:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:59.567 01:00:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:59.567 01:00:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:59.567 01:00:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:59.567 01:00:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:59.567 01:00:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:59.567 01:00:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:59.567 01:00:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:59.567 01:00:14 -- paths/export.sh@5 -- # export PATH 00:05:59.567 01:00:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:59.567 01:00:14 -- nvmf/common.sh@46 -- # : 0 00:05:59.567 01:00:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:59.567 01:00:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:59.567 01:00:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:59.567 01:00:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:59.567 01:00:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:59.567 01:00:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:59.567 01:00:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:59.567 01:00:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:59.567 01:00:14 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:05:59.567 01:00:14 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:05:59.567 01:00:14 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:05:59.567 01:00:14 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:59.567 01:00:14 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:05:59.567 01:00:14 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:05:59.567 01:00:14 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:59.567 01:00:14 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:05:59.567 01:00:14 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:59.568 01:00:14 -- json_config/json_config.sh@32 -- # declare -A app_params 00:05:59.568 01:00:14 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:05:59.568 01:00:14 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:05:59.568 01:00:14 -- json_config/json_config.sh@43 -- # last_event_id=0 00:05:59.568 01:00:14 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:59.568 01:00:14 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:05:59.568 INFO: JSON configuration test init 00:05:59.568 01:00:14 -- json_config/json_config.sh@420 -- # json_config_test_init 00:05:59.568 01:00:14 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:05:59.568 01:00:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:59.568 01:00:14 -- common/autotest_common.sh@10 -- # set +x 00:05:59.568 01:00:14 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:05:59.568 01:00:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:59.568 01:00:14 -- common/autotest_common.sh@10 -- # set +x 00:05:59.568 01:00:14 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:05:59.568 01:00:14 -- json_config/json_config.sh@98 -- # local app=target 00:05:59.568 01:00:14 -- json_config/json_config.sh@99 -- # shift 00:05:59.568 01:00:14 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:59.568 01:00:14 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:59.568 01:00:14 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:59.568 01:00:14 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:59.568 01:00:14 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:59.568 01:00:14 -- json_config/json_config.sh@111 -- # app_pid[$app]=1910837 00:05:59.568 01:00:14 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:59.568 01:00:14 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:59.568 Waiting for target to run... 00:05:59.568 01:00:14 -- json_config/json_config.sh@114 -- # waitforlisten 1910837 /var/tmp/spdk_tgt.sock 00:05:59.568 01:00:14 -- common/autotest_common.sh@829 -- # '[' -z 1910837 ']' 00:05:59.568 01:00:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:59.568 01:00:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:59.568 01:00:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:59.568 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:59.568 01:00:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:59.568 01:00:14 -- common/autotest_common.sh@10 -- # set +x 00:05:59.568 [2024-11-28 01:00:14.073841] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:59.568 [2024-11-28 01:00:14.073946] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1910837 ] 00:05:59.568 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.135 [2024-11-28 01:00:14.429859] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.135 [2024-11-28 01:00:14.491117] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:00.135 [2024-11-28 01:00:14.491306] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:00.700 01:00:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:00.700 01:00:15 -- common/autotest_common.sh@862 -- # return 0 00:06:00.700 01:00:15 -- json_config/json_config.sh@115 -- # echo '' 00:06:00.700 00:06:00.700 01:00:15 -- json_config/json_config.sh@322 -- # create_accel_config 00:06:00.700 01:00:15 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:06:00.700 01:00:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:00.700 01:00:15 -- common/autotest_common.sh@10 -- # set +x 00:06:00.700 01:00:15 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:06:00.700 01:00:15 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:06:00.700 01:00:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:00.700 01:00:15 -- common/autotest_common.sh@10 -- # set +x 00:06:00.700 01:00:15 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:06:00.700 01:00:15 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:06:00.700 01:00:15 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:06:03.983 01:00:18 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:06:03.983 01:00:18 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:06:03.983 01:00:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:03.983 01:00:18 -- common/autotest_common.sh@10 -- # set +x 00:06:03.983 01:00:18 -- json_config/json_config.sh@48 -- # local ret=0 00:06:03.983 01:00:18 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:06:03.983 01:00:18 -- json_config/json_config.sh@49 -- # local enabled_types 00:06:03.983 01:00:18 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:06:03.983 01:00:18 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:06:03.983 01:00:18 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:06:03.984 01:00:18 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:06:03.984 01:00:18 -- json_config/json_config.sh@51 -- # local get_types 00:06:03.984 01:00:18 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:06:03.984 01:00:18 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:06:03.984 01:00:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:03.984 01:00:18 -- common/autotest_common.sh@10 -- # set +x 00:06:03.984 01:00:18 -- json_config/json_config.sh@58 -- # return 0 00:06:03.984 01:00:18 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:06:03.984 01:00:18 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:06:03.984 01:00:18 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:06:03.984 01:00:18 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:06:03.984 01:00:18 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:06:03.984 01:00:18 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:06:03.984 01:00:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:03.984 01:00:18 -- common/autotest_common.sh@10 -- # set +x 00:06:03.984 01:00:18 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:06:03.984 01:00:18 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:06:03.984 01:00:18 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:06:03.984 01:00:18 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:06:03.984 01:00:18 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:06:04.241 MallocForNvmf0 00:06:04.241 01:00:18 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:06:04.241 01:00:18 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:06:04.499 MallocForNvmf1 00:06:04.499 01:00:19 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:06:04.499 01:00:19 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:06:04.756 [2024-11-28 01:00:19.260198] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:04.756 01:00:19 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:04.756 01:00:19 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:05.013 01:00:19 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:06:05.013 01:00:19 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:06:05.271 01:00:19 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:06:05.271 01:00:19 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:06:05.528 01:00:20 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:06:05.529 01:00:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:06:05.786 [2024-11-28 01:00:20.259577] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:06:05.786 01:00:20 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:06:05.786 01:00:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:05.786 01:00:20 -- common/autotest_common.sh@10 -- # set +x 00:06:05.786 01:00:20 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:06:05.786 01:00:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:05.786 01:00:20 -- common/autotest_common.sh@10 -- # set +x 00:06:05.786 01:00:20 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:06:05.786 01:00:20 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:06:05.786 01:00:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:06:06.043 MallocBdevForConfigChangeCheck 00:06:06.043 01:00:20 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:06:06.043 01:00:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:06.043 01:00:20 -- common/autotest_common.sh@10 -- # set +x 00:06:06.043 01:00:20 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:06:06.043 01:00:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:06.608 01:00:20 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:06:06.608 INFO: shutting down applications... 00:06:06.608 01:00:20 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:06:06.608 01:00:20 -- json_config/json_config.sh@431 -- # json_config_clear target 00:06:06.608 01:00:20 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:06:06.608 01:00:20 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:06:07.979 Calling clear_iscsi_subsystem 00:06:07.979 Calling clear_nvmf_subsystem 00:06:07.979 Calling clear_nbd_subsystem 00:06:07.979 Calling clear_ublk_subsystem 00:06:07.979 Calling clear_vhost_blk_subsystem 00:06:07.979 Calling clear_vhost_scsi_subsystem 00:06:07.979 Calling clear_scheduler_subsystem 00:06:07.979 Calling clear_bdev_subsystem 00:06:07.979 Calling clear_accel_subsystem 00:06:07.979 Calling clear_vmd_subsystem 00:06:07.979 Calling clear_sock_subsystem 00:06:07.979 Calling clear_iobuf_subsystem 00:06:08.236 01:00:22 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:06:08.236 01:00:22 -- json_config/json_config.sh@396 -- # count=100 00:06:08.236 01:00:22 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:06:08.236 01:00:22 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:08.236 01:00:22 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:06:08.236 01:00:22 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:06:08.494 01:00:22 -- json_config/json_config.sh@398 -- # break 00:06:08.494 01:00:22 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:06:08.494 01:00:22 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:06:08.494 01:00:22 -- json_config/json_config.sh@120 -- # local app=target 00:06:08.494 01:00:22 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:06:08.494 01:00:22 -- json_config/json_config.sh@124 -- # [[ -n 1910837 ]] 00:06:08.494 01:00:22 -- json_config/json_config.sh@127 -- # kill -SIGINT 1910837 00:06:08.494 01:00:22 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:06:08.494 01:00:22 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:06:08.494 01:00:22 -- json_config/json_config.sh@130 -- # kill -0 1910837 00:06:08.494 01:00:22 -- json_config/json_config.sh@134 -- # sleep 0.5 00:06:09.060 01:00:23 -- json_config/json_config.sh@129 -- # (( i++ )) 00:06:09.060 01:00:23 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:06:09.060 01:00:23 -- json_config/json_config.sh@130 -- # kill -0 1910837 00:06:09.060 01:00:23 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:06:09.060 01:00:23 -- json_config/json_config.sh@132 -- # break 00:06:09.060 01:00:23 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:06:09.060 01:00:23 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:06:09.060 SPDK target shutdown done 00:06:09.060 01:00:23 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:06:09.060 INFO: relaunching applications... 00:06:09.060 01:00:23 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:09.060 01:00:23 -- json_config/json_config.sh@98 -- # local app=target 00:06:09.060 01:00:23 -- json_config/json_config.sh@99 -- # shift 00:06:09.060 01:00:23 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:06:09.060 01:00:23 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:06:09.060 01:00:23 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:06:09.060 01:00:23 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:06:09.061 01:00:23 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:06:09.061 01:00:23 -- json_config/json_config.sh@111 -- # app_pid[$app]=1912186 00:06:09.061 01:00:23 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:09.061 01:00:23 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:06:09.061 Waiting for target to run... 00:06:09.061 01:00:23 -- json_config/json_config.sh@114 -- # waitforlisten 1912186 /var/tmp/spdk_tgt.sock 00:06:09.061 01:00:23 -- common/autotest_common.sh@829 -- # '[' -z 1912186 ']' 00:06:09.061 01:00:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:09.061 01:00:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:09.061 01:00:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:09.061 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:09.061 01:00:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:09.061 01:00:23 -- common/autotest_common.sh@10 -- # set +x 00:06:09.061 [2024-11-28 01:00:23.514334] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:09.061 [2024-11-28 01:00:23.514424] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1912186 ] 00:06:09.061 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.627 [2024-11-28 01:00:24.042230] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.627 [2024-11-28 01:00:24.121954] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:09.627 [2024-11-28 01:00:24.122157] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.912 [2024-11-28 01:00:27.141635] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:12.912 [2024-11-28 01:00:27.174142] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:06:12.912 01:00:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:12.912 01:00:27 -- common/autotest_common.sh@862 -- # return 0 00:06:12.912 01:00:27 -- json_config/json_config.sh@115 -- # echo '' 00:06:12.912 00:06:12.912 01:00:27 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:06:12.912 01:00:27 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:06:12.912 INFO: Checking if target configuration is the same... 00:06:12.912 01:00:27 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:12.912 01:00:27 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:06:12.912 01:00:27 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:12.912 + '[' 2 -ne 2 ']' 00:06:12.912 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:06:12.912 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:06:12.912 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:12.912 +++ basename /dev/fd/62 00:06:12.912 ++ mktemp /tmp/62.XXX 00:06:12.912 + tmp_file_1=/tmp/62.tsm 00:06:12.912 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:12.912 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:06:12.912 + tmp_file_2=/tmp/spdk_tgt_config.json.ggr 00:06:12.912 + ret=0 00:06:12.912 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:13.549 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:13.549 + diff -u /tmp/62.tsm /tmp/spdk_tgt_config.json.ggr 00:06:13.549 + echo 'INFO: JSON config files are the same' 00:06:13.549 INFO: JSON config files are the same 00:06:13.549 + rm /tmp/62.tsm /tmp/spdk_tgt_config.json.ggr 00:06:13.549 + exit 0 00:06:13.549 01:00:27 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:06:13.549 01:00:27 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:06:13.549 INFO: changing configuration and checking if this can be detected... 00:06:13.549 01:00:27 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:06:13.549 01:00:27 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:06:13.549 01:00:28 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:13.549 01:00:28 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:06:13.549 01:00:28 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:13.549 + '[' 2 -ne 2 ']' 00:06:13.549 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:06:13.549 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:06:13.549 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:13.549 +++ basename /dev/fd/62 00:06:13.549 ++ mktemp /tmp/62.XXX 00:06:13.549 + tmp_file_1=/tmp/62.UFa 00:06:13.549 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:13.549 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:06:13.549 + tmp_file_2=/tmp/spdk_tgt_config.json.rfG 00:06:13.549 + ret=0 00:06:13.549 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:14.115 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:14.115 + diff -u /tmp/62.UFa /tmp/spdk_tgt_config.json.rfG 00:06:14.115 + ret=1 00:06:14.115 + echo '=== Start of file: /tmp/62.UFa ===' 00:06:14.115 + cat /tmp/62.UFa 00:06:14.115 + echo '=== End of file: /tmp/62.UFa ===' 00:06:14.115 + echo '' 00:06:14.115 + echo '=== Start of file: /tmp/spdk_tgt_config.json.rfG ===' 00:06:14.115 + cat /tmp/spdk_tgt_config.json.rfG 00:06:14.115 + echo '=== End of file: /tmp/spdk_tgt_config.json.rfG ===' 00:06:14.115 + echo '' 00:06:14.115 + rm /tmp/62.UFa /tmp/spdk_tgt_config.json.rfG 00:06:14.115 + exit 1 00:06:14.115 01:00:28 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:06:14.115 INFO: configuration change detected. 00:06:14.115 01:00:28 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:06:14.115 01:00:28 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:06:14.115 01:00:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:14.115 01:00:28 -- common/autotest_common.sh@10 -- # set +x 00:06:14.115 01:00:28 -- json_config/json_config.sh@360 -- # local ret=0 00:06:14.115 01:00:28 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:06:14.115 01:00:28 -- json_config/json_config.sh@370 -- # [[ -n 1912186 ]] 00:06:14.115 01:00:28 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:06:14.115 01:00:28 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:06:14.115 01:00:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:14.115 01:00:28 -- common/autotest_common.sh@10 -- # set +x 00:06:14.115 01:00:28 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:06:14.115 01:00:28 -- json_config/json_config.sh@246 -- # uname -s 00:06:14.115 01:00:28 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:06:14.115 01:00:28 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:06:14.115 01:00:28 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:06:14.115 01:00:28 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:06:14.115 01:00:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:14.115 01:00:28 -- common/autotest_common.sh@10 -- # set +x 00:06:14.115 01:00:28 -- json_config/json_config.sh@376 -- # killprocess 1912186 00:06:14.115 01:00:28 -- common/autotest_common.sh@936 -- # '[' -z 1912186 ']' 00:06:14.115 01:00:28 -- common/autotest_common.sh@940 -- # kill -0 1912186 00:06:14.115 01:00:28 -- common/autotest_common.sh@941 -- # uname 00:06:14.115 01:00:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:14.115 01:00:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1912186 00:06:14.115 01:00:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:14.115 01:00:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:14.115 01:00:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1912186' 00:06:14.115 killing process with pid 1912186 00:06:14.115 01:00:28 -- common/autotest_common.sh@955 -- # kill 1912186 00:06:14.115 01:00:28 -- common/autotest_common.sh@960 -- # wait 1912186 00:06:16.018 01:00:30 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:16.018 01:00:30 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:06:16.018 01:00:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:16.018 01:00:30 -- common/autotest_common.sh@10 -- # set +x 00:06:16.018 01:00:30 -- json_config/json_config.sh@381 -- # return 0 00:06:16.018 01:00:30 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:06:16.018 INFO: Success 00:06:16.018 00:06:16.018 real 0m16.314s 00:06:16.018 user 0m18.762s 00:06:16.018 sys 0m2.121s 00:06:16.018 01:00:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:16.018 01:00:30 -- common/autotest_common.sh@10 -- # set +x 00:06:16.018 ************************************ 00:06:16.018 END TEST json_config 00:06:16.018 ************************************ 00:06:16.018 01:00:30 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:06:16.018 01:00:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:16.018 01:00:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:16.018 01:00:30 -- common/autotest_common.sh@10 -- # set +x 00:06:16.018 ************************************ 00:06:16.018 START TEST json_config_extra_key 00:06:16.018 ************************************ 00:06:16.018 01:00:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:06:16.018 01:00:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:16.018 01:00:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:16.018 01:00:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:16.018 01:00:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:16.018 01:00:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:16.018 01:00:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:16.018 01:00:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:16.018 01:00:30 -- scripts/common.sh@335 -- # IFS=.-: 00:06:16.018 01:00:30 -- scripts/common.sh@335 -- # read -ra ver1 00:06:16.018 01:00:30 -- scripts/common.sh@336 -- # IFS=.-: 00:06:16.018 01:00:30 -- scripts/common.sh@336 -- # read -ra ver2 00:06:16.018 01:00:30 -- scripts/common.sh@337 -- # local 'op=<' 00:06:16.018 01:00:30 -- scripts/common.sh@339 -- # ver1_l=2 00:06:16.018 01:00:30 -- scripts/common.sh@340 -- # ver2_l=1 00:06:16.018 01:00:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:16.018 01:00:30 -- scripts/common.sh@343 -- # case "$op" in 00:06:16.019 01:00:30 -- scripts/common.sh@344 -- # : 1 00:06:16.019 01:00:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:16.019 01:00:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:16.019 01:00:30 -- scripts/common.sh@364 -- # decimal 1 00:06:16.019 01:00:30 -- scripts/common.sh@352 -- # local d=1 00:06:16.019 01:00:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:16.019 01:00:30 -- scripts/common.sh@354 -- # echo 1 00:06:16.019 01:00:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:16.019 01:00:30 -- scripts/common.sh@365 -- # decimal 2 00:06:16.019 01:00:30 -- scripts/common.sh@352 -- # local d=2 00:06:16.019 01:00:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:16.019 01:00:30 -- scripts/common.sh@354 -- # echo 2 00:06:16.019 01:00:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:16.019 01:00:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:16.019 01:00:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:16.019 01:00:30 -- scripts/common.sh@367 -- # return 0 00:06:16.019 01:00:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:16.019 01:00:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:16.019 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:16.019 --rc genhtml_branch_coverage=1 00:06:16.019 --rc genhtml_function_coverage=1 00:06:16.019 --rc genhtml_legend=1 00:06:16.019 --rc geninfo_all_blocks=1 00:06:16.019 --rc geninfo_unexecuted_blocks=1 00:06:16.019 00:06:16.019 ' 00:06:16.019 01:00:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:16.019 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:16.019 --rc genhtml_branch_coverage=1 00:06:16.019 --rc genhtml_function_coverage=1 00:06:16.019 --rc genhtml_legend=1 00:06:16.019 --rc geninfo_all_blocks=1 00:06:16.019 --rc geninfo_unexecuted_blocks=1 00:06:16.019 00:06:16.019 ' 00:06:16.019 01:00:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:16.019 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:16.019 --rc genhtml_branch_coverage=1 00:06:16.019 --rc genhtml_function_coverage=1 00:06:16.019 --rc genhtml_legend=1 00:06:16.019 --rc geninfo_all_blocks=1 00:06:16.019 --rc geninfo_unexecuted_blocks=1 00:06:16.019 00:06:16.019 ' 00:06:16.019 01:00:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:16.019 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:16.019 --rc genhtml_branch_coverage=1 00:06:16.019 --rc genhtml_function_coverage=1 00:06:16.019 --rc genhtml_legend=1 00:06:16.019 --rc geninfo_all_blocks=1 00:06:16.019 --rc geninfo_unexecuted_blocks=1 00:06:16.019 00:06:16.019 ' 00:06:16.019 01:00:30 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:16.019 01:00:30 -- nvmf/common.sh@7 -- # uname -s 00:06:16.019 01:00:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:16.019 01:00:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:16.019 01:00:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:16.019 01:00:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:16.019 01:00:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:16.019 01:00:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:16.019 01:00:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:16.019 01:00:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:16.019 01:00:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:16.019 01:00:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:16.019 01:00:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:16.019 01:00:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:16.019 01:00:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:16.019 01:00:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:16.019 01:00:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:06:16.019 01:00:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:16.019 01:00:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:16.019 01:00:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:16.019 01:00:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:16.019 01:00:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:16.019 01:00:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:16.019 01:00:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:16.019 01:00:30 -- paths/export.sh@5 -- # export PATH 00:06:16.019 01:00:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:16.019 01:00:30 -- nvmf/common.sh@46 -- # : 0 00:06:16.019 01:00:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:16.019 01:00:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:16.019 01:00:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:16.019 01:00:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:16.019 01:00:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:16.019 01:00:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:16.019 01:00:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:16.019 01:00:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:16.019 01:00:30 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:06:16.019 01:00:30 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:06:16.019 01:00:30 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:06:16.019 01:00:30 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:06:16.019 01:00:30 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:06:16.019 01:00:30 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:06:16.019 01:00:30 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:06:16.019 01:00:30 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:06:16.019 01:00:30 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:06:16.019 01:00:30 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:06:16.019 INFO: launching applications... 00:06:16.019 01:00:30 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:06:16.019 01:00:30 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:06:16.019 01:00:30 -- json_config/json_config_extra_key.sh@25 -- # shift 00:06:16.019 01:00:30 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:06:16.019 01:00:30 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:06:16.019 01:00:30 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=1913141 00:06:16.019 01:00:30 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:06:16.019 01:00:30 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:06:16.019 Waiting for target to run... 00:06:16.019 01:00:30 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 1913141 /var/tmp/spdk_tgt.sock 00:06:16.019 01:00:30 -- common/autotest_common.sh@829 -- # '[' -z 1913141 ']' 00:06:16.019 01:00:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:16.019 01:00:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:16.019 01:00:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:16.019 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:16.019 01:00:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:16.019 01:00:30 -- common/autotest_common.sh@10 -- # set +x 00:06:16.019 [2024-11-28 01:00:30.418402] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:16.019 [2024-11-28 01:00:30.418490] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1913141 ] 00:06:16.019 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.587 [2024-11-28 01:00:30.914219] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:16.587 [2024-11-28 01:00:30.993880] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:16.587 [2024-11-28 01:00:30.994086] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.846 01:00:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:16.846 01:00:31 -- common/autotest_common.sh@862 -- # return 0 00:06:16.846 01:00:31 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:06:16.846 00:06:16.846 01:00:31 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:06:16.846 INFO: shutting down applications... 00:06:16.846 01:00:31 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:06:16.846 01:00:31 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:06:16.846 01:00:31 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:06:16.846 01:00:31 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 1913141 ]] 00:06:16.846 01:00:31 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 1913141 00:06:16.846 01:00:31 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:06:16.846 01:00:31 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:06:16.846 01:00:31 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1913141 00:06:16.846 01:00:31 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:06:17.412 01:00:31 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:06:17.412 01:00:31 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:06:17.412 01:00:31 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1913141 00:06:17.412 01:00:31 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:06:17.412 01:00:31 -- json_config/json_config_extra_key.sh@52 -- # break 00:06:17.412 01:00:31 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:06:17.412 01:00:31 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:06:17.412 SPDK target shutdown done 00:06:17.412 01:00:31 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:06:17.412 Success 00:06:17.412 00:06:17.412 real 0m1.659s 00:06:17.412 user 0m1.486s 00:06:17.412 sys 0m0.607s 00:06:17.412 01:00:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:17.412 01:00:31 -- common/autotest_common.sh@10 -- # set +x 00:06:17.412 ************************************ 00:06:17.412 END TEST json_config_extra_key 00:06:17.412 ************************************ 00:06:17.412 01:00:31 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:17.412 01:00:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:17.412 01:00:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:17.412 01:00:31 -- common/autotest_common.sh@10 -- # set +x 00:06:17.412 ************************************ 00:06:17.412 START TEST alias_rpc 00:06:17.412 ************************************ 00:06:17.412 01:00:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:17.412 * Looking for test storage... 00:06:17.412 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:06:17.412 01:00:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:17.412 01:00:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:17.412 01:00:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:17.671 01:00:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:17.671 01:00:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:17.671 01:00:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:17.671 01:00:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:17.671 01:00:32 -- scripts/common.sh@335 -- # IFS=.-: 00:06:17.671 01:00:32 -- scripts/common.sh@335 -- # read -ra ver1 00:06:17.671 01:00:32 -- scripts/common.sh@336 -- # IFS=.-: 00:06:17.671 01:00:32 -- scripts/common.sh@336 -- # read -ra ver2 00:06:17.671 01:00:32 -- scripts/common.sh@337 -- # local 'op=<' 00:06:17.671 01:00:32 -- scripts/common.sh@339 -- # ver1_l=2 00:06:17.671 01:00:32 -- scripts/common.sh@340 -- # ver2_l=1 00:06:17.671 01:00:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:17.671 01:00:32 -- scripts/common.sh@343 -- # case "$op" in 00:06:17.671 01:00:32 -- scripts/common.sh@344 -- # : 1 00:06:17.671 01:00:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:17.671 01:00:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:17.671 01:00:32 -- scripts/common.sh@364 -- # decimal 1 00:06:17.671 01:00:32 -- scripts/common.sh@352 -- # local d=1 00:06:17.671 01:00:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:17.671 01:00:32 -- scripts/common.sh@354 -- # echo 1 00:06:17.671 01:00:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:17.671 01:00:32 -- scripts/common.sh@365 -- # decimal 2 00:06:17.671 01:00:32 -- scripts/common.sh@352 -- # local d=2 00:06:17.671 01:00:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:17.671 01:00:32 -- scripts/common.sh@354 -- # echo 2 00:06:17.671 01:00:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:17.671 01:00:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:17.671 01:00:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:17.671 01:00:32 -- scripts/common.sh@367 -- # return 0 00:06:17.671 01:00:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:17.671 01:00:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:17.671 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:17.671 --rc genhtml_branch_coverage=1 00:06:17.671 --rc genhtml_function_coverage=1 00:06:17.671 --rc genhtml_legend=1 00:06:17.671 --rc geninfo_all_blocks=1 00:06:17.671 --rc geninfo_unexecuted_blocks=1 00:06:17.671 00:06:17.671 ' 00:06:17.671 01:00:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:17.671 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:17.671 --rc genhtml_branch_coverage=1 00:06:17.671 --rc genhtml_function_coverage=1 00:06:17.671 --rc genhtml_legend=1 00:06:17.671 --rc geninfo_all_blocks=1 00:06:17.671 --rc geninfo_unexecuted_blocks=1 00:06:17.671 00:06:17.671 ' 00:06:17.671 01:00:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:17.671 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:17.671 --rc genhtml_branch_coverage=1 00:06:17.671 --rc genhtml_function_coverage=1 00:06:17.671 --rc genhtml_legend=1 00:06:17.671 --rc geninfo_all_blocks=1 00:06:17.671 --rc geninfo_unexecuted_blocks=1 00:06:17.671 00:06:17.671 ' 00:06:17.671 01:00:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:17.671 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:17.671 --rc genhtml_branch_coverage=1 00:06:17.671 --rc genhtml_function_coverage=1 00:06:17.671 --rc genhtml_legend=1 00:06:17.671 --rc geninfo_all_blocks=1 00:06:17.671 --rc geninfo_unexecuted_blocks=1 00:06:17.671 00:06:17.671 ' 00:06:17.671 01:00:32 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:17.671 01:00:32 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=1913333 00:06:17.671 01:00:32 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:17.671 01:00:32 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 1913333 00:06:17.671 01:00:32 -- common/autotest_common.sh@829 -- # '[' -z 1913333 ']' 00:06:17.671 01:00:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:17.671 01:00:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:17.671 01:00:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:17.671 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:17.671 01:00:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:17.671 01:00:32 -- common/autotest_common.sh@10 -- # set +x 00:06:17.671 [2024-11-28 01:00:32.100801] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:17.671 [2024-11-28 01:00:32.100889] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1913333 ] 00:06:17.671 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.671 [2024-11-28 01:00:32.163022] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:17.671 [2024-11-28 01:00:32.255424] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:17.672 [2024-11-28 01:00:32.255622] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.607 01:00:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:18.607 01:00:33 -- common/autotest_common.sh@862 -- # return 0 00:06:18.607 01:00:33 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:06:18.865 01:00:33 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 1913333 00:06:18.865 01:00:33 -- common/autotest_common.sh@936 -- # '[' -z 1913333 ']' 00:06:18.865 01:00:33 -- common/autotest_common.sh@940 -- # kill -0 1913333 00:06:18.865 01:00:33 -- common/autotest_common.sh@941 -- # uname 00:06:18.865 01:00:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:18.865 01:00:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1913333 00:06:18.865 01:00:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:18.865 01:00:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:18.865 01:00:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1913333' 00:06:18.865 killing process with pid 1913333 00:06:18.865 01:00:33 -- common/autotest_common.sh@955 -- # kill 1913333 00:06:18.865 01:00:33 -- common/autotest_common.sh@960 -- # wait 1913333 00:06:19.431 00:06:19.431 real 0m1.848s 00:06:19.431 user 0m2.125s 00:06:19.431 sys 0m0.476s 00:06:19.431 01:00:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:19.431 01:00:33 -- common/autotest_common.sh@10 -- # set +x 00:06:19.431 ************************************ 00:06:19.431 END TEST alias_rpc 00:06:19.431 ************************************ 00:06:19.431 01:00:33 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:06:19.431 01:00:33 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:19.431 01:00:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:19.431 01:00:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:19.431 01:00:33 -- common/autotest_common.sh@10 -- # set +x 00:06:19.431 ************************************ 00:06:19.431 START TEST spdkcli_tcp 00:06:19.431 ************************************ 00:06:19.431 01:00:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:19.431 * Looking for test storage... 00:06:19.431 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:06:19.431 01:00:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:19.431 01:00:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:19.431 01:00:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:19.431 01:00:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:19.431 01:00:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:19.432 01:00:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:19.432 01:00:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:19.432 01:00:33 -- scripts/common.sh@335 -- # IFS=.-: 00:06:19.432 01:00:33 -- scripts/common.sh@335 -- # read -ra ver1 00:06:19.432 01:00:33 -- scripts/common.sh@336 -- # IFS=.-: 00:06:19.432 01:00:33 -- scripts/common.sh@336 -- # read -ra ver2 00:06:19.432 01:00:33 -- scripts/common.sh@337 -- # local 'op=<' 00:06:19.432 01:00:33 -- scripts/common.sh@339 -- # ver1_l=2 00:06:19.432 01:00:33 -- scripts/common.sh@340 -- # ver2_l=1 00:06:19.432 01:00:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:19.432 01:00:33 -- scripts/common.sh@343 -- # case "$op" in 00:06:19.432 01:00:33 -- scripts/common.sh@344 -- # : 1 00:06:19.432 01:00:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:19.432 01:00:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:19.432 01:00:33 -- scripts/common.sh@364 -- # decimal 1 00:06:19.432 01:00:33 -- scripts/common.sh@352 -- # local d=1 00:06:19.432 01:00:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:19.432 01:00:33 -- scripts/common.sh@354 -- # echo 1 00:06:19.432 01:00:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:19.432 01:00:33 -- scripts/common.sh@365 -- # decimal 2 00:06:19.432 01:00:33 -- scripts/common.sh@352 -- # local d=2 00:06:19.432 01:00:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:19.432 01:00:33 -- scripts/common.sh@354 -- # echo 2 00:06:19.432 01:00:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:19.432 01:00:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:19.432 01:00:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:19.432 01:00:33 -- scripts/common.sh@367 -- # return 0 00:06:19.432 01:00:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:19.432 01:00:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:19.432 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:19.432 --rc genhtml_branch_coverage=1 00:06:19.432 --rc genhtml_function_coverage=1 00:06:19.432 --rc genhtml_legend=1 00:06:19.432 --rc geninfo_all_blocks=1 00:06:19.432 --rc geninfo_unexecuted_blocks=1 00:06:19.432 00:06:19.432 ' 00:06:19.432 01:00:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:19.432 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:19.432 --rc genhtml_branch_coverage=1 00:06:19.432 --rc genhtml_function_coverage=1 00:06:19.432 --rc genhtml_legend=1 00:06:19.432 --rc geninfo_all_blocks=1 00:06:19.432 --rc geninfo_unexecuted_blocks=1 00:06:19.432 00:06:19.432 ' 00:06:19.432 01:00:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:19.432 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:19.432 --rc genhtml_branch_coverage=1 00:06:19.432 --rc genhtml_function_coverage=1 00:06:19.432 --rc genhtml_legend=1 00:06:19.432 --rc geninfo_all_blocks=1 00:06:19.432 --rc geninfo_unexecuted_blocks=1 00:06:19.432 00:06:19.432 ' 00:06:19.432 01:00:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:19.432 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:19.432 --rc genhtml_branch_coverage=1 00:06:19.432 --rc genhtml_function_coverage=1 00:06:19.432 --rc genhtml_legend=1 00:06:19.432 --rc geninfo_all_blocks=1 00:06:19.432 --rc geninfo_unexecuted_blocks=1 00:06:19.432 00:06:19.432 ' 00:06:19.432 01:00:33 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:06:19.432 01:00:33 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:06:19.432 01:00:33 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:06:19.432 01:00:33 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:06:19.432 01:00:33 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:06:19.432 01:00:33 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:06:19.432 01:00:33 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:06:19.432 01:00:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:19.432 01:00:33 -- common/autotest_common.sh@10 -- # set +x 00:06:19.432 01:00:33 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=1913664 00:06:19.432 01:00:33 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:06:19.432 01:00:33 -- spdkcli/tcp.sh@27 -- # waitforlisten 1913664 00:06:19.432 01:00:33 -- common/autotest_common.sh@829 -- # '[' -z 1913664 ']' 00:06:19.432 01:00:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:19.432 01:00:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:19.432 01:00:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:19.432 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:19.432 01:00:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:19.432 01:00:33 -- common/autotest_common.sh@10 -- # set +x 00:06:19.432 [2024-11-28 01:00:33.984693] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:19.432 [2024-11-28 01:00:33.984785] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1913664 ] 00:06:19.432 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.690 [2024-11-28 01:00:34.047050] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:19.690 [2024-11-28 01:00:34.135825] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:19.690 [2024-11-28 01:00:34.136056] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:19.690 [2024-11-28 01:00:34.136063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.627 01:00:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:20.627 01:00:34 -- common/autotest_common.sh@862 -- # return 0 00:06:20.627 01:00:34 -- spdkcli/tcp.sh@31 -- # socat_pid=1913807 00:06:20.627 01:00:34 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:06:20.627 01:00:34 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:06:20.627 [ 00:06:20.627 "bdev_malloc_delete", 00:06:20.627 "bdev_malloc_create", 00:06:20.627 "bdev_null_resize", 00:06:20.627 "bdev_null_delete", 00:06:20.627 "bdev_null_create", 00:06:20.627 "bdev_nvme_cuse_unregister", 00:06:20.627 "bdev_nvme_cuse_register", 00:06:20.627 "bdev_opal_new_user", 00:06:20.627 "bdev_opal_set_lock_state", 00:06:20.627 "bdev_opal_delete", 00:06:20.627 "bdev_opal_get_info", 00:06:20.627 "bdev_opal_create", 00:06:20.627 "bdev_nvme_opal_revert", 00:06:20.627 "bdev_nvme_opal_init", 00:06:20.627 "bdev_nvme_send_cmd", 00:06:20.627 "bdev_nvme_get_path_iostat", 00:06:20.627 "bdev_nvme_get_mdns_discovery_info", 00:06:20.627 "bdev_nvme_stop_mdns_discovery", 00:06:20.627 "bdev_nvme_start_mdns_discovery", 00:06:20.627 "bdev_nvme_set_multipath_policy", 00:06:20.627 "bdev_nvme_set_preferred_path", 00:06:20.627 "bdev_nvme_get_io_paths", 00:06:20.627 "bdev_nvme_remove_error_injection", 00:06:20.627 "bdev_nvme_add_error_injection", 00:06:20.627 "bdev_nvme_get_discovery_info", 00:06:20.627 "bdev_nvme_stop_discovery", 00:06:20.627 "bdev_nvme_start_discovery", 00:06:20.627 "bdev_nvme_get_controller_health_info", 00:06:20.627 "bdev_nvme_disable_controller", 00:06:20.627 "bdev_nvme_enable_controller", 00:06:20.627 "bdev_nvme_reset_controller", 00:06:20.627 "bdev_nvme_get_transport_statistics", 00:06:20.627 "bdev_nvme_apply_firmware", 00:06:20.627 "bdev_nvme_detach_controller", 00:06:20.627 "bdev_nvme_get_controllers", 00:06:20.627 "bdev_nvme_attach_controller", 00:06:20.627 "bdev_nvme_set_hotplug", 00:06:20.627 "bdev_nvme_set_options", 00:06:20.627 "bdev_passthru_delete", 00:06:20.627 "bdev_passthru_create", 00:06:20.627 "bdev_lvol_grow_lvstore", 00:06:20.627 "bdev_lvol_get_lvols", 00:06:20.627 "bdev_lvol_get_lvstores", 00:06:20.627 "bdev_lvol_delete", 00:06:20.627 "bdev_lvol_set_read_only", 00:06:20.627 "bdev_lvol_resize", 00:06:20.627 "bdev_lvol_decouple_parent", 00:06:20.627 "bdev_lvol_inflate", 00:06:20.627 "bdev_lvol_rename", 00:06:20.627 "bdev_lvol_clone_bdev", 00:06:20.627 "bdev_lvol_clone", 00:06:20.627 "bdev_lvol_snapshot", 00:06:20.628 "bdev_lvol_create", 00:06:20.628 "bdev_lvol_delete_lvstore", 00:06:20.628 "bdev_lvol_rename_lvstore", 00:06:20.628 "bdev_lvol_create_lvstore", 00:06:20.628 "bdev_raid_set_options", 00:06:20.628 "bdev_raid_remove_base_bdev", 00:06:20.628 "bdev_raid_add_base_bdev", 00:06:20.628 "bdev_raid_delete", 00:06:20.628 "bdev_raid_create", 00:06:20.628 "bdev_raid_get_bdevs", 00:06:20.628 "bdev_error_inject_error", 00:06:20.628 "bdev_error_delete", 00:06:20.628 "bdev_error_create", 00:06:20.628 "bdev_split_delete", 00:06:20.628 "bdev_split_create", 00:06:20.628 "bdev_delay_delete", 00:06:20.628 "bdev_delay_create", 00:06:20.628 "bdev_delay_update_latency", 00:06:20.628 "bdev_zone_block_delete", 00:06:20.628 "bdev_zone_block_create", 00:06:20.628 "blobfs_create", 00:06:20.628 "blobfs_detect", 00:06:20.628 "blobfs_set_cache_size", 00:06:20.628 "bdev_aio_delete", 00:06:20.628 "bdev_aio_rescan", 00:06:20.628 "bdev_aio_create", 00:06:20.628 "bdev_ftl_set_property", 00:06:20.628 "bdev_ftl_get_properties", 00:06:20.628 "bdev_ftl_get_stats", 00:06:20.628 "bdev_ftl_unmap", 00:06:20.628 "bdev_ftl_unload", 00:06:20.628 "bdev_ftl_delete", 00:06:20.628 "bdev_ftl_load", 00:06:20.628 "bdev_ftl_create", 00:06:20.628 "bdev_virtio_attach_controller", 00:06:20.628 "bdev_virtio_scsi_get_devices", 00:06:20.628 "bdev_virtio_detach_controller", 00:06:20.628 "bdev_virtio_blk_set_hotplug", 00:06:20.628 "bdev_iscsi_delete", 00:06:20.628 "bdev_iscsi_create", 00:06:20.628 "bdev_iscsi_set_options", 00:06:20.628 "accel_error_inject_error", 00:06:20.628 "ioat_scan_accel_module", 00:06:20.628 "dsa_scan_accel_module", 00:06:20.628 "iaa_scan_accel_module", 00:06:20.628 "vfu_virtio_create_scsi_endpoint", 00:06:20.628 "vfu_virtio_scsi_remove_target", 00:06:20.628 "vfu_virtio_scsi_add_target", 00:06:20.628 "vfu_virtio_create_blk_endpoint", 00:06:20.628 "vfu_virtio_delete_endpoint", 00:06:20.628 "iscsi_set_options", 00:06:20.628 "iscsi_get_auth_groups", 00:06:20.628 "iscsi_auth_group_remove_secret", 00:06:20.628 "iscsi_auth_group_add_secret", 00:06:20.628 "iscsi_delete_auth_group", 00:06:20.628 "iscsi_create_auth_group", 00:06:20.628 "iscsi_set_discovery_auth", 00:06:20.628 "iscsi_get_options", 00:06:20.628 "iscsi_target_node_request_logout", 00:06:20.628 "iscsi_target_node_set_redirect", 00:06:20.628 "iscsi_target_node_set_auth", 00:06:20.628 "iscsi_target_node_add_lun", 00:06:20.628 "iscsi_get_connections", 00:06:20.628 "iscsi_portal_group_set_auth", 00:06:20.628 "iscsi_start_portal_group", 00:06:20.628 "iscsi_delete_portal_group", 00:06:20.628 "iscsi_create_portal_group", 00:06:20.628 "iscsi_get_portal_groups", 00:06:20.628 "iscsi_delete_target_node", 00:06:20.628 "iscsi_target_node_remove_pg_ig_maps", 00:06:20.628 "iscsi_target_node_add_pg_ig_maps", 00:06:20.628 "iscsi_create_target_node", 00:06:20.628 "iscsi_get_target_nodes", 00:06:20.628 "iscsi_delete_initiator_group", 00:06:20.628 "iscsi_initiator_group_remove_initiators", 00:06:20.628 "iscsi_initiator_group_add_initiators", 00:06:20.628 "iscsi_create_initiator_group", 00:06:20.628 "iscsi_get_initiator_groups", 00:06:20.628 "nvmf_set_crdt", 00:06:20.628 "nvmf_set_config", 00:06:20.628 "nvmf_set_max_subsystems", 00:06:20.628 "nvmf_subsystem_get_listeners", 00:06:20.628 "nvmf_subsystem_get_qpairs", 00:06:20.628 "nvmf_subsystem_get_controllers", 00:06:20.628 "nvmf_get_stats", 00:06:20.628 "nvmf_get_transports", 00:06:20.628 "nvmf_create_transport", 00:06:20.628 "nvmf_get_targets", 00:06:20.628 "nvmf_delete_target", 00:06:20.628 "nvmf_create_target", 00:06:20.628 "nvmf_subsystem_allow_any_host", 00:06:20.628 "nvmf_subsystem_remove_host", 00:06:20.628 "nvmf_subsystem_add_host", 00:06:20.628 "nvmf_subsystem_remove_ns", 00:06:20.628 "nvmf_subsystem_add_ns", 00:06:20.628 "nvmf_subsystem_listener_set_ana_state", 00:06:20.628 "nvmf_discovery_get_referrals", 00:06:20.628 "nvmf_discovery_remove_referral", 00:06:20.628 "nvmf_discovery_add_referral", 00:06:20.628 "nvmf_subsystem_remove_listener", 00:06:20.628 "nvmf_subsystem_add_listener", 00:06:20.628 "nvmf_delete_subsystem", 00:06:20.628 "nvmf_create_subsystem", 00:06:20.628 "nvmf_get_subsystems", 00:06:20.628 "env_dpdk_get_mem_stats", 00:06:20.628 "nbd_get_disks", 00:06:20.628 "nbd_stop_disk", 00:06:20.628 "nbd_start_disk", 00:06:20.628 "ublk_recover_disk", 00:06:20.628 "ublk_get_disks", 00:06:20.628 "ublk_stop_disk", 00:06:20.628 "ublk_start_disk", 00:06:20.628 "ublk_destroy_target", 00:06:20.628 "ublk_create_target", 00:06:20.628 "virtio_blk_create_transport", 00:06:20.628 "virtio_blk_get_transports", 00:06:20.628 "vhost_controller_set_coalescing", 00:06:20.628 "vhost_get_controllers", 00:06:20.628 "vhost_delete_controller", 00:06:20.628 "vhost_create_blk_controller", 00:06:20.628 "vhost_scsi_controller_remove_target", 00:06:20.628 "vhost_scsi_controller_add_target", 00:06:20.628 "vhost_start_scsi_controller", 00:06:20.628 "vhost_create_scsi_controller", 00:06:20.628 "thread_set_cpumask", 00:06:20.628 "framework_get_scheduler", 00:06:20.628 "framework_set_scheduler", 00:06:20.628 "framework_get_reactors", 00:06:20.628 "thread_get_io_channels", 00:06:20.628 "thread_get_pollers", 00:06:20.628 "thread_get_stats", 00:06:20.628 "framework_monitor_context_switch", 00:06:20.628 "spdk_kill_instance", 00:06:20.628 "log_enable_timestamps", 00:06:20.628 "log_get_flags", 00:06:20.628 "log_clear_flag", 00:06:20.628 "log_set_flag", 00:06:20.628 "log_get_level", 00:06:20.628 "log_set_level", 00:06:20.628 "log_get_print_level", 00:06:20.628 "log_set_print_level", 00:06:20.628 "framework_enable_cpumask_locks", 00:06:20.628 "framework_disable_cpumask_locks", 00:06:20.628 "framework_wait_init", 00:06:20.628 "framework_start_init", 00:06:20.628 "scsi_get_devices", 00:06:20.628 "bdev_get_histogram", 00:06:20.628 "bdev_enable_histogram", 00:06:20.628 "bdev_set_qos_limit", 00:06:20.628 "bdev_set_qd_sampling_period", 00:06:20.628 "bdev_get_bdevs", 00:06:20.629 "bdev_reset_iostat", 00:06:20.629 "bdev_get_iostat", 00:06:20.629 "bdev_examine", 00:06:20.629 "bdev_wait_for_examine", 00:06:20.629 "bdev_set_options", 00:06:20.629 "notify_get_notifications", 00:06:20.629 "notify_get_types", 00:06:20.629 "accel_get_stats", 00:06:20.629 "accel_set_options", 00:06:20.629 "accel_set_driver", 00:06:20.629 "accel_crypto_key_destroy", 00:06:20.629 "accel_crypto_keys_get", 00:06:20.629 "accel_crypto_key_create", 00:06:20.629 "accel_assign_opc", 00:06:20.629 "accel_get_module_info", 00:06:20.629 "accel_get_opc_assignments", 00:06:20.629 "vmd_rescan", 00:06:20.629 "vmd_remove_device", 00:06:20.629 "vmd_enable", 00:06:20.629 "sock_set_default_impl", 00:06:20.629 "sock_impl_set_options", 00:06:20.629 "sock_impl_get_options", 00:06:20.629 "iobuf_get_stats", 00:06:20.629 "iobuf_set_options", 00:06:20.629 "framework_get_pci_devices", 00:06:20.629 "framework_get_config", 00:06:20.629 "framework_get_subsystems", 00:06:20.629 "vfu_tgt_set_base_path", 00:06:20.629 "trace_get_info", 00:06:20.629 "trace_get_tpoint_group_mask", 00:06:20.629 "trace_disable_tpoint_group", 00:06:20.629 "trace_enable_tpoint_group", 00:06:20.629 "trace_clear_tpoint_mask", 00:06:20.629 "trace_set_tpoint_mask", 00:06:20.629 "spdk_get_version", 00:06:20.629 "rpc_get_methods" 00:06:20.629 ] 00:06:20.629 01:00:35 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:06:20.629 01:00:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:20.629 01:00:35 -- common/autotest_common.sh@10 -- # set +x 00:06:20.629 01:00:35 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:06:20.629 01:00:35 -- spdkcli/tcp.sh@38 -- # killprocess 1913664 00:06:20.629 01:00:35 -- common/autotest_common.sh@936 -- # '[' -z 1913664 ']' 00:06:20.629 01:00:35 -- common/autotest_common.sh@940 -- # kill -0 1913664 00:06:20.629 01:00:35 -- common/autotest_common.sh@941 -- # uname 00:06:20.629 01:00:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:20.629 01:00:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1913664 00:06:20.629 01:00:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:20.629 01:00:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:20.629 01:00:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1913664' 00:06:20.629 killing process with pid 1913664 00:06:20.629 01:00:35 -- common/autotest_common.sh@955 -- # kill 1913664 00:06:20.629 01:00:35 -- common/autotest_common.sh@960 -- # wait 1913664 00:06:21.195 00:06:21.195 real 0m1.832s 00:06:21.195 user 0m3.470s 00:06:21.195 sys 0m0.522s 00:06:21.195 01:00:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:21.195 01:00:35 -- common/autotest_common.sh@10 -- # set +x 00:06:21.195 ************************************ 00:06:21.195 END TEST spdkcli_tcp 00:06:21.195 ************************************ 00:06:21.195 01:00:35 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:21.195 01:00:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:21.195 01:00:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:21.195 01:00:35 -- common/autotest_common.sh@10 -- # set +x 00:06:21.195 ************************************ 00:06:21.195 START TEST dpdk_mem_utility 00:06:21.195 ************************************ 00:06:21.195 01:00:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:21.195 * Looking for test storage... 00:06:21.195 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:06:21.196 01:00:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:21.196 01:00:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:21.196 01:00:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:21.196 01:00:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:21.196 01:00:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:21.196 01:00:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:21.196 01:00:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:21.196 01:00:35 -- scripts/common.sh@335 -- # IFS=.-: 00:06:21.196 01:00:35 -- scripts/common.sh@335 -- # read -ra ver1 00:06:21.196 01:00:35 -- scripts/common.sh@336 -- # IFS=.-: 00:06:21.196 01:00:35 -- scripts/common.sh@336 -- # read -ra ver2 00:06:21.196 01:00:35 -- scripts/common.sh@337 -- # local 'op=<' 00:06:21.196 01:00:35 -- scripts/common.sh@339 -- # ver1_l=2 00:06:21.196 01:00:35 -- scripts/common.sh@340 -- # ver2_l=1 00:06:21.196 01:00:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:21.196 01:00:35 -- scripts/common.sh@343 -- # case "$op" in 00:06:21.196 01:00:35 -- scripts/common.sh@344 -- # : 1 00:06:21.196 01:00:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:21.196 01:00:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:21.196 01:00:35 -- scripts/common.sh@364 -- # decimal 1 00:06:21.196 01:00:35 -- scripts/common.sh@352 -- # local d=1 00:06:21.196 01:00:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:21.196 01:00:35 -- scripts/common.sh@354 -- # echo 1 00:06:21.196 01:00:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:21.196 01:00:35 -- scripts/common.sh@365 -- # decimal 2 00:06:21.196 01:00:35 -- scripts/common.sh@352 -- # local d=2 00:06:21.196 01:00:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:21.196 01:00:35 -- scripts/common.sh@354 -- # echo 2 00:06:21.196 01:00:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:21.196 01:00:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:21.196 01:00:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:21.196 01:00:35 -- scripts/common.sh@367 -- # return 0 00:06:21.196 01:00:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:21.196 01:00:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:21.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:21.196 --rc genhtml_branch_coverage=1 00:06:21.196 --rc genhtml_function_coverage=1 00:06:21.196 --rc genhtml_legend=1 00:06:21.196 --rc geninfo_all_blocks=1 00:06:21.196 --rc geninfo_unexecuted_blocks=1 00:06:21.196 00:06:21.196 ' 00:06:21.196 01:00:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:21.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:21.196 --rc genhtml_branch_coverage=1 00:06:21.196 --rc genhtml_function_coverage=1 00:06:21.196 --rc genhtml_legend=1 00:06:21.196 --rc geninfo_all_blocks=1 00:06:21.196 --rc geninfo_unexecuted_blocks=1 00:06:21.196 00:06:21.196 ' 00:06:21.196 01:00:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:21.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:21.196 --rc genhtml_branch_coverage=1 00:06:21.196 --rc genhtml_function_coverage=1 00:06:21.196 --rc genhtml_legend=1 00:06:21.196 --rc geninfo_all_blocks=1 00:06:21.196 --rc geninfo_unexecuted_blocks=1 00:06:21.196 00:06:21.196 ' 00:06:21.196 01:00:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:21.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:21.196 --rc genhtml_branch_coverage=1 00:06:21.196 --rc genhtml_function_coverage=1 00:06:21.196 --rc genhtml_legend=1 00:06:21.196 --rc geninfo_all_blocks=1 00:06:21.196 --rc geninfo_unexecuted_blocks=1 00:06:21.196 00:06:21.196 ' 00:06:21.196 01:00:35 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:21.196 01:00:35 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=1914011 00:06:21.196 01:00:35 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:21.196 01:00:35 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 1914011 00:06:21.196 01:00:35 -- common/autotest_common.sh@829 -- # '[' -z 1914011 ']' 00:06:21.196 01:00:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:21.196 01:00:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:21.196 01:00:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:21.196 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:21.196 01:00:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:21.196 01:00:35 -- common/autotest_common.sh@10 -- # set +x 00:06:21.454 [2024-11-28 01:00:35.836301] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:21.454 [2024-11-28 01:00:35.836384] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1914011 ] 00:06:21.454 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.454 [2024-11-28 01:00:35.910130] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:21.454 [2024-11-28 01:00:35.999154] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:21.454 [2024-11-28 01:00:35.999340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.389 01:00:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:22.389 01:00:36 -- common/autotest_common.sh@862 -- # return 0 00:06:22.389 01:00:36 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:06:22.389 01:00:36 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:06:22.389 01:00:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:22.389 01:00:36 -- common/autotest_common.sh@10 -- # set +x 00:06:22.389 { 00:06:22.389 "filename": "/tmp/spdk_mem_dump.txt" 00:06:22.389 } 00:06:22.389 01:00:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:22.389 01:00:36 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:22.389 DPDK memory size 814.000000 MiB in 1 heap(s) 00:06:22.389 1 heaps totaling size 814.000000 MiB 00:06:22.389 size: 814.000000 MiB heap id: 0 00:06:22.389 end heaps---------- 00:06:22.389 8 mempools totaling size 598.116089 MiB 00:06:22.389 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:06:22.389 size: 158.602051 MiB name: PDU_data_out_Pool 00:06:22.389 size: 84.521057 MiB name: bdev_io_1914011 00:06:22.389 size: 51.011292 MiB name: evtpool_1914011 00:06:22.389 size: 50.003479 MiB name: msgpool_1914011 00:06:22.389 size: 21.763794 MiB name: PDU_Pool 00:06:22.389 size: 19.513306 MiB name: SCSI_TASK_Pool 00:06:22.389 size: 0.026123 MiB name: Session_Pool 00:06:22.389 end mempools------- 00:06:22.389 6 memzones totaling size 4.142822 MiB 00:06:22.389 size: 1.000366 MiB name: RG_ring_0_1914011 00:06:22.389 size: 1.000366 MiB name: RG_ring_1_1914011 00:06:22.389 size: 1.000366 MiB name: RG_ring_4_1914011 00:06:22.389 size: 1.000366 MiB name: RG_ring_5_1914011 00:06:22.389 size: 0.125366 MiB name: RG_ring_2_1914011 00:06:22.389 size: 0.015991 MiB name: RG_ring_3_1914011 00:06:22.389 end memzones------- 00:06:22.389 01:00:36 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:06:22.389 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:06:22.389 list of free elements. size: 12.519348 MiB 00:06:22.389 element at address: 0x200000400000 with size: 1.999512 MiB 00:06:22.389 element at address: 0x200018e00000 with size: 0.999878 MiB 00:06:22.389 element at address: 0x200019000000 with size: 0.999878 MiB 00:06:22.389 element at address: 0x200003e00000 with size: 0.996277 MiB 00:06:22.389 element at address: 0x200031c00000 with size: 0.994446 MiB 00:06:22.389 element at address: 0x200013800000 with size: 0.978699 MiB 00:06:22.389 element at address: 0x200007000000 with size: 0.959839 MiB 00:06:22.389 element at address: 0x200019200000 with size: 0.936584 MiB 00:06:22.389 element at address: 0x200000200000 with size: 0.841614 MiB 00:06:22.389 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:06:22.389 element at address: 0x20000b200000 with size: 0.490723 MiB 00:06:22.389 element at address: 0x200000800000 with size: 0.487793 MiB 00:06:22.390 element at address: 0x200019400000 with size: 0.485657 MiB 00:06:22.390 element at address: 0x200027e00000 with size: 0.410034 MiB 00:06:22.390 element at address: 0x200003a00000 with size: 0.355530 MiB 00:06:22.390 list of standard malloc elements. size: 199.218079 MiB 00:06:22.390 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:06:22.390 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:06:22.390 element at address: 0x200018efff80 with size: 1.000122 MiB 00:06:22.390 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:06:22.390 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:06:22.390 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:06:22.390 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:06:22.390 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:06:22.390 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:06:22.390 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:06:22.390 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:06:22.390 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:06:22.390 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:06:22.390 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:06:22.390 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:06:22.390 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:06:22.390 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:06:22.390 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:06:22.390 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:06:22.390 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:06:22.390 element at address: 0x200003adb300 with size: 0.000183 MiB 00:06:22.390 element at address: 0x200003adb500 with size: 0.000183 MiB 00:06:22.390 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:06:22.390 element at address: 0x200003affa80 with size: 0.000183 MiB 00:06:22.390 element at address: 0x200003affb40 with size: 0.000183 MiB 00:06:22.390 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:06:22.390 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:06:22.390 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:06:22.390 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:06:22.390 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:06:22.390 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:06:22.390 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:06:22.390 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:06:22.390 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:06:22.390 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:06:22.390 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:06:22.390 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:06:22.390 element at address: 0x200027e69040 with size: 0.000183 MiB 00:06:22.390 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:06:22.390 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:06:22.390 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:06:22.390 list of memzone associated elements. size: 602.262573 MiB 00:06:22.390 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:06:22.390 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:06:22.390 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:06:22.390 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:06:22.390 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:06:22.390 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_1914011_0 00:06:22.390 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:06:22.390 associated memzone info: size: 48.002930 MiB name: MP_evtpool_1914011_0 00:06:22.390 element at address: 0x200003fff380 with size: 48.003052 MiB 00:06:22.390 associated memzone info: size: 48.002930 MiB name: MP_msgpool_1914011_0 00:06:22.390 element at address: 0x2000195be940 with size: 20.255554 MiB 00:06:22.390 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:06:22.390 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:06:22.390 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:06:22.390 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:06:22.390 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_1914011 00:06:22.390 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:06:22.390 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_1914011 00:06:22.390 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:06:22.390 associated memzone info: size: 1.007996 MiB name: MP_evtpool_1914011 00:06:22.390 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:06:22.390 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:06:22.390 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:06:22.390 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:06:22.390 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:06:22.390 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:06:22.390 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:06:22.390 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:06:22.390 element at address: 0x200003eff180 with size: 1.000488 MiB 00:06:22.390 associated memzone info: size: 1.000366 MiB name: RG_ring_0_1914011 00:06:22.390 element at address: 0x200003affc00 with size: 1.000488 MiB 00:06:22.390 associated memzone info: size: 1.000366 MiB name: RG_ring_1_1914011 00:06:22.390 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:06:22.390 associated memzone info: size: 1.000366 MiB name: RG_ring_4_1914011 00:06:22.390 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:06:22.390 associated memzone info: size: 1.000366 MiB name: RG_ring_5_1914011 00:06:22.390 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:06:22.390 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_1914011 00:06:22.390 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:06:22.390 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:06:22.390 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:06:22.390 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:06:22.390 element at address: 0x20001947c540 with size: 0.250488 MiB 00:06:22.390 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:06:22.390 element at address: 0x200003adf880 with size: 0.125488 MiB 00:06:22.390 associated memzone info: size: 0.125366 MiB name: RG_ring_2_1914011 00:06:22.390 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:06:22.390 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:06:22.390 element at address: 0x200027e69100 with size: 0.023743 MiB 00:06:22.390 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:06:22.390 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:06:22.390 associated memzone info: size: 0.015991 MiB name: RG_ring_3_1914011 00:06:22.390 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:06:22.390 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:06:22.390 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:06:22.390 associated memzone info: size: 0.000183 MiB name: MP_msgpool_1914011 00:06:22.390 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:06:22.390 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_1914011 00:06:22.390 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:06:22.390 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:06:22.390 01:00:36 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:06:22.390 01:00:36 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 1914011 00:06:22.390 01:00:36 -- common/autotest_common.sh@936 -- # '[' -z 1914011 ']' 00:06:22.390 01:00:36 -- common/autotest_common.sh@940 -- # kill -0 1914011 00:06:22.390 01:00:36 -- common/autotest_common.sh@941 -- # uname 00:06:22.390 01:00:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:22.390 01:00:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1914011 00:06:22.390 01:00:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:22.390 01:00:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:22.390 01:00:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1914011' 00:06:22.390 killing process with pid 1914011 00:06:22.390 01:00:36 -- common/autotest_common.sh@955 -- # kill 1914011 00:06:22.390 01:00:36 -- common/autotest_common.sh@960 -- # wait 1914011 00:06:22.956 00:06:22.956 real 0m1.715s 00:06:22.956 user 0m1.832s 00:06:22.956 sys 0m0.513s 00:06:22.956 01:00:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:22.956 01:00:37 -- common/autotest_common.sh@10 -- # set +x 00:06:22.956 ************************************ 00:06:22.956 END TEST dpdk_mem_utility 00:06:22.956 ************************************ 00:06:22.956 01:00:37 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:06:22.956 01:00:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:22.956 01:00:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:22.956 01:00:37 -- common/autotest_common.sh@10 -- # set +x 00:06:22.956 ************************************ 00:06:22.956 START TEST event 00:06:22.956 ************************************ 00:06:22.956 01:00:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:06:22.956 * Looking for test storage... 00:06:22.956 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:22.956 01:00:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:22.956 01:00:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:22.956 01:00:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:22.956 01:00:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:22.956 01:00:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:22.956 01:00:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:22.956 01:00:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:22.956 01:00:37 -- scripts/common.sh@335 -- # IFS=.-: 00:06:22.956 01:00:37 -- scripts/common.sh@335 -- # read -ra ver1 00:06:22.956 01:00:37 -- scripts/common.sh@336 -- # IFS=.-: 00:06:22.956 01:00:37 -- scripts/common.sh@336 -- # read -ra ver2 00:06:22.956 01:00:37 -- scripts/common.sh@337 -- # local 'op=<' 00:06:22.956 01:00:37 -- scripts/common.sh@339 -- # ver1_l=2 00:06:22.956 01:00:37 -- scripts/common.sh@340 -- # ver2_l=1 00:06:22.956 01:00:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:22.956 01:00:37 -- scripts/common.sh@343 -- # case "$op" in 00:06:22.956 01:00:37 -- scripts/common.sh@344 -- # : 1 00:06:22.956 01:00:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:22.956 01:00:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:22.956 01:00:37 -- scripts/common.sh@364 -- # decimal 1 00:06:22.956 01:00:37 -- scripts/common.sh@352 -- # local d=1 00:06:22.956 01:00:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:22.956 01:00:37 -- scripts/common.sh@354 -- # echo 1 00:06:22.956 01:00:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:22.956 01:00:37 -- scripts/common.sh@365 -- # decimal 2 00:06:22.956 01:00:37 -- scripts/common.sh@352 -- # local d=2 00:06:22.956 01:00:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:22.956 01:00:37 -- scripts/common.sh@354 -- # echo 2 00:06:22.956 01:00:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:22.956 01:00:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:22.957 01:00:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:22.957 01:00:37 -- scripts/common.sh@367 -- # return 0 00:06:22.957 01:00:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:22.957 01:00:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:22.957 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:22.957 --rc genhtml_branch_coverage=1 00:06:22.957 --rc genhtml_function_coverage=1 00:06:22.957 --rc genhtml_legend=1 00:06:22.957 --rc geninfo_all_blocks=1 00:06:22.957 --rc geninfo_unexecuted_blocks=1 00:06:22.957 00:06:22.957 ' 00:06:22.957 01:00:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:22.957 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:22.957 --rc genhtml_branch_coverage=1 00:06:22.957 --rc genhtml_function_coverage=1 00:06:22.957 --rc genhtml_legend=1 00:06:22.957 --rc geninfo_all_blocks=1 00:06:22.957 --rc geninfo_unexecuted_blocks=1 00:06:22.957 00:06:22.957 ' 00:06:22.957 01:00:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:22.957 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:22.957 --rc genhtml_branch_coverage=1 00:06:22.957 --rc genhtml_function_coverage=1 00:06:22.957 --rc genhtml_legend=1 00:06:22.957 --rc geninfo_all_blocks=1 00:06:22.957 --rc geninfo_unexecuted_blocks=1 00:06:22.957 00:06:22.957 ' 00:06:22.957 01:00:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:22.957 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:22.957 --rc genhtml_branch_coverage=1 00:06:22.957 --rc genhtml_function_coverage=1 00:06:22.957 --rc genhtml_legend=1 00:06:22.957 --rc geninfo_all_blocks=1 00:06:22.957 --rc geninfo_unexecuted_blocks=1 00:06:22.957 00:06:22.957 ' 00:06:22.957 01:00:37 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:06:22.957 01:00:37 -- bdev/nbd_common.sh@6 -- # set -e 00:06:22.957 01:00:37 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:22.957 01:00:37 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:22.957 01:00:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:22.957 01:00:37 -- common/autotest_common.sh@10 -- # set +x 00:06:22.957 ************************************ 00:06:22.957 START TEST event_perf 00:06:22.957 ************************************ 00:06:22.957 01:00:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:22.957 Running I/O for 1 seconds...[2024-11-28 01:00:37.545057] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:22.957 [2024-11-28 01:00:37.545143] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1914215 ] 00:06:23.215 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.215 [2024-11-28 01:00:37.606031] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:23.215 [2024-11-28 01:00:37.697437] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:23.215 [2024-11-28 01:00:37.697490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:23.215 [2024-11-28 01:00:37.697610] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.215 [2024-11-28 01:00:37.697606] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:24.588 Running I/O for 1 seconds... 00:06:24.588 lcore 0: 228367 00:06:24.588 lcore 1: 228367 00:06:24.588 lcore 2: 228367 00:06:24.588 lcore 3: 228367 00:06:24.588 done. 00:06:24.588 00:06:24.588 real 0m1.250s 00:06:24.588 user 0m4.156s 00:06:24.588 sys 0m0.091s 00:06:24.588 01:00:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:24.588 01:00:38 -- common/autotest_common.sh@10 -- # set +x 00:06:24.588 ************************************ 00:06:24.588 END TEST event_perf 00:06:24.588 ************************************ 00:06:24.588 01:00:38 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:24.588 01:00:38 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:24.588 01:00:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.588 01:00:38 -- common/autotest_common.sh@10 -- # set +x 00:06:24.588 ************************************ 00:06:24.588 START TEST event_reactor 00:06:24.588 ************************************ 00:06:24.588 01:00:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:24.588 [2024-11-28 01:00:38.825812] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:24.588 [2024-11-28 01:00:38.825918] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1914374 ] 00:06:24.588 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.588 [2024-11-28 01:00:38.890979] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:24.588 [2024-11-28 01:00:38.977043] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:25.522 test_start 00:06:25.522 oneshot 00:06:25.522 tick 100 00:06:25.522 tick 100 00:06:25.522 tick 250 00:06:25.522 tick 100 00:06:25.522 tick 100 00:06:25.522 tick 100 00:06:25.522 tick 250 00:06:25.522 tick 500 00:06:25.522 tick 100 00:06:25.522 tick 100 00:06:25.522 tick 250 00:06:25.522 tick 100 00:06:25.522 tick 100 00:06:25.522 test_end 00:06:25.522 00:06:25.522 real 0m1.250s 00:06:25.522 user 0m1.164s 00:06:25.522 sys 0m0.081s 00:06:25.522 01:00:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:25.522 01:00:40 -- common/autotest_common.sh@10 -- # set +x 00:06:25.522 ************************************ 00:06:25.522 END TEST event_reactor 00:06:25.522 ************************************ 00:06:25.522 01:00:40 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:25.522 01:00:40 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:25.522 01:00:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.522 01:00:40 -- common/autotest_common.sh@10 -- # set +x 00:06:25.522 ************************************ 00:06:25.522 START TEST event_reactor_perf 00:06:25.522 ************************************ 00:06:25.522 01:00:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:25.522 [2024-11-28 01:00:40.100114] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:25.522 [2024-11-28 01:00:40.100193] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1914588 ] 00:06:25.781 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.781 [2024-11-28 01:00:40.167848] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:25.781 [2024-11-28 01:00:40.258424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:27.155 test_start 00:06:27.155 test_end 00:06:27.155 Performance: 353519 events per second 00:06:27.155 00:06:27.155 real 0m1.251s 00:06:27.155 user 0m1.160s 00:06:27.155 sys 0m0.084s 00:06:27.155 01:00:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.155 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:06:27.155 ************************************ 00:06:27.155 END TEST event_reactor_perf 00:06:27.155 ************************************ 00:06:27.155 01:00:41 -- event/event.sh@49 -- # uname -s 00:06:27.155 01:00:41 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:06:27.155 01:00:41 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:27.155 01:00:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:27.155 01:00:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.155 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:06:27.155 ************************************ 00:06:27.155 START TEST event_scheduler 00:06:27.155 ************************************ 00:06:27.155 01:00:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:27.155 * Looking for test storage... 00:06:27.155 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:06:27.155 01:00:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:27.155 01:00:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:27.155 01:00:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:27.155 01:00:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:27.155 01:00:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:27.155 01:00:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:27.155 01:00:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:27.155 01:00:41 -- scripts/common.sh@335 -- # IFS=.-: 00:06:27.155 01:00:41 -- scripts/common.sh@335 -- # read -ra ver1 00:06:27.155 01:00:41 -- scripts/common.sh@336 -- # IFS=.-: 00:06:27.155 01:00:41 -- scripts/common.sh@336 -- # read -ra ver2 00:06:27.155 01:00:41 -- scripts/common.sh@337 -- # local 'op=<' 00:06:27.155 01:00:41 -- scripts/common.sh@339 -- # ver1_l=2 00:06:27.155 01:00:41 -- scripts/common.sh@340 -- # ver2_l=1 00:06:27.155 01:00:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:27.155 01:00:41 -- scripts/common.sh@343 -- # case "$op" in 00:06:27.155 01:00:41 -- scripts/common.sh@344 -- # : 1 00:06:27.155 01:00:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:27.155 01:00:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:27.155 01:00:41 -- scripts/common.sh@364 -- # decimal 1 00:06:27.155 01:00:41 -- scripts/common.sh@352 -- # local d=1 00:06:27.155 01:00:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:27.155 01:00:41 -- scripts/common.sh@354 -- # echo 1 00:06:27.155 01:00:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:27.155 01:00:41 -- scripts/common.sh@365 -- # decimal 2 00:06:27.155 01:00:41 -- scripts/common.sh@352 -- # local d=2 00:06:27.155 01:00:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:27.155 01:00:41 -- scripts/common.sh@354 -- # echo 2 00:06:27.155 01:00:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:27.155 01:00:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:27.155 01:00:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:27.155 01:00:41 -- scripts/common.sh@367 -- # return 0 00:06:27.155 01:00:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:27.155 01:00:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:27.155 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.155 --rc genhtml_branch_coverage=1 00:06:27.155 --rc genhtml_function_coverage=1 00:06:27.155 --rc genhtml_legend=1 00:06:27.155 --rc geninfo_all_blocks=1 00:06:27.155 --rc geninfo_unexecuted_blocks=1 00:06:27.155 00:06:27.155 ' 00:06:27.155 01:00:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:27.155 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.155 --rc genhtml_branch_coverage=1 00:06:27.155 --rc genhtml_function_coverage=1 00:06:27.155 --rc genhtml_legend=1 00:06:27.155 --rc geninfo_all_blocks=1 00:06:27.155 --rc geninfo_unexecuted_blocks=1 00:06:27.155 00:06:27.155 ' 00:06:27.155 01:00:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:27.155 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.155 --rc genhtml_branch_coverage=1 00:06:27.155 --rc genhtml_function_coverage=1 00:06:27.155 --rc genhtml_legend=1 00:06:27.155 --rc geninfo_all_blocks=1 00:06:27.155 --rc geninfo_unexecuted_blocks=1 00:06:27.155 00:06:27.155 ' 00:06:27.155 01:00:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:27.155 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.155 --rc genhtml_branch_coverage=1 00:06:27.155 --rc genhtml_function_coverage=1 00:06:27.155 --rc genhtml_legend=1 00:06:27.155 --rc geninfo_all_blocks=1 00:06:27.155 --rc geninfo_unexecuted_blocks=1 00:06:27.155 00:06:27.155 ' 00:06:27.155 01:00:41 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:06:27.155 01:00:41 -- scheduler/scheduler.sh@35 -- # scheduler_pid=1914851 00:06:27.155 01:00:41 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:06:27.155 01:00:41 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:06:27.155 01:00:41 -- scheduler/scheduler.sh@37 -- # waitforlisten 1914851 00:06:27.155 01:00:41 -- common/autotest_common.sh@829 -- # '[' -z 1914851 ']' 00:06:27.155 01:00:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:27.155 01:00:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:27.155 01:00:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:27.155 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:27.155 01:00:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:27.155 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:06:27.155 [2024-11-28 01:00:41.546668] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:27.155 [2024-11-28 01:00:41.546752] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1914851 ] 00:06:27.155 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.155 [2024-11-28 01:00:41.604177] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:27.155 [2024-11-28 01:00:41.687107] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:27.155 [2024-11-28 01:00:41.687172] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:27.156 [2024-11-28 01:00:41.687235] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:27.156 [2024-11-28 01:00:41.687238] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:27.414 01:00:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:27.414 01:00:41 -- common/autotest_common.sh@862 -- # return 0 00:06:27.414 01:00:41 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:06:27.414 01:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:27.414 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:06:27.414 POWER: Env isn't set yet! 00:06:27.414 POWER: Attempting to initialise ACPI cpufreq power management... 00:06:27.414 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:06:27.414 POWER: Cannot get available frequencies of lcore 0 00:06:27.414 POWER: Attempting to initialise PSTAT power management... 00:06:27.414 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:06:27.414 POWER: Initialized successfully for lcore 0 power management 00:06:27.414 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:06:27.414 POWER: Initialized successfully for lcore 1 power management 00:06:27.414 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:06:27.414 POWER: Initialized successfully for lcore 2 power management 00:06:27.414 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:06:27.414 POWER: Initialized successfully for lcore 3 power management 00:06:27.414 [2024-11-28 01:00:41.802730] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:06:27.414 [2024-11-28 01:00:41.802748] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:06:27.414 [2024-11-28 01:00:41.802759] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:06:27.414 01:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:27.414 01:00:41 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:06:27.414 01:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:27.414 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:06:27.414 [2024-11-28 01:00:41.904233] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:06:27.414 01:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:27.414 01:00:41 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:06:27.414 01:00:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:27.414 01:00:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.414 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:06:27.414 ************************************ 00:06:27.414 START TEST scheduler_create_thread 00:06:27.414 ************************************ 00:06:27.414 01:00:41 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:06:27.414 01:00:41 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:06:27.414 01:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:27.414 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:06:27.414 2 00:06:27.414 01:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:27.414 01:00:41 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:06:27.414 01:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:27.414 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:06:27.414 3 00:06:27.414 01:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:27.414 01:00:41 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:06:27.414 01:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:27.414 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:06:27.414 4 00:06:27.414 01:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:27.414 01:00:41 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:06:27.414 01:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:27.414 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:06:27.414 5 00:06:27.414 01:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:27.414 01:00:41 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:06:27.414 01:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:27.414 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:06:27.414 6 00:06:27.414 01:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:27.414 01:00:41 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:06:27.414 01:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:27.414 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:06:27.414 7 00:06:27.414 01:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:27.414 01:00:41 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:06:27.414 01:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:27.414 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:06:27.414 8 00:06:27.414 01:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:27.414 01:00:41 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:06:27.414 01:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:27.414 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:06:27.414 9 00:06:27.414 01:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:27.414 01:00:41 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:06:27.414 01:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:27.414 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:06:27.414 10 00:06:27.414 01:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:27.414 01:00:42 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:06:27.414 01:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:27.414 01:00:42 -- common/autotest_common.sh@10 -- # set +x 00:06:27.414 01:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:27.414 01:00:42 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:06:27.415 01:00:42 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:06:27.415 01:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:27.415 01:00:42 -- common/autotest_common.sh@10 -- # set +x 00:06:27.981 01:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:27.981 01:00:42 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:06:27.981 01:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:27.981 01:00:42 -- common/autotest_common.sh@10 -- # set +x 00:06:29.354 01:00:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:29.354 01:00:43 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:06:29.354 01:00:43 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:06:29.354 01:00:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:29.354 01:00:43 -- common/autotest_common.sh@10 -- # set +x 00:06:30.726 01:00:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:30.726 00:06:30.726 real 0m3.101s 00:06:30.726 user 0m0.010s 00:06:30.726 sys 0m0.005s 00:06:30.726 01:00:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:30.726 01:00:45 -- common/autotest_common.sh@10 -- # set +x 00:06:30.726 ************************************ 00:06:30.726 END TEST scheduler_create_thread 00:06:30.726 ************************************ 00:06:30.726 01:00:45 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:06:30.726 01:00:45 -- scheduler/scheduler.sh@46 -- # killprocess 1914851 00:06:30.726 01:00:45 -- common/autotest_common.sh@936 -- # '[' -z 1914851 ']' 00:06:30.726 01:00:45 -- common/autotest_common.sh@940 -- # kill -0 1914851 00:06:30.726 01:00:45 -- common/autotest_common.sh@941 -- # uname 00:06:30.726 01:00:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:30.726 01:00:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1914851 00:06:30.726 01:00:45 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:30.726 01:00:45 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:30.726 01:00:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1914851' 00:06:30.726 killing process with pid 1914851 00:06:30.726 01:00:45 -- common/autotest_common.sh@955 -- # kill 1914851 00:06:30.726 01:00:45 -- common/autotest_common.sh@960 -- # wait 1914851 00:06:30.984 [2024-11-28 01:00:45.392544] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:06:30.984 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:06:30.984 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:06:30.984 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:06:30.984 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:06:30.984 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:06:30.984 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:06:30.984 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:06:30.984 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:06:31.242 00:06:31.242 real 0m4.278s 00:06:31.242 user 0m6.970s 00:06:31.242 sys 0m0.353s 00:06:31.242 01:00:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:31.242 01:00:45 -- common/autotest_common.sh@10 -- # set +x 00:06:31.242 ************************************ 00:06:31.242 END TEST event_scheduler 00:06:31.242 ************************************ 00:06:31.242 01:00:45 -- event/event.sh@51 -- # modprobe -n nbd 00:06:31.242 01:00:45 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:06:31.242 01:00:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:31.242 01:00:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:31.242 01:00:45 -- common/autotest_common.sh@10 -- # set +x 00:06:31.242 ************************************ 00:06:31.242 START TEST app_repeat 00:06:31.242 ************************************ 00:06:31.242 01:00:45 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:06:31.242 01:00:45 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:31.242 01:00:45 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:31.242 01:00:45 -- event/event.sh@13 -- # local nbd_list 00:06:31.242 01:00:45 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:31.242 01:00:45 -- event/event.sh@14 -- # local bdev_list 00:06:31.242 01:00:45 -- event/event.sh@15 -- # local repeat_times=4 00:06:31.242 01:00:45 -- event/event.sh@17 -- # modprobe nbd 00:06:31.242 01:00:45 -- event/event.sh@19 -- # repeat_pid=1915337 00:06:31.242 01:00:45 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:06:31.242 01:00:45 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:06:31.242 01:00:45 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 1915337' 00:06:31.242 Process app_repeat pid: 1915337 00:06:31.242 01:00:45 -- event/event.sh@23 -- # for i in {0..2} 00:06:31.242 01:00:45 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:06:31.242 spdk_app_start Round 0 00:06:31.242 01:00:45 -- event/event.sh@25 -- # waitforlisten 1915337 /var/tmp/spdk-nbd.sock 00:06:31.242 01:00:45 -- common/autotest_common.sh@829 -- # '[' -z 1915337 ']' 00:06:31.242 01:00:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:31.242 01:00:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:31.242 01:00:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:31.242 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:31.242 01:00:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:31.242 01:00:45 -- common/autotest_common.sh@10 -- # set +x 00:06:31.242 [2024-11-28 01:00:45.706824] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:31.242 [2024-11-28 01:00:45.706910] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1915337 ] 00:06:31.242 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.242 [2024-11-28 01:00:45.766863] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:31.500 [2024-11-28 01:00:45.856568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:31.500 [2024-11-28 01:00:45.856572] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:32.434 01:00:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:32.434 01:00:46 -- common/autotest_common.sh@862 -- # return 0 00:06:32.434 01:00:46 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:32.434 Malloc0 00:06:32.434 01:00:46 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:32.692 Malloc1 00:06:32.692 01:00:47 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:32.692 01:00:47 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:32.692 01:00:47 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:32.692 01:00:47 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:32.692 01:00:47 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:32.692 01:00:47 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:32.692 01:00:47 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:32.692 01:00:47 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:32.692 01:00:47 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:32.692 01:00:47 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:32.692 01:00:47 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:32.692 01:00:47 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:32.692 01:00:47 -- bdev/nbd_common.sh@12 -- # local i 00:06:32.692 01:00:47 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:32.693 01:00:47 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:32.693 01:00:47 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:32.950 /dev/nbd0 00:06:32.950 01:00:47 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:32.950 01:00:47 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:32.950 01:00:47 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:32.951 01:00:47 -- common/autotest_common.sh@867 -- # local i 00:06:32.951 01:00:47 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:32.951 01:00:47 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:32.951 01:00:47 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:32.951 01:00:47 -- common/autotest_common.sh@871 -- # break 00:06:32.951 01:00:47 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:32.951 01:00:47 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:32.951 01:00:47 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:32.951 1+0 records in 00:06:32.951 1+0 records out 00:06:32.951 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000209183 s, 19.6 MB/s 00:06:32.951 01:00:47 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:32.951 01:00:47 -- common/autotest_common.sh@884 -- # size=4096 00:06:32.951 01:00:47 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:32.951 01:00:47 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:32.951 01:00:47 -- common/autotest_common.sh@887 -- # return 0 00:06:32.951 01:00:47 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:32.951 01:00:47 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:32.951 01:00:47 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:33.209 /dev/nbd1 00:06:33.209 01:00:47 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:33.209 01:00:47 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:33.209 01:00:47 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:33.209 01:00:47 -- common/autotest_common.sh@867 -- # local i 00:06:33.209 01:00:47 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:33.209 01:00:47 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:33.209 01:00:47 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:33.209 01:00:47 -- common/autotest_common.sh@871 -- # break 00:06:33.209 01:00:47 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:33.209 01:00:47 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:33.209 01:00:47 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:33.209 1+0 records in 00:06:33.209 1+0 records out 00:06:33.209 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000193607 s, 21.2 MB/s 00:06:33.209 01:00:47 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:33.467 01:00:47 -- common/autotest_common.sh@884 -- # size=4096 00:06:33.467 01:00:47 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:33.467 01:00:47 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:33.467 01:00:47 -- common/autotest_common.sh@887 -- # return 0 00:06:33.467 01:00:47 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:33.467 01:00:47 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:33.467 01:00:47 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:33.467 01:00:47 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:33.467 01:00:47 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:33.726 { 00:06:33.726 "nbd_device": "/dev/nbd0", 00:06:33.726 "bdev_name": "Malloc0" 00:06:33.726 }, 00:06:33.726 { 00:06:33.726 "nbd_device": "/dev/nbd1", 00:06:33.726 "bdev_name": "Malloc1" 00:06:33.726 } 00:06:33.726 ]' 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:33.726 { 00:06:33.726 "nbd_device": "/dev/nbd0", 00:06:33.726 "bdev_name": "Malloc0" 00:06:33.726 }, 00:06:33.726 { 00:06:33.726 "nbd_device": "/dev/nbd1", 00:06:33.726 "bdev_name": "Malloc1" 00:06:33.726 } 00:06:33.726 ]' 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:33.726 /dev/nbd1' 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:33.726 /dev/nbd1' 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@65 -- # count=2 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@95 -- # count=2 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:33.726 256+0 records in 00:06:33.726 256+0 records out 00:06:33.726 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00511161 s, 205 MB/s 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:33.726 256+0 records in 00:06:33.726 256+0 records out 00:06:33.726 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190755 s, 55.0 MB/s 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:33.726 256+0 records in 00:06:33.726 256+0 records out 00:06:33.726 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223845 s, 46.8 MB/s 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@51 -- # local i 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:33.726 01:00:48 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:33.985 01:00:48 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:33.985 01:00:48 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:33.985 01:00:48 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:33.985 01:00:48 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:33.985 01:00:48 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:33.985 01:00:48 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:33.985 01:00:48 -- bdev/nbd_common.sh@41 -- # break 00:06:33.985 01:00:48 -- bdev/nbd_common.sh@45 -- # return 0 00:06:33.985 01:00:48 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:33.985 01:00:48 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:34.242 01:00:48 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:34.242 01:00:48 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:34.242 01:00:48 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:34.242 01:00:48 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:34.242 01:00:48 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:34.242 01:00:48 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:34.242 01:00:48 -- bdev/nbd_common.sh@41 -- # break 00:06:34.242 01:00:48 -- bdev/nbd_common.sh@45 -- # return 0 00:06:34.242 01:00:48 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:34.242 01:00:48 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:34.242 01:00:48 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:34.500 01:00:48 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:34.500 01:00:48 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:34.500 01:00:48 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:34.500 01:00:49 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:34.500 01:00:49 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:34.500 01:00:49 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:34.500 01:00:49 -- bdev/nbd_common.sh@65 -- # true 00:06:34.500 01:00:49 -- bdev/nbd_common.sh@65 -- # count=0 00:06:34.500 01:00:49 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:34.500 01:00:49 -- bdev/nbd_common.sh@104 -- # count=0 00:06:34.500 01:00:49 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:34.500 01:00:49 -- bdev/nbd_common.sh@109 -- # return 0 00:06:34.500 01:00:49 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:34.758 01:00:49 -- event/event.sh@35 -- # sleep 3 00:06:35.016 [2024-11-28 01:00:49.543503] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:35.275 [2024-11-28 01:00:49.633135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.275 [2024-11-28 01:00:49.633136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:35.275 [2024-11-28 01:00:49.694700] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:35.275 [2024-11-28 01:00:49.694772] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:37.803 01:00:52 -- event/event.sh@23 -- # for i in {0..2} 00:06:37.804 01:00:52 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:06:37.804 spdk_app_start Round 1 00:06:37.804 01:00:52 -- event/event.sh@25 -- # waitforlisten 1915337 /var/tmp/spdk-nbd.sock 00:06:37.804 01:00:52 -- common/autotest_common.sh@829 -- # '[' -z 1915337 ']' 00:06:37.804 01:00:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:37.804 01:00:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:37.804 01:00:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:37.804 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:37.804 01:00:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:37.804 01:00:52 -- common/autotest_common.sh@10 -- # set +x 00:06:38.062 01:00:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:38.062 01:00:52 -- common/autotest_common.sh@862 -- # return 0 00:06:38.062 01:00:52 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:38.322 Malloc0 00:06:38.322 01:00:52 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:38.581 Malloc1 00:06:38.581 01:00:53 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:38.581 01:00:53 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:38.581 01:00:53 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:38.581 01:00:53 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:38.581 01:00:53 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:38.581 01:00:53 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:38.581 01:00:53 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:38.581 01:00:53 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:38.581 01:00:53 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:38.581 01:00:53 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:38.581 01:00:53 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:38.581 01:00:53 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:38.581 01:00:53 -- bdev/nbd_common.sh@12 -- # local i 00:06:38.581 01:00:53 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:38.581 01:00:53 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:38.581 01:00:53 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:38.839 /dev/nbd0 00:06:38.839 01:00:53 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:38.839 01:00:53 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:38.839 01:00:53 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:38.839 01:00:53 -- common/autotest_common.sh@867 -- # local i 00:06:38.839 01:00:53 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:38.840 01:00:53 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:38.840 01:00:53 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:38.840 01:00:53 -- common/autotest_common.sh@871 -- # break 00:06:38.840 01:00:53 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:38.840 01:00:53 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:38.840 01:00:53 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:38.840 1+0 records in 00:06:38.840 1+0 records out 00:06:38.840 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000211537 s, 19.4 MB/s 00:06:38.840 01:00:53 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:38.840 01:00:53 -- common/autotest_common.sh@884 -- # size=4096 00:06:38.840 01:00:53 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:38.840 01:00:53 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:38.840 01:00:53 -- common/autotest_common.sh@887 -- # return 0 00:06:38.840 01:00:53 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:38.840 01:00:53 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:38.840 01:00:53 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:39.098 /dev/nbd1 00:06:39.098 01:00:53 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:39.098 01:00:53 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:39.098 01:00:53 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:39.098 01:00:53 -- common/autotest_common.sh@867 -- # local i 00:06:39.098 01:00:53 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:39.098 01:00:53 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:39.098 01:00:53 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:39.098 01:00:53 -- common/autotest_common.sh@871 -- # break 00:06:39.098 01:00:53 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:39.098 01:00:53 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:39.098 01:00:53 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:39.098 1+0 records in 00:06:39.098 1+0 records out 00:06:39.098 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000215904 s, 19.0 MB/s 00:06:39.098 01:00:53 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:39.098 01:00:53 -- common/autotest_common.sh@884 -- # size=4096 00:06:39.098 01:00:53 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:39.098 01:00:53 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:39.098 01:00:53 -- common/autotest_common.sh@887 -- # return 0 00:06:39.098 01:00:53 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:39.098 01:00:53 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:39.098 01:00:53 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:39.356 01:00:53 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:39.356 01:00:53 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:39.356 01:00:53 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:39.356 { 00:06:39.356 "nbd_device": "/dev/nbd0", 00:06:39.356 "bdev_name": "Malloc0" 00:06:39.356 }, 00:06:39.356 { 00:06:39.356 "nbd_device": "/dev/nbd1", 00:06:39.356 "bdev_name": "Malloc1" 00:06:39.356 } 00:06:39.356 ]' 00:06:39.356 01:00:53 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:39.356 { 00:06:39.356 "nbd_device": "/dev/nbd0", 00:06:39.356 "bdev_name": "Malloc0" 00:06:39.356 }, 00:06:39.356 { 00:06:39.356 "nbd_device": "/dev/nbd1", 00:06:39.356 "bdev_name": "Malloc1" 00:06:39.356 } 00:06:39.356 ]' 00:06:39.356 01:00:53 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:39.614 01:00:53 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:39.614 /dev/nbd1' 00:06:39.614 01:00:53 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:39.614 /dev/nbd1' 00:06:39.614 01:00:53 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:39.614 01:00:53 -- bdev/nbd_common.sh@65 -- # count=2 00:06:39.614 01:00:53 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:39.614 01:00:53 -- bdev/nbd_common.sh@95 -- # count=2 00:06:39.614 01:00:53 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:39.614 01:00:53 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:39.614 01:00:53 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:39.614 01:00:53 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:39.614 01:00:53 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:39.614 01:00:53 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:39.614 01:00:53 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:39.614 01:00:53 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:39.614 256+0 records in 00:06:39.614 256+0 records out 00:06:39.614 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00490815 s, 214 MB/s 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:39.614 256+0 records in 00:06:39.614 256+0 records out 00:06:39.614 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222293 s, 47.2 MB/s 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:39.614 256+0 records in 00:06:39.614 256+0 records out 00:06:39.614 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213571 s, 49.1 MB/s 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@51 -- # local i 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:39.614 01:00:54 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:39.872 01:00:54 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:39.872 01:00:54 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:39.872 01:00:54 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:39.872 01:00:54 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:39.872 01:00:54 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:39.872 01:00:54 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:39.872 01:00:54 -- bdev/nbd_common.sh@41 -- # break 00:06:39.872 01:00:54 -- bdev/nbd_common.sh@45 -- # return 0 00:06:39.872 01:00:54 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:39.872 01:00:54 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:40.130 01:00:54 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:40.130 01:00:54 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:40.130 01:00:54 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:40.130 01:00:54 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:40.130 01:00:54 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:40.130 01:00:54 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:40.130 01:00:54 -- bdev/nbd_common.sh@41 -- # break 00:06:40.130 01:00:54 -- bdev/nbd_common.sh@45 -- # return 0 00:06:40.130 01:00:54 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:40.130 01:00:54 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:40.130 01:00:54 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:40.389 01:00:54 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:40.389 01:00:54 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:40.389 01:00:54 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:40.389 01:00:54 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:40.389 01:00:54 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:40.389 01:00:54 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:40.389 01:00:54 -- bdev/nbd_common.sh@65 -- # true 00:06:40.389 01:00:54 -- bdev/nbd_common.sh@65 -- # count=0 00:06:40.389 01:00:54 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:40.389 01:00:54 -- bdev/nbd_common.sh@104 -- # count=0 00:06:40.389 01:00:54 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:40.389 01:00:54 -- bdev/nbd_common.sh@109 -- # return 0 00:06:40.389 01:00:54 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:40.646 01:00:55 -- event/event.sh@35 -- # sleep 3 00:06:40.903 [2024-11-28 01:00:55.416518] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:40.903 [2024-11-28 01:00:55.504001] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:40.904 [2024-11-28 01:00:55.504007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:41.161 [2024-11-28 01:00:55.565969] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:41.161 [2024-11-28 01:00:55.566045] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:43.689 01:00:58 -- event/event.sh@23 -- # for i in {0..2} 00:06:43.689 01:00:58 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:43.689 spdk_app_start Round 2 00:06:43.689 01:00:58 -- event/event.sh@25 -- # waitforlisten 1915337 /var/tmp/spdk-nbd.sock 00:06:43.689 01:00:58 -- common/autotest_common.sh@829 -- # '[' -z 1915337 ']' 00:06:43.689 01:00:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:43.689 01:00:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:43.689 01:00:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:43.689 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:43.689 01:00:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:43.689 01:00:58 -- common/autotest_common.sh@10 -- # set +x 00:06:43.947 01:00:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:43.947 01:00:58 -- common/autotest_common.sh@862 -- # return 0 00:06:43.947 01:00:58 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:44.205 Malloc0 00:06:44.205 01:00:58 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:44.464 Malloc1 00:06:44.464 01:00:58 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:44.464 01:00:58 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:44.464 01:00:58 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:44.464 01:00:58 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:44.464 01:00:58 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:44.464 01:00:58 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:44.464 01:00:58 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:44.464 01:00:58 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:44.464 01:00:58 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:44.464 01:00:58 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:44.464 01:00:58 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:44.464 01:00:58 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:44.464 01:00:58 -- bdev/nbd_common.sh@12 -- # local i 00:06:44.464 01:00:58 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:44.464 01:00:58 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:44.464 01:00:58 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:44.722 /dev/nbd0 00:06:44.722 01:00:59 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:44.722 01:00:59 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:44.722 01:00:59 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:44.722 01:00:59 -- common/autotest_common.sh@867 -- # local i 00:06:44.722 01:00:59 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:44.722 01:00:59 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:44.722 01:00:59 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:44.722 01:00:59 -- common/autotest_common.sh@871 -- # break 00:06:44.722 01:00:59 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:44.722 01:00:59 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:44.722 01:00:59 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:44.722 1+0 records in 00:06:44.722 1+0 records out 00:06:44.722 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000190567 s, 21.5 MB/s 00:06:44.722 01:00:59 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:44.722 01:00:59 -- common/autotest_common.sh@884 -- # size=4096 00:06:44.722 01:00:59 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:44.722 01:00:59 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:44.722 01:00:59 -- common/autotest_common.sh@887 -- # return 0 00:06:44.722 01:00:59 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:44.722 01:00:59 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:44.722 01:00:59 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:44.980 /dev/nbd1 00:06:44.980 01:00:59 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:44.980 01:00:59 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:44.980 01:00:59 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:44.980 01:00:59 -- common/autotest_common.sh@867 -- # local i 00:06:44.980 01:00:59 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:44.980 01:00:59 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:44.980 01:00:59 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:44.980 01:00:59 -- common/autotest_common.sh@871 -- # break 00:06:44.980 01:00:59 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:44.980 01:00:59 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:44.980 01:00:59 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:44.980 1+0 records in 00:06:44.980 1+0 records out 00:06:44.980 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000198573 s, 20.6 MB/s 00:06:44.980 01:00:59 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:44.980 01:00:59 -- common/autotest_common.sh@884 -- # size=4096 00:06:44.980 01:00:59 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:44.980 01:00:59 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:44.980 01:00:59 -- common/autotest_common.sh@887 -- # return 0 00:06:44.980 01:00:59 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:44.980 01:00:59 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:44.980 01:00:59 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:44.980 01:00:59 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:44.980 01:00:59 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:45.269 01:00:59 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:45.269 { 00:06:45.269 "nbd_device": "/dev/nbd0", 00:06:45.269 "bdev_name": "Malloc0" 00:06:45.269 }, 00:06:45.269 { 00:06:45.269 "nbd_device": "/dev/nbd1", 00:06:45.269 "bdev_name": "Malloc1" 00:06:45.269 } 00:06:45.269 ]' 00:06:45.269 01:00:59 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:45.269 { 00:06:45.269 "nbd_device": "/dev/nbd0", 00:06:45.269 "bdev_name": "Malloc0" 00:06:45.269 }, 00:06:45.269 { 00:06:45.269 "nbd_device": "/dev/nbd1", 00:06:45.269 "bdev_name": "Malloc1" 00:06:45.269 } 00:06:45.269 ]' 00:06:45.269 01:00:59 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:45.269 01:00:59 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:45.269 /dev/nbd1' 00:06:45.269 01:00:59 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:45.269 /dev/nbd1' 00:06:45.269 01:00:59 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:45.269 01:00:59 -- bdev/nbd_common.sh@65 -- # count=2 00:06:45.269 01:00:59 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:45.269 01:00:59 -- bdev/nbd_common.sh@95 -- # count=2 00:06:45.269 01:00:59 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:45.269 01:00:59 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:45.269 01:00:59 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:45.269 01:00:59 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:45.270 01:00:59 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:45.270 01:00:59 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:45.270 01:00:59 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:45.270 01:00:59 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:45.270 256+0 records in 00:06:45.270 256+0 records out 00:06:45.270 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00511392 s, 205 MB/s 00:06:45.270 01:00:59 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:45.270 01:00:59 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:45.554 256+0 records in 00:06:45.554 256+0 records out 00:06:45.554 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204642 s, 51.2 MB/s 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:45.554 256+0 records in 00:06:45.554 256+0 records out 00:06:45.554 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234367 s, 44.7 MB/s 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@51 -- # local i 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:45.554 01:00:59 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:45.811 01:01:00 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:45.811 01:01:00 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:45.811 01:01:00 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:45.811 01:01:00 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:45.811 01:01:00 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:45.811 01:01:00 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:45.811 01:01:00 -- bdev/nbd_common.sh@41 -- # break 00:06:45.811 01:01:00 -- bdev/nbd_common.sh@45 -- # return 0 00:06:45.811 01:01:00 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:45.811 01:01:00 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:46.069 01:01:00 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:46.069 01:01:00 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:46.069 01:01:00 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:46.069 01:01:00 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:46.069 01:01:00 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:46.069 01:01:00 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:46.069 01:01:00 -- bdev/nbd_common.sh@41 -- # break 00:06:46.069 01:01:00 -- bdev/nbd_common.sh@45 -- # return 0 00:06:46.069 01:01:00 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:46.069 01:01:00 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:46.069 01:01:00 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:46.327 01:01:00 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:46.327 01:01:00 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:46.327 01:01:00 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:46.327 01:01:00 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:46.327 01:01:00 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:46.327 01:01:00 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:46.327 01:01:00 -- bdev/nbd_common.sh@65 -- # true 00:06:46.327 01:01:00 -- bdev/nbd_common.sh@65 -- # count=0 00:06:46.327 01:01:00 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:46.327 01:01:00 -- bdev/nbd_common.sh@104 -- # count=0 00:06:46.327 01:01:00 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:46.327 01:01:00 -- bdev/nbd_common.sh@109 -- # return 0 00:06:46.327 01:01:00 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:46.584 01:01:01 -- event/event.sh@35 -- # sleep 3 00:06:46.843 [2024-11-28 01:01:01.302964] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:46.843 [2024-11-28 01:01:01.392962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:46.843 [2024-11-28 01:01:01.392967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:47.101 [2024-11-28 01:01:01.450814] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:47.101 [2024-11-28 01:01:01.450887] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:49.631 01:01:04 -- event/event.sh@38 -- # waitforlisten 1915337 /var/tmp/spdk-nbd.sock 00:06:49.631 01:01:04 -- common/autotest_common.sh@829 -- # '[' -z 1915337 ']' 00:06:49.631 01:01:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:49.631 01:01:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:49.631 01:01:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:49.631 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:49.631 01:01:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:49.631 01:01:04 -- common/autotest_common.sh@10 -- # set +x 00:06:49.888 01:01:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:49.888 01:01:04 -- common/autotest_common.sh@862 -- # return 0 00:06:49.888 01:01:04 -- event/event.sh@39 -- # killprocess 1915337 00:06:49.888 01:01:04 -- common/autotest_common.sh@936 -- # '[' -z 1915337 ']' 00:06:49.888 01:01:04 -- common/autotest_common.sh@940 -- # kill -0 1915337 00:06:49.888 01:01:04 -- common/autotest_common.sh@941 -- # uname 00:06:49.888 01:01:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:49.888 01:01:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1915337 00:06:49.888 01:01:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:49.888 01:01:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:49.888 01:01:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1915337' 00:06:49.888 killing process with pid 1915337 00:06:49.888 01:01:04 -- common/autotest_common.sh@955 -- # kill 1915337 00:06:49.888 01:01:04 -- common/autotest_common.sh@960 -- # wait 1915337 00:06:50.147 spdk_app_start is called in Round 0. 00:06:50.147 Shutdown signal received, stop current app iteration 00:06:50.147 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:50.147 spdk_app_start is called in Round 1. 00:06:50.147 Shutdown signal received, stop current app iteration 00:06:50.147 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:50.147 spdk_app_start is called in Round 2. 00:06:50.147 Shutdown signal received, stop current app iteration 00:06:50.147 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:50.147 spdk_app_start is called in Round 3. 00:06:50.147 Shutdown signal received, stop current app iteration 00:06:50.147 01:01:04 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:50.147 01:01:04 -- event/event.sh@42 -- # return 0 00:06:50.147 00:06:50.147 real 0m18.893s 00:06:50.147 user 0m41.528s 00:06:50.147 sys 0m3.150s 00:06:50.147 01:01:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.147 01:01:04 -- common/autotest_common.sh@10 -- # set +x 00:06:50.147 ************************************ 00:06:50.147 END TEST app_repeat 00:06:50.147 ************************************ 00:06:50.147 01:01:04 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:50.147 01:01:04 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:50.147 01:01:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:50.147 01:01:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.147 01:01:04 -- common/autotest_common.sh@10 -- # set +x 00:06:50.147 ************************************ 00:06:50.147 START TEST cpu_locks 00:06:50.147 ************************************ 00:06:50.147 01:01:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:50.147 * Looking for test storage... 00:06:50.147 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:50.147 01:01:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:50.147 01:01:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:50.147 01:01:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:50.147 01:01:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:50.147 01:01:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:50.147 01:01:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:50.147 01:01:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:50.147 01:01:04 -- scripts/common.sh@335 -- # IFS=.-: 00:06:50.147 01:01:04 -- scripts/common.sh@335 -- # read -ra ver1 00:06:50.147 01:01:04 -- scripts/common.sh@336 -- # IFS=.-: 00:06:50.147 01:01:04 -- scripts/common.sh@336 -- # read -ra ver2 00:06:50.147 01:01:04 -- scripts/common.sh@337 -- # local 'op=<' 00:06:50.147 01:01:04 -- scripts/common.sh@339 -- # ver1_l=2 00:06:50.147 01:01:04 -- scripts/common.sh@340 -- # ver2_l=1 00:06:50.147 01:01:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:50.147 01:01:04 -- scripts/common.sh@343 -- # case "$op" in 00:06:50.147 01:01:04 -- scripts/common.sh@344 -- # : 1 00:06:50.147 01:01:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:50.147 01:01:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:50.147 01:01:04 -- scripts/common.sh@364 -- # decimal 1 00:06:50.147 01:01:04 -- scripts/common.sh@352 -- # local d=1 00:06:50.147 01:01:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:50.147 01:01:04 -- scripts/common.sh@354 -- # echo 1 00:06:50.147 01:01:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:50.147 01:01:04 -- scripts/common.sh@365 -- # decimal 2 00:06:50.147 01:01:04 -- scripts/common.sh@352 -- # local d=2 00:06:50.405 01:01:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:50.405 01:01:04 -- scripts/common.sh@354 -- # echo 2 00:06:50.405 01:01:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:50.405 01:01:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:50.405 01:01:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:50.405 01:01:04 -- scripts/common.sh@367 -- # return 0 00:06:50.405 01:01:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:50.405 01:01:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:50.405 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:50.405 --rc genhtml_branch_coverage=1 00:06:50.405 --rc genhtml_function_coverage=1 00:06:50.405 --rc genhtml_legend=1 00:06:50.405 --rc geninfo_all_blocks=1 00:06:50.405 --rc geninfo_unexecuted_blocks=1 00:06:50.405 00:06:50.405 ' 00:06:50.405 01:01:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:50.405 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:50.405 --rc genhtml_branch_coverage=1 00:06:50.405 --rc genhtml_function_coverage=1 00:06:50.405 --rc genhtml_legend=1 00:06:50.405 --rc geninfo_all_blocks=1 00:06:50.405 --rc geninfo_unexecuted_blocks=1 00:06:50.405 00:06:50.405 ' 00:06:50.405 01:01:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:50.405 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:50.405 --rc genhtml_branch_coverage=1 00:06:50.405 --rc genhtml_function_coverage=1 00:06:50.405 --rc genhtml_legend=1 00:06:50.405 --rc geninfo_all_blocks=1 00:06:50.405 --rc geninfo_unexecuted_blocks=1 00:06:50.405 00:06:50.405 ' 00:06:50.405 01:01:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:50.405 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:50.405 --rc genhtml_branch_coverage=1 00:06:50.405 --rc genhtml_function_coverage=1 00:06:50.405 --rc genhtml_legend=1 00:06:50.405 --rc geninfo_all_blocks=1 00:06:50.405 --rc geninfo_unexecuted_blocks=1 00:06:50.405 00:06:50.405 ' 00:06:50.405 01:01:04 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:50.405 01:01:04 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:50.405 01:01:04 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:50.405 01:01:04 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:50.405 01:01:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:50.405 01:01:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.405 01:01:04 -- common/autotest_common.sh@10 -- # set +x 00:06:50.405 ************************************ 00:06:50.405 START TEST default_locks 00:06:50.405 ************************************ 00:06:50.405 01:01:04 -- common/autotest_common.sh@1114 -- # default_locks 00:06:50.405 01:01:04 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=1917923 00:06:50.405 01:01:04 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:50.405 01:01:04 -- event/cpu_locks.sh@47 -- # waitforlisten 1917923 00:06:50.405 01:01:04 -- common/autotest_common.sh@829 -- # '[' -z 1917923 ']' 00:06:50.405 01:01:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:50.405 01:01:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:50.405 01:01:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:50.405 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:50.405 01:01:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:50.405 01:01:04 -- common/autotest_common.sh@10 -- # set +x 00:06:50.405 [2024-11-28 01:01:04.809460] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:50.405 [2024-11-28 01:01:04.809575] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1917923 ] 00:06:50.405 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.405 [2024-11-28 01:01:04.869951] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.405 [2024-11-28 01:01:04.957127] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:50.405 [2024-11-28 01:01:04.957301] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.342 01:01:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:51.342 01:01:05 -- common/autotest_common.sh@862 -- # return 0 00:06:51.342 01:01:05 -- event/cpu_locks.sh@49 -- # locks_exist 1917923 00:06:51.342 01:01:05 -- event/cpu_locks.sh@22 -- # lslocks -p 1917923 00:06:51.342 01:01:05 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:51.600 lslocks: write error 00:06:51.600 01:01:05 -- event/cpu_locks.sh@50 -- # killprocess 1917923 00:06:51.600 01:01:05 -- common/autotest_common.sh@936 -- # '[' -z 1917923 ']' 00:06:51.600 01:01:05 -- common/autotest_common.sh@940 -- # kill -0 1917923 00:06:51.600 01:01:05 -- common/autotest_common.sh@941 -- # uname 00:06:51.600 01:01:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:51.600 01:01:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1917923 00:06:51.600 01:01:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:51.600 01:01:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:51.600 01:01:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1917923' 00:06:51.600 killing process with pid 1917923 00:06:51.600 01:01:06 -- common/autotest_common.sh@955 -- # kill 1917923 00:06:51.600 01:01:06 -- common/autotest_common.sh@960 -- # wait 1917923 00:06:51.859 01:01:06 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 1917923 00:06:51.859 01:01:06 -- common/autotest_common.sh@650 -- # local es=0 00:06:51.859 01:01:06 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1917923 00:06:51.859 01:01:06 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:51.859 01:01:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:51.859 01:01:06 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:51.859 01:01:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:51.859 01:01:06 -- common/autotest_common.sh@653 -- # waitforlisten 1917923 00:06:51.859 01:01:06 -- common/autotest_common.sh@829 -- # '[' -z 1917923 ']' 00:06:51.859 01:01:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:51.859 01:01:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:51.859 01:01:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:51.859 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:51.859 01:01:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:51.859 01:01:06 -- common/autotest_common.sh@10 -- # set +x 00:06:51.860 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1917923) - No such process 00:06:51.860 ERROR: process (pid: 1917923) is no longer running 00:06:51.860 01:01:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:51.860 01:01:06 -- common/autotest_common.sh@862 -- # return 1 00:06:51.860 01:01:06 -- common/autotest_common.sh@653 -- # es=1 00:06:51.860 01:01:06 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:51.860 01:01:06 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:51.860 01:01:06 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:51.860 01:01:06 -- event/cpu_locks.sh@54 -- # no_locks 00:06:51.860 01:01:06 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:51.860 01:01:06 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:51.860 01:01:06 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:51.860 00:06:51.860 real 0m1.700s 00:06:51.860 user 0m1.844s 00:06:51.860 sys 0m0.558s 00:06:51.860 01:01:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:51.860 01:01:06 -- common/autotest_common.sh@10 -- # set +x 00:06:51.860 ************************************ 00:06:51.860 END TEST default_locks 00:06:51.860 ************************************ 00:06:52.118 01:01:06 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:52.118 01:01:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:52.118 01:01:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:52.118 01:01:06 -- common/autotest_common.sh@10 -- # set +x 00:06:52.118 ************************************ 00:06:52.118 START TEST default_locks_via_rpc 00:06:52.118 ************************************ 00:06:52.118 01:01:06 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:06:52.118 01:01:06 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=1918164 00:06:52.118 01:01:06 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:52.118 01:01:06 -- event/cpu_locks.sh@63 -- # waitforlisten 1918164 00:06:52.118 01:01:06 -- common/autotest_common.sh@829 -- # '[' -z 1918164 ']' 00:06:52.118 01:01:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:52.118 01:01:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:52.118 01:01:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:52.118 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:52.118 01:01:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:52.118 01:01:06 -- common/autotest_common.sh@10 -- # set +x 00:06:52.118 [2024-11-28 01:01:06.537106] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:52.118 [2024-11-28 01:01:06.537200] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1918164 ] 00:06:52.118 EAL: No free 2048 kB hugepages reported on node 1 00:06:52.118 [2024-11-28 01:01:06.597644] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:52.118 [2024-11-28 01:01:06.686606] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:52.118 [2024-11-28 01:01:06.686791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:53.054 01:01:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:53.054 01:01:07 -- common/autotest_common.sh@862 -- # return 0 00:06:53.054 01:01:07 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:53.054 01:01:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:53.054 01:01:07 -- common/autotest_common.sh@10 -- # set +x 00:06:53.054 01:01:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:53.054 01:01:07 -- event/cpu_locks.sh@67 -- # no_locks 00:06:53.054 01:01:07 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:53.054 01:01:07 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:53.054 01:01:07 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:53.054 01:01:07 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:53.054 01:01:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:53.054 01:01:07 -- common/autotest_common.sh@10 -- # set +x 00:06:53.054 01:01:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:53.054 01:01:07 -- event/cpu_locks.sh@71 -- # locks_exist 1918164 00:06:53.054 01:01:07 -- event/cpu_locks.sh@22 -- # lslocks -p 1918164 00:06:53.054 01:01:07 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:53.312 01:01:07 -- event/cpu_locks.sh@73 -- # killprocess 1918164 00:06:53.312 01:01:07 -- common/autotest_common.sh@936 -- # '[' -z 1918164 ']' 00:06:53.312 01:01:07 -- common/autotest_common.sh@940 -- # kill -0 1918164 00:06:53.312 01:01:07 -- common/autotest_common.sh@941 -- # uname 00:06:53.312 01:01:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:53.312 01:01:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1918164 00:06:53.312 01:01:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:53.312 01:01:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:53.312 01:01:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1918164' 00:06:53.312 killing process with pid 1918164 00:06:53.312 01:01:07 -- common/autotest_common.sh@955 -- # kill 1918164 00:06:53.312 01:01:07 -- common/autotest_common.sh@960 -- # wait 1918164 00:06:53.570 00:06:53.570 real 0m1.662s 00:06:53.570 user 0m1.796s 00:06:53.570 sys 0m0.551s 00:06:53.570 01:01:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:53.570 01:01:08 -- common/autotest_common.sh@10 -- # set +x 00:06:53.570 ************************************ 00:06:53.570 END TEST default_locks_via_rpc 00:06:53.571 ************************************ 00:06:53.571 01:01:08 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:53.571 01:01:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:53.571 01:01:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:53.571 01:01:08 -- common/autotest_common.sh@10 -- # set +x 00:06:53.829 ************************************ 00:06:53.829 START TEST non_locking_app_on_locked_coremask 00:06:53.829 ************************************ 00:06:53.829 01:01:08 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:06:53.829 01:01:08 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=1918423 00:06:53.829 01:01:08 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:53.829 01:01:08 -- event/cpu_locks.sh@81 -- # waitforlisten 1918423 /var/tmp/spdk.sock 00:06:53.829 01:01:08 -- common/autotest_common.sh@829 -- # '[' -z 1918423 ']' 00:06:53.829 01:01:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:53.829 01:01:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:53.829 01:01:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:53.829 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:53.829 01:01:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:53.829 01:01:08 -- common/autotest_common.sh@10 -- # set +x 00:06:53.829 [2024-11-28 01:01:08.227720] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:53.829 [2024-11-28 01:01:08.227803] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1918423 ] 00:06:53.829 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.829 [2024-11-28 01:01:08.286985] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:53.829 [2024-11-28 01:01:08.376189] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:53.829 [2024-11-28 01:01:08.376375] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.763 01:01:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:54.763 01:01:09 -- common/autotest_common.sh@862 -- # return 0 00:06:54.763 01:01:09 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=1918481 00:06:54.763 01:01:09 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:54.763 01:01:09 -- event/cpu_locks.sh@85 -- # waitforlisten 1918481 /var/tmp/spdk2.sock 00:06:54.763 01:01:09 -- common/autotest_common.sh@829 -- # '[' -z 1918481 ']' 00:06:54.763 01:01:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:54.763 01:01:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:54.763 01:01:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:54.763 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:54.763 01:01:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:54.763 01:01:09 -- common/autotest_common.sh@10 -- # set +x 00:06:54.763 [2024-11-28 01:01:09.236926] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:54.763 [2024-11-28 01:01:09.237010] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1918481 ] 00:06:54.763 EAL: No free 2048 kB hugepages reported on node 1 00:06:54.763 [2024-11-28 01:01:09.333079] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:54.763 [2024-11-28 01:01:09.333113] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:55.020 [2024-11-28 01:01:09.514845] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:55.021 [2024-11-28 01:01:09.515032] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:55.953 01:01:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:55.953 01:01:10 -- common/autotest_common.sh@862 -- # return 0 00:06:55.953 01:01:10 -- event/cpu_locks.sh@87 -- # locks_exist 1918423 00:06:55.953 01:01:10 -- event/cpu_locks.sh@22 -- # lslocks -p 1918423 00:06:55.953 01:01:10 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:56.210 lslocks: write error 00:06:56.210 01:01:10 -- event/cpu_locks.sh@89 -- # killprocess 1918423 00:06:56.210 01:01:10 -- common/autotest_common.sh@936 -- # '[' -z 1918423 ']' 00:06:56.210 01:01:10 -- common/autotest_common.sh@940 -- # kill -0 1918423 00:06:56.210 01:01:10 -- common/autotest_common.sh@941 -- # uname 00:06:56.210 01:01:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:56.210 01:01:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1918423 00:06:56.210 01:01:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:56.210 01:01:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:56.210 01:01:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1918423' 00:06:56.210 killing process with pid 1918423 00:06:56.210 01:01:10 -- common/autotest_common.sh@955 -- # kill 1918423 00:06:56.210 01:01:10 -- common/autotest_common.sh@960 -- # wait 1918423 00:06:57.145 01:01:11 -- event/cpu_locks.sh@90 -- # killprocess 1918481 00:06:57.145 01:01:11 -- common/autotest_common.sh@936 -- # '[' -z 1918481 ']' 00:06:57.145 01:01:11 -- common/autotest_common.sh@940 -- # kill -0 1918481 00:06:57.145 01:01:11 -- common/autotest_common.sh@941 -- # uname 00:06:57.145 01:01:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:57.145 01:01:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1918481 00:06:57.145 01:01:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:57.145 01:01:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:57.145 01:01:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1918481' 00:06:57.145 killing process with pid 1918481 00:06:57.145 01:01:11 -- common/autotest_common.sh@955 -- # kill 1918481 00:06:57.145 01:01:11 -- common/autotest_common.sh@960 -- # wait 1918481 00:06:57.403 00:06:57.403 real 0m3.640s 00:06:57.403 user 0m4.027s 00:06:57.403 sys 0m1.091s 00:06:57.403 01:01:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:57.403 01:01:11 -- common/autotest_common.sh@10 -- # set +x 00:06:57.403 ************************************ 00:06:57.403 END TEST non_locking_app_on_locked_coremask 00:06:57.403 ************************************ 00:06:57.403 01:01:11 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:57.403 01:01:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:57.403 01:01:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:57.403 01:01:11 -- common/autotest_common.sh@10 -- # set +x 00:06:57.403 ************************************ 00:06:57.403 START TEST locking_app_on_unlocked_coremask 00:06:57.403 ************************************ 00:06:57.403 01:01:11 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:06:57.403 01:01:11 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=1918917 00:06:57.403 01:01:11 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:57.403 01:01:11 -- event/cpu_locks.sh@99 -- # waitforlisten 1918917 /var/tmp/spdk.sock 00:06:57.403 01:01:11 -- common/autotest_common.sh@829 -- # '[' -z 1918917 ']' 00:06:57.403 01:01:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:57.403 01:01:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:57.403 01:01:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:57.403 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:57.403 01:01:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:57.403 01:01:11 -- common/autotest_common.sh@10 -- # set +x 00:06:57.403 [2024-11-28 01:01:11.895300] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:57.403 [2024-11-28 01:01:11.895396] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1918917 ] 00:06:57.403 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.403 [2024-11-28 01:01:11.957606] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:57.403 [2024-11-28 01:01:11.957655] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:57.661 [2024-11-28 01:01:12.043619] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:57.661 [2024-11-28 01:01:12.043787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:58.594 01:01:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:58.594 01:01:12 -- common/autotest_common.sh@862 -- # return 0 00:06:58.594 01:01:12 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=1919057 00:06:58.594 01:01:12 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:58.594 01:01:12 -- event/cpu_locks.sh@103 -- # waitforlisten 1919057 /var/tmp/spdk2.sock 00:06:58.594 01:01:12 -- common/autotest_common.sh@829 -- # '[' -z 1919057 ']' 00:06:58.594 01:01:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:58.594 01:01:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:58.594 01:01:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:58.594 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:58.594 01:01:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:58.594 01:01:12 -- common/autotest_common.sh@10 -- # set +x 00:06:58.594 [2024-11-28 01:01:12.894142] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:58.594 [2024-11-28 01:01:12.894222] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1919057 ] 00:06:58.594 EAL: No free 2048 kB hugepages reported on node 1 00:06:58.594 [2024-11-28 01:01:12.991460] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:58.594 [2024-11-28 01:01:13.168672] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:58.594 [2024-11-28 01:01:13.168863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.529 01:01:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:59.529 01:01:13 -- common/autotest_common.sh@862 -- # return 0 00:06:59.529 01:01:13 -- event/cpu_locks.sh@105 -- # locks_exist 1919057 00:06:59.529 01:01:13 -- event/cpu_locks.sh@22 -- # lslocks -p 1919057 00:06:59.529 01:01:13 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:59.788 lslocks: write error 00:06:59.788 01:01:14 -- event/cpu_locks.sh@107 -- # killprocess 1918917 00:06:59.788 01:01:14 -- common/autotest_common.sh@936 -- # '[' -z 1918917 ']' 00:06:59.788 01:01:14 -- common/autotest_common.sh@940 -- # kill -0 1918917 00:06:59.788 01:01:14 -- common/autotest_common.sh@941 -- # uname 00:06:59.788 01:01:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:59.788 01:01:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1918917 00:06:59.788 01:01:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:59.788 01:01:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:59.788 01:01:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1918917' 00:06:59.788 killing process with pid 1918917 00:06:59.788 01:01:14 -- common/autotest_common.sh@955 -- # kill 1918917 00:06:59.788 01:01:14 -- common/autotest_common.sh@960 -- # wait 1918917 00:07:00.719 01:01:15 -- event/cpu_locks.sh@108 -- # killprocess 1919057 00:07:00.719 01:01:15 -- common/autotest_common.sh@936 -- # '[' -z 1919057 ']' 00:07:00.719 01:01:15 -- common/autotest_common.sh@940 -- # kill -0 1919057 00:07:00.719 01:01:15 -- common/autotest_common.sh@941 -- # uname 00:07:00.719 01:01:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:00.719 01:01:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1919057 00:07:00.719 01:01:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:00.719 01:01:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:00.719 01:01:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1919057' 00:07:00.719 killing process with pid 1919057 00:07:00.719 01:01:15 -- common/autotest_common.sh@955 -- # kill 1919057 00:07:00.719 01:01:15 -- common/autotest_common.sh@960 -- # wait 1919057 00:07:00.977 00:07:00.977 real 0m3.613s 00:07:00.977 user 0m3.986s 00:07:00.977 sys 0m1.051s 00:07:00.977 01:01:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:00.977 01:01:15 -- common/autotest_common.sh@10 -- # set +x 00:07:00.977 ************************************ 00:07:00.977 END TEST locking_app_on_unlocked_coremask 00:07:00.977 ************************************ 00:07:00.977 01:01:15 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:07:00.977 01:01:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:00.977 01:01:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:00.977 01:01:15 -- common/autotest_common.sh@10 -- # set +x 00:07:00.977 ************************************ 00:07:00.977 START TEST locking_app_on_locked_coremask 00:07:00.977 ************************************ 00:07:00.977 01:01:15 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:07:00.977 01:01:15 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=1919363 00:07:00.977 01:01:15 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:00.977 01:01:15 -- event/cpu_locks.sh@116 -- # waitforlisten 1919363 /var/tmp/spdk.sock 00:07:00.977 01:01:15 -- common/autotest_common.sh@829 -- # '[' -z 1919363 ']' 00:07:00.977 01:01:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:00.977 01:01:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:00.977 01:01:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:00.977 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:00.977 01:01:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:00.977 01:01:15 -- common/autotest_common.sh@10 -- # set +x 00:07:00.977 [2024-11-28 01:01:15.535284] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:00.977 [2024-11-28 01:01:15.535381] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1919363 ] 00:07:00.977 EAL: No free 2048 kB hugepages reported on node 1 00:07:01.236 [2024-11-28 01:01:15.595049] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:01.236 [2024-11-28 01:01:15.683823] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:01.236 [2024-11-28 01:01:15.684010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:02.169 01:01:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:02.170 01:01:16 -- common/autotest_common.sh@862 -- # return 0 00:07:02.170 01:01:16 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=1919503 00:07:02.170 01:01:16 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:07:02.170 01:01:16 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 1919503 /var/tmp/spdk2.sock 00:07:02.170 01:01:16 -- common/autotest_common.sh@650 -- # local es=0 00:07:02.170 01:01:16 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1919503 /var/tmp/spdk2.sock 00:07:02.170 01:01:16 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:07:02.170 01:01:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:02.170 01:01:16 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:07:02.170 01:01:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:02.170 01:01:16 -- common/autotest_common.sh@653 -- # waitforlisten 1919503 /var/tmp/spdk2.sock 00:07:02.170 01:01:16 -- common/autotest_common.sh@829 -- # '[' -z 1919503 ']' 00:07:02.170 01:01:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:02.170 01:01:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:02.170 01:01:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:02.170 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:02.170 01:01:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:02.170 01:01:16 -- common/autotest_common.sh@10 -- # set +x 00:07:02.170 [2024-11-28 01:01:16.542538] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:02.170 [2024-11-28 01:01:16.542625] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1919503 ] 00:07:02.170 EAL: No free 2048 kB hugepages reported on node 1 00:07:02.170 [2024-11-28 01:01:16.634786] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 1919363 has claimed it. 00:07:02.170 [2024-11-28 01:01:16.634836] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:07:02.736 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1919503) - No such process 00:07:02.736 ERROR: process (pid: 1919503) is no longer running 00:07:02.736 01:01:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:02.736 01:01:17 -- common/autotest_common.sh@862 -- # return 1 00:07:02.736 01:01:17 -- common/autotest_common.sh@653 -- # es=1 00:07:02.736 01:01:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:02.736 01:01:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:02.736 01:01:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:02.736 01:01:17 -- event/cpu_locks.sh@122 -- # locks_exist 1919363 00:07:02.736 01:01:17 -- event/cpu_locks.sh@22 -- # lslocks -p 1919363 00:07:02.736 01:01:17 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:03.301 lslocks: write error 00:07:03.301 01:01:17 -- event/cpu_locks.sh@124 -- # killprocess 1919363 00:07:03.301 01:01:17 -- common/autotest_common.sh@936 -- # '[' -z 1919363 ']' 00:07:03.301 01:01:17 -- common/autotest_common.sh@940 -- # kill -0 1919363 00:07:03.301 01:01:17 -- common/autotest_common.sh@941 -- # uname 00:07:03.302 01:01:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:03.302 01:01:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1919363 00:07:03.302 01:01:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:03.302 01:01:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:03.302 01:01:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1919363' 00:07:03.302 killing process with pid 1919363 00:07:03.302 01:01:17 -- common/autotest_common.sh@955 -- # kill 1919363 00:07:03.302 01:01:17 -- common/autotest_common.sh@960 -- # wait 1919363 00:07:03.559 00:07:03.559 real 0m2.572s 00:07:03.559 user 0m2.938s 00:07:03.559 sys 0m0.683s 00:07:03.559 01:01:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:03.559 01:01:18 -- common/autotest_common.sh@10 -- # set +x 00:07:03.559 ************************************ 00:07:03.559 END TEST locking_app_on_locked_coremask 00:07:03.559 ************************************ 00:07:03.559 01:01:18 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:07:03.559 01:01:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:03.559 01:01:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:03.559 01:01:18 -- common/autotest_common.sh@10 -- # set +x 00:07:03.559 ************************************ 00:07:03.559 START TEST locking_overlapped_coremask 00:07:03.559 ************************************ 00:07:03.559 01:01:18 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:07:03.559 01:01:18 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=1919677 00:07:03.559 01:01:18 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:07:03.559 01:01:18 -- event/cpu_locks.sh@133 -- # waitforlisten 1919677 /var/tmp/spdk.sock 00:07:03.559 01:01:18 -- common/autotest_common.sh@829 -- # '[' -z 1919677 ']' 00:07:03.559 01:01:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:03.559 01:01:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:03.559 01:01:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:03.559 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:03.560 01:01:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:03.560 01:01:18 -- common/autotest_common.sh@10 -- # set +x 00:07:03.560 [2024-11-28 01:01:18.132164] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:03.560 [2024-11-28 01:01:18.132257] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1919677 ] 00:07:03.560 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.816 [2024-11-28 01:01:18.193366] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:03.816 [2024-11-28 01:01:18.283753] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:03.816 [2024-11-28 01:01:18.283962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:03.816 [2024-11-28 01:01:18.283998] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:03.816 [2024-11-28 01:01:18.284001] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:04.749 01:01:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:04.749 01:01:19 -- common/autotest_common.sh@862 -- # return 0 00:07:04.749 01:01:19 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=1919817 00:07:04.749 01:01:19 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 1919817 /var/tmp/spdk2.sock 00:07:04.749 01:01:19 -- common/autotest_common.sh@650 -- # local es=0 00:07:04.749 01:01:19 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1919817 /var/tmp/spdk2.sock 00:07:04.749 01:01:19 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:07:04.749 01:01:19 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:07:04.749 01:01:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:04.749 01:01:19 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:07:04.749 01:01:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:04.749 01:01:19 -- common/autotest_common.sh@653 -- # waitforlisten 1919817 /var/tmp/spdk2.sock 00:07:04.749 01:01:19 -- common/autotest_common.sh@829 -- # '[' -z 1919817 ']' 00:07:04.749 01:01:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:04.749 01:01:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:04.749 01:01:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:04.749 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:04.749 01:01:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:04.749 01:01:19 -- common/autotest_common.sh@10 -- # set +x 00:07:04.749 [2024-11-28 01:01:19.140474] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:04.749 [2024-11-28 01:01:19.140576] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1919817 ] 00:07:04.749 EAL: No free 2048 kB hugepages reported on node 1 00:07:04.749 [2024-11-28 01:01:19.228646] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1919677 has claimed it. 00:07:04.749 [2024-11-28 01:01:19.228715] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:07:05.314 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1919817) - No such process 00:07:05.314 ERROR: process (pid: 1919817) is no longer running 00:07:05.314 01:01:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:05.314 01:01:19 -- common/autotest_common.sh@862 -- # return 1 00:07:05.314 01:01:19 -- common/autotest_common.sh@653 -- # es=1 00:07:05.314 01:01:19 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:05.314 01:01:19 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:05.314 01:01:19 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:05.314 01:01:19 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:07:05.314 01:01:19 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:07:05.314 01:01:19 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:07:05.314 01:01:19 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:07:05.315 01:01:19 -- event/cpu_locks.sh@141 -- # killprocess 1919677 00:07:05.315 01:01:19 -- common/autotest_common.sh@936 -- # '[' -z 1919677 ']' 00:07:05.315 01:01:19 -- common/autotest_common.sh@940 -- # kill -0 1919677 00:07:05.315 01:01:19 -- common/autotest_common.sh@941 -- # uname 00:07:05.315 01:01:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:05.315 01:01:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1919677 00:07:05.315 01:01:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:05.315 01:01:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:05.315 01:01:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1919677' 00:07:05.315 killing process with pid 1919677 00:07:05.315 01:01:19 -- common/autotest_common.sh@955 -- # kill 1919677 00:07:05.315 01:01:19 -- common/autotest_common.sh@960 -- # wait 1919677 00:07:05.880 00:07:05.880 real 0m2.218s 00:07:05.880 user 0m6.403s 00:07:05.880 sys 0m0.490s 00:07:05.880 01:01:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:05.880 01:01:20 -- common/autotest_common.sh@10 -- # set +x 00:07:05.880 ************************************ 00:07:05.880 END TEST locking_overlapped_coremask 00:07:05.880 ************************************ 00:07:05.880 01:01:20 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:07:05.880 01:01:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:05.880 01:01:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:05.880 01:01:20 -- common/autotest_common.sh@10 -- # set +x 00:07:05.880 ************************************ 00:07:05.880 START TEST locking_overlapped_coremask_via_rpc 00:07:05.880 ************************************ 00:07:05.881 01:01:20 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:07:05.881 01:01:20 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=1919983 00:07:05.881 01:01:20 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:07:05.881 01:01:20 -- event/cpu_locks.sh@149 -- # waitforlisten 1919983 /var/tmp/spdk.sock 00:07:05.881 01:01:20 -- common/autotest_common.sh@829 -- # '[' -z 1919983 ']' 00:07:05.881 01:01:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:05.881 01:01:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:05.881 01:01:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:05.881 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:05.881 01:01:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:05.881 01:01:20 -- common/autotest_common.sh@10 -- # set +x 00:07:05.881 [2024-11-28 01:01:20.378997] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:05.881 [2024-11-28 01:01:20.379089] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1919983 ] 00:07:05.881 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.881 [2024-11-28 01:01:20.439838] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:05.881 [2024-11-28 01:01:20.439874] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:06.139 [2024-11-28 01:01:20.530432] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:06.139 [2024-11-28 01:01:20.530678] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:06.139 [2024-11-28 01:01:20.533544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:06.139 [2024-11-28 01:01:20.533555] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:07.072 01:01:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:07.072 01:01:21 -- common/autotest_common.sh@862 -- # return 0 00:07:07.073 01:01:21 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=1920125 00:07:07.073 01:01:21 -- event/cpu_locks.sh@153 -- # waitforlisten 1920125 /var/tmp/spdk2.sock 00:07:07.073 01:01:21 -- common/autotest_common.sh@829 -- # '[' -z 1920125 ']' 00:07:07.073 01:01:21 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:07:07.073 01:01:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:07.073 01:01:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:07.073 01:01:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:07.073 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:07.073 01:01:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:07.073 01:01:21 -- common/autotest_common.sh@10 -- # set +x 00:07:07.073 [2024-11-28 01:01:21.391856] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:07.073 [2024-11-28 01:01:21.391932] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1920125 ] 00:07:07.073 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.073 [2024-11-28 01:01:21.479759] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:07.073 [2024-11-28 01:01:21.479791] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:07.073 [2024-11-28 01:01:21.650088] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:07.073 [2024-11-28 01:01:21.650372] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:07.073 [2024-11-28 01:01:21.653632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:07:07.073 [2024-11-28 01:01:21.653634] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:08.005 01:01:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:08.005 01:01:22 -- common/autotest_common.sh@862 -- # return 0 00:07:08.005 01:01:22 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:07:08.005 01:01:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:08.005 01:01:22 -- common/autotest_common.sh@10 -- # set +x 00:07:08.005 01:01:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:08.005 01:01:22 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:08.005 01:01:22 -- common/autotest_common.sh@650 -- # local es=0 00:07:08.005 01:01:22 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:08.005 01:01:22 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:07:08.005 01:01:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:08.005 01:01:22 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:07:08.005 01:01:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:08.005 01:01:22 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:08.005 01:01:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:08.005 01:01:22 -- common/autotest_common.sh@10 -- # set +x 00:07:08.005 [2024-11-28 01:01:22.362620] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1919983 has claimed it. 00:07:08.005 request: 00:07:08.005 { 00:07:08.005 "method": "framework_enable_cpumask_locks", 00:07:08.005 "req_id": 1 00:07:08.005 } 00:07:08.005 Got JSON-RPC error response 00:07:08.005 response: 00:07:08.005 { 00:07:08.005 "code": -32603, 00:07:08.005 "message": "Failed to claim CPU core: 2" 00:07:08.005 } 00:07:08.005 01:01:22 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:07:08.005 01:01:22 -- common/autotest_common.sh@653 -- # es=1 00:07:08.005 01:01:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:08.005 01:01:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:08.005 01:01:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:08.005 01:01:22 -- event/cpu_locks.sh@158 -- # waitforlisten 1919983 /var/tmp/spdk.sock 00:07:08.005 01:01:22 -- common/autotest_common.sh@829 -- # '[' -z 1919983 ']' 00:07:08.005 01:01:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:08.005 01:01:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:08.005 01:01:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:08.005 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:08.005 01:01:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:08.005 01:01:22 -- common/autotest_common.sh@10 -- # set +x 00:07:08.262 01:01:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:08.262 01:01:22 -- common/autotest_common.sh@862 -- # return 0 00:07:08.262 01:01:22 -- event/cpu_locks.sh@159 -- # waitforlisten 1920125 /var/tmp/spdk2.sock 00:07:08.262 01:01:22 -- common/autotest_common.sh@829 -- # '[' -z 1920125 ']' 00:07:08.262 01:01:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:08.262 01:01:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:08.262 01:01:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:08.262 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:08.262 01:01:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:08.262 01:01:22 -- common/autotest_common.sh@10 -- # set +x 00:07:08.531 01:01:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:08.531 01:01:22 -- common/autotest_common.sh@862 -- # return 0 00:07:08.531 01:01:22 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:07:08.531 01:01:22 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:07:08.531 01:01:22 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:07:08.531 01:01:22 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:07:08.531 00:07:08.531 real 0m2.572s 00:07:08.531 user 0m1.288s 00:07:08.531 sys 0m0.205s 00:07:08.531 01:01:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:08.531 01:01:22 -- common/autotest_common.sh@10 -- # set +x 00:07:08.531 ************************************ 00:07:08.531 END TEST locking_overlapped_coremask_via_rpc 00:07:08.531 ************************************ 00:07:08.531 01:01:22 -- event/cpu_locks.sh@174 -- # cleanup 00:07:08.531 01:01:22 -- event/cpu_locks.sh@15 -- # [[ -z 1919983 ]] 00:07:08.531 01:01:22 -- event/cpu_locks.sh@15 -- # killprocess 1919983 00:07:08.531 01:01:22 -- common/autotest_common.sh@936 -- # '[' -z 1919983 ']' 00:07:08.531 01:01:22 -- common/autotest_common.sh@940 -- # kill -0 1919983 00:07:08.531 01:01:22 -- common/autotest_common.sh@941 -- # uname 00:07:08.531 01:01:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:08.531 01:01:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1919983 00:07:08.531 01:01:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:08.531 01:01:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:08.531 01:01:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1919983' 00:07:08.531 killing process with pid 1919983 00:07:08.531 01:01:22 -- common/autotest_common.sh@955 -- # kill 1919983 00:07:08.531 01:01:22 -- common/autotest_common.sh@960 -- # wait 1919983 00:07:08.788 01:01:23 -- event/cpu_locks.sh@16 -- # [[ -z 1920125 ]] 00:07:08.788 01:01:23 -- event/cpu_locks.sh@16 -- # killprocess 1920125 00:07:08.788 01:01:23 -- common/autotest_common.sh@936 -- # '[' -z 1920125 ']' 00:07:08.788 01:01:23 -- common/autotest_common.sh@940 -- # kill -0 1920125 00:07:08.788 01:01:23 -- common/autotest_common.sh@941 -- # uname 00:07:08.788 01:01:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:08.788 01:01:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1920125 00:07:09.044 01:01:23 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:07:09.044 01:01:23 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:07:09.044 01:01:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1920125' 00:07:09.044 killing process with pid 1920125 00:07:09.044 01:01:23 -- common/autotest_common.sh@955 -- # kill 1920125 00:07:09.044 01:01:23 -- common/autotest_common.sh@960 -- # wait 1920125 00:07:09.311 01:01:23 -- event/cpu_locks.sh@18 -- # rm -f 00:07:09.311 01:01:23 -- event/cpu_locks.sh@1 -- # cleanup 00:07:09.311 01:01:23 -- event/cpu_locks.sh@15 -- # [[ -z 1919983 ]] 00:07:09.312 01:01:23 -- event/cpu_locks.sh@15 -- # killprocess 1919983 00:07:09.312 01:01:23 -- common/autotest_common.sh@936 -- # '[' -z 1919983 ']' 00:07:09.312 01:01:23 -- common/autotest_common.sh@940 -- # kill -0 1919983 00:07:09.312 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1919983) - No such process 00:07:09.312 01:01:23 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1919983 is not found' 00:07:09.312 Process with pid 1919983 is not found 00:07:09.312 01:01:23 -- event/cpu_locks.sh@16 -- # [[ -z 1920125 ]] 00:07:09.312 01:01:23 -- event/cpu_locks.sh@16 -- # killprocess 1920125 00:07:09.312 01:01:23 -- common/autotest_common.sh@936 -- # '[' -z 1920125 ']' 00:07:09.312 01:01:23 -- common/autotest_common.sh@940 -- # kill -0 1920125 00:07:09.312 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1920125) - No such process 00:07:09.312 01:01:23 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1920125 is not found' 00:07:09.312 Process with pid 1920125 is not found 00:07:09.312 01:01:23 -- event/cpu_locks.sh@18 -- # rm -f 00:07:09.312 00:07:09.312 real 0m19.209s 00:07:09.312 user 0m35.102s 00:07:09.312 sys 0m5.470s 00:07:09.312 01:01:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:09.312 01:01:23 -- common/autotest_common.sh@10 -- # set +x 00:07:09.312 ************************************ 00:07:09.312 END TEST cpu_locks 00:07:09.312 ************************************ 00:07:09.312 00:07:09.312 real 0m46.447s 00:07:09.312 user 1m30.238s 00:07:09.312 sys 0m9.422s 00:07:09.312 01:01:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:09.312 01:01:23 -- common/autotest_common.sh@10 -- # set +x 00:07:09.312 ************************************ 00:07:09.312 END TEST event 00:07:09.312 ************************************ 00:07:09.312 01:01:23 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:07:09.312 01:01:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:09.312 01:01:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:09.312 01:01:23 -- common/autotest_common.sh@10 -- # set +x 00:07:09.312 ************************************ 00:07:09.312 START TEST thread 00:07:09.312 ************************************ 00:07:09.312 01:01:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:07:09.312 * Looking for test storage... 00:07:09.312 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:07:09.312 01:01:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:09.631 01:01:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:09.631 01:01:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:09.631 01:01:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:09.631 01:01:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:09.631 01:01:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:09.631 01:01:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:09.631 01:01:23 -- scripts/common.sh@335 -- # IFS=.-: 00:07:09.631 01:01:23 -- scripts/common.sh@335 -- # read -ra ver1 00:07:09.631 01:01:23 -- scripts/common.sh@336 -- # IFS=.-: 00:07:09.631 01:01:23 -- scripts/common.sh@336 -- # read -ra ver2 00:07:09.631 01:01:23 -- scripts/common.sh@337 -- # local 'op=<' 00:07:09.631 01:01:23 -- scripts/common.sh@339 -- # ver1_l=2 00:07:09.632 01:01:23 -- scripts/common.sh@340 -- # ver2_l=1 00:07:09.632 01:01:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:09.632 01:01:23 -- scripts/common.sh@343 -- # case "$op" in 00:07:09.632 01:01:23 -- scripts/common.sh@344 -- # : 1 00:07:09.632 01:01:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:09.632 01:01:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:09.632 01:01:23 -- scripts/common.sh@364 -- # decimal 1 00:07:09.632 01:01:23 -- scripts/common.sh@352 -- # local d=1 00:07:09.632 01:01:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:09.632 01:01:23 -- scripts/common.sh@354 -- # echo 1 00:07:09.632 01:01:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:09.632 01:01:23 -- scripts/common.sh@365 -- # decimal 2 00:07:09.632 01:01:23 -- scripts/common.sh@352 -- # local d=2 00:07:09.632 01:01:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:09.632 01:01:23 -- scripts/common.sh@354 -- # echo 2 00:07:09.632 01:01:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:09.632 01:01:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:09.632 01:01:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:09.632 01:01:23 -- scripts/common.sh@367 -- # return 0 00:07:09.632 01:01:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:09.632 01:01:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:09.632 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:09.632 --rc genhtml_branch_coverage=1 00:07:09.632 --rc genhtml_function_coverage=1 00:07:09.632 --rc genhtml_legend=1 00:07:09.632 --rc geninfo_all_blocks=1 00:07:09.632 --rc geninfo_unexecuted_blocks=1 00:07:09.632 00:07:09.632 ' 00:07:09.632 01:01:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:09.632 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:09.632 --rc genhtml_branch_coverage=1 00:07:09.632 --rc genhtml_function_coverage=1 00:07:09.632 --rc genhtml_legend=1 00:07:09.632 --rc geninfo_all_blocks=1 00:07:09.632 --rc geninfo_unexecuted_blocks=1 00:07:09.632 00:07:09.632 ' 00:07:09.632 01:01:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:09.632 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:09.632 --rc genhtml_branch_coverage=1 00:07:09.632 --rc genhtml_function_coverage=1 00:07:09.632 --rc genhtml_legend=1 00:07:09.632 --rc geninfo_all_blocks=1 00:07:09.632 --rc geninfo_unexecuted_blocks=1 00:07:09.632 00:07:09.632 ' 00:07:09.632 01:01:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:09.632 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:09.632 --rc genhtml_branch_coverage=1 00:07:09.632 --rc genhtml_function_coverage=1 00:07:09.632 --rc genhtml_legend=1 00:07:09.632 --rc geninfo_all_blocks=1 00:07:09.632 --rc geninfo_unexecuted_blocks=1 00:07:09.632 00:07:09.632 ' 00:07:09.632 01:01:23 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:07:09.632 01:01:23 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:09.632 01:01:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:09.632 01:01:23 -- common/autotest_common.sh@10 -- # set +x 00:07:09.632 ************************************ 00:07:09.632 START TEST thread_poller_perf 00:07:09.632 ************************************ 00:07:09.632 01:01:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:07:09.632 [2024-11-28 01:01:24.005558] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:09.632 [2024-11-28 01:01:24.005642] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1920633 ] 00:07:09.632 EAL: No free 2048 kB hugepages reported on node 1 00:07:09.632 [2024-11-28 01:01:24.063771] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:09.632 [2024-11-28 01:01:24.153544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.632 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:07:11.002 [2024-11-28T00:01:25.605Z] ====================================== 00:07:11.002 [2024-11-28T00:01:25.605Z] busy:2714116155 (cyc) 00:07:11.002 [2024-11-28T00:01:25.605Z] total_run_count: 280000 00:07:11.002 [2024-11-28T00:01:25.605Z] tsc_hz: 2700000000 (cyc) 00:07:11.002 [2024-11-28T00:01:25.605Z] ====================================== 00:07:11.002 [2024-11-28T00:01:25.605Z] poller_cost: 9693 (cyc), 3590 (nsec) 00:07:11.002 00:07:11.002 real 0m1.248s 00:07:11.002 user 0m1.163s 00:07:11.002 sys 0m0.079s 00:07:11.002 01:01:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:11.002 01:01:25 -- common/autotest_common.sh@10 -- # set +x 00:07:11.002 ************************************ 00:07:11.002 END TEST thread_poller_perf 00:07:11.002 ************************************ 00:07:11.002 01:01:25 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:07:11.002 01:01:25 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:11.002 01:01:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:11.002 01:01:25 -- common/autotest_common.sh@10 -- # set +x 00:07:11.002 ************************************ 00:07:11.002 START TEST thread_poller_perf 00:07:11.002 ************************************ 00:07:11.002 01:01:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:07:11.002 [2024-11-28 01:01:25.284902] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:11.002 [2024-11-28 01:01:25.284993] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1920791 ] 00:07:11.002 EAL: No free 2048 kB hugepages reported on node 1 00:07:11.002 [2024-11-28 01:01:25.348322] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:11.002 [2024-11-28 01:01:25.436034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:11.002 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:07:11.933 [2024-11-28T00:01:26.536Z] ====================================== 00:07:11.933 [2024-11-28T00:01:26.536Z] busy:2703264184 (cyc) 00:07:11.933 [2024-11-28T00:01:26.536Z] total_run_count: 3827000 00:07:11.933 [2024-11-28T00:01:26.536Z] tsc_hz: 2700000000 (cyc) 00:07:11.933 [2024-11-28T00:01:26.536Z] ====================================== 00:07:11.933 [2024-11-28T00:01:26.536Z] poller_cost: 706 (cyc), 261 (nsec) 00:07:11.933 00:07:11.933 real 0m1.250s 00:07:11.933 user 0m1.157s 00:07:11.933 sys 0m0.086s 00:07:11.933 01:01:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:11.933 01:01:26 -- common/autotest_common.sh@10 -- # set +x 00:07:11.933 ************************************ 00:07:11.933 END TEST thread_poller_perf 00:07:11.933 ************************************ 00:07:12.192 01:01:26 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:07:12.192 00:07:12.192 real 0m2.686s 00:07:12.192 user 0m2.431s 00:07:12.192 sys 0m0.258s 00:07:12.192 01:01:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:12.192 01:01:26 -- common/autotest_common.sh@10 -- # set +x 00:07:12.192 ************************************ 00:07:12.192 END TEST thread 00:07:12.192 ************************************ 00:07:12.192 01:01:26 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:07:12.192 01:01:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:12.192 01:01:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:12.192 01:01:26 -- common/autotest_common.sh@10 -- # set +x 00:07:12.192 ************************************ 00:07:12.192 START TEST accel 00:07:12.192 ************************************ 00:07:12.192 01:01:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:07:12.192 * Looking for test storage... 00:07:12.192 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:12.192 01:01:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:12.192 01:01:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:12.192 01:01:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:12.192 01:01:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:12.192 01:01:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:12.192 01:01:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:12.192 01:01:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:12.192 01:01:26 -- scripts/common.sh@335 -- # IFS=.-: 00:07:12.192 01:01:26 -- scripts/common.sh@335 -- # read -ra ver1 00:07:12.192 01:01:26 -- scripts/common.sh@336 -- # IFS=.-: 00:07:12.192 01:01:26 -- scripts/common.sh@336 -- # read -ra ver2 00:07:12.192 01:01:26 -- scripts/common.sh@337 -- # local 'op=<' 00:07:12.192 01:01:26 -- scripts/common.sh@339 -- # ver1_l=2 00:07:12.192 01:01:26 -- scripts/common.sh@340 -- # ver2_l=1 00:07:12.192 01:01:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:12.192 01:01:26 -- scripts/common.sh@343 -- # case "$op" in 00:07:12.192 01:01:26 -- scripts/common.sh@344 -- # : 1 00:07:12.192 01:01:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:12.192 01:01:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:12.192 01:01:26 -- scripts/common.sh@364 -- # decimal 1 00:07:12.192 01:01:26 -- scripts/common.sh@352 -- # local d=1 00:07:12.192 01:01:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:12.192 01:01:26 -- scripts/common.sh@354 -- # echo 1 00:07:12.192 01:01:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:12.192 01:01:26 -- scripts/common.sh@365 -- # decimal 2 00:07:12.192 01:01:26 -- scripts/common.sh@352 -- # local d=2 00:07:12.192 01:01:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:12.192 01:01:26 -- scripts/common.sh@354 -- # echo 2 00:07:12.192 01:01:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:12.192 01:01:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:12.192 01:01:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:12.192 01:01:26 -- scripts/common.sh@367 -- # return 0 00:07:12.192 01:01:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:12.192 01:01:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:12.192 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:12.192 --rc genhtml_branch_coverage=1 00:07:12.192 --rc genhtml_function_coverage=1 00:07:12.193 --rc genhtml_legend=1 00:07:12.193 --rc geninfo_all_blocks=1 00:07:12.193 --rc geninfo_unexecuted_blocks=1 00:07:12.193 00:07:12.193 ' 00:07:12.193 01:01:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:12.193 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:12.193 --rc genhtml_branch_coverage=1 00:07:12.193 --rc genhtml_function_coverage=1 00:07:12.193 --rc genhtml_legend=1 00:07:12.193 --rc geninfo_all_blocks=1 00:07:12.193 --rc geninfo_unexecuted_blocks=1 00:07:12.193 00:07:12.193 ' 00:07:12.193 01:01:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:12.193 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:12.193 --rc genhtml_branch_coverage=1 00:07:12.193 --rc genhtml_function_coverage=1 00:07:12.193 --rc genhtml_legend=1 00:07:12.193 --rc geninfo_all_blocks=1 00:07:12.193 --rc geninfo_unexecuted_blocks=1 00:07:12.193 00:07:12.193 ' 00:07:12.193 01:01:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:12.193 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:12.193 --rc genhtml_branch_coverage=1 00:07:12.193 --rc genhtml_function_coverage=1 00:07:12.193 --rc genhtml_legend=1 00:07:12.193 --rc geninfo_all_blocks=1 00:07:12.193 --rc geninfo_unexecuted_blocks=1 00:07:12.193 00:07:12.193 ' 00:07:12.193 01:01:26 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:07:12.193 01:01:26 -- accel/accel.sh@74 -- # get_expected_opcs 00:07:12.193 01:01:26 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:12.193 01:01:26 -- accel/accel.sh@59 -- # spdk_tgt_pid=1920993 00:07:12.193 01:01:26 -- accel/accel.sh@60 -- # waitforlisten 1920993 00:07:12.193 01:01:26 -- common/autotest_common.sh@829 -- # '[' -z 1920993 ']' 00:07:12.193 01:01:26 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:07:12.193 01:01:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:12.193 01:01:26 -- accel/accel.sh@58 -- # build_accel_config 00:07:12.193 01:01:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:12.193 01:01:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:12.193 01:01:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:12.193 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:12.193 01:01:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:12.193 01:01:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:12.193 01:01:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:12.193 01:01:26 -- common/autotest_common.sh@10 -- # set +x 00:07:12.193 01:01:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:12.193 01:01:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:12.193 01:01:26 -- accel/accel.sh@41 -- # local IFS=, 00:07:12.193 01:01:26 -- accel/accel.sh@42 -- # jq -r . 00:07:12.193 [2024-11-28 01:01:26.757039] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:12.193 [2024-11-28 01:01:26.757121] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1920993 ] 00:07:12.193 EAL: No free 2048 kB hugepages reported on node 1 00:07:12.451 [2024-11-28 01:01:26.819362] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:12.451 [2024-11-28 01:01:26.909244] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:12.451 [2024-11-28 01:01:26.909426] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:13.386 01:01:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:13.386 01:01:27 -- common/autotest_common.sh@862 -- # return 0 00:07:13.386 01:01:27 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:07:13.386 01:01:27 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:07:13.386 01:01:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.386 01:01:27 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:07:13.386 01:01:27 -- common/autotest_common.sh@10 -- # set +x 00:07:13.386 01:01:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.386 01:01:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # IFS== 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # read -r opc module 00:07:13.386 01:01:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:13.386 01:01:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # IFS== 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # read -r opc module 00:07:13.386 01:01:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:13.386 01:01:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # IFS== 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # read -r opc module 00:07:13.386 01:01:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:13.386 01:01:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # IFS== 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # read -r opc module 00:07:13.386 01:01:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:13.386 01:01:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # IFS== 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # read -r opc module 00:07:13.386 01:01:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:13.386 01:01:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # IFS== 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # read -r opc module 00:07:13.386 01:01:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:13.386 01:01:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # IFS== 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # read -r opc module 00:07:13.386 01:01:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:13.386 01:01:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # IFS== 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # read -r opc module 00:07:13.386 01:01:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:13.386 01:01:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # IFS== 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # read -r opc module 00:07:13.386 01:01:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:13.386 01:01:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # IFS== 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # read -r opc module 00:07:13.386 01:01:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:13.386 01:01:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # IFS== 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # read -r opc module 00:07:13.386 01:01:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:13.386 01:01:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # IFS== 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # read -r opc module 00:07:13.386 01:01:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:13.386 01:01:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # IFS== 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # read -r opc module 00:07:13.386 01:01:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:13.386 01:01:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # IFS== 00:07:13.386 01:01:27 -- accel/accel.sh@64 -- # read -r opc module 00:07:13.386 01:01:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:07:13.386 01:01:27 -- accel/accel.sh@67 -- # killprocess 1920993 00:07:13.386 01:01:27 -- common/autotest_common.sh@936 -- # '[' -z 1920993 ']' 00:07:13.386 01:01:27 -- common/autotest_common.sh@940 -- # kill -0 1920993 00:07:13.386 01:01:27 -- common/autotest_common.sh@941 -- # uname 00:07:13.386 01:01:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:13.386 01:01:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1920993 00:07:13.386 01:01:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:13.386 01:01:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:13.386 01:01:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1920993' 00:07:13.386 killing process with pid 1920993 00:07:13.386 01:01:27 -- common/autotest_common.sh@955 -- # kill 1920993 00:07:13.386 01:01:27 -- common/autotest_common.sh@960 -- # wait 1920993 00:07:13.645 01:01:28 -- accel/accel.sh@68 -- # trap - ERR 00:07:13.645 01:01:28 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:07:13.646 01:01:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:13.646 01:01:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:13.646 01:01:28 -- common/autotest_common.sh@10 -- # set +x 00:07:13.646 01:01:28 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:07:13.646 01:01:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:07:13.646 01:01:28 -- accel/accel.sh@12 -- # build_accel_config 00:07:13.646 01:01:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:13.646 01:01:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:13.646 01:01:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:13.646 01:01:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:13.646 01:01:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:13.646 01:01:28 -- accel/accel.sh@41 -- # local IFS=, 00:07:13.646 01:01:28 -- accel/accel.sh@42 -- # jq -r . 00:07:13.904 01:01:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:13.905 01:01:28 -- common/autotest_common.sh@10 -- # set +x 00:07:13.905 01:01:28 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:07:13.905 01:01:28 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:13.905 01:01:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:13.905 01:01:28 -- common/autotest_common.sh@10 -- # set +x 00:07:13.905 ************************************ 00:07:13.905 START TEST accel_missing_filename 00:07:13.905 ************************************ 00:07:13.905 01:01:28 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:07:13.905 01:01:28 -- common/autotest_common.sh@650 -- # local es=0 00:07:13.905 01:01:28 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:07:13.905 01:01:28 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:07:13.905 01:01:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:13.905 01:01:28 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:07:13.905 01:01:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:13.905 01:01:28 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:07:13.905 01:01:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:07:13.905 01:01:28 -- accel/accel.sh@12 -- # build_accel_config 00:07:13.905 01:01:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:13.905 01:01:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:13.905 01:01:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:13.905 01:01:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:13.905 01:01:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:13.905 01:01:28 -- accel/accel.sh@41 -- # local IFS=, 00:07:13.905 01:01:28 -- accel/accel.sh@42 -- # jq -r . 00:07:13.905 [2024-11-28 01:01:28.298771] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:13.905 [2024-11-28 01:01:28.298885] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1921175 ] 00:07:13.905 EAL: No free 2048 kB hugepages reported on node 1 00:07:13.905 [2024-11-28 01:01:28.363005] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:13.905 [2024-11-28 01:01:28.452870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.163 [2024-11-28 01:01:28.511752] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:07:14.163 [2024-11-28 01:01:28.588058] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:07:14.163 A filename is required. 00:07:14.163 01:01:28 -- common/autotest_common.sh@653 -- # es=234 00:07:14.163 01:01:28 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:14.163 01:01:28 -- common/autotest_common.sh@662 -- # es=106 00:07:14.163 01:01:28 -- common/autotest_common.sh@663 -- # case "$es" in 00:07:14.163 01:01:28 -- common/autotest_common.sh@670 -- # es=1 00:07:14.163 01:01:28 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:14.163 00:07:14.163 real 0m0.391s 00:07:14.163 user 0m0.284s 00:07:14.163 sys 0m0.140s 00:07:14.163 01:01:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:14.163 01:01:28 -- common/autotest_common.sh@10 -- # set +x 00:07:14.163 ************************************ 00:07:14.163 END TEST accel_missing_filename 00:07:14.163 ************************************ 00:07:14.163 01:01:28 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:14.163 01:01:28 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:07:14.163 01:01:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:14.163 01:01:28 -- common/autotest_common.sh@10 -- # set +x 00:07:14.163 ************************************ 00:07:14.163 START TEST accel_compress_verify 00:07:14.163 ************************************ 00:07:14.163 01:01:28 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:14.163 01:01:28 -- common/autotest_common.sh@650 -- # local es=0 00:07:14.163 01:01:28 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:14.163 01:01:28 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:07:14.163 01:01:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:14.163 01:01:28 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:07:14.163 01:01:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:14.163 01:01:28 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:14.163 01:01:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:14.163 01:01:28 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.163 01:01:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:14.163 01:01:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.163 01:01:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.163 01:01:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:14.163 01:01:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:14.163 01:01:28 -- accel/accel.sh@41 -- # local IFS=, 00:07:14.163 01:01:28 -- accel/accel.sh@42 -- # jq -r . 00:07:14.163 [2024-11-28 01:01:28.718775] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:14.163 [2024-11-28 01:01:28.718859] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1921317 ] 00:07:14.163 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.422 [2024-11-28 01:01:28.782421] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:14.422 [2024-11-28 01:01:28.870325] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.422 [2024-11-28 01:01:28.932624] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:07:14.422 [2024-11-28 01:01:29.020199] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:07:14.681 00:07:14.681 Compression does not support the verify option, aborting. 00:07:14.681 01:01:29 -- common/autotest_common.sh@653 -- # es=161 00:07:14.681 01:01:29 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:14.681 01:01:29 -- common/autotest_common.sh@662 -- # es=33 00:07:14.681 01:01:29 -- common/autotest_common.sh@663 -- # case "$es" in 00:07:14.681 01:01:29 -- common/autotest_common.sh@670 -- # es=1 00:07:14.681 01:01:29 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:14.681 00:07:14.681 real 0m0.405s 00:07:14.681 user 0m0.297s 00:07:14.681 sys 0m0.142s 00:07:14.681 01:01:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:14.681 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:07:14.682 ************************************ 00:07:14.682 END TEST accel_compress_verify 00:07:14.682 ************************************ 00:07:14.682 01:01:29 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:07:14.682 01:01:29 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:14.682 01:01:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:14.682 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:07:14.682 ************************************ 00:07:14.682 START TEST accel_wrong_workload 00:07:14.682 ************************************ 00:07:14.682 01:01:29 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:07:14.682 01:01:29 -- common/autotest_common.sh@650 -- # local es=0 00:07:14.682 01:01:29 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:07:14.682 01:01:29 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:07:14.682 01:01:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:14.682 01:01:29 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:07:14.682 01:01:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:14.682 01:01:29 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:07:14.682 01:01:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:07:14.682 01:01:29 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.682 01:01:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:14.682 01:01:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.682 01:01:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.682 01:01:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:14.682 01:01:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:14.682 01:01:29 -- accel/accel.sh@41 -- # local IFS=, 00:07:14.682 01:01:29 -- accel/accel.sh@42 -- # jq -r . 00:07:14.682 Unsupported workload type: foobar 00:07:14.682 [2024-11-28 01:01:29.148072] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:07:14.682 accel_perf options: 00:07:14.682 [-h help message] 00:07:14.682 [-q queue depth per core] 00:07:14.682 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:07:14.682 [-T number of threads per core 00:07:14.682 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:07:14.682 [-t time in seconds] 00:07:14.682 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:07:14.682 [ dif_verify, , dif_generate, dif_generate_copy 00:07:14.682 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:07:14.682 [-l for compress/decompress workloads, name of uncompressed input file 00:07:14.682 [-S for crc32c workload, use this seed value (default 0) 00:07:14.682 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:07:14.682 [-f for fill workload, use this BYTE value (default 255) 00:07:14.682 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:07:14.682 [-y verify result if this switch is on] 00:07:14.682 [-a tasks to allocate per core (default: same value as -q)] 00:07:14.682 Can be used to spread operations across a wider range of memory. 00:07:14.682 01:01:29 -- common/autotest_common.sh@653 -- # es=1 00:07:14.682 01:01:29 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:14.682 01:01:29 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:14.682 01:01:29 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:14.682 00:07:14.682 real 0m0.021s 00:07:14.682 user 0m0.012s 00:07:14.682 sys 0m0.009s 00:07:14.682 01:01:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:14.682 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:07:14.682 ************************************ 00:07:14.682 END TEST accel_wrong_workload 00:07:14.682 ************************************ 00:07:14.682 Error: writing output failed: Broken pipe 00:07:14.682 01:01:29 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:07:14.682 01:01:29 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:07:14.682 01:01:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:14.682 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:07:14.682 ************************************ 00:07:14.682 START TEST accel_negative_buffers 00:07:14.682 ************************************ 00:07:14.682 01:01:29 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:07:14.682 01:01:29 -- common/autotest_common.sh@650 -- # local es=0 00:07:14.682 01:01:29 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:07:14.682 01:01:29 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:07:14.682 01:01:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:14.682 01:01:29 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:07:14.682 01:01:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:14.682 01:01:29 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:07:14.682 01:01:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:07:14.682 01:01:29 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.682 01:01:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:14.682 01:01:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.682 01:01:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.682 01:01:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:14.682 01:01:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:14.682 01:01:29 -- accel/accel.sh@41 -- # local IFS=, 00:07:14.682 01:01:29 -- accel/accel.sh@42 -- # jq -r . 00:07:14.682 -x option must be non-negative. 00:07:14.682 [2024-11-28 01:01:29.191972] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:07:14.682 accel_perf options: 00:07:14.682 [-h help message] 00:07:14.682 [-q queue depth per core] 00:07:14.682 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:07:14.682 [-T number of threads per core 00:07:14.682 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:07:14.682 [-t time in seconds] 00:07:14.682 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:07:14.682 [ dif_verify, , dif_generate, dif_generate_copy 00:07:14.682 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:07:14.682 [-l for compress/decompress workloads, name of uncompressed input file 00:07:14.682 [-S for crc32c workload, use this seed value (default 0) 00:07:14.682 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:07:14.682 [-f for fill workload, use this BYTE value (default 255) 00:07:14.682 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:07:14.682 [-y verify result if this switch is on] 00:07:14.682 [-a tasks to allocate per core (default: same value as -q)] 00:07:14.682 Can be used to spread operations across a wider range of memory. 00:07:14.682 01:01:29 -- common/autotest_common.sh@653 -- # es=1 00:07:14.682 01:01:29 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:14.682 01:01:29 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:14.682 01:01:29 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:14.682 00:07:14.682 real 0m0.019s 00:07:14.682 user 0m0.012s 00:07:14.682 sys 0m0.006s 00:07:14.682 01:01:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:14.682 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:07:14.682 ************************************ 00:07:14.682 END TEST accel_negative_buffers 00:07:14.682 ************************************ 00:07:14.682 Error: writing output failed: Broken pipe 00:07:14.683 01:01:29 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:07:14.683 01:01:29 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:14.683 01:01:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:14.683 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:07:14.683 ************************************ 00:07:14.683 START TEST accel_crc32c 00:07:14.683 ************************************ 00:07:14.683 01:01:29 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:07:14.683 01:01:29 -- accel/accel.sh@16 -- # local accel_opc 00:07:14.683 01:01:29 -- accel/accel.sh@17 -- # local accel_module 00:07:14.683 01:01:29 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:07:14.683 01:01:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:07:14.683 01:01:29 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.683 01:01:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:14.683 01:01:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.683 01:01:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.683 01:01:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:14.683 01:01:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:14.683 01:01:29 -- accel/accel.sh@41 -- # local IFS=, 00:07:14.683 01:01:29 -- accel/accel.sh@42 -- # jq -r . 00:07:14.683 [2024-11-28 01:01:29.241253] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:14.683 [2024-11-28 01:01:29.241332] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1921378 ] 00:07:14.683 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.941 [2024-11-28 01:01:29.306227] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:14.941 [2024-11-28 01:01:29.397710] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:16.315 01:01:30 -- accel/accel.sh@18 -- # out=' 00:07:16.315 SPDK Configuration: 00:07:16.315 Core mask: 0x1 00:07:16.315 00:07:16.315 Accel Perf Configuration: 00:07:16.315 Workload Type: crc32c 00:07:16.315 CRC-32C seed: 32 00:07:16.315 Transfer size: 4096 bytes 00:07:16.315 Vector count 1 00:07:16.315 Module: software 00:07:16.315 Queue depth: 32 00:07:16.315 Allocate depth: 32 00:07:16.315 # threads/core: 1 00:07:16.315 Run time: 1 seconds 00:07:16.315 Verify: Yes 00:07:16.315 00:07:16.315 Running for 1 seconds... 00:07:16.315 00:07:16.315 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:16.315 ------------------------------------------------------------------------------------ 00:07:16.315 0,0 415968/s 1624 MiB/s 0 0 00:07:16.315 ==================================================================================== 00:07:16.315 Total 415968/s 1624 MiB/s 0 0' 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # IFS=: 00:07:16.315 01:01:30 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # read -r var val 00:07:16.315 01:01:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:07:16.315 01:01:30 -- accel/accel.sh@12 -- # build_accel_config 00:07:16.315 01:01:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:16.315 01:01:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:16.315 01:01:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:16.315 01:01:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:16.315 01:01:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:16.315 01:01:30 -- accel/accel.sh@41 -- # local IFS=, 00:07:16.315 01:01:30 -- accel/accel.sh@42 -- # jq -r . 00:07:16.315 [2024-11-28 01:01:30.643691] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:16.315 [2024-11-28 01:01:30.643770] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1921585 ] 00:07:16.315 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.315 [2024-11-28 01:01:30.705967] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:16.315 [2024-11-28 01:01:30.796379] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:16.315 01:01:30 -- accel/accel.sh@21 -- # val= 00:07:16.315 01:01:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # IFS=: 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # read -r var val 00:07:16.315 01:01:30 -- accel/accel.sh@21 -- # val= 00:07:16.315 01:01:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # IFS=: 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # read -r var val 00:07:16.315 01:01:30 -- accel/accel.sh@21 -- # val=0x1 00:07:16.315 01:01:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # IFS=: 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # read -r var val 00:07:16.315 01:01:30 -- accel/accel.sh@21 -- # val= 00:07:16.315 01:01:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # IFS=: 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # read -r var val 00:07:16.315 01:01:30 -- accel/accel.sh@21 -- # val= 00:07:16.315 01:01:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # IFS=: 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # read -r var val 00:07:16.315 01:01:30 -- accel/accel.sh@21 -- # val=crc32c 00:07:16.315 01:01:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.315 01:01:30 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # IFS=: 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # read -r var val 00:07:16.315 01:01:30 -- accel/accel.sh@21 -- # val=32 00:07:16.315 01:01:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # IFS=: 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # read -r var val 00:07:16.315 01:01:30 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:16.315 01:01:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # IFS=: 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # read -r var val 00:07:16.315 01:01:30 -- accel/accel.sh@21 -- # val= 00:07:16.315 01:01:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # IFS=: 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # read -r var val 00:07:16.315 01:01:30 -- accel/accel.sh@21 -- # val=software 00:07:16.315 01:01:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.315 01:01:30 -- accel/accel.sh@23 -- # accel_module=software 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # IFS=: 00:07:16.315 01:01:30 -- accel/accel.sh@20 -- # read -r var val 00:07:16.315 01:01:30 -- accel/accel.sh@21 -- # val=32 00:07:16.315 01:01:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.316 01:01:30 -- accel/accel.sh@20 -- # IFS=: 00:07:16.316 01:01:30 -- accel/accel.sh@20 -- # read -r var val 00:07:16.316 01:01:30 -- accel/accel.sh@21 -- # val=32 00:07:16.316 01:01:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.316 01:01:30 -- accel/accel.sh@20 -- # IFS=: 00:07:16.316 01:01:30 -- accel/accel.sh@20 -- # read -r var val 00:07:16.316 01:01:30 -- accel/accel.sh@21 -- # val=1 00:07:16.316 01:01:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.316 01:01:30 -- accel/accel.sh@20 -- # IFS=: 00:07:16.316 01:01:30 -- accel/accel.sh@20 -- # read -r var val 00:07:16.316 01:01:30 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:16.316 01:01:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.316 01:01:30 -- accel/accel.sh@20 -- # IFS=: 00:07:16.316 01:01:30 -- accel/accel.sh@20 -- # read -r var val 00:07:16.316 01:01:30 -- accel/accel.sh@21 -- # val=Yes 00:07:16.316 01:01:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.316 01:01:30 -- accel/accel.sh@20 -- # IFS=: 00:07:16.316 01:01:30 -- accel/accel.sh@20 -- # read -r var val 00:07:16.316 01:01:30 -- accel/accel.sh@21 -- # val= 00:07:16.316 01:01:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.316 01:01:30 -- accel/accel.sh@20 -- # IFS=: 00:07:16.316 01:01:30 -- accel/accel.sh@20 -- # read -r var val 00:07:16.316 01:01:30 -- accel/accel.sh@21 -- # val= 00:07:16.316 01:01:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.316 01:01:30 -- accel/accel.sh@20 -- # IFS=: 00:07:16.316 01:01:30 -- accel/accel.sh@20 -- # read -r var val 00:07:17.691 01:01:32 -- accel/accel.sh@21 -- # val= 00:07:17.691 01:01:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.691 01:01:32 -- accel/accel.sh@20 -- # IFS=: 00:07:17.691 01:01:32 -- accel/accel.sh@20 -- # read -r var val 00:07:17.691 01:01:32 -- accel/accel.sh@21 -- # val= 00:07:17.691 01:01:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.691 01:01:32 -- accel/accel.sh@20 -- # IFS=: 00:07:17.691 01:01:32 -- accel/accel.sh@20 -- # read -r var val 00:07:17.691 01:01:32 -- accel/accel.sh@21 -- # val= 00:07:17.691 01:01:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.691 01:01:32 -- accel/accel.sh@20 -- # IFS=: 00:07:17.691 01:01:32 -- accel/accel.sh@20 -- # read -r var val 00:07:17.691 01:01:32 -- accel/accel.sh@21 -- # val= 00:07:17.691 01:01:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.691 01:01:32 -- accel/accel.sh@20 -- # IFS=: 00:07:17.691 01:01:32 -- accel/accel.sh@20 -- # read -r var val 00:07:17.691 01:01:32 -- accel/accel.sh@21 -- # val= 00:07:17.691 01:01:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.691 01:01:32 -- accel/accel.sh@20 -- # IFS=: 00:07:17.691 01:01:32 -- accel/accel.sh@20 -- # read -r var val 00:07:17.691 01:01:32 -- accel/accel.sh@21 -- # val= 00:07:17.691 01:01:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.691 01:01:32 -- accel/accel.sh@20 -- # IFS=: 00:07:17.691 01:01:32 -- accel/accel.sh@20 -- # read -r var val 00:07:17.691 01:01:32 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:17.691 01:01:32 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:07:17.692 01:01:32 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:17.692 00:07:17.692 real 0m2.790s 00:07:17.692 user 0m2.492s 00:07:17.692 sys 0m0.292s 00:07:17.692 01:01:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:17.692 01:01:32 -- common/autotest_common.sh@10 -- # set +x 00:07:17.692 ************************************ 00:07:17.692 END TEST accel_crc32c 00:07:17.692 ************************************ 00:07:17.692 01:01:32 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:07:17.692 01:01:32 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:17.692 01:01:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:17.692 01:01:32 -- common/autotest_common.sh@10 -- # set +x 00:07:17.692 ************************************ 00:07:17.692 START TEST accel_crc32c_C2 00:07:17.692 ************************************ 00:07:17.692 01:01:32 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:07:17.692 01:01:32 -- accel/accel.sh@16 -- # local accel_opc 00:07:17.692 01:01:32 -- accel/accel.sh@17 -- # local accel_module 00:07:17.692 01:01:32 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:07:17.692 01:01:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:07:17.692 01:01:32 -- accel/accel.sh@12 -- # build_accel_config 00:07:17.692 01:01:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:17.692 01:01:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:17.692 01:01:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:17.692 01:01:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:17.692 01:01:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:17.692 01:01:32 -- accel/accel.sh@41 -- # local IFS=, 00:07:17.692 01:01:32 -- accel/accel.sh@42 -- # jq -r . 00:07:17.692 [2024-11-28 01:01:32.058696] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:17.692 [2024-11-28 01:01:32.058781] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1921800 ] 00:07:17.692 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.692 [2024-11-28 01:01:32.123719] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:17.692 [2024-11-28 01:01:32.213979] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:19.066 01:01:33 -- accel/accel.sh@18 -- # out=' 00:07:19.066 SPDK Configuration: 00:07:19.066 Core mask: 0x1 00:07:19.066 00:07:19.066 Accel Perf Configuration: 00:07:19.066 Workload Type: crc32c 00:07:19.066 CRC-32C seed: 0 00:07:19.066 Transfer size: 4096 bytes 00:07:19.066 Vector count 2 00:07:19.066 Module: software 00:07:19.066 Queue depth: 32 00:07:19.066 Allocate depth: 32 00:07:19.066 # threads/core: 1 00:07:19.066 Run time: 1 seconds 00:07:19.066 Verify: Yes 00:07:19.066 00:07:19.066 Running for 1 seconds... 00:07:19.066 00:07:19.066 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:19.066 ------------------------------------------------------------------------------------ 00:07:19.066 0,0 315392/s 2464 MiB/s 0 0 00:07:19.066 ==================================================================================== 00:07:19.066 Total 315392/s 1232 MiB/s 0 0' 00:07:19.066 01:01:33 -- accel/accel.sh@20 -- # IFS=: 00:07:19.066 01:01:33 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:07:19.066 01:01:33 -- accel/accel.sh@20 -- # read -r var val 00:07:19.066 01:01:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:07:19.066 01:01:33 -- accel/accel.sh@12 -- # build_accel_config 00:07:19.066 01:01:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:19.066 01:01:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:19.066 01:01:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:19.066 01:01:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:19.066 01:01:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:19.066 01:01:33 -- accel/accel.sh@41 -- # local IFS=, 00:07:19.066 01:01:33 -- accel/accel.sh@42 -- # jq -r . 00:07:19.066 [2024-11-28 01:01:33.470220] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:19.066 [2024-11-28 01:01:33.470301] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1921944 ] 00:07:19.066 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.066 [2024-11-28 01:01:33.532538] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:19.066 [2024-11-28 01:01:33.622889] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:19.324 01:01:33 -- accel/accel.sh@21 -- # val= 00:07:19.324 01:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.324 01:01:33 -- accel/accel.sh@20 -- # IFS=: 00:07:19.324 01:01:33 -- accel/accel.sh@20 -- # read -r var val 00:07:19.324 01:01:33 -- accel/accel.sh@21 -- # val= 00:07:19.324 01:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.324 01:01:33 -- accel/accel.sh@20 -- # IFS=: 00:07:19.324 01:01:33 -- accel/accel.sh@20 -- # read -r var val 00:07:19.324 01:01:33 -- accel/accel.sh@21 -- # val=0x1 00:07:19.324 01:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.324 01:01:33 -- accel/accel.sh@20 -- # IFS=: 00:07:19.324 01:01:33 -- accel/accel.sh@20 -- # read -r var val 00:07:19.324 01:01:33 -- accel/accel.sh@21 -- # val= 00:07:19.324 01:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.324 01:01:33 -- accel/accel.sh@20 -- # IFS=: 00:07:19.324 01:01:33 -- accel/accel.sh@20 -- # read -r var val 00:07:19.324 01:01:33 -- accel/accel.sh@21 -- # val= 00:07:19.324 01:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.324 01:01:33 -- accel/accel.sh@20 -- # IFS=: 00:07:19.324 01:01:33 -- accel/accel.sh@20 -- # read -r var val 00:07:19.324 01:01:33 -- accel/accel.sh@21 -- # val=crc32c 00:07:19.324 01:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.324 01:01:33 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:07:19.324 01:01:33 -- accel/accel.sh@20 -- # IFS=: 00:07:19.324 01:01:33 -- accel/accel.sh@20 -- # read -r var val 00:07:19.324 01:01:33 -- accel/accel.sh@21 -- # val=0 00:07:19.324 01:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.324 01:01:33 -- accel/accel.sh@20 -- # IFS=: 00:07:19.324 01:01:33 -- accel/accel.sh@20 -- # read -r var val 00:07:19.324 01:01:33 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:19.324 01:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.324 01:01:33 -- accel/accel.sh@20 -- # IFS=: 00:07:19.324 01:01:33 -- accel/accel.sh@20 -- # read -r var val 00:07:19.324 01:01:33 -- accel/accel.sh@21 -- # val= 00:07:19.325 01:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.325 01:01:33 -- accel/accel.sh@20 -- # IFS=: 00:07:19.325 01:01:33 -- accel/accel.sh@20 -- # read -r var val 00:07:19.325 01:01:33 -- accel/accel.sh@21 -- # val=software 00:07:19.325 01:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.325 01:01:33 -- accel/accel.sh@23 -- # accel_module=software 00:07:19.325 01:01:33 -- accel/accel.sh@20 -- # IFS=: 00:07:19.325 01:01:33 -- accel/accel.sh@20 -- # read -r var val 00:07:19.325 01:01:33 -- accel/accel.sh@21 -- # val=32 00:07:19.325 01:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.325 01:01:33 -- accel/accel.sh@20 -- # IFS=: 00:07:19.325 01:01:33 -- accel/accel.sh@20 -- # read -r var val 00:07:19.325 01:01:33 -- accel/accel.sh@21 -- # val=32 00:07:19.325 01:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.325 01:01:33 -- accel/accel.sh@20 -- # IFS=: 00:07:19.325 01:01:33 -- accel/accel.sh@20 -- # read -r var val 00:07:19.325 01:01:33 -- accel/accel.sh@21 -- # val=1 00:07:19.325 01:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.325 01:01:33 -- accel/accel.sh@20 -- # IFS=: 00:07:19.325 01:01:33 -- accel/accel.sh@20 -- # read -r var val 00:07:19.325 01:01:33 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:19.325 01:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.325 01:01:33 -- accel/accel.sh@20 -- # IFS=: 00:07:19.325 01:01:33 -- accel/accel.sh@20 -- # read -r var val 00:07:19.325 01:01:33 -- accel/accel.sh@21 -- # val=Yes 00:07:19.325 01:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.325 01:01:33 -- accel/accel.sh@20 -- # IFS=: 00:07:19.325 01:01:33 -- accel/accel.sh@20 -- # read -r var val 00:07:19.325 01:01:33 -- accel/accel.sh@21 -- # val= 00:07:19.325 01:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.325 01:01:33 -- accel/accel.sh@20 -- # IFS=: 00:07:19.325 01:01:33 -- accel/accel.sh@20 -- # read -r var val 00:07:19.325 01:01:33 -- accel/accel.sh@21 -- # val= 00:07:19.325 01:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.325 01:01:33 -- accel/accel.sh@20 -- # IFS=: 00:07:19.325 01:01:33 -- accel/accel.sh@20 -- # read -r var val 00:07:20.260 01:01:34 -- accel/accel.sh@21 -- # val= 00:07:20.260 01:01:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.260 01:01:34 -- accel/accel.sh@20 -- # IFS=: 00:07:20.260 01:01:34 -- accel/accel.sh@20 -- # read -r var val 00:07:20.260 01:01:34 -- accel/accel.sh@21 -- # val= 00:07:20.260 01:01:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.260 01:01:34 -- accel/accel.sh@20 -- # IFS=: 00:07:20.260 01:01:34 -- accel/accel.sh@20 -- # read -r var val 00:07:20.260 01:01:34 -- accel/accel.sh@21 -- # val= 00:07:20.260 01:01:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.260 01:01:34 -- accel/accel.sh@20 -- # IFS=: 00:07:20.260 01:01:34 -- accel/accel.sh@20 -- # read -r var val 00:07:20.260 01:01:34 -- accel/accel.sh@21 -- # val= 00:07:20.260 01:01:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.260 01:01:34 -- accel/accel.sh@20 -- # IFS=: 00:07:20.260 01:01:34 -- accel/accel.sh@20 -- # read -r var val 00:07:20.260 01:01:34 -- accel/accel.sh@21 -- # val= 00:07:20.260 01:01:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.260 01:01:34 -- accel/accel.sh@20 -- # IFS=: 00:07:20.260 01:01:34 -- accel/accel.sh@20 -- # read -r var val 00:07:20.260 01:01:34 -- accel/accel.sh@21 -- # val= 00:07:20.260 01:01:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.260 01:01:34 -- accel/accel.sh@20 -- # IFS=: 00:07:20.518 01:01:34 -- accel/accel.sh@20 -- # read -r var val 00:07:20.518 01:01:34 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:20.518 01:01:34 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:07:20.518 01:01:34 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:20.518 00:07:20.518 real 0m2.823s 00:07:20.518 user 0m2.515s 00:07:20.518 sys 0m0.301s 00:07:20.518 01:01:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:20.518 01:01:34 -- common/autotest_common.sh@10 -- # set +x 00:07:20.518 ************************************ 00:07:20.518 END TEST accel_crc32c_C2 00:07:20.518 ************************************ 00:07:20.518 01:01:34 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:07:20.518 01:01:34 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:20.518 01:01:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:20.518 01:01:34 -- common/autotest_common.sh@10 -- # set +x 00:07:20.518 ************************************ 00:07:20.518 START TEST accel_copy 00:07:20.518 ************************************ 00:07:20.518 01:01:34 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:07:20.518 01:01:34 -- accel/accel.sh@16 -- # local accel_opc 00:07:20.518 01:01:34 -- accel/accel.sh@17 -- # local accel_module 00:07:20.518 01:01:34 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:07:20.518 01:01:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:07:20.518 01:01:34 -- accel/accel.sh@12 -- # build_accel_config 00:07:20.518 01:01:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:20.518 01:01:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:20.518 01:01:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:20.518 01:01:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:20.518 01:01:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:20.518 01:01:34 -- accel/accel.sh@41 -- # local IFS=, 00:07:20.518 01:01:34 -- accel/accel.sh@42 -- # jq -r . 00:07:20.518 [2024-11-28 01:01:34.905806] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:20.518 [2024-11-28 01:01:34.905905] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1922097 ] 00:07:20.518 EAL: No free 2048 kB hugepages reported on node 1 00:07:20.518 [2024-11-28 01:01:34.968620] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:20.518 [2024-11-28 01:01:35.059702] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:21.892 01:01:36 -- accel/accel.sh@18 -- # out=' 00:07:21.892 SPDK Configuration: 00:07:21.892 Core mask: 0x1 00:07:21.892 00:07:21.892 Accel Perf Configuration: 00:07:21.892 Workload Type: copy 00:07:21.892 Transfer size: 4096 bytes 00:07:21.892 Vector count 1 00:07:21.892 Module: software 00:07:21.892 Queue depth: 32 00:07:21.892 Allocate depth: 32 00:07:21.892 # threads/core: 1 00:07:21.892 Run time: 1 seconds 00:07:21.892 Verify: Yes 00:07:21.892 00:07:21.892 Running for 1 seconds... 00:07:21.892 00:07:21.892 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:21.892 ------------------------------------------------------------------------------------ 00:07:21.892 0,0 279872/s 1093 MiB/s 0 0 00:07:21.892 ==================================================================================== 00:07:21.892 Total 279872/s 1093 MiB/s 0 0' 00:07:21.892 01:01:36 -- accel/accel.sh@20 -- # IFS=: 00:07:21.892 01:01:36 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:07:21.892 01:01:36 -- accel/accel.sh@20 -- # read -r var val 00:07:21.892 01:01:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:07:21.892 01:01:36 -- accel/accel.sh@12 -- # build_accel_config 00:07:21.892 01:01:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:21.892 01:01:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:21.892 01:01:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:21.892 01:01:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:21.892 01:01:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:21.892 01:01:36 -- accel/accel.sh@41 -- # local IFS=, 00:07:21.892 01:01:36 -- accel/accel.sh@42 -- # jq -r . 00:07:21.892 [2024-11-28 01:01:36.307613] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:21.892 [2024-11-28 01:01:36.307691] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1922294 ] 00:07:21.892 EAL: No free 2048 kB hugepages reported on node 1 00:07:21.892 [2024-11-28 01:01:36.369952] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:21.892 [2024-11-28 01:01:36.459766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:22.151 01:01:36 -- accel/accel.sh@21 -- # val= 00:07:22.151 01:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.151 01:01:36 -- accel/accel.sh@20 -- # IFS=: 00:07:22.151 01:01:36 -- accel/accel.sh@20 -- # read -r var val 00:07:22.151 01:01:36 -- accel/accel.sh@21 -- # val= 00:07:22.151 01:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.151 01:01:36 -- accel/accel.sh@20 -- # IFS=: 00:07:22.151 01:01:36 -- accel/accel.sh@20 -- # read -r var val 00:07:22.151 01:01:36 -- accel/accel.sh@21 -- # val=0x1 00:07:22.151 01:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.151 01:01:36 -- accel/accel.sh@20 -- # IFS=: 00:07:22.151 01:01:36 -- accel/accel.sh@20 -- # read -r var val 00:07:22.151 01:01:36 -- accel/accel.sh@21 -- # val= 00:07:22.151 01:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.151 01:01:36 -- accel/accel.sh@20 -- # IFS=: 00:07:22.151 01:01:36 -- accel/accel.sh@20 -- # read -r var val 00:07:22.151 01:01:36 -- accel/accel.sh@21 -- # val= 00:07:22.151 01:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.151 01:01:36 -- accel/accel.sh@20 -- # IFS=: 00:07:22.151 01:01:36 -- accel/accel.sh@20 -- # read -r var val 00:07:22.151 01:01:36 -- accel/accel.sh@21 -- # val=copy 00:07:22.151 01:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.151 01:01:36 -- accel/accel.sh@24 -- # accel_opc=copy 00:07:22.151 01:01:36 -- accel/accel.sh@20 -- # IFS=: 00:07:22.151 01:01:36 -- accel/accel.sh@20 -- # read -r var val 00:07:22.151 01:01:36 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:22.151 01:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.151 01:01:36 -- accel/accel.sh@20 -- # IFS=: 00:07:22.151 01:01:36 -- accel/accel.sh@20 -- # read -r var val 00:07:22.151 01:01:36 -- accel/accel.sh@21 -- # val= 00:07:22.151 01:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.152 01:01:36 -- accel/accel.sh@20 -- # IFS=: 00:07:22.152 01:01:36 -- accel/accel.sh@20 -- # read -r var val 00:07:22.152 01:01:36 -- accel/accel.sh@21 -- # val=software 00:07:22.152 01:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.152 01:01:36 -- accel/accel.sh@23 -- # accel_module=software 00:07:22.152 01:01:36 -- accel/accel.sh@20 -- # IFS=: 00:07:22.152 01:01:36 -- accel/accel.sh@20 -- # read -r var val 00:07:22.152 01:01:36 -- accel/accel.sh@21 -- # val=32 00:07:22.152 01:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.152 01:01:36 -- accel/accel.sh@20 -- # IFS=: 00:07:22.152 01:01:36 -- accel/accel.sh@20 -- # read -r var val 00:07:22.152 01:01:36 -- accel/accel.sh@21 -- # val=32 00:07:22.152 01:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.152 01:01:36 -- accel/accel.sh@20 -- # IFS=: 00:07:22.152 01:01:36 -- accel/accel.sh@20 -- # read -r var val 00:07:22.152 01:01:36 -- accel/accel.sh@21 -- # val=1 00:07:22.152 01:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.152 01:01:36 -- accel/accel.sh@20 -- # IFS=: 00:07:22.152 01:01:36 -- accel/accel.sh@20 -- # read -r var val 00:07:22.152 01:01:36 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:22.152 01:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.152 01:01:36 -- accel/accel.sh@20 -- # IFS=: 00:07:22.152 01:01:36 -- accel/accel.sh@20 -- # read -r var val 00:07:22.152 01:01:36 -- accel/accel.sh@21 -- # val=Yes 00:07:22.152 01:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.152 01:01:36 -- accel/accel.sh@20 -- # IFS=: 00:07:22.152 01:01:36 -- accel/accel.sh@20 -- # read -r var val 00:07:22.152 01:01:36 -- accel/accel.sh@21 -- # val= 00:07:22.152 01:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.152 01:01:36 -- accel/accel.sh@20 -- # IFS=: 00:07:22.152 01:01:36 -- accel/accel.sh@20 -- # read -r var val 00:07:22.152 01:01:36 -- accel/accel.sh@21 -- # val= 00:07:22.152 01:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.152 01:01:36 -- accel/accel.sh@20 -- # IFS=: 00:07:22.152 01:01:36 -- accel/accel.sh@20 -- # read -r var val 00:07:23.085 01:01:37 -- accel/accel.sh@21 -- # val= 00:07:23.085 01:01:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.085 01:01:37 -- accel/accel.sh@20 -- # IFS=: 00:07:23.085 01:01:37 -- accel/accel.sh@20 -- # read -r var val 00:07:23.085 01:01:37 -- accel/accel.sh@21 -- # val= 00:07:23.085 01:01:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.085 01:01:37 -- accel/accel.sh@20 -- # IFS=: 00:07:23.085 01:01:37 -- accel/accel.sh@20 -- # read -r var val 00:07:23.085 01:01:37 -- accel/accel.sh@21 -- # val= 00:07:23.085 01:01:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.085 01:01:37 -- accel/accel.sh@20 -- # IFS=: 00:07:23.085 01:01:37 -- accel/accel.sh@20 -- # read -r var val 00:07:23.085 01:01:37 -- accel/accel.sh@21 -- # val= 00:07:23.085 01:01:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.085 01:01:37 -- accel/accel.sh@20 -- # IFS=: 00:07:23.085 01:01:37 -- accel/accel.sh@20 -- # read -r var val 00:07:23.085 01:01:37 -- accel/accel.sh@21 -- # val= 00:07:23.085 01:01:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.085 01:01:37 -- accel/accel.sh@20 -- # IFS=: 00:07:23.085 01:01:37 -- accel/accel.sh@20 -- # read -r var val 00:07:23.085 01:01:37 -- accel/accel.sh@21 -- # val= 00:07:23.085 01:01:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.085 01:01:37 -- accel/accel.sh@20 -- # IFS=: 00:07:23.085 01:01:37 -- accel/accel.sh@20 -- # read -r var val 00:07:23.085 01:01:37 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:23.085 01:01:37 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:07:23.085 01:01:37 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:23.085 00:07:23.085 real 0m2.789s 00:07:23.085 user 0m2.494s 00:07:23.085 sys 0m0.286s 00:07:23.085 01:01:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:23.085 01:01:37 -- common/autotest_common.sh@10 -- # set +x 00:07:23.085 ************************************ 00:07:23.085 END TEST accel_copy 00:07:23.085 ************************************ 00:07:23.344 01:01:37 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:23.344 01:01:37 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:23.344 01:01:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:23.344 01:01:37 -- common/autotest_common.sh@10 -- # set +x 00:07:23.344 ************************************ 00:07:23.344 START TEST accel_fill 00:07:23.344 ************************************ 00:07:23.344 01:01:37 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:23.344 01:01:37 -- accel/accel.sh@16 -- # local accel_opc 00:07:23.344 01:01:37 -- accel/accel.sh@17 -- # local accel_module 00:07:23.344 01:01:37 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:23.344 01:01:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:23.344 01:01:37 -- accel/accel.sh@12 -- # build_accel_config 00:07:23.344 01:01:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:23.344 01:01:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:23.344 01:01:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:23.344 01:01:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:23.344 01:01:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:23.344 01:01:37 -- accel/accel.sh@41 -- # local IFS=, 00:07:23.344 01:01:37 -- accel/accel.sh@42 -- # jq -r . 00:07:23.344 [2024-11-28 01:01:37.721239] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:23.344 [2024-11-28 01:01:37.721328] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1922524 ] 00:07:23.344 EAL: No free 2048 kB hugepages reported on node 1 00:07:23.344 [2024-11-28 01:01:37.785308] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:23.344 [2024-11-28 01:01:37.876269] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:24.719 01:01:39 -- accel/accel.sh@18 -- # out=' 00:07:24.719 SPDK Configuration: 00:07:24.719 Core mask: 0x1 00:07:24.719 00:07:24.719 Accel Perf Configuration: 00:07:24.719 Workload Type: fill 00:07:24.719 Fill pattern: 0x80 00:07:24.719 Transfer size: 4096 bytes 00:07:24.719 Vector count 1 00:07:24.719 Module: software 00:07:24.719 Queue depth: 64 00:07:24.719 Allocate depth: 64 00:07:24.719 # threads/core: 1 00:07:24.719 Run time: 1 seconds 00:07:24.719 Verify: Yes 00:07:24.719 00:07:24.719 Running for 1 seconds... 00:07:24.719 00:07:24.719 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:24.719 ------------------------------------------------------------------------------------ 00:07:24.719 0,0 406016/s 1586 MiB/s 0 0 00:07:24.719 ==================================================================================== 00:07:24.719 Total 406016/s 1586 MiB/s 0 0' 00:07:24.719 01:01:39 -- accel/accel.sh@20 -- # IFS=: 00:07:24.719 01:01:39 -- accel/accel.sh@20 -- # read -r var val 00:07:24.719 01:01:39 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:24.719 01:01:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:24.719 01:01:39 -- accel/accel.sh@12 -- # build_accel_config 00:07:24.719 01:01:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:24.719 01:01:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:24.719 01:01:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:24.719 01:01:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:24.719 01:01:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:24.719 01:01:39 -- accel/accel.sh@41 -- # local IFS=, 00:07:24.719 01:01:39 -- accel/accel.sh@42 -- # jq -r . 00:07:24.719 [2024-11-28 01:01:39.130498] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:24.719 [2024-11-28 01:01:39.130608] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1922665 ] 00:07:24.719 EAL: No free 2048 kB hugepages reported on node 1 00:07:24.719 [2024-11-28 01:01:39.191565] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:24.719 [2024-11-28 01:01:39.282670] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:24.979 01:01:39 -- accel/accel.sh@21 -- # val= 00:07:24.979 01:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # IFS=: 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # read -r var val 00:07:24.979 01:01:39 -- accel/accel.sh@21 -- # val= 00:07:24.979 01:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # IFS=: 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # read -r var val 00:07:24.979 01:01:39 -- accel/accel.sh@21 -- # val=0x1 00:07:24.979 01:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # IFS=: 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # read -r var val 00:07:24.979 01:01:39 -- accel/accel.sh@21 -- # val= 00:07:24.979 01:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # IFS=: 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # read -r var val 00:07:24.979 01:01:39 -- accel/accel.sh@21 -- # val= 00:07:24.979 01:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # IFS=: 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # read -r var val 00:07:24.979 01:01:39 -- accel/accel.sh@21 -- # val=fill 00:07:24.979 01:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.979 01:01:39 -- accel/accel.sh@24 -- # accel_opc=fill 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # IFS=: 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # read -r var val 00:07:24.979 01:01:39 -- accel/accel.sh@21 -- # val=0x80 00:07:24.979 01:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # IFS=: 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # read -r var val 00:07:24.979 01:01:39 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:24.979 01:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # IFS=: 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # read -r var val 00:07:24.979 01:01:39 -- accel/accel.sh@21 -- # val= 00:07:24.979 01:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # IFS=: 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # read -r var val 00:07:24.979 01:01:39 -- accel/accel.sh@21 -- # val=software 00:07:24.979 01:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.979 01:01:39 -- accel/accel.sh@23 -- # accel_module=software 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # IFS=: 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # read -r var val 00:07:24.979 01:01:39 -- accel/accel.sh@21 -- # val=64 00:07:24.979 01:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # IFS=: 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # read -r var val 00:07:24.979 01:01:39 -- accel/accel.sh@21 -- # val=64 00:07:24.979 01:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # IFS=: 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # read -r var val 00:07:24.979 01:01:39 -- accel/accel.sh@21 -- # val=1 00:07:24.979 01:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # IFS=: 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # read -r var val 00:07:24.979 01:01:39 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:24.979 01:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # IFS=: 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # read -r var val 00:07:24.979 01:01:39 -- accel/accel.sh@21 -- # val=Yes 00:07:24.979 01:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # IFS=: 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # read -r var val 00:07:24.979 01:01:39 -- accel/accel.sh@21 -- # val= 00:07:24.979 01:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # IFS=: 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # read -r var val 00:07:24.979 01:01:39 -- accel/accel.sh@21 -- # val= 00:07:24.979 01:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # IFS=: 00:07:24.979 01:01:39 -- accel/accel.sh@20 -- # read -r var val 00:07:26.354 01:01:40 -- accel/accel.sh@21 -- # val= 00:07:26.354 01:01:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.354 01:01:40 -- accel/accel.sh@20 -- # IFS=: 00:07:26.354 01:01:40 -- accel/accel.sh@20 -- # read -r var val 00:07:26.354 01:01:40 -- accel/accel.sh@21 -- # val= 00:07:26.354 01:01:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.354 01:01:40 -- accel/accel.sh@20 -- # IFS=: 00:07:26.354 01:01:40 -- accel/accel.sh@20 -- # read -r var val 00:07:26.354 01:01:40 -- accel/accel.sh@21 -- # val= 00:07:26.354 01:01:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.354 01:01:40 -- accel/accel.sh@20 -- # IFS=: 00:07:26.354 01:01:40 -- accel/accel.sh@20 -- # read -r var val 00:07:26.354 01:01:40 -- accel/accel.sh@21 -- # val= 00:07:26.354 01:01:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.354 01:01:40 -- accel/accel.sh@20 -- # IFS=: 00:07:26.354 01:01:40 -- accel/accel.sh@20 -- # read -r var val 00:07:26.354 01:01:40 -- accel/accel.sh@21 -- # val= 00:07:26.354 01:01:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.354 01:01:40 -- accel/accel.sh@20 -- # IFS=: 00:07:26.354 01:01:40 -- accel/accel.sh@20 -- # read -r var val 00:07:26.354 01:01:40 -- accel/accel.sh@21 -- # val= 00:07:26.354 01:01:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.354 01:01:40 -- accel/accel.sh@20 -- # IFS=: 00:07:26.354 01:01:40 -- accel/accel.sh@20 -- # read -r var val 00:07:26.354 01:01:40 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:26.354 01:01:40 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:07:26.354 01:01:40 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:26.354 00:07:26.354 real 0m2.821s 00:07:26.354 user 0m2.529s 00:07:26.354 sys 0m0.284s 00:07:26.354 01:01:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:26.354 01:01:40 -- common/autotest_common.sh@10 -- # set +x 00:07:26.354 ************************************ 00:07:26.354 END TEST accel_fill 00:07:26.354 ************************************ 00:07:26.354 01:01:40 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:07:26.354 01:01:40 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:26.354 01:01:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:26.354 01:01:40 -- common/autotest_common.sh@10 -- # set +x 00:07:26.354 ************************************ 00:07:26.354 START TEST accel_copy_crc32c 00:07:26.354 ************************************ 00:07:26.354 01:01:40 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:07:26.354 01:01:40 -- accel/accel.sh@16 -- # local accel_opc 00:07:26.354 01:01:40 -- accel/accel.sh@17 -- # local accel_module 00:07:26.354 01:01:40 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:26.354 01:01:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:26.354 01:01:40 -- accel/accel.sh@12 -- # build_accel_config 00:07:26.354 01:01:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:26.354 01:01:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:26.354 01:01:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:26.354 01:01:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:26.354 01:01:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:26.354 01:01:40 -- accel/accel.sh@41 -- # local IFS=, 00:07:26.354 01:01:40 -- accel/accel.sh@42 -- # jq -r . 00:07:26.354 [2024-11-28 01:01:40.566611] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:26.354 [2024-11-28 01:01:40.566686] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1922824 ] 00:07:26.354 EAL: No free 2048 kB hugepages reported on node 1 00:07:26.354 [2024-11-28 01:01:40.628232] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:26.354 [2024-11-28 01:01:40.718937] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:27.729 01:01:41 -- accel/accel.sh@18 -- # out=' 00:07:27.729 SPDK Configuration: 00:07:27.729 Core mask: 0x1 00:07:27.729 00:07:27.729 Accel Perf Configuration: 00:07:27.729 Workload Type: copy_crc32c 00:07:27.729 CRC-32C seed: 0 00:07:27.729 Vector size: 4096 bytes 00:07:27.729 Transfer size: 4096 bytes 00:07:27.729 Vector count 1 00:07:27.729 Module: software 00:07:27.729 Queue depth: 32 00:07:27.729 Allocate depth: 32 00:07:27.729 # threads/core: 1 00:07:27.729 Run time: 1 seconds 00:07:27.729 Verify: Yes 00:07:27.729 00:07:27.729 Running for 1 seconds... 00:07:27.729 00:07:27.729 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:27.729 ------------------------------------------------------------------------------------ 00:07:27.729 0,0 219296/s 856 MiB/s 0 0 00:07:27.729 ==================================================================================== 00:07:27.729 Total 219296/s 856 MiB/s 0 0' 00:07:27.729 01:01:41 -- accel/accel.sh@20 -- # IFS=: 00:07:27.729 01:01:41 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:27.729 01:01:41 -- accel/accel.sh@20 -- # read -r var val 00:07:27.729 01:01:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:27.729 01:01:41 -- accel/accel.sh@12 -- # build_accel_config 00:07:27.729 01:01:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:27.729 01:01:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:27.729 01:01:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:27.729 01:01:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:27.729 01:01:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:27.729 01:01:41 -- accel/accel.sh@41 -- # local IFS=, 00:07:27.729 01:01:41 -- accel/accel.sh@42 -- # jq -r . 00:07:27.729 [2024-11-28 01:01:41.970089] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:27.729 [2024-11-28 01:01:41.970169] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1922988 ] 00:07:27.729 EAL: No free 2048 kB hugepages reported on node 1 00:07:27.729 [2024-11-28 01:01:42.034051] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:27.729 [2024-11-28 01:01:42.124788] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:27.729 01:01:42 -- accel/accel.sh@21 -- # val= 00:07:27.729 01:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.729 01:01:42 -- accel/accel.sh@20 -- # IFS=: 00:07:27.729 01:01:42 -- accel/accel.sh@20 -- # read -r var val 00:07:27.729 01:01:42 -- accel/accel.sh@21 -- # val= 00:07:27.729 01:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.729 01:01:42 -- accel/accel.sh@20 -- # IFS=: 00:07:27.729 01:01:42 -- accel/accel.sh@20 -- # read -r var val 00:07:27.729 01:01:42 -- accel/accel.sh@21 -- # val=0x1 00:07:27.729 01:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.729 01:01:42 -- accel/accel.sh@20 -- # IFS=: 00:07:27.729 01:01:42 -- accel/accel.sh@20 -- # read -r var val 00:07:27.729 01:01:42 -- accel/accel.sh@21 -- # val= 00:07:27.729 01:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.729 01:01:42 -- accel/accel.sh@20 -- # IFS=: 00:07:27.729 01:01:42 -- accel/accel.sh@20 -- # read -r var val 00:07:27.729 01:01:42 -- accel/accel.sh@21 -- # val= 00:07:27.729 01:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.729 01:01:42 -- accel/accel.sh@20 -- # IFS=: 00:07:27.729 01:01:42 -- accel/accel.sh@20 -- # read -r var val 00:07:27.729 01:01:42 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:27.729 01:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.729 01:01:42 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:27.729 01:01:42 -- accel/accel.sh@20 -- # IFS=: 00:07:27.729 01:01:42 -- accel/accel.sh@20 -- # read -r var val 00:07:27.729 01:01:42 -- accel/accel.sh@21 -- # val=0 00:07:27.729 01:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.729 01:01:42 -- accel/accel.sh@20 -- # IFS=: 00:07:27.729 01:01:42 -- accel/accel.sh@20 -- # read -r var val 00:07:27.729 01:01:42 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:27.730 01:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # IFS=: 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # read -r var val 00:07:27.730 01:01:42 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:27.730 01:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # IFS=: 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # read -r var val 00:07:27.730 01:01:42 -- accel/accel.sh@21 -- # val= 00:07:27.730 01:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # IFS=: 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # read -r var val 00:07:27.730 01:01:42 -- accel/accel.sh@21 -- # val=software 00:07:27.730 01:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.730 01:01:42 -- accel/accel.sh@23 -- # accel_module=software 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # IFS=: 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # read -r var val 00:07:27.730 01:01:42 -- accel/accel.sh@21 -- # val=32 00:07:27.730 01:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # IFS=: 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # read -r var val 00:07:27.730 01:01:42 -- accel/accel.sh@21 -- # val=32 00:07:27.730 01:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # IFS=: 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # read -r var val 00:07:27.730 01:01:42 -- accel/accel.sh@21 -- # val=1 00:07:27.730 01:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # IFS=: 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # read -r var val 00:07:27.730 01:01:42 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:27.730 01:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # IFS=: 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # read -r var val 00:07:27.730 01:01:42 -- accel/accel.sh@21 -- # val=Yes 00:07:27.730 01:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # IFS=: 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # read -r var val 00:07:27.730 01:01:42 -- accel/accel.sh@21 -- # val= 00:07:27.730 01:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # IFS=: 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # read -r var val 00:07:27.730 01:01:42 -- accel/accel.sh@21 -- # val= 00:07:27.730 01:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # IFS=: 00:07:27.730 01:01:42 -- accel/accel.sh@20 -- # read -r var val 00:07:29.103 01:01:43 -- accel/accel.sh@21 -- # val= 00:07:29.103 01:01:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.103 01:01:43 -- accel/accel.sh@20 -- # IFS=: 00:07:29.103 01:01:43 -- accel/accel.sh@20 -- # read -r var val 00:07:29.103 01:01:43 -- accel/accel.sh@21 -- # val= 00:07:29.103 01:01:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.103 01:01:43 -- accel/accel.sh@20 -- # IFS=: 00:07:29.103 01:01:43 -- accel/accel.sh@20 -- # read -r var val 00:07:29.103 01:01:43 -- accel/accel.sh@21 -- # val= 00:07:29.103 01:01:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.103 01:01:43 -- accel/accel.sh@20 -- # IFS=: 00:07:29.103 01:01:43 -- accel/accel.sh@20 -- # read -r var val 00:07:29.103 01:01:43 -- accel/accel.sh@21 -- # val= 00:07:29.103 01:01:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.103 01:01:43 -- accel/accel.sh@20 -- # IFS=: 00:07:29.103 01:01:43 -- accel/accel.sh@20 -- # read -r var val 00:07:29.103 01:01:43 -- accel/accel.sh@21 -- # val= 00:07:29.103 01:01:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.103 01:01:43 -- accel/accel.sh@20 -- # IFS=: 00:07:29.103 01:01:43 -- accel/accel.sh@20 -- # read -r var val 00:07:29.103 01:01:43 -- accel/accel.sh@21 -- # val= 00:07:29.103 01:01:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.103 01:01:43 -- accel/accel.sh@20 -- # IFS=: 00:07:29.103 01:01:43 -- accel/accel.sh@20 -- # read -r var val 00:07:29.103 01:01:43 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:29.103 01:01:43 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:29.103 01:01:43 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:29.103 00:07:29.103 real 0m2.803s 00:07:29.103 user 0m2.497s 00:07:29.103 sys 0m0.298s 00:07:29.103 01:01:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:29.104 01:01:43 -- common/autotest_common.sh@10 -- # set +x 00:07:29.104 ************************************ 00:07:29.104 END TEST accel_copy_crc32c 00:07:29.104 ************************************ 00:07:29.104 01:01:43 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:07:29.104 01:01:43 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:29.104 01:01:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:29.104 01:01:43 -- common/autotest_common.sh@10 -- # set +x 00:07:29.104 ************************************ 00:07:29.104 START TEST accel_copy_crc32c_C2 00:07:29.104 ************************************ 00:07:29.104 01:01:43 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:07:29.104 01:01:43 -- accel/accel.sh@16 -- # local accel_opc 00:07:29.104 01:01:43 -- accel/accel.sh@17 -- # local accel_module 00:07:29.104 01:01:43 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:29.104 01:01:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:29.104 01:01:43 -- accel/accel.sh@12 -- # build_accel_config 00:07:29.104 01:01:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:29.104 01:01:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:29.104 01:01:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:29.104 01:01:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:29.104 01:01:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:29.104 01:01:43 -- accel/accel.sh@41 -- # local IFS=, 00:07:29.104 01:01:43 -- accel/accel.sh@42 -- # jq -r . 00:07:29.104 [2024-11-28 01:01:43.395401] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:29.104 [2024-11-28 01:01:43.395486] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1923250 ] 00:07:29.104 EAL: No free 2048 kB hugepages reported on node 1 00:07:29.104 [2024-11-28 01:01:43.454476] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:29.104 [2024-11-28 01:01:43.546481] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:30.477 01:01:44 -- accel/accel.sh@18 -- # out=' 00:07:30.477 SPDK Configuration: 00:07:30.477 Core mask: 0x1 00:07:30.477 00:07:30.477 Accel Perf Configuration: 00:07:30.477 Workload Type: copy_crc32c 00:07:30.477 CRC-32C seed: 0 00:07:30.477 Vector size: 4096 bytes 00:07:30.477 Transfer size: 8192 bytes 00:07:30.477 Vector count 2 00:07:30.477 Module: software 00:07:30.477 Queue depth: 32 00:07:30.477 Allocate depth: 32 00:07:30.477 # threads/core: 1 00:07:30.477 Run time: 1 seconds 00:07:30.477 Verify: Yes 00:07:30.477 00:07:30.477 Running for 1 seconds... 00:07:30.477 00:07:30.477 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:30.477 ------------------------------------------------------------------------------------ 00:07:30.477 0,0 154432/s 1206 MiB/s 0 0 00:07:30.477 ==================================================================================== 00:07:30.477 Total 154432/s 603 MiB/s 0 0' 00:07:30.477 01:01:44 -- accel/accel.sh@20 -- # IFS=: 00:07:30.477 01:01:44 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:30.477 01:01:44 -- accel/accel.sh@20 -- # read -r var val 00:07:30.477 01:01:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:30.477 01:01:44 -- accel/accel.sh@12 -- # build_accel_config 00:07:30.477 01:01:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:30.478 01:01:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:30.478 01:01:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:30.478 01:01:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:30.478 01:01:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:30.478 01:01:44 -- accel/accel.sh@41 -- # local IFS=, 00:07:30.478 01:01:44 -- accel/accel.sh@42 -- # jq -r . 00:07:30.478 [2024-11-28 01:01:44.796927] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:30.478 [2024-11-28 01:01:44.797006] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1923392 ] 00:07:30.478 EAL: No free 2048 kB hugepages reported on node 1 00:07:30.478 [2024-11-28 01:01:44.859197] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:30.478 [2024-11-28 01:01:44.949674] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:30.478 01:01:45 -- accel/accel.sh@21 -- # val= 00:07:30.478 01:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # IFS=: 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # read -r var val 00:07:30.478 01:01:45 -- accel/accel.sh@21 -- # val= 00:07:30.478 01:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # IFS=: 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # read -r var val 00:07:30.478 01:01:45 -- accel/accel.sh@21 -- # val=0x1 00:07:30.478 01:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # IFS=: 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # read -r var val 00:07:30.478 01:01:45 -- accel/accel.sh@21 -- # val= 00:07:30.478 01:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # IFS=: 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # read -r var val 00:07:30.478 01:01:45 -- accel/accel.sh@21 -- # val= 00:07:30.478 01:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # IFS=: 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # read -r var val 00:07:30.478 01:01:45 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:30.478 01:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.478 01:01:45 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # IFS=: 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # read -r var val 00:07:30.478 01:01:45 -- accel/accel.sh@21 -- # val=0 00:07:30.478 01:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # IFS=: 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # read -r var val 00:07:30.478 01:01:45 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:30.478 01:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # IFS=: 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # read -r var val 00:07:30.478 01:01:45 -- accel/accel.sh@21 -- # val='8192 bytes' 00:07:30.478 01:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # IFS=: 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # read -r var val 00:07:30.478 01:01:45 -- accel/accel.sh@21 -- # val= 00:07:30.478 01:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # IFS=: 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # read -r var val 00:07:30.478 01:01:45 -- accel/accel.sh@21 -- # val=software 00:07:30.478 01:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.478 01:01:45 -- accel/accel.sh@23 -- # accel_module=software 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # IFS=: 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # read -r var val 00:07:30.478 01:01:45 -- accel/accel.sh@21 -- # val=32 00:07:30.478 01:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # IFS=: 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # read -r var val 00:07:30.478 01:01:45 -- accel/accel.sh@21 -- # val=32 00:07:30.478 01:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # IFS=: 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # read -r var val 00:07:30.478 01:01:45 -- accel/accel.sh@21 -- # val=1 00:07:30.478 01:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # IFS=: 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # read -r var val 00:07:30.478 01:01:45 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:30.478 01:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # IFS=: 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # read -r var val 00:07:30.478 01:01:45 -- accel/accel.sh@21 -- # val=Yes 00:07:30.478 01:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # IFS=: 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # read -r var val 00:07:30.478 01:01:45 -- accel/accel.sh@21 -- # val= 00:07:30.478 01:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # IFS=: 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # read -r var val 00:07:30.478 01:01:45 -- accel/accel.sh@21 -- # val= 00:07:30.478 01:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # IFS=: 00:07:30.478 01:01:45 -- accel/accel.sh@20 -- # read -r var val 00:07:31.851 01:01:46 -- accel/accel.sh@21 -- # val= 00:07:31.851 01:01:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.851 01:01:46 -- accel/accel.sh@20 -- # IFS=: 00:07:31.851 01:01:46 -- accel/accel.sh@20 -- # read -r var val 00:07:31.851 01:01:46 -- accel/accel.sh@21 -- # val= 00:07:31.851 01:01:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.851 01:01:46 -- accel/accel.sh@20 -- # IFS=: 00:07:31.851 01:01:46 -- accel/accel.sh@20 -- # read -r var val 00:07:31.851 01:01:46 -- accel/accel.sh@21 -- # val= 00:07:31.851 01:01:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.851 01:01:46 -- accel/accel.sh@20 -- # IFS=: 00:07:31.851 01:01:46 -- accel/accel.sh@20 -- # read -r var val 00:07:31.851 01:01:46 -- accel/accel.sh@21 -- # val= 00:07:31.851 01:01:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.851 01:01:46 -- accel/accel.sh@20 -- # IFS=: 00:07:31.851 01:01:46 -- accel/accel.sh@20 -- # read -r var val 00:07:31.851 01:01:46 -- accel/accel.sh@21 -- # val= 00:07:31.851 01:01:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.851 01:01:46 -- accel/accel.sh@20 -- # IFS=: 00:07:31.851 01:01:46 -- accel/accel.sh@20 -- # read -r var val 00:07:31.851 01:01:46 -- accel/accel.sh@21 -- # val= 00:07:31.851 01:01:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.851 01:01:46 -- accel/accel.sh@20 -- # IFS=: 00:07:31.851 01:01:46 -- accel/accel.sh@20 -- # read -r var val 00:07:31.851 01:01:46 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:31.851 01:01:46 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:31.851 01:01:46 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:31.851 00:07:31.851 real 0m2.813s 00:07:31.851 user 0m2.511s 00:07:31.851 sys 0m0.295s 00:07:31.851 01:01:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:31.851 01:01:46 -- common/autotest_common.sh@10 -- # set +x 00:07:31.851 ************************************ 00:07:31.851 END TEST accel_copy_crc32c_C2 00:07:31.851 ************************************ 00:07:31.851 01:01:46 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:07:31.851 01:01:46 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:31.851 01:01:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:31.851 01:01:46 -- common/autotest_common.sh@10 -- # set +x 00:07:31.851 ************************************ 00:07:31.851 START TEST accel_dualcast 00:07:31.851 ************************************ 00:07:31.851 01:01:46 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:07:31.851 01:01:46 -- accel/accel.sh@16 -- # local accel_opc 00:07:31.851 01:01:46 -- accel/accel.sh@17 -- # local accel_module 00:07:31.851 01:01:46 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:07:31.851 01:01:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:31.851 01:01:46 -- accel/accel.sh@12 -- # build_accel_config 00:07:31.851 01:01:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:31.851 01:01:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:31.851 01:01:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:31.851 01:01:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:31.851 01:01:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:31.851 01:01:46 -- accel/accel.sh@41 -- # local IFS=, 00:07:31.851 01:01:46 -- accel/accel.sh@42 -- # jq -r . 00:07:31.851 [2024-11-28 01:01:46.233624] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:31.851 [2024-11-28 01:01:46.233703] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1923545 ] 00:07:31.851 EAL: No free 2048 kB hugepages reported on node 1 00:07:31.851 [2024-11-28 01:01:46.298053] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:31.851 [2024-11-28 01:01:46.388953] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:33.226 01:01:47 -- accel/accel.sh@18 -- # out=' 00:07:33.226 SPDK Configuration: 00:07:33.226 Core mask: 0x1 00:07:33.226 00:07:33.226 Accel Perf Configuration: 00:07:33.226 Workload Type: dualcast 00:07:33.226 Transfer size: 4096 bytes 00:07:33.226 Vector count 1 00:07:33.226 Module: software 00:07:33.226 Queue depth: 32 00:07:33.226 Allocate depth: 32 00:07:33.226 # threads/core: 1 00:07:33.226 Run time: 1 seconds 00:07:33.226 Verify: Yes 00:07:33.226 00:07:33.226 Running for 1 seconds... 00:07:33.226 00:07:33.226 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:33.226 ------------------------------------------------------------------------------------ 00:07:33.226 0,0 299776/s 1171 MiB/s 0 0 00:07:33.226 ==================================================================================== 00:07:33.226 Total 299776/s 1171 MiB/s 0 0' 00:07:33.226 01:01:47 -- accel/accel.sh@20 -- # IFS=: 00:07:33.226 01:01:47 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:07:33.226 01:01:47 -- accel/accel.sh@20 -- # read -r var val 00:07:33.226 01:01:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:33.226 01:01:47 -- accel/accel.sh@12 -- # build_accel_config 00:07:33.226 01:01:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:33.226 01:01:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:33.226 01:01:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:33.226 01:01:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:33.226 01:01:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:33.226 01:01:47 -- accel/accel.sh@41 -- # local IFS=, 00:07:33.226 01:01:47 -- accel/accel.sh@42 -- # jq -r . 00:07:33.226 [2024-11-28 01:01:47.642819] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:33.226 [2024-11-28 01:01:47.642906] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1923706 ] 00:07:33.226 EAL: No free 2048 kB hugepages reported on node 1 00:07:33.226 [2024-11-28 01:01:47.704508] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:33.226 [2024-11-28 01:01:47.794370] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:33.485 01:01:47 -- accel/accel.sh@21 -- # val= 00:07:33.485 01:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # IFS=: 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # read -r var val 00:07:33.485 01:01:47 -- accel/accel.sh@21 -- # val= 00:07:33.485 01:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # IFS=: 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # read -r var val 00:07:33.485 01:01:47 -- accel/accel.sh@21 -- # val=0x1 00:07:33.485 01:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # IFS=: 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # read -r var val 00:07:33.485 01:01:47 -- accel/accel.sh@21 -- # val= 00:07:33.485 01:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # IFS=: 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # read -r var val 00:07:33.485 01:01:47 -- accel/accel.sh@21 -- # val= 00:07:33.485 01:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # IFS=: 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # read -r var val 00:07:33.485 01:01:47 -- accel/accel.sh@21 -- # val=dualcast 00:07:33.485 01:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.485 01:01:47 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # IFS=: 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # read -r var val 00:07:33.485 01:01:47 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:33.485 01:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # IFS=: 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # read -r var val 00:07:33.485 01:01:47 -- accel/accel.sh@21 -- # val= 00:07:33.485 01:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # IFS=: 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # read -r var val 00:07:33.485 01:01:47 -- accel/accel.sh@21 -- # val=software 00:07:33.485 01:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.485 01:01:47 -- accel/accel.sh@23 -- # accel_module=software 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # IFS=: 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # read -r var val 00:07:33.485 01:01:47 -- accel/accel.sh@21 -- # val=32 00:07:33.485 01:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # IFS=: 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # read -r var val 00:07:33.485 01:01:47 -- accel/accel.sh@21 -- # val=32 00:07:33.485 01:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # IFS=: 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # read -r var val 00:07:33.485 01:01:47 -- accel/accel.sh@21 -- # val=1 00:07:33.485 01:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # IFS=: 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # read -r var val 00:07:33.485 01:01:47 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:33.485 01:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # IFS=: 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # read -r var val 00:07:33.485 01:01:47 -- accel/accel.sh@21 -- # val=Yes 00:07:33.485 01:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # IFS=: 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # read -r var val 00:07:33.485 01:01:47 -- accel/accel.sh@21 -- # val= 00:07:33.485 01:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # IFS=: 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # read -r var val 00:07:33.485 01:01:47 -- accel/accel.sh@21 -- # val= 00:07:33.485 01:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # IFS=: 00:07:33.485 01:01:47 -- accel/accel.sh@20 -- # read -r var val 00:07:34.859 01:01:49 -- accel/accel.sh@21 -- # val= 00:07:34.859 01:01:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.859 01:01:49 -- accel/accel.sh@20 -- # IFS=: 00:07:34.859 01:01:49 -- accel/accel.sh@20 -- # read -r var val 00:07:34.859 01:01:49 -- accel/accel.sh@21 -- # val= 00:07:34.859 01:01:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.859 01:01:49 -- accel/accel.sh@20 -- # IFS=: 00:07:34.859 01:01:49 -- accel/accel.sh@20 -- # read -r var val 00:07:34.859 01:01:49 -- accel/accel.sh@21 -- # val= 00:07:34.859 01:01:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.859 01:01:49 -- accel/accel.sh@20 -- # IFS=: 00:07:34.859 01:01:49 -- accel/accel.sh@20 -- # read -r var val 00:07:34.859 01:01:49 -- accel/accel.sh@21 -- # val= 00:07:34.859 01:01:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.859 01:01:49 -- accel/accel.sh@20 -- # IFS=: 00:07:34.859 01:01:49 -- accel/accel.sh@20 -- # read -r var val 00:07:34.859 01:01:49 -- accel/accel.sh@21 -- # val= 00:07:34.859 01:01:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.859 01:01:49 -- accel/accel.sh@20 -- # IFS=: 00:07:34.859 01:01:49 -- accel/accel.sh@20 -- # read -r var val 00:07:34.859 01:01:49 -- accel/accel.sh@21 -- # val= 00:07:34.859 01:01:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.859 01:01:49 -- accel/accel.sh@20 -- # IFS=: 00:07:34.859 01:01:49 -- accel/accel.sh@20 -- # read -r var val 00:07:34.859 01:01:49 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:34.859 01:01:49 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:07:34.859 01:01:49 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:34.859 00:07:34.859 real 0m2.816s 00:07:34.859 user 0m2.526s 00:07:34.859 sys 0m0.282s 00:07:34.859 01:01:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:34.859 01:01:49 -- common/autotest_common.sh@10 -- # set +x 00:07:34.859 ************************************ 00:07:34.859 END TEST accel_dualcast 00:07:34.859 ************************************ 00:07:34.859 01:01:49 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:07:34.859 01:01:49 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:34.859 01:01:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:34.859 01:01:49 -- common/autotest_common.sh@10 -- # set +x 00:07:34.859 ************************************ 00:07:34.859 START TEST accel_compare 00:07:34.859 ************************************ 00:07:34.859 01:01:49 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:07:34.859 01:01:49 -- accel/accel.sh@16 -- # local accel_opc 00:07:34.859 01:01:49 -- accel/accel.sh@17 -- # local accel_module 00:07:34.859 01:01:49 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:07:34.859 01:01:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:34.859 01:01:49 -- accel/accel.sh@12 -- # build_accel_config 00:07:34.860 01:01:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:34.860 01:01:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:34.860 01:01:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:34.860 01:01:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:34.860 01:01:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:34.860 01:01:49 -- accel/accel.sh@41 -- # local IFS=, 00:07:34.860 01:01:49 -- accel/accel.sh@42 -- # jq -r . 00:07:34.860 [2024-11-28 01:01:49.078097] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:34.860 [2024-11-28 01:01:49.078184] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1923965 ] 00:07:34.860 EAL: No free 2048 kB hugepages reported on node 1 00:07:34.860 [2024-11-28 01:01:49.142980] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:34.860 [2024-11-28 01:01:49.231189] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:36.233 01:01:50 -- accel/accel.sh@18 -- # out=' 00:07:36.233 SPDK Configuration: 00:07:36.233 Core mask: 0x1 00:07:36.233 00:07:36.233 Accel Perf Configuration: 00:07:36.233 Workload Type: compare 00:07:36.233 Transfer size: 4096 bytes 00:07:36.233 Vector count 1 00:07:36.233 Module: software 00:07:36.233 Queue depth: 32 00:07:36.234 Allocate depth: 32 00:07:36.234 # threads/core: 1 00:07:36.234 Run time: 1 seconds 00:07:36.234 Verify: Yes 00:07:36.234 00:07:36.234 Running for 1 seconds... 00:07:36.234 00:07:36.234 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:36.234 ------------------------------------------------------------------------------------ 00:07:36.234 0,0 401408/s 1568 MiB/s 0 0 00:07:36.234 ==================================================================================== 00:07:36.234 Total 401408/s 1568 MiB/s 0 0' 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # IFS=: 00:07:36.234 01:01:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # read -r var val 00:07:36.234 01:01:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:36.234 01:01:50 -- accel/accel.sh@12 -- # build_accel_config 00:07:36.234 01:01:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:36.234 01:01:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:36.234 01:01:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:36.234 01:01:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:36.234 01:01:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:36.234 01:01:50 -- accel/accel.sh@41 -- # local IFS=, 00:07:36.234 01:01:50 -- accel/accel.sh@42 -- # jq -r . 00:07:36.234 [2024-11-28 01:01:50.479580] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:36.234 [2024-11-28 01:01:50.479656] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1924119 ] 00:07:36.234 EAL: No free 2048 kB hugepages reported on node 1 00:07:36.234 [2024-11-28 01:01:50.544623] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:36.234 [2024-11-28 01:01:50.634934] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:36.234 01:01:50 -- accel/accel.sh@21 -- # val= 00:07:36.234 01:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # IFS=: 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # read -r var val 00:07:36.234 01:01:50 -- accel/accel.sh@21 -- # val= 00:07:36.234 01:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # IFS=: 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # read -r var val 00:07:36.234 01:01:50 -- accel/accel.sh@21 -- # val=0x1 00:07:36.234 01:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # IFS=: 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # read -r var val 00:07:36.234 01:01:50 -- accel/accel.sh@21 -- # val= 00:07:36.234 01:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # IFS=: 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # read -r var val 00:07:36.234 01:01:50 -- accel/accel.sh@21 -- # val= 00:07:36.234 01:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # IFS=: 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # read -r var val 00:07:36.234 01:01:50 -- accel/accel.sh@21 -- # val=compare 00:07:36.234 01:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.234 01:01:50 -- accel/accel.sh@24 -- # accel_opc=compare 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # IFS=: 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # read -r var val 00:07:36.234 01:01:50 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:36.234 01:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # IFS=: 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # read -r var val 00:07:36.234 01:01:50 -- accel/accel.sh@21 -- # val= 00:07:36.234 01:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # IFS=: 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # read -r var val 00:07:36.234 01:01:50 -- accel/accel.sh@21 -- # val=software 00:07:36.234 01:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.234 01:01:50 -- accel/accel.sh@23 -- # accel_module=software 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # IFS=: 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # read -r var val 00:07:36.234 01:01:50 -- accel/accel.sh@21 -- # val=32 00:07:36.234 01:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # IFS=: 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # read -r var val 00:07:36.234 01:01:50 -- accel/accel.sh@21 -- # val=32 00:07:36.234 01:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # IFS=: 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # read -r var val 00:07:36.234 01:01:50 -- accel/accel.sh@21 -- # val=1 00:07:36.234 01:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # IFS=: 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # read -r var val 00:07:36.234 01:01:50 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:36.234 01:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # IFS=: 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # read -r var val 00:07:36.234 01:01:50 -- accel/accel.sh@21 -- # val=Yes 00:07:36.234 01:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # IFS=: 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # read -r var val 00:07:36.234 01:01:50 -- accel/accel.sh@21 -- # val= 00:07:36.234 01:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # IFS=: 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # read -r var val 00:07:36.234 01:01:50 -- accel/accel.sh@21 -- # val= 00:07:36.234 01:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # IFS=: 00:07:36.234 01:01:50 -- accel/accel.sh@20 -- # read -r var val 00:07:37.608 01:01:51 -- accel/accel.sh@21 -- # val= 00:07:37.608 01:01:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.608 01:01:51 -- accel/accel.sh@20 -- # IFS=: 00:07:37.608 01:01:51 -- accel/accel.sh@20 -- # read -r var val 00:07:37.608 01:01:51 -- accel/accel.sh@21 -- # val= 00:07:37.608 01:01:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.608 01:01:51 -- accel/accel.sh@20 -- # IFS=: 00:07:37.608 01:01:51 -- accel/accel.sh@20 -- # read -r var val 00:07:37.608 01:01:51 -- accel/accel.sh@21 -- # val= 00:07:37.608 01:01:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.608 01:01:51 -- accel/accel.sh@20 -- # IFS=: 00:07:37.608 01:01:51 -- accel/accel.sh@20 -- # read -r var val 00:07:37.608 01:01:51 -- accel/accel.sh@21 -- # val= 00:07:37.608 01:01:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.608 01:01:51 -- accel/accel.sh@20 -- # IFS=: 00:07:37.608 01:01:51 -- accel/accel.sh@20 -- # read -r var val 00:07:37.608 01:01:51 -- accel/accel.sh@21 -- # val= 00:07:37.608 01:01:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.608 01:01:51 -- accel/accel.sh@20 -- # IFS=: 00:07:37.608 01:01:51 -- accel/accel.sh@20 -- # read -r var val 00:07:37.608 01:01:51 -- accel/accel.sh@21 -- # val= 00:07:37.608 01:01:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.608 01:01:51 -- accel/accel.sh@20 -- # IFS=: 00:07:37.608 01:01:51 -- accel/accel.sh@20 -- # read -r var val 00:07:37.608 01:01:51 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:37.608 01:01:51 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:07:37.608 01:01:51 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:37.608 00:07:37.608 real 0m2.815s 00:07:37.608 user 0m2.518s 00:07:37.608 sys 0m0.289s 00:07:37.608 01:01:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:37.608 01:01:51 -- common/autotest_common.sh@10 -- # set +x 00:07:37.608 ************************************ 00:07:37.608 END TEST accel_compare 00:07:37.608 ************************************ 00:07:37.608 01:01:51 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:07:37.608 01:01:51 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:37.608 01:01:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:37.608 01:01:51 -- common/autotest_common.sh@10 -- # set +x 00:07:37.608 ************************************ 00:07:37.608 START TEST accel_xor 00:07:37.608 ************************************ 00:07:37.608 01:01:51 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:07:37.608 01:01:51 -- accel/accel.sh@16 -- # local accel_opc 00:07:37.608 01:01:51 -- accel/accel.sh@17 -- # local accel_module 00:07:37.608 01:01:51 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:07:37.608 01:01:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:37.608 01:01:51 -- accel/accel.sh@12 -- # build_accel_config 00:07:37.608 01:01:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:37.608 01:01:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:37.608 01:01:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:37.608 01:01:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:37.608 01:01:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:37.608 01:01:51 -- accel/accel.sh@41 -- # local IFS=, 00:07:37.608 01:01:51 -- accel/accel.sh@42 -- # jq -r . 00:07:37.608 [2024-11-28 01:01:51.918337] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:37.608 [2024-11-28 01:01:51.918414] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1924272 ] 00:07:37.608 EAL: No free 2048 kB hugepages reported on node 1 00:07:37.608 [2024-11-28 01:01:51.980349] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:37.608 [2024-11-28 01:01:52.071502] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:38.985 01:01:53 -- accel/accel.sh@18 -- # out=' 00:07:38.985 SPDK Configuration: 00:07:38.985 Core mask: 0x1 00:07:38.985 00:07:38.985 Accel Perf Configuration: 00:07:38.985 Workload Type: xor 00:07:38.985 Source buffers: 2 00:07:38.985 Transfer size: 4096 bytes 00:07:38.985 Vector count 1 00:07:38.985 Module: software 00:07:38.985 Queue depth: 32 00:07:38.985 Allocate depth: 32 00:07:38.985 # threads/core: 1 00:07:38.985 Run time: 1 seconds 00:07:38.985 Verify: Yes 00:07:38.985 00:07:38.985 Running for 1 seconds... 00:07:38.985 00:07:38.985 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:38.985 ------------------------------------------------------------------------------------ 00:07:38.985 0,0 196800/s 768 MiB/s 0 0 00:07:38.985 ==================================================================================== 00:07:38.985 Total 196800/s 768 MiB/s 0 0' 00:07:38.985 01:01:53 -- accel/accel.sh@20 -- # IFS=: 00:07:38.985 01:01:53 -- accel/accel.sh@20 -- # read -r var val 00:07:38.985 01:01:53 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:07:38.985 01:01:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:38.985 01:01:53 -- accel/accel.sh@12 -- # build_accel_config 00:07:38.985 01:01:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:38.985 01:01:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:38.985 01:01:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:38.985 01:01:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:38.985 01:01:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:38.985 01:01:53 -- accel/accel.sh@41 -- # local IFS=, 00:07:38.985 01:01:53 -- accel/accel.sh@42 -- # jq -r . 00:07:38.985 [2024-11-28 01:01:53.323161] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:38.985 [2024-11-28 01:01:53.323239] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1924415 ] 00:07:38.985 EAL: No free 2048 kB hugepages reported on node 1 00:07:38.985 [2024-11-28 01:01:53.387011] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:38.985 [2024-11-28 01:01:53.476304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:38.985 01:01:53 -- accel/accel.sh@21 -- # val= 00:07:38.985 01:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.985 01:01:53 -- accel/accel.sh@20 -- # IFS=: 00:07:38.985 01:01:53 -- accel/accel.sh@20 -- # read -r var val 00:07:38.985 01:01:53 -- accel/accel.sh@21 -- # val= 00:07:38.985 01:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.985 01:01:53 -- accel/accel.sh@20 -- # IFS=: 00:07:38.985 01:01:53 -- accel/accel.sh@20 -- # read -r var val 00:07:38.985 01:01:53 -- accel/accel.sh@21 -- # val=0x1 00:07:38.985 01:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.985 01:01:53 -- accel/accel.sh@20 -- # IFS=: 00:07:38.985 01:01:53 -- accel/accel.sh@20 -- # read -r var val 00:07:38.985 01:01:53 -- accel/accel.sh@21 -- # val= 00:07:38.985 01:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.985 01:01:53 -- accel/accel.sh@20 -- # IFS=: 00:07:38.985 01:01:53 -- accel/accel.sh@20 -- # read -r var val 00:07:38.985 01:01:53 -- accel/accel.sh@21 -- # val= 00:07:38.985 01:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.985 01:01:53 -- accel/accel.sh@20 -- # IFS=: 00:07:38.985 01:01:53 -- accel/accel.sh@20 -- # read -r var val 00:07:38.985 01:01:53 -- accel/accel.sh@21 -- # val=xor 00:07:38.985 01:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.985 01:01:53 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:38.985 01:01:53 -- accel/accel.sh@20 -- # IFS=: 00:07:38.985 01:01:53 -- accel/accel.sh@20 -- # read -r var val 00:07:38.985 01:01:53 -- accel/accel.sh@21 -- # val=2 00:07:38.985 01:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.985 01:01:53 -- accel/accel.sh@20 -- # IFS=: 00:07:38.985 01:01:53 -- accel/accel.sh@20 -- # read -r var val 00:07:38.985 01:01:53 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:38.985 01:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.985 01:01:53 -- accel/accel.sh@20 -- # IFS=: 00:07:38.985 01:01:53 -- accel/accel.sh@20 -- # read -r var val 00:07:38.986 01:01:53 -- accel/accel.sh@21 -- # val= 00:07:38.986 01:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.986 01:01:53 -- accel/accel.sh@20 -- # IFS=: 00:07:38.986 01:01:53 -- accel/accel.sh@20 -- # read -r var val 00:07:38.986 01:01:53 -- accel/accel.sh@21 -- # val=software 00:07:38.986 01:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.986 01:01:53 -- accel/accel.sh@23 -- # accel_module=software 00:07:38.986 01:01:53 -- accel/accel.sh@20 -- # IFS=: 00:07:38.986 01:01:53 -- accel/accel.sh@20 -- # read -r var val 00:07:38.986 01:01:53 -- accel/accel.sh@21 -- # val=32 00:07:38.986 01:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.986 01:01:53 -- accel/accel.sh@20 -- # IFS=: 00:07:38.986 01:01:53 -- accel/accel.sh@20 -- # read -r var val 00:07:38.986 01:01:53 -- accel/accel.sh@21 -- # val=32 00:07:38.986 01:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.986 01:01:53 -- accel/accel.sh@20 -- # IFS=: 00:07:38.986 01:01:53 -- accel/accel.sh@20 -- # read -r var val 00:07:38.986 01:01:53 -- accel/accel.sh@21 -- # val=1 00:07:38.986 01:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.986 01:01:53 -- accel/accel.sh@20 -- # IFS=: 00:07:38.986 01:01:53 -- accel/accel.sh@20 -- # read -r var val 00:07:38.986 01:01:53 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:38.986 01:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.986 01:01:53 -- accel/accel.sh@20 -- # IFS=: 00:07:38.986 01:01:53 -- accel/accel.sh@20 -- # read -r var val 00:07:38.986 01:01:53 -- accel/accel.sh@21 -- # val=Yes 00:07:38.986 01:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.986 01:01:53 -- accel/accel.sh@20 -- # IFS=: 00:07:38.986 01:01:53 -- accel/accel.sh@20 -- # read -r var val 00:07:38.986 01:01:53 -- accel/accel.sh@21 -- # val= 00:07:38.986 01:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.986 01:01:53 -- accel/accel.sh@20 -- # IFS=: 00:07:38.986 01:01:53 -- accel/accel.sh@20 -- # read -r var val 00:07:38.986 01:01:53 -- accel/accel.sh@21 -- # val= 00:07:38.986 01:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.986 01:01:53 -- accel/accel.sh@20 -- # IFS=: 00:07:38.986 01:01:53 -- accel/accel.sh@20 -- # read -r var val 00:07:40.435 01:01:54 -- accel/accel.sh@21 -- # val= 00:07:40.435 01:01:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.435 01:01:54 -- accel/accel.sh@20 -- # IFS=: 00:07:40.435 01:01:54 -- accel/accel.sh@20 -- # read -r var val 00:07:40.435 01:01:54 -- accel/accel.sh@21 -- # val= 00:07:40.435 01:01:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.435 01:01:54 -- accel/accel.sh@20 -- # IFS=: 00:07:40.435 01:01:54 -- accel/accel.sh@20 -- # read -r var val 00:07:40.435 01:01:54 -- accel/accel.sh@21 -- # val= 00:07:40.435 01:01:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.435 01:01:54 -- accel/accel.sh@20 -- # IFS=: 00:07:40.435 01:01:54 -- accel/accel.sh@20 -- # read -r var val 00:07:40.435 01:01:54 -- accel/accel.sh@21 -- # val= 00:07:40.435 01:01:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.435 01:01:54 -- accel/accel.sh@20 -- # IFS=: 00:07:40.435 01:01:54 -- accel/accel.sh@20 -- # read -r var val 00:07:40.435 01:01:54 -- accel/accel.sh@21 -- # val= 00:07:40.435 01:01:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.435 01:01:54 -- accel/accel.sh@20 -- # IFS=: 00:07:40.435 01:01:54 -- accel/accel.sh@20 -- # read -r var val 00:07:40.435 01:01:54 -- accel/accel.sh@21 -- # val= 00:07:40.435 01:01:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.435 01:01:54 -- accel/accel.sh@20 -- # IFS=: 00:07:40.435 01:01:54 -- accel/accel.sh@20 -- # read -r var val 00:07:40.435 01:01:54 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:40.435 01:01:54 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:40.435 01:01:54 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:40.435 00:07:40.435 real 0m2.810s 00:07:40.435 user 0m2.518s 00:07:40.435 sys 0m0.284s 00:07:40.435 01:01:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:40.435 01:01:54 -- common/autotest_common.sh@10 -- # set +x 00:07:40.435 ************************************ 00:07:40.435 END TEST accel_xor 00:07:40.435 ************************************ 00:07:40.435 01:01:54 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:07:40.435 01:01:54 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:40.435 01:01:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:40.435 01:01:54 -- common/autotest_common.sh@10 -- # set +x 00:07:40.435 ************************************ 00:07:40.435 START TEST accel_xor 00:07:40.435 ************************************ 00:07:40.435 01:01:54 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:07:40.435 01:01:54 -- accel/accel.sh@16 -- # local accel_opc 00:07:40.435 01:01:54 -- accel/accel.sh@17 -- # local accel_module 00:07:40.435 01:01:54 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:07:40.435 01:01:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:40.435 01:01:54 -- accel/accel.sh@12 -- # build_accel_config 00:07:40.435 01:01:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:40.435 01:01:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:40.435 01:01:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:40.435 01:01:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:40.436 01:01:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:40.436 01:01:54 -- accel/accel.sh@41 -- # local IFS=, 00:07:40.436 01:01:54 -- accel/accel.sh@42 -- # jq -r . 00:07:40.436 [2024-11-28 01:01:54.753429] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:40.436 [2024-11-28 01:01:54.753505] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1924695 ] 00:07:40.436 EAL: No free 2048 kB hugepages reported on node 1 00:07:40.436 [2024-11-28 01:01:54.818402] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:40.436 [2024-11-28 01:01:54.913988] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:41.808 01:01:56 -- accel/accel.sh@18 -- # out=' 00:07:41.809 SPDK Configuration: 00:07:41.809 Core mask: 0x1 00:07:41.809 00:07:41.809 Accel Perf Configuration: 00:07:41.809 Workload Type: xor 00:07:41.809 Source buffers: 3 00:07:41.809 Transfer size: 4096 bytes 00:07:41.809 Vector count 1 00:07:41.809 Module: software 00:07:41.809 Queue depth: 32 00:07:41.809 Allocate depth: 32 00:07:41.809 # threads/core: 1 00:07:41.809 Run time: 1 seconds 00:07:41.809 Verify: Yes 00:07:41.809 00:07:41.809 Running for 1 seconds... 00:07:41.809 00:07:41.809 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:41.809 ------------------------------------------------------------------------------------ 00:07:41.809 0,0 184640/s 721 MiB/s 0 0 00:07:41.809 ==================================================================================== 00:07:41.809 Total 184640/s 721 MiB/s 0 0' 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # IFS=: 00:07:41.809 01:01:56 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # read -r var val 00:07:41.809 01:01:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:41.809 01:01:56 -- accel/accel.sh@12 -- # build_accel_config 00:07:41.809 01:01:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:41.809 01:01:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:41.809 01:01:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:41.809 01:01:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:41.809 01:01:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:41.809 01:01:56 -- accel/accel.sh@41 -- # local IFS=, 00:07:41.809 01:01:56 -- accel/accel.sh@42 -- # jq -r . 00:07:41.809 [2024-11-28 01:01:56.146400] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:41.809 [2024-11-28 01:01:56.146483] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1924843 ] 00:07:41.809 EAL: No free 2048 kB hugepages reported on node 1 00:07:41.809 [2024-11-28 01:01:56.207349] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:41.809 [2024-11-28 01:01:56.297154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:41.809 01:01:56 -- accel/accel.sh@21 -- # val= 00:07:41.809 01:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # IFS=: 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # read -r var val 00:07:41.809 01:01:56 -- accel/accel.sh@21 -- # val= 00:07:41.809 01:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # IFS=: 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # read -r var val 00:07:41.809 01:01:56 -- accel/accel.sh@21 -- # val=0x1 00:07:41.809 01:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # IFS=: 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # read -r var val 00:07:41.809 01:01:56 -- accel/accel.sh@21 -- # val= 00:07:41.809 01:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # IFS=: 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # read -r var val 00:07:41.809 01:01:56 -- accel/accel.sh@21 -- # val= 00:07:41.809 01:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # IFS=: 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # read -r var val 00:07:41.809 01:01:56 -- accel/accel.sh@21 -- # val=xor 00:07:41.809 01:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.809 01:01:56 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # IFS=: 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # read -r var val 00:07:41.809 01:01:56 -- accel/accel.sh@21 -- # val=3 00:07:41.809 01:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # IFS=: 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # read -r var val 00:07:41.809 01:01:56 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:41.809 01:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # IFS=: 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # read -r var val 00:07:41.809 01:01:56 -- accel/accel.sh@21 -- # val= 00:07:41.809 01:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # IFS=: 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # read -r var val 00:07:41.809 01:01:56 -- accel/accel.sh@21 -- # val=software 00:07:41.809 01:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.809 01:01:56 -- accel/accel.sh@23 -- # accel_module=software 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # IFS=: 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # read -r var val 00:07:41.809 01:01:56 -- accel/accel.sh@21 -- # val=32 00:07:41.809 01:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # IFS=: 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # read -r var val 00:07:41.809 01:01:56 -- accel/accel.sh@21 -- # val=32 00:07:41.809 01:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # IFS=: 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # read -r var val 00:07:41.809 01:01:56 -- accel/accel.sh@21 -- # val=1 00:07:41.809 01:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # IFS=: 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # read -r var val 00:07:41.809 01:01:56 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:41.809 01:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # IFS=: 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # read -r var val 00:07:41.809 01:01:56 -- accel/accel.sh@21 -- # val=Yes 00:07:41.809 01:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # IFS=: 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # read -r var val 00:07:41.809 01:01:56 -- accel/accel.sh@21 -- # val= 00:07:41.809 01:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.809 01:01:56 -- accel/accel.sh@20 -- # IFS=: 00:07:41.810 01:01:56 -- accel/accel.sh@20 -- # read -r var val 00:07:41.810 01:01:56 -- accel/accel.sh@21 -- # val= 00:07:41.810 01:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.810 01:01:56 -- accel/accel.sh@20 -- # IFS=: 00:07:41.810 01:01:56 -- accel/accel.sh@20 -- # read -r var val 00:07:43.185 01:01:57 -- accel/accel.sh@21 -- # val= 00:07:43.185 01:01:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.185 01:01:57 -- accel/accel.sh@20 -- # IFS=: 00:07:43.185 01:01:57 -- accel/accel.sh@20 -- # read -r var val 00:07:43.185 01:01:57 -- accel/accel.sh@21 -- # val= 00:07:43.185 01:01:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.185 01:01:57 -- accel/accel.sh@20 -- # IFS=: 00:07:43.185 01:01:57 -- accel/accel.sh@20 -- # read -r var val 00:07:43.185 01:01:57 -- accel/accel.sh@21 -- # val= 00:07:43.185 01:01:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.185 01:01:57 -- accel/accel.sh@20 -- # IFS=: 00:07:43.185 01:01:57 -- accel/accel.sh@20 -- # read -r var val 00:07:43.185 01:01:57 -- accel/accel.sh@21 -- # val= 00:07:43.185 01:01:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.185 01:01:57 -- accel/accel.sh@20 -- # IFS=: 00:07:43.185 01:01:57 -- accel/accel.sh@20 -- # read -r var val 00:07:43.185 01:01:57 -- accel/accel.sh@21 -- # val= 00:07:43.185 01:01:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.185 01:01:57 -- accel/accel.sh@20 -- # IFS=: 00:07:43.185 01:01:57 -- accel/accel.sh@20 -- # read -r var val 00:07:43.185 01:01:57 -- accel/accel.sh@21 -- # val= 00:07:43.185 01:01:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.185 01:01:57 -- accel/accel.sh@20 -- # IFS=: 00:07:43.185 01:01:57 -- accel/accel.sh@20 -- # read -r var val 00:07:43.185 01:01:57 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:43.185 01:01:57 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:43.185 01:01:57 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:43.185 00:07:43.185 real 0m2.797s 00:07:43.185 user 0m2.493s 00:07:43.185 sys 0m0.296s 00:07:43.185 01:01:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:43.185 01:01:57 -- common/autotest_common.sh@10 -- # set +x 00:07:43.185 ************************************ 00:07:43.185 END TEST accel_xor 00:07:43.185 ************************************ 00:07:43.185 01:01:57 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:07:43.185 01:01:57 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:43.185 01:01:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:43.185 01:01:57 -- common/autotest_common.sh@10 -- # set +x 00:07:43.185 ************************************ 00:07:43.185 START TEST accel_dif_verify 00:07:43.185 ************************************ 00:07:43.185 01:01:57 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:07:43.185 01:01:57 -- accel/accel.sh@16 -- # local accel_opc 00:07:43.185 01:01:57 -- accel/accel.sh@17 -- # local accel_module 00:07:43.185 01:01:57 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:07:43.185 01:01:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:43.185 01:01:57 -- accel/accel.sh@12 -- # build_accel_config 00:07:43.185 01:01:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:43.185 01:01:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:43.185 01:01:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:43.185 01:01:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:43.185 01:01:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:43.185 01:01:57 -- accel/accel.sh@41 -- # local IFS=, 00:07:43.185 01:01:57 -- accel/accel.sh@42 -- # jq -r . 00:07:43.185 [2024-11-28 01:01:57.578612] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:43.185 [2024-11-28 01:01:57.578695] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1925002 ] 00:07:43.185 EAL: No free 2048 kB hugepages reported on node 1 00:07:43.185 [2024-11-28 01:01:57.641569] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:43.185 [2024-11-28 01:01:57.730178] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:44.558 01:01:58 -- accel/accel.sh@18 -- # out=' 00:07:44.558 SPDK Configuration: 00:07:44.558 Core mask: 0x1 00:07:44.558 00:07:44.558 Accel Perf Configuration: 00:07:44.558 Workload Type: dif_verify 00:07:44.558 Vector size: 4096 bytes 00:07:44.558 Transfer size: 4096 bytes 00:07:44.558 Block size: 512 bytes 00:07:44.558 Metadata size: 8 bytes 00:07:44.558 Vector count 1 00:07:44.558 Module: software 00:07:44.558 Queue depth: 32 00:07:44.558 Allocate depth: 32 00:07:44.558 # threads/core: 1 00:07:44.558 Run time: 1 seconds 00:07:44.558 Verify: No 00:07:44.558 00:07:44.558 Running for 1 seconds... 00:07:44.558 00:07:44.558 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:44.558 ------------------------------------------------------------------------------------ 00:07:44.558 0,0 82208/s 326 MiB/s 0 0 00:07:44.558 ==================================================================================== 00:07:44.558 Total 82208/s 321 MiB/s 0 0' 00:07:44.558 01:01:58 -- accel/accel.sh@20 -- # IFS=: 00:07:44.558 01:01:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:07:44.558 01:01:58 -- accel/accel.sh@20 -- # read -r var val 00:07:44.558 01:01:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:44.558 01:01:58 -- accel/accel.sh@12 -- # build_accel_config 00:07:44.558 01:01:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:44.558 01:01:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:44.558 01:01:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:44.558 01:01:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:44.558 01:01:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:44.558 01:01:58 -- accel/accel.sh@41 -- # local IFS=, 00:07:44.558 01:01:58 -- accel/accel.sh@42 -- # jq -r . 00:07:44.558 [2024-11-28 01:01:58.987191] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:44.558 [2024-11-28 01:01:58.987270] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1925140 ] 00:07:44.558 EAL: No free 2048 kB hugepages reported on node 1 00:07:44.558 [2024-11-28 01:01:59.049364] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:44.558 [2024-11-28 01:01:59.138520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:44.816 01:01:59 -- accel/accel.sh@21 -- # val= 00:07:44.816 01:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.816 01:01:59 -- accel/accel.sh@20 -- # IFS=: 00:07:44.816 01:01:59 -- accel/accel.sh@20 -- # read -r var val 00:07:44.816 01:01:59 -- accel/accel.sh@21 -- # val= 00:07:44.816 01:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.816 01:01:59 -- accel/accel.sh@20 -- # IFS=: 00:07:44.816 01:01:59 -- accel/accel.sh@20 -- # read -r var val 00:07:44.816 01:01:59 -- accel/accel.sh@21 -- # val=0x1 00:07:44.816 01:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.816 01:01:59 -- accel/accel.sh@20 -- # IFS=: 00:07:44.816 01:01:59 -- accel/accel.sh@20 -- # read -r var val 00:07:44.816 01:01:59 -- accel/accel.sh@21 -- # val= 00:07:44.816 01:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.816 01:01:59 -- accel/accel.sh@20 -- # IFS=: 00:07:44.816 01:01:59 -- accel/accel.sh@20 -- # read -r var val 00:07:44.816 01:01:59 -- accel/accel.sh@21 -- # val= 00:07:44.817 01:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # IFS=: 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # read -r var val 00:07:44.817 01:01:59 -- accel/accel.sh@21 -- # val=dif_verify 00:07:44.817 01:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.817 01:01:59 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # IFS=: 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # read -r var val 00:07:44.817 01:01:59 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:44.817 01:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # IFS=: 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # read -r var val 00:07:44.817 01:01:59 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:44.817 01:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # IFS=: 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # read -r var val 00:07:44.817 01:01:59 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:44.817 01:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # IFS=: 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # read -r var val 00:07:44.817 01:01:59 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:44.817 01:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # IFS=: 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # read -r var val 00:07:44.817 01:01:59 -- accel/accel.sh@21 -- # val= 00:07:44.817 01:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # IFS=: 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # read -r var val 00:07:44.817 01:01:59 -- accel/accel.sh@21 -- # val=software 00:07:44.817 01:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.817 01:01:59 -- accel/accel.sh@23 -- # accel_module=software 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # IFS=: 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # read -r var val 00:07:44.817 01:01:59 -- accel/accel.sh@21 -- # val=32 00:07:44.817 01:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # IFS=: 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # read -r var val 00:07:44.817 01:01:59 -- accel/accel.sh@21 -- # val=32 00:07:44.817 01:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # IFS=: 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # read -r var val 00:07:44.817 01:01:59 -- accel/accel.sh@21 -- # val=1 00:07:44.817 01:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # IFS=: 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # read -r var val 00:07:44.817 01:01:59 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:44.817 01:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # IFS=: 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # read -r var val 00:07:44.817 01:01:59 -- accel/accel.sh@21 -- # val=No 00:07:44.817 01:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # IFS=: 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # read -r var val 00:07:44.817 01:01:59 -- accel/accel.sh@21 -- # val= 00:07:44.817 01:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # IFS=: 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # read -r var val 00:07:44.817 01:01:59 -- accel/accel.sh@21 -- # val= 00:07:44.817 01:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # IFS=: 00:07:44.817 01:01:59 -- accel/accel.sh@20 -- # read -r var val 00:07:46.189 01:02:00 -- accel/accel.sh@21 -- # val= 00:07:46.189 01:02:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.189 01:02:00 -- accel/accel.sh@20 -- # IFS=: 00:07:46.189 01:02:00 -- accel/accel.sh@20 -- # read -r var val 00:07:46.189 01:02:00 -- accel/accel.sh@21 -- # val= 00:07:46.189 01:02:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.189 01:02:00 -- accel/accel.sh@20 -- # IFS=: 00:07:46.189 01:02:00 -- accel/accel.sh@20 -- # read -r var val 00:07:46.189 01:02:00 -- accel/accel.sh@21 -- # val= 00:07:46.189 01:02:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.189 01:02:00 -- accel/accel.sh@20 -- # IFS=: 00:07:46.189 01:02:00 -- accel/accel.sh@20 -- # read -r var val 00:07:46.189 01:02:00 -- accel/accel.sh@21 -- # val= 00:07:46.189 01:02:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.189 01:02:00 -- accel/accel.sh@20 -- # IFS=: 00:07:46.189 01:02:00 -- accel/accel.sh@20 -- # read -r var val 00:07:46.189 01:02:00 -- accel/accel.sh@21 -- # val= 00:07:46.189 01:02:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.189 01:02:00 -- accel/accel.sh@20 -- # IFS=: 00:07:46.189 01:02:00 -- accel/accel.sh@20 -- # read -r var val 00:07:46.189 01:02:00 -- accel/accel.sh@21 -- # val= 00:07:46.189 01:02:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.189 01:02:00 -- accel/accel.sh@20 -- # IFS=: 00:07:46.189 01:02:00 -- accel/accel.sh@20 -- # read -r var val 00:07:46.189 01:02:00 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:46.189 01:02:00 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:07:46.189 01:02:00 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:46.189 00:07:46.189 real 0m2.812s 00:07:46.189 user 0m2.515s 00:07:46.189 sys 0m0.290s 00:07:46.190 01:02:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:46.190 01:02:00 -- common/autotest_common.sh@10 -- # set +x 00:07:46.190 ************************************ 00:07:46.190 END TEST accel_dif_verify 00:07:46.190 ************************************ 00:07:46.190 01:02:00 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:46.190 01:02:00 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:46.190 01:02:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:46.190 01:02:00 -- common/autotest_common.sh@10 -- # set +x 00:07:46.190 ************************************ 00:07:46.190 START TEST accel_dif_generate 00:07:46.190 ************************************ 00:07:46.190 01:02:00 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:07:46.190 01:02:00 -- accel/accel.sh@16 -- # local accel_opc 00:07:46.190 01:02:00 -- accel/accel.sh@17 -- # local accel_module 00:07:46.190 01:02:00 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:07:46.190 01:02:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:46.190 01:02:00 -- accel/accel.sh@12 -- # build_accel_config 00:07:46.190 01:02:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:46.190 01:02:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:46.190 01:02:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:46.190 01:02:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:46.190 01:02:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:46.190 01:02:00 -- accel/accel.sh@41 -- # local IFS=, 00:07:46.190 01:02:00 -- accel/accel.sh@42 -- # jq -r . 00:07:46.190 [2024-11-28 01:02:00.415857] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:46.190 [2024-11-28 01:02:00.415933] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1925414 ] 00:07:46.190 EAL: No free 2048 kB hugepages reported on node 1 00:07:46.190 [2024-11-28 01:02:00.478479] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:46.190 [2024-11-28 01:02:00.567387] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:47.561 01:02:01 -- accel/accel.sh@18 -- # out=' 00:07:47.561 SPDK Configuration: 00:07:47.561 Core mask: 0x1 00:07:47.561 00:07:47.561 Accel Perf Configuration: 00:07:47.561 Workload Type: dif_generate 00:07:47.561 Vector size: 4096 bytes 00:07:47.561 Transfer size: 4096 bytes 00:07:47.561 Block size: 512 bytes 00:07:47.561 Metadata size: 8 bytes 00:07:47.561 Vector count 1 00:07:47.561 Module: software 00:07:47.561 Queue depth: 32 00:07:47.561 Allocate depth: 32 00:07:47.561 # threads/core: 1 00:07:47.561 Run time: 1 seconds 00:07:47.561 Verify: No 00:07:47.561 00:07:47.561 Running for 1 seconds... 00:07:47.561 00:07:47.561 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:47.561 ------------------------------------------------------------------------------------ 00:07:47.561 0,0 96448/s 382 MiB/s 0 0 00:07:47.561 ==================================================================================== 00:07:47.561 Total 96448/s 376 MiB/s 0 0' 00:07:47.561 01:02:01 -- accel/accel.sh@20 -- # IFS=: 00:07:47.561 01:02:01 -- accel/accel.sh@20 -- # read -r var val 00:07:47.561 01:02:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:47.561 01:02:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:47.561 01:02:01 -- accel/accel.sh@12 -- # build_accel_config 00:07:47.561 01:02:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:47.561 01:02:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:47.561 01:02:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:47.561 01:02:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:47.561 01:02:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:47.561 01:02:01 -- accel/accel.sh@41 -- # local IFS=, 00:07:47.561 01:02:01 -- accel/accel.sh@42 -- # jq -r . 00:07:47.561 [2024-11-28 01:02:01.808366] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:47.561 [2024-11-28 01:02:01.808451] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1925567 ] 00:07:47.561 EAL: No free 2048 kB hugepages reported on node 1 00:07:47.561 [2024-11-28 01:02:01.869845] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:47.561 [2024-11-28 01:02:01.959922] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:47.561 01:02:02 -- accel/accel.sh@21 -- # val= 00:07:47.561 01:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.561 01:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:47.561 01:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:47.561 01:02:02 -- accel/accel.sh@21 -- # val= 00:07:47.561 01:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.561 01:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:47.561 01:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:47.561 01:02:02 -- accel/accel.sh@21 -- # val=0x1 00:07:47.562 01:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:47.562 01:02:02 -- accel/accel.sh@21 -- # val= 00:07:47.562 01:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:47.562 01:02:02 -- accel/accel.sh@21 -- # val= 00:07:47.562 01:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:47.562 01:02:02 -- accel/accel.sh@21 -- # val=dif_generate 00:07:47.562 01:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.562 01:02:02 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:47.562 01:02:02 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:47.562 01:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:47.562 01:02:02 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:47.562 01:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:47.562 01:02:02 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:47.562 01:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:47.562 01:02:02 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:47.562 01:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:47.562 01:02:02 -- accel/accel.sh@21 -- # val= 00:07:47.562 01:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:47.562 01:02:02 -- accel/accel.sh@21 -- # val=software 00:07:47.562 01:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.562 01:02:02 -- accel/accel.sh@23 -- # accel_module=software 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:47.562 01:02:02 -- accel/accel.sh@21 -- # val=32 00:07:47.562 01:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:47.562 01:02:02 -- accel/accel.sh@21 -- # val=32 00:07:47.562 01:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:47.562 01:02:02 -- accel/accel.sh@21 -- # val=1 00:07:47.562 01:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:47.562 01:02:02 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:47.562 01:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:47.562 01:02:02 -- accel/accel.sh@21 -- # val=No 00:07:47.562 01:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:47.562 01:02:02 -- accel/accel.sh@21 -- # val= 00:07:47.562 01:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:47.562 01:02:02 -- accel/accel.sh@21 -- # val= 00:07:47.562 01:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:47.562 01:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:48.935 01:02:03 -- accel/accel.sh@21 -- # val= 00:07:48.935 01:02:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.935 01:02:03 -- accel/accel.sh@20 -- # IFS=: 00:07:48.935 01:02:03 -- accel/accel.sh@20 -- # read -r var val 00:07:48.935 01:02:03 -- accel/accel.sh@21 -- # val= 00:07:48.935 01:02:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.935 01:02:03 -- accel/accel.sh@20 -- # IFS=: 00:07:48.935 01:02:03 -- accel/accel.sh@20 -- # read -r var val 00:07:48.935 01:02:03 -- accel/accel.sh@21 -- # val= 00:07:48.935 01:02:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.935 01:02:03 -- accel/accel.sh@20 -- # IFS=: 00:07:48.935 01:02:03 -- accel/accel.sh@20 -- # read -r var val 00:07:48.935 01:02:03 -- accel/accel.sh@21 -- # val= 00:07:48.935 01:02:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.935 01:02:03 -- accel/accel.sh@20 -- # IFS=: 00:07:48.935 01:02:03 -- accel/accel.sh@20 -- # read -r var val 00:07:48.935 01:02:03 -- accel/accel.sh@21 -- # val= 00:07:48.935 01:02:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.935 01:02:03 -- accel/accel.sh@20 -- # IFS=: 00:07:48.935 01:02:03 -- accel/accel.sh@20 -- # read -r var val 00:07:48.935 01:02:03 -- accel/accel.sh@21 -- # val= 00:07:48.935 01:02:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.935 01:02:03 -- accel/accel.sh@20 -- # IFS=: 00:07:48.935 01:02:03 -- accel/accel.sh@20 -- # read -r var val 00:07:48.935 01:02:03 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:48.935 01:02:03 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:07:48.935 01:02:03 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:48.935 00:07:48.935 real 0m2.802s 00:07:48.935 user 0m2.513s 00:07:48.935 sys 0m0.284s 00:07:48.935 01:02:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:48.935 01:02:03 -- common/autotest_common.sh@10 -- # set +x 00:07:48.935 ************************************ 00:07:48.935 END TEST accel_dif_generate 00:07:48.935 ************************************ 00:07:48.935 01:02:03 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:48.935 01:02:03 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:48.935 01:02:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:48.935 01:02:03 -- common/autotest_common.sh@10 -- # set +x 00:07:48.935 ************************************ 00:07:48.935 START TEST accel_dif_generate_copy 00:07:48.935 ************************************ 00:07:48.935 01:02:03 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:07:48.935 01:02:03 -- accel/accel.sh@16 -- # local accel_opc 00:07:48.935 01:02:03 -- accel/accel.sh@17 -- # local accel_module 00:07:48.935 01:02:03 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:07:48.935 01:02:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:48.935 01:02:03 -- accel/accel.sh@12 -- # build_accel_config 00:07:48.935 01:02:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:48.935 01:02:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:48.935 01:02:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:48.935 01:02:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:48.935 01:02:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:48.935 01:02:03 -- accel/accel.sh@41 -- # local IFS=, 00:07:48.935 01:02:03 -- accel/accel.sh@42 -- # jq -r . 00:07:48.935 [2024-11-28 01:02:03.247225] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:48.935 [2024-11-28 01:02:03.247317] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1925723 ] 00:07:48.935 EAL: No free 2048 kB hugepages reported on node 1 00:07:48.935 [2024-11-28 01:02:03.309606] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:48.935 [2024-11-28 01:02:03.398010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:50.308 01:02:04 -- accel/accel.sh@18 -- # out=' 00:07:50.308 SPDK Configuration: 00:07:50.308 Core mask: 0x1 00:07:50.308 00:07:50.308 Accel Perf Configuration: 00:07:50.308 Workload Type: dif_generate_copy 00:07:50.308 Vector size: 4096 bytes 00:07:50.308 Transfer size: 4096 bytes 00:07:50.308 Vector count 1 00:07:50.308 Module: software 00:07:50.308 Queue depth: 32 00:07:50.308 Allocate depth: 32 00:07:50.308 # threads/core: 1 00:07:50.308 Run time: 1 seconds 00:07:50.308 Verify: No 00:07:50.308 00:07:50.308 Running for 1 seconds... 00:07:50.308 00:07:50.308 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:50.308 ------------------------------------------------------------------------------------ 00:07:50.308 0,0 76192/s 302 MiB/s 0 0 00:07:50.308 ==================================================================================== 00:07:50.308 Total 76192/s 297 MiB/s 0 0' 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:50.308 01:02:04 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:50.308 01:02:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:50.308 01:02:04 -- accel/accel.sh@12 -- # build_accel_config 00:07:50.308 01:02:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:50.308 01:02:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:50.308 01:02:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:50.308 01:02:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:50.308 01:02:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:50.308 01:02:04 -- accel/accel.sh@41 -- # local IFS=, 00:07:50.308 01:02:04 -- accel/accel.sh@42 -- # jq -r . 00:07:50.308 [2024-11-28 01:02:04.648846] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:50.308 [2024-11-28 01:02:04.648926] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1925867 ] 00:07:50.308 EAL: No free 2048 kB hugepages reported on node 1 00:07:50.308 [2024-11-28 01:02:04.711428] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:50.308 [2024-11-28 01:02:04.801065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:50.308 01:02:04 -- accel/accel.sh@21 -- # val= 00:07:50.308 01:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:50.308 01:02:04 -- accel/accel.sh@21 -- # val= 00:07:50.308 01:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:50.308 01:02:04 -- accel/accel.sh@21 -- # val=0x1 00:07:50.308 01:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:50.308 01:02:04 -- accel/accel.sh@21 -- # val= 00:07:50.308 01:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:50.308 01:02:04 -- accel/accel.sh@21 -- # val= 00:07:50.308 01:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:50.308 01:02:04 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:07:50.308 01:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.308 01:02:04 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:50.308 01:02:04 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:50.308 01:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:50.308 01:02:04 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:50.308 01:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:50.308 01:02:04 -- accel/accel.sh@21 -- # val= 00:07:50.308 01:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:50.308 01:02:04 -- accel/accel.sh@21 -- # val=software 00:07:50.308 01:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.308 01:02:04 -- accel/accel.sh@23 -- # accel_module=software 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:50.308 01:02:04 -- accel/accel.sh@21 -- # val=32 00:07:50.308 01:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:50.308 01:02:04 -- accel/accel.sh@21 -- # val=32 00:07:50.308 01:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:50.308 01:02:04 -- accel/accel.sh@21 -- # val=1 00:07:50.308 01:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:50.308 01:02:04 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:50.308 01:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:50.308 01:02:04 -- accel/accel.sh@21 -- # val=No 00:07:50.308 01:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:50.308 01:02:04 -- accel/accel.sh@21 -- # val= 00:07:50.308 01:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:50.308 01:02:04 -- accel/accel.sh@21 -- # val= 00:07:50.308 01:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:50.308 01:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:51.681 01:02:06 -- accel/accel.sh@21 -- # val= 00:07:51.681 01:02:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.681 01:02:06 -- accel/accel.sh@20 -- # IFS=: 00:07:51.681 01:02:06 -- accel/accel.sh@20 -- # read -r var val 00:07:51.681 01:02:06 -- accel/accel.sh@21 -- # val= 00:07:51.681 01:02:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.681 01:02:06 -- accel/accel.sh@20 -- # IFS=: 00:07:51.681 01:02:06 -- accel/accel.sh@20 -- # read -r var val 00:07:51.681 01:02:06 -- accel/accel.sh@21 -- # val= 00:07:51.681 01:02:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.681 01:02:06 -- accel/accel.sh@20 -- # IFS=: 00:07:51.681 01:02:06 -- accel/accel.sh@20 -- # read -r var val 00:07:51.681 01:02:06 -- accel/accel.sh@21 -- # val= 00:07:51.681 01:02:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.681 01:02:06 -- accel/accel.sh@20 -- # IFS=: 00:07:51.681 01:02:06 -- accel/accel.sh@20 -- # read -r var val 00:07:51.681 01:02:06 -- accel/accel.sh@21 -- # val= 00:07:51.681 01:02:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.681 01:02:06 -- accel/accel.sh@20 -- # IFS=: 00:07:51.681 01:02:06 -- accel/accel.sh@20 -- # read -r var val 00:07:51.681 01:02:06 -- accel/accel.sh@21 -- # val= 00:07:51.681 01:02:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.681 01:02:06 -- accel/accel.sh@20 -- # IFS=: 00:07:51.681 01:02:06 -- accel/accel.sh@20 -- # read -r var val 00:07:51.681 01:02:06 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:51.681 01:02:06 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:07:51.681 01:02:06 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:51.681 00:07:51.681 real 0m2.798s 00:07:51.681 user 0m2.488s 00:07:51.681 sys 0m0.301s 00:07:51.681 01:02:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:51.681 01:02:06 -- common/autotest_common.sh@10 -- # set +x 00:07:51.681 ************************************ 00:07:51.681 END TEST accel_dif_generate_copy 00:07:51.681 ************************************ 00:07:51.681 01:02:06 -- accel/accel.sh@107 -- # [[ y == y ]] 00:07:51.681 01:02:06 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:51.681 01:02:06 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:51.681 01:02:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:51.681 01:02:06 -- common/autotest_common.sh@10 -- # set +x 00:07:51.681 ************************************ 00:07:51.681 START TEST accel_comp 00:07:51.681 ************************************ 00:07:51.681 01:02:06 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:51.681 01:02:06 -- accel/accel.sh@16 -- # local accel_opc 00:07:51.681 01:02:06 -- accel/accel.sh@17 -- # local accel_module 00:07:51.681 01:02:06 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:51.681 01:02:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:51.681 01:02:06 -- accel/accel.sh@12 -- # build_accel_config 00:07:51.681 01:02:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:51.681 01:02:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:51.681 01:02:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:51.681 01:02:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:51.681 01:02:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:51.681 01:02:06 -- accel/accel.sh@41 -- # local IFS=, 00:07:51.681 01:02:06 -- accel/accel.sh@42 -- # jq -r . 00:07:51.681 [2024-11-28 01:02:06.071053] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:51.681 [2024-11-28 01:02:06.071130] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1926141 ] 00:07:51.681 EAL: No free 2048 kB hugepages reported on node 1 00:07:51.681 [2024-11-28 01:02:06.133604] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:51.681 [2024-11-28 01:02:06.224261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:53.055 01:02:07 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:53.055 00:07:53.055 SPDK Configuration: 00:07:53.055 Core mask: 0x1 00:07:53.055 00:07:53.056 Accel Perf Configuration: 00:07:53.056 Workload Type: compress 00:07:53.056 Transfer size: 4096 bytes 00:07:53.056 Vector count 1 00:07:53.056 Module: software 00:07:53.056 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:53.056 Queue depth: 32 00:07:53.056 Allocate depth: 32 00:07:53.056 # threads/core: 1 00:07:53.056 Run time: 1 seconds 00:07:53.056 Verify: No 00:07:53.056 00:07:53.056 Running for 1 seconds... 00:07:53.056 00:07:53.056 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:53.056 ------------------------------------------------------------------------------------ 00:07:53.056 0,0 31488/s 131 MiB/s 0 0 00:07:53.056 ==================================================================================== 00:07:53.056 Total 31488/s 123 MiB/s 0 0' 00:07:53.056 01:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:53.056 01:02:07 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:53.056 01:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:53.056 01:02:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:53.056 01:02:07 -- accel/accel.sh@12 -- # build_accel_config 00:07:53.056 01:02:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:53.056 01:02:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:53.056 01:02:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:53.056 01:02:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:53.056 01:02:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:53.056 01:02:07 -- accel/accel.sh@41 -- # local IFS=, 00:07:53.056 01:02:07 -- accel/accel.sh@42 -- # jq -r . 00:07:53.056 [2024-11-28 01:02:07.472326] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:53.056 [2024-11-28 01:02:07.472403] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1926283 ] 00:07:53.056 EAL: No free 2048 kB hugepages reported on node 1 00:07:53.056 [2024-11-28 01:02:07.534459] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:53.056 [2024-11-28 01:02:07.622854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:53.314 01:02:07 -- accel/accel.sh@21 -- # val= 00:07:53.314 01:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.314 01:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:53.314 01:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:53.314 01:02:07 -- accel/accel.sh@21 -- # val= 00:07:53.314 01:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.314 01:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:53.314 01:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:53.314 01:02:07 -- accel/accel.sh@21 -- # val= 00:07:53.314 01:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.314 01:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:53.314 01:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:53.314 01:02:07 -- accel/accel.sh@21 -- # val=0x1 00:07:53.314 01:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.314 01:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:53.314 01:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:53.314 01:02:07 -- accel/accel.sh@21 -- # val= 00:07:53.314 01:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.314 01:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:53.314 01:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:53.314 01:02:07 -- accel/accel.sh@21 -- # val= 00:07:53.314 01:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.314 01:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:53.314 01:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:53.314 01:02:07 -- accel/accel.sh@21 -- # val=compress 00:07:53.314 01:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.314 01:02:07 -- accel/accel.sh@24 -- # accel_opc=compress 00:07:53.314 01:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:53.314 01:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:53.314 01:02:07 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:53.314 01:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.314 01:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:53.315 01:02:07 -- accel/accel.sh@21 -- # val= 00:07:53.315 01:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:53.315 01:02:07 -- accel/accel.sh@21 -- # val=software 00:07:53.315 01:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.315 01:02:07 -- accel/accel.sh@23 -- # accel_module=software 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:53.315 01:02:07 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:53.315 01:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:53.315 01:02:07 -- accel/accel.sh@21 -- # val=32 00:07:53.315 01:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:53.315 01:02:07 -- accel/accel.sh@21 -- # val=32 00:07:53.315 01:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:53.315 01:02:07 -- accel/accel.sh@21 -- # val=1 00:07:53.315 01:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:53.315 01:02:07 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:53.315 01:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:53.315 01:02:07 -- accel/accel.sh@21 -- # val=No 00:07:53.315 01:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:53.315 01:02:07 -- accel/accel.sh@21 -- # val= 00:07:53.315 01:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:53.315 01:02:07 -- accel/accel.sh@21 -- # val= 00:07:53.315 01:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:53.315 01:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:54.249 01:02:08 -- accel/accel.sh@21 -- # val= 00:07:54.249 01:02:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.249 01:02:08 -- accel/accel.sh@20 -- # IFS=: 00:07:54.249 01:02:08 -- accel/accel.sh@20 -- # read -r var val 00:07:54.249 01:02:08 -- accel/accel.sh@21 -- # val= 00:07:54.249 01:02:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.249 01:02:08 -- accel/accel.sh@20 -- # IFS=: 00:07:54.249 01:02:08 -- accel/accel.sh@20 -- # read -r var val 00:07:54.249 01:02:08 -- accel/accel.sh@21 -- # val= 00:07:54.249 01:02:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.249 01:02:08 -- accel/accel.sh@20 -- # IFS=: 00:07:54.249 01:02:08 -- accel/accel.sh@20 -- # read -r var val 00:07:54.249 01:02:08 -- accel/accel.sh@21 -- # val= 00:07:54.249 01:02:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.249 01:02:08 -- accel/accel.sh@20 -- # IFS=: 00:07:54.249 01:02:08 -- accel/accel.sh@20 -- # read -r var val 00:07:54.249 01:02:08 -- accel/accel.sh@21 -- # val= 00:07:54.249 01:02:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.249 01:02:08 -- accel/accel.sh@20 -- # IFS=: 00:07:54.249 01:02:08 -- accel/accel.sh@20 -- # read -r var val 00:07:54.249 01:02:08 -- accel/accel.sh@21 -- # val= 00:07:54.508 01:02:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.508 01:02:08 -- accel/accel.sh@20 -- # IFS=: 00:07:54.508 01:02:08 -- accel/accel.sh@20 -- # read -r var val 00:07:54.508 01:02:08 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:54.508 01:02:08 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:07:54.508 01:02:08 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:54.508 00:07:54.508 real 0m2.800s 00:07:54.508 user 0m2.499s 00:07:54.508 sys 0m0.294s 00:07:54.508 01:02:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:54.508 01:02:08 -- common/autotest_common.sh@10 -- # set +x 00:07:54.508 ************************************ 00:07:54.508 END TEST accel_comp 00:07:54.508 ************************************ 00:07:54.508 01:02:08 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:54.508 01:02:08 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:54.508 01:02:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:54.508 01:02:08 -- common/autotest_common.sh@10 -- # set +x 00:07:54.508 ************************************ 00:07:54.508 START TEST accel_decomp 00:07:54.508 ************************************ 00:07:54.508 01:02:08 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:54.508 01:02:08 -- accel/accel.sh@16 -- # local accel_opc 00:07:54.508 01:02:08 -- accel/accel.sh@17 -- # local accel_module 00:07:54.508 01:02:08 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:54.508 01:02:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:54.508 01:02:08 -- accel/accel.sh@12 -- # build_accel_config 00:07:54.508 01:02:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:54.508 01:02:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:54.508 01:02:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:54.508 01:02:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:54.508 01:02:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:54.508 01:02:08 -- accel/accel.sh@41 -- # local IFS=, 00:07:54.508 01:02:08 -- accel/accel.sh@42 -- # jq -r . 00:07:54.508 [2024-11-28 01:02:08.896711] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:54.508 [2024-11-28 01:02:08.896789] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1926450 ] 00:07:54.508 EAL: No free 2048 kB hugepages reported on node 1 00:07:54.508 [2024-11-28 01:02:08.960918] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:54.508 [2024-11-28 01:02:09.051656] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:55.882 01:02:10 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:55.882 00:07:55.882 SPDK Configuration: 00:07:55.882 Core mask: 0x1 00:07:55.882 00:07:55.882 Accel Perf Configuration: 00:07:55.882 Workload Type: decompress 00:07:55.882 Transfer size: 4096 bytes 00:07:55.882 Vector count 1 00:07:55.882 Module: software 00:07:55.882 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:55.882 Queue depth: 32 00:07:55.882 Allocate depth: 32 00:07:55.882 # threads/core: 1 00:07:55.882 Run time: 1 seconds 00:07:55.882 Verify: Yes 00:07:55.882 00:07:55.882 Running for 1 seconds... 00:07:55.882 00:07:55.882 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:55.882 ------------------------------------------------------------------------------------ 00:07:55.882 0,0 55520/s 102 MiB/s 0 0 00:07:55.882 ==================================================================================== 00:07:55.882 Total 55520/s 216 MiB/s 0 0' 00:07:55.882 01:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:55.882 01:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:55.882 01:02:10 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:55.882 01:02:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:55.882 01:02:10 -- accel/accel.sh@12 -- # build_accel_config 00:07:55.882 01:02:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:55.882 01:02:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:55.882 01:02:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:55.882 01:02:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:55.882 01:02:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:55.882 01:02:10 -- accel/accel.sh@41 -- # local IFS=, 00:07:55.882 01:02:10 -- accel/accel.sh@42 -- # jq -r . 00:07:55.882 [2024-11-28 01:02:10.311495] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:55.883 [2024-11-28 01:02:10.311584] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1926588 ] 00:07:55.883 EAL: No free 2048 kB hugepages reported on node 1 00:07:55.883 [2024-11-28 01:02:10.373034] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:55.883 [2024-11-28 01:02:10.463417] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:56.174 01:02:10 -- accel/accel.sh@21 -- # val= 00:07:56.174 01:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:56.174 01:02:10 -- accel/accel.sh@21 -- # val= 00:07:56.174 01:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:56.174 01:02:10 -- accel/accel.sh@21 -- # val= 00:07:56.174 01:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:56.174 01:02:10 -- accel/accel.sh@21 -- # val=0x1 00:07:56.174 01:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:56.174 01:02:10 -- accel/accel.sh@21 -- # val= 00:07:56.174 01:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:56.174 01:02:10 -- accel/accel.sh@21 -- # val= 00:07:56.174 01:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:56.174 01:02:10 -- accel/accel.sh@21 -- # val=decompress 00:07:56.174 01:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.174 01:02:10 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:56.174 01:02:10 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:56.174 01:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:56.174 01:02:10 -- accel/accel.sh@21 -- # val= 00:07:56.174 01:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:56.174 01:02:10 -- accel/accel.sh@21 -- # val=software 00:07:56.174 01:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.174 01:02:10 -- accel/accel.sh@23 -- # accel_module=software 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:56.174 01:02:10 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:56.174 01:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:56.174 01:02:10 -- accel/accel.sh@21 -- # val=32 00:07:56.174 01:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:56.174 01:02:10 -- accel/accel.sh@21 -- # val=32 00:07:56.174 01:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:56.174 01:02:10 -- accel/accel.sh@21 -- # val=1 00:07:56.174 01:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:56.174 01:02:10 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:56.174 01:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:56.174 01:02:10 -- accel/accel.sh@21 -- # val=Yes 00:07:56.174 01:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:56.174 01:02:10 -- accel/accel.sh@21 -- # val= 00:07:56.174 01:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:56.174 01:02:10 -- accel/accel.sh@21 -- # val= 00:07:56.174 01:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:56.174 01:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:57.106 01:02:11 -- accel/accel.sh@21 -- # val= 00:07:57.106 01:02:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.106 01:02:11 -- accel/accel.sh@20 -- # IFS=: 00:07:57.106 01:02:11 -- accel/accel.sh@20 -- # read -r var val 00:07:57.106 01:02:11 -- accel/accel.sh@21 -- # val= 00:07:57.106 01:02:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.106 01:02:11 -- accel/accel.sh@20 -- # IFS=: 00:07:57.106 01:02:11 -- accel/accel.sh@20 -- # read -r var val 00:07:57.106 01:02:11 -- accel/accel.sh@21 -- # val= 00:07:57.106 01:02:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.106 01:02:11 -- accel/accel.sh@20 -- # IFS=: 00:07:57.106 01:02:11 -- accel/accel.sh@20 -- # read -r var val 00:07:57.106 01:02:11 -- accel/accel.sh@21 -- # val= 00:07:57.106 01:02:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.106 01:02:11 -- accel/accel.sh@20 -- # IFS=: 00:07:57.106 01:02:11 -- accel/accel.sh@20 -- # read -r var val 00:07:57.106 01:02:11 -- accel/accel.sh@21 -- # val= 00:07:57.106 01:02:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.106 01:02:11 -- accel/accel.sh@20 -- # IFS=: 00:07:57.106 01:02:11 -- accel/accel.sh@20 -- # read -r var val 00:07:57.106 01:02:11 -- accel/accel.sh@21 -- # val= 00:07:57.106 01:02:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:57.106 01:02:11 -- accel/accel.sh@20 -- # IFS=: 00:07:57.106 01:02:11 -- accel/accel.sh@20 -- # read -r var val 00:07:57.106 01:02:11 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:57.106 01:02:11 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:57.106 01:02:11 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:57.106 00:07:57.106 real 0m2.813s 00:07:57.106 user 0m2.512s 00:07:57.106 sys 0m0.295s 00:07:57.106 01:02:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:57.106 01:02:11 -- common/autotest_common.sh@10 -- # set +x 00:07:57.106 ************************************ 00:07:57.106 END TEST accel_decomp 00:07:57.106 ************************************ 00:07:57.365 01:02:11 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:57.365 01:02:11 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:57.365 01:02:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:57.365 01:02:11 -- common/autotest_common.sh@10 -- # set +x 00:07:57.365 ************************************ 00:07:57.365 START TEST accel_decmop_full 00:07:57.365 ************************************ 00:07:57.365 01:02:11 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:57.365 01:02:11 -- accel/accel.sh@16 -- # local accel_opc 00:07:57.365 01:02:11 -- accel/accel.sh@17 -- # local accel_module 00:07:57.365 01:02:11 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:57.365 01:02:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:57.365 01:02:11 -- accel/accel.sh@12 -- # build_accel_config 00:07:57.365 01:02:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:57.365 01:02:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:57.365 01:02:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:57.365 01:02:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:57.365 01:02:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:57.365 01:02:11 -- accel/accel.sh@41 -- # local IFS=, 00:07:57.365 01:02:11 -- accel/accel.sh@42 -- # jq -r . 00:07:57.365 [2024-11-28 01:02:11.735325] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:57.365 [2024-11-28 01:02:11.735406] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1926868 ] 00:07:57.365 EAL: No free 2048 kB hugepages reported on node 1 00:07:57.365 [2024-11-28 01:02:11.797377] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:57.365 [2024-11-28 01:02:11.886270] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:58.738 01:02:13 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:58.738 00:07:58.738 SPDK Configuration: 00:07:58.738 Core mask: 0x1 00:07:58.738 00:07:58.738 Accel Perf Configuration: 00:07:58.738 Workload Type: decompress 00:07:58.738 Transfer size: 111250 bytes 00:07:58.738 Vector count 1 00:07:58.738 Module: software 00:07:58.738 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:58.738 Queue depth: 32 00:07:58.738 Allocate depth: 32 00:07:58.738 # threads/core: 1 00:07:58.738 Run time: 1 seconds 00:07:58.738 Verify: Yes 00:07:58.738 00:07:58.738 Running for 1 seconds... 00:07:58.738 00:07:58.738 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:58.738 ------------------------------------------------------------------------------------ 00:07:58.738 0,0 3808/s 157 MiB/s 0 0 00:07:58.738 ==================================================================================== 00:07:58.738 Total 3808/s 404 MiB/s 0 0' 00:07:58.738 01:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:58.738 01:02:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:58.738 01:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:58.738 01:02:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:58.738 01:02:13 -- accel/accel.sh@12 -- # build_accel_config 00:07:58.738 01:02:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:58.738 01:02:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:58.738 01:02:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:58.738 01:02:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:58.738 01:02:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:58.738 01:02:13 -- accel/accel.sh@41 -- # local IFS=, 00:07:58.738 01:02:13 -- accel/accel.sh@42 -- # jq -r . 00:07:58.738 [2024-11-28 01:02:13.157910] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:58.738 [2024-11-28 01:02:13.157994] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1927008 ] 00:07:58.738 EAL: No free 2048 kB hugepages reported on node 1 00:07:58.738 [2024-11-28 01:02:13.224537] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:58.738 [2024-11-28 01:02:13.318184] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:58.996 01:02:13 -- accel/accel.sh@21 -- # val= 00:07:58.996 01:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:58.996 01:02:13 -- accel/accel.sh@21 -- # val= 00:07:58.996 01:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:58.996 01:02:13 -- accel/accel.sh@21 -- # val= 00:07:58.996 01:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:58.996 01:02:13 -- accel/accel.sh@21 -- # val=0x1 00:07:58.996 01:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:58.996 01:02:13 -- accel/accel.sh@21 -- # val= 00:07:58.996 01:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:58.996 01:02:13 -- accel/accel.sh@21 -- # val= 00:07:58.996 01:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:58.996 01:02:13 -- accel/accel.sh@21 -- # val=decompress 00:07:58.996 01:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.996 01:02:13 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:58.996 01:02:13 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:58.996 01:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:58.996 01:02:13 -- accel/accel.sh@21 -- # val= 00:07:58.996 01:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:58.996 01:02:13 -- accel/accel.sh@21 -- # val=software 00:07:58.996 01:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.996 01:02:13 -- accel/accel.sh@23 -- # accel_module=software 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:58.996 01:02:13 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:58.996 01:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:58.996 01:02:13 -- accel/accel.sh@21 -- # val=32 00:07:58.996 01:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:58.996 01:02:13 -- accel/accel.sh@21 -- # val=32 00:07:58.996 01:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:58.996 01:02:13 -- accel/accel.sh@21 -- # val=1 00:07:58.996 01:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:58.996 01:02:13 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:58.996 01:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:58.996 01:02:13 -- accel/accel.sh@21 -- # val=Yes 00:07:58.996 01:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:58.996 01:02:13 -- accel/accel.sh@21 -- # val= 00:07:58.996 01:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:58.996 01:02:13 -- accel/accel.sh@21 -- # val= 00:07:58.996 01:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:58.996 01:02:13 -- accel/accel.sh@20 -- # read -r var val 00:08:00.369 01:02:14 -- accel/accel.sh@21 -- # val= 00:08:00.369 01:02:14 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.369 01:02:14 -- accel/accel.sh@20 -- # IFS=: 00:08:00.369 01:02:14 -- accel/accel.sh@20 -- # read -r var val 00:08:00.369 01:02:14 -- accel/accel.sh@21 -- # val= 00:08:00.369 01:02:14 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.369 01:02:14 -- accel/accel.sh@20 -- # IFS=: 00:08:00.369 01:02:14 -- accel/accel.sh@20 -- # read -r var val 00:08:00.369 01:02:14 -- accel/accel.sh@21 -- # val= 00:08:00.369 01:02:14 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.369 01:02:14 -- accel/accel.sh@20 -- # IFS=: 00:08:00.369 01:02:14 -- accel/accel.sh@20 -- # read -r var val 00:08:00.369 01:02:14 -- accel/accel.sh@21 -- # val= 00:08:00.369 01:02:14 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.369 01:02:14 -- accel/accel.sh@20 -- # IFS=: 00:08:00.369 01:02:14 -- accel/accel.sh@20 -- # read -r var val 00:08:00.369 01:02:14 -- accel/accel.sh@21 -- # val= 00:08:00.369 01:02:14 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.369 01:02:14 -- accel/accel.sh@20 -- # IFS=: 00:08:00.369 01:02:14 -- accel/accel.sh@20 -- # read -r var val 00:08:00.369 01:02:14 -- accel/accel.sh@21 -- # val= 00:08:00.369 01:02:14 -- accel/accel.sh@22 -- # case "$var" in 00:08:00.369 01:02:14 -- accel/accel.sh@20 -- # IFS=: 00:08:00.369 01:02:14 -- accel/accel.sh@20 -- # read -r var val 00:08:00.369 01:02:14 -- accel/accel.sh@28 -- # [[ -n software ]] 00:08:00.369 01:02:14 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:08:00.370 01:02:14 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:00.370 00:08:00.370 real 0m2.839s 00:08:00.370 user 0m2.542s 00:08:00.370 sys 0m0.289s 00:08:00.370 01:02:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:00.370 01:02:14 -- common/autotest_common.sh@10 -- # set +x 00:08:00.370 ************************************ 00:08:00.370 END TEST accel_decmop_full 00:08:00.370 ************************************ 00:08:00.370 01:02:14 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:08:00.370 01:02:14 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:08:00.370 01:02:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:00.370 01:02:14 -- common/autotest_common.sh@10 -- # set +x 00:08:00.370 ************************************ 00:08:00.370 START TEST accel_decomp_mcore 00:08:00.370 ************************************ 00:08:00.370 01:02:14 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:08:00.370 01:02:14 -- accel/accel.sh@16 -- # local accel_opc 00:08:00.370 01:02:14 -- accel/accel.sh@17 -- # local accel_module 00:08:00.370 01:02:14 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:08:00.370 01:02:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:08:00.370 01:02:14 -- accel/accel.sh@12 -- # build_accel_config 00:08:00.370 01:02:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:00.370 01:02:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:00.370 01:02:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:00.370 01:02:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:00.370 01:02:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:00.370 01:02:14 -- accel/accel.sh@41 -- # local IFS=, 00:08:00.370 01:02:14 -- accel/accel.sh@42 -- # jq -r . 00:08:00.370 [2024-11-28 01:02:14.602128] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:00.370 [2024-11-28 01:02:14.602210] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1927171 ] 00:08:00.370 EAL: No free 2048 kB hugepages reported on node 1 00:08:00.370 [2024-11-28 01:02:14.669287] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:00.370 [2024-11-28 01:02:14.766743] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:00.370 [2024-11-28 01:02:14.766797] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:00.370 [2024-11-28 01:02:14.766850] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:00.370 [2024-11-28 01:02:14.766854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:01.743 01:02:16 -- accel/accel.sh@18 -- # out='Preparing input file... 00:08:01.743 00:08:01.743 SPDK Configuration: 00:08:01.743 Core mask: 0xf 00:08:01.743 00:08:01.743 Accel Perf Configuration: 00:08:01.743 Workload Type: decompress 00:08:01.743 Transfer size: 4096 bytes 00:08:01.743 Vector count 1 00:08:01.743 Module: software 00:08:01.743 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:01.743 Queue depth: 32 00:08:01.743 Allocate depth: 32 00:08:01.743 # threads/core: 1 00:08:01.743 Run time: 1 seconds 00:08:01.743 Verify: Yes 00:08:01.743 00:08:01.743 Running for 1 seconds... 00:08:01.743 00:08:01.743 Core,Thread Transfers Bandwidth Failed Miscompares 00:08:01.743 ------------------------------------------------------------------------------------ 00:08:01.743 0,0 50368/s 92 MiB/s 0 0 00:08:01.743 3,0 50656/s 93 MiB/s 0 0 00:08:01.743 2,0 50560/s 93 MiB/s 0 0 00:08:01.743 1,0 50592/s 93 MiB/s 0 0 00:08:01.743 ==================================================================================== 00:08:01.743 Total 202176/s 789 MiB/s 0 0' 00:08:01.743 01:02:16 -- accel/accel.sh@20 -- # IFS=: 00:08:01.743 01:02:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:08:01.743 01:02:16 -- accel/accel.sh@20 -- # read -r var val 00:08:01.743 01:02:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:08:01.743 01:02:16 -- accel/accel.sh@12 -- # build_accel_config 00:08:01.743 01:02:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:01.743 01:02:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:01.743 01:02:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:01.743 01:02:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:01.743 01:02:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:01.743 01:02:16 -- accel/accel.sh@41 -- # local IFS=, 00:08:01.743 01:02:16 -- accel/accel.sh@42 -- # jq -r . 00:08:01.743 [2024-11-28 01:02:16.035030] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:01.743 [2024-11-28 01:02:16.035107] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1927318 ] 00:08:01.743 EAL: No free 2048 kB hugepages reported on node 1 00:08:01.743 [2024-11-28 01:02:16.098891] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:01.743 [2024-11-28 01:02:16.197535] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:01.743 [2024-11-28 01:02:16.197598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:01.743 [2024-11-28 01:02:16.197601] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:01.743 [2024-11-28 01:02:16.197568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:01.743 01:02:16 -- accel/accel.sh@21 -- # val= 00:08:01.743 01:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.743 01:02:16 -- accel/accel.sh@20 -- # IFS=: 00:08:01.743 01:02:16 -- accel/accel.sh@20 -- # read -r var val 00:08:01.743 01:02:16 -- accel/accel.sh@21 -- # val= 00:08:01.743 01:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.743 01:02:16 -- accel/accel.sh@20 -- # IFS=: 00:08:01.743 01:02:16 -- accel/accel.sh@20 -- # read -r var val 00:08:01.743 01:02:16 -- accel/accel.sh@21 -- # val= 00:08:01.743 01:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.743 01:02:16 -- accel/accel.sh@20 -- # IFS=: 00:08:01.743 01:02:16 -- accel/accel.sh@20 -- # read -r var val 00:08:01.743 01:02:16 -- accel/accel.sh@21 -- # val=0xf 00:08:01.743 01:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.743 01:02:16 -- accel/accel.sh@20 -- # IFS=: 00:08:01.743 01:02:16 -- accel/accel.sh@20 -- # read -r var val 00:08:01.743 01:02:16 -- accel/accel.sh@21 -- # val= 00:08:01.743 01:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.743 01:02:16 -- accel/accel.sh@20 -- # IFS=: 00:08:01.743 01:02:16 -- accel/accel.sh@20 -- # read -r var val 00:08:01.743 01:02:16 -- accel/accel.sh@21 -- # val= 00:08:01.743 01:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.743 01:02:16 -- accel/accel.sh@20 -- # IFS=: 00:08:01.743 01:02:16 -- accel/accel.sh@20 -- # read -r var val 00:08:01.743 01:02:16 -- accel/accel.sh@21 -- # val=decompress 00:08:01.743 01:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.743 01:02:16 -- accel/accel.sh@24 -- # accel_opc=decompress 00:08:01.743 01:02:16 -- accel/accel.sh@20 -- # IFS=: 00:08:01.743 01:02:16 -- accel/accel.sh@20 -- # read -r var val 00:08:01.743 01:02:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:08:01.743 01:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.743 01:02:16 -- accel/accel.sh@20 -- # IFS=: 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # read -r var val 00:08:01.744 01:02:16 -- accel/accel.sh@21 -- # val= 00:08:01.744 01:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # IFS=: 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # read -r var val 00:08:01.744 01:02:16 -- accel/accel.sh@21 -- # val=software 00:08:01.744 01:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.744 01:02:16 -- accel/accel.sh@23 -- # accel_module=software 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # IFS=: 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # read -r var val 00:08:01.744 01:02:16 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:01.744 01:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # IFS=: 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # read -r var val 00:08:01.744 01:02:16 -- accel/accel.sh@21 -- # val=32 00:08:01.744 01:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # IFS=: 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # read -r var val 00:08:01.744 01:02:16 -- accel/accel.sh@21 -- # val=32 00:08:01.744 01:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # IFS=: 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # read -r var val 00:08:01.744 01:02:16 -- accel/accel.sh@21 -- # val=1 00:08:01.744 01:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # IFS=: 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # read -r var val 00:08:01.744 01:02:16 -- accel/accel.sh@21 -- # val='1 seconds' 00:08:01.744 01:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # IFS=: 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # read -r var val 00:08:01.744 01:02:16 -- accel/accel.sh@21 -- # val=Yes 00:08:01.744 01:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # IFS=: 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # read -r var val 00:08:01.744 01:02:16 -- accel/accel.sh@21 -- # val= 00:08:01.744 01:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # IFS=: 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # read -r var val 00:08:01.744 01:02:16 -- accel/accel.sh@21 -- # val= 00:08:01.744 01:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # IFS=: 00:08:01.744 01:02:16 -- accel/accel.sh@20 -- # read -r var val 00:08:03.117 01:02:17 -- accel/accel.sh@21 -- # val= 00:08:03.117 01:02:17 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.117 01:02:17 -- accel/accel.sh@20 -- # IFS=: 00:08:03.117 01:02:17 -- accel/accel.sh@20 -- # read -r var val 00:08:03.117 01:02:17 -- accel/accel.sh@21 -- # val= 00:08:03.117 01:02:17 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.117 01:02:17 -- accel/accel.sh@20 -- # IFS=: 00:08:03.117 01:02:17 -- accel/accel.sh@20 -- # read -r var val 00:08:03.117 01:02:17 -- accel/accel.sh@21 -- # val= 00:08:03.117 01:02:17 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.117 01:02:17 -- accel/accel.sh@20 -- # IFS=: 00:08:03.117 01:02:17 -- accel/accel.sh@20 -- # read -r var val 00:08:03.117 01:02:17 -- accel/accel.sh@21 -- # val= 00:08:03.117 01:02:17 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.117 01:02:17 -- accel/accel.sh@20 -- # IFS=: 00:08:03.117 01:02:17 -- accel/accel.sh@20 -- # read -r var val 00:08:03.117 01:02:17 -- accel/accel.sh@21 -- # val= 00:08:03.118 01:02:17 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.118 01:02:17 -- accel/accel.sh@20 -- # IFS=: 00:08:03.118 01:02:17 -- accel/accel.sh@20 -- # read -r var val 00:08:03.118 01:02:17 -- accel/accel.sh@21 -- # val= 00:08:03.118 01:02:17 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.118 01:02:17 -- accel/accel.sh@20 -- # IFS=: 00:08:03.118 01:02:17 -- accel/accel.sh@20 -- # read -r var val 00:08:03.118 01:02:17 -- accel/accel.sh@21 -- # val= 00:08:03.118 01:02:17 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.118 01:02:17 -- accel/accel.sh@20 -- # IFS=: 00:08:03.118 01:02:17 -- accel/accel.sh@20 -- # read -r var val 00:08:03.118 01:02:17 -- accel/accel.sh@21 -- # val= 00:08:03.118 01:02:17 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.118 01:02:17 -- accel/accel.sh@20 -- # IFS=: 00:08:03.118 01:02:17 -- accel/accel.sh@20 -- # read -r var val 00:08:03.118 01:02:17 -- accel/accel.sh@21 -- # val= 00:08:03.118 01:02:17 -- accel/accel.sh@22 -- # case "$var" in 00:08:03.118 01:02:17 -- accel/accel.sh@20 -- # IFS=: 00:08:03.118 01:02:17 -- accel/accel.sh@20 -- # read -r var val 00:08:03.118 01:02:17 -- accel/accel.sh@28 -- # [[ -n software ]] 00:08:03.118 01:02:17 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:08:03.118 01:02:17 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:03.118 00:08:03.118 real 0m2.857s 00:08:03.118 user 0m9.475s 00:08:03.118 sys 0m0.308s 00:08:03.118 01:02:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:03.118 01:02:17 -- common/autotest_common.sh@10 -- # set +x 00:08:03.118 ************************************ 00:08:03.118 END TEST accel_decomp_mcore 00:08:03.118 ************************************ 00:08:03.118 01:02:17 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:08:03.118 01:02:17 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:08:03.118 01:02:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:03.118 01:02:17 -- common/autotest_common.sh@10 -- # set +x 00:08:03.118 ************************************ 00:08:03.118 START TEST accel_decomp_full_mcore 00:08:03.118 ************************************ 00:08:03.118 01:02:17 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:08:03.118 01:02:17 -- accel/accel.sh@16 -- # local accel_opc 00:08:03.118 01:02:17 -- accel/accel.sh@17 -- # local accel_module 00:08:03.118 01:02:17 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:08:03.118 01:02:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:08:03.118 01:02:17 -- accel/accel.sh@12 -- # build_accel_config 00:08:03.118 01:02:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:03.118 01:02:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:03.118 01:02:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:03.118 01:02:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:03.118 01:02:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:03.118 01:02:17 -- accel/accel.sh@41 -- # local IFS=, 00:08:03.118 01:02:17 -- accel/accel.sh@42 -- # jq -r . 00:08:03.118 [2024-11-28 01:02:17.487644] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:03.118 [2024-11-28 01:02:17.487726] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1927595 ] 00:08:03.118 EAL: No free 2048 kB hugepages reported on node 1 00:08:03.118 [2024-11-28 01:02:17.548940] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:03.118 [2024-11-28 01:02:17.646234] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:03.118 [2024-11-28 01:02:17.646290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:03.118 [2024-11-28 01:02:17.646342] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:03.118 [2024-11-28 01:02:17.646345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:04.488 01:02:18 -- accel/accel.sh@18 -- # out='Preparing input file... 00:08:04.488 00:08:04.488 SPDK Configuration: 00:08:04.488 Core mask: 0xf 00:08:04.488 00:08:04.488 Accel Perf Configuration: 00:08:04.488 Workload Type: decompress 00:08:04.488 Transfer size: 111250 bytes 00:08:04.488 Vector count 1 00:08:04.488 Module: software 00:08:04.488 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:04.488 Queue depth: 32 00:08:04.488 Allocate depth: 32 00:08:04.488 # threads/core: 1 00:08:04.488 Run time: 1 seconds 00:08:04.488 Verify: Yes 00:08:04.488 00:08:04.488 Running for 1 seconds... 00:08:04.488 00:08:04.488 Core,Thread Transfers Bandwidth Failed Miscompares 00:08:04.488 ------------------------------------------------------------------------------------ 00:08:04.488 0,0 4224/s 174 MiB/s 0 0 00:08:04.488 3,0 4224/s 174 MiB/s 0 0 00:08:04.488 2,0 4224/s 174 MiB/s 0 0 00:08:04.488 1,0 4224/s 174 MiB/s 0 0 00:08:04.488 ==================================================================================== 00:08:04.488 Total 16896/s 1792 MiB/s 0 0' 00:08:04.488 01:02:18 -- accel/accel.sh@20 -- # IFS=: 00:08:04.488 01:02:18 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:08:04.488 01:02:18 -- accel/accel.sh@20 -- # read -r var val 00:08:04.488 01:02:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:08:04.488 01:02:18 -- accel/accel.sh@12 -- # build_accel_config 00:08:04.488 01:02:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:04.488 01:02:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:04.488 01:02:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:04.488 01:02:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:04.488 01:02:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:04.488 01:02:18 -- accel/accel.sh@41 -- # local IFS=, 00:08:04.488 01:02:18 -- accel/accel.sh@42 -- # jq -r . 00:08:04.488 [2024-11-28 01:02:18.913887] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:04.488 [2024-11-28 01:02:18.913979] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1927744 ] 00:08:04.488 EAL: No free 2048 kB hugepages reported on node 1 00:08:04.488 [2024-11-28 01:02:18.976666] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:04.488 [2024-11-28 01:02:19.072595] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:04.488 [2024-11-28 01:02:19.072652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:04.488 [2024-11-28 01:02:19.072704] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:04.488 [2024-11-28 01:02:19.072708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:04.746 01:02:19 -- accel/accel.sh@21 -- # val= 00:08:04.746 01:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # IFS=: 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # read -r var val 00:08:04.746 01:02:19 -- accel/accel.sh@21 -- # val= 00:08:04.746 01:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # IFS=: 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # read -r var val 00:08:04.746 01:02:19 -- accel/accel.sh@21 -- # val= 00:08:04.746 01:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # IFS=: 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # read -r var val 00:08:04.746 01:02:19 -- accel/accel.sh@21 -- # val=0xf 00:08:04.746 01:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # IFS=: 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # read -r var val 00:08:04.746 01:02:19 -- accel/accel.sh@21 -- # val= 00:08:04.746 01:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # IFS=: 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # read -r var val 00:08:04.746 01:02:19 -- accel/accel.sh@21 -- # val= 00:08:04.746 01:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # IFS=: 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # read -r var val 00:08:04.746 01:02:19 -- accel/accel.sh@21 -- # val=decompress 00:08:04.746 01:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.746 01:02:19 -- accel/accel.sh@24 -- # accel_opc=decompress 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # IFS=: 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # read -r var val 00:08:04.746 01:02:19 -- accel/accel.sh@21 -- # val='111250 bytes' 00:08:04.746 01:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # IFS=: 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # read -r var val 00:08:04.746 01:02:19 -- accel/accel.sh@21 -- # val= 00:08:04.746 01:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # IFS=: 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # read -r var val 00:08:04.746 01:02:19 -- accel/accel.sh@21 -- # val=software 00:08:04.746 01:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.746 01:02:19 -- accel/accel.sh@23 -- # accel_module=software 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # IFS=: 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # read -r var val 00:08:04.746 01:02:19 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:04.746 01:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # IFS=: 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # read -r var val 00:08:04.746 01:02:19 -- accel/accel.sh@21 -- # val=32 00:08:04.746 01:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # IFS=: 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # read -r var val 00:08:04.746 01:02:19 -- accel/accel.sh@21 -- # val=32 00:08:04.746 01:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # IFS=: 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # read -r var val 00:08:04.746 01:02:19 -- accel/accel.sh@21 -- # val=1 00:08:04.746 01:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # IFS=: 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # read -r var val 00:08:04.746 01:02:19 -- accel/accel.sh@21 -- # val='1 seconds' 00:08:04.746 01:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # IFS=: 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # read -r var val 00:08:04.746 01:02:19 -- accel/accel.sh@21 -- # val=Yes 00:08:04.746 01:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # IFS=: 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # read -r var val 00:08:04.746 01:02:19 -- accel/accel.sh@21 -- # val= 00:08:04.746 01:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # IFS=: 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # read -r var val 00:08:04.746 01:02:19 -- accel/accel.sh@21 -- # val= 00:08:04.746 01:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # IFS=: 00:08:04.746 01:02:19 -- accel/accel.sh@20 -- # read -r var val 00:08:06.118 01:02:20 -- accel/accel.sh@21 -- # val= 00:08:06.119 01:02:20 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.119 01:02:20 -- accel/accel.sh@20 -- # IFS=: 00:08:06.119 01:02:20 -- accel/accel.sh@20 -- # read -r var val 00:08:06.119 01:02:20 -- accel/accel.sh@21 -- # val= 00:08:06.119 01:02:20 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.119 01:02:20 -- accel/accel.sh@20 -- # IFS=: 00:08:06.119 01:02:20 -- accel/accel.sh@20 -- # read -r var val 00:08:06.119 01:02:20 -- accel/accel.sh@21 -- # val= 00:08:06.119 01:02:20 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.119 01:02:20 -- accel/accel.sh@20 -- # IFS=: 00:08:06.119 01:02:20 -- accel/accel.sh@20 -- # read -r var val 00:08:06.119 01:02:20 -- accel/accel.sh@21 -- # val= 00:08:06.119 01:02:20 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.119 01:02:20 -- accel/accel.sh@20 -- # IFS=: 00:08:06.119 01:02:20 -- accel/accel.sh@20 -- # read -r var val 00:08:06.119 01:02:20 -- accel/accel.sh@21 -- # val= 00:08:06.119 01:02:20 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.119 01:02:20 -- accel/accel.sh@20 -- # IFS=: 00:08:06.119 01:02:20 -- accel/accel.sh@20 -- # read -r var val 00:08:06.119 01:02:20 -- accel/accel.sh@21 -- # val= 00:08:06.119 01:02:20 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.119 01:02:20 -- accel/accel.sh@20 -- # IFS=: 00:08:06.119 01:02:20 -- accel/accel.sh@20 -- # read -r var val 00:08:06.119 01:02:20 -- accel/accel.sh@21 -- # val= 00:08:06.119 01:02:20 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.119 01:02:20 -- accel/accel.sh@20 -- # IFS=: 00:08:06.119 01:02:20 -- accel/accel.sh@20 -- # read -r var val 00:08:06.119 01:02:20 -- accel/accel.sh@21 -- # val= 00:08:06.119 01:02:20 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.119 01:02:20 -- accel/accel.sh@20 -- # IFS=: 00:08:06.119 01:02:20 -- accel/accel.sh@20 -- # read -r var val 00:08:06.119 01:02:20 -- accel/accel.sh@21 -- # val= 00:08:06.119 01:02:20 -- accel/accel.sh@22 -- # case "$var" in 00:08:06.119 01:02:20 -- accel/accel.sh@20 -- # IFS=: 00:08:06.119 01:02:20 -- accel/accel.sh@20 -- # read -r var val 00:08:06.119 01:02:20 -- accel/accel.sh@28 -- # [[ -n software ]] 00:08:06.119 01:02:20 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:08:06.119 01:02:20 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:06.119 00:08:06.119 real 0m2.846s 00:08:06.119 user 0m9.475s 00:08:06.119 sys 0m0.315s 00:08:06.119 01:02:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:06.119 01:02:20 -- common/autotest_common.sh@10 -- # set +x 00:08:06.119 ************************************ 00:08:06.119 END TEST accel_decomp_full_mcore 00:08:06.119 ************************************ 00:08:06.119 01:02:20 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:08:06.119 01:02:20 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:08:06.119 01:02:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:06.119 01:02:20 -- common/autotest_common.sh@10 -- # set +x 00:08:06.119 ************************************ 00:08:06.119 START TEST accel_decomp_mthread 00:08:06.119 ************************************ 00:08:06.119 01:02:20 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:08:06.119 01:02:20 -- accel/accel.sh@16 -- # local accel_opc 00:08:06.119 01:02:20 -- accel/accel.sh@17 -- # local accel_module 00:08:06.119 01:02:20 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:08:06.119 01:02:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:08:06.119 01:02:20 -- accel/accel.sh@12 -- # build_accel_config 00:08:06.119 01:02:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:06.119 01:02:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:06.119 01:02:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:06.119 01:02:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:06.119 01:02:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:06.119 01:02:20 -- accel/accel.sh@41 -- # local IFS=, 00:08:06.119 01:02:20 -- accel/accel.sh@42 -- # jq -r . 00:08:06.119 [2024-11-28 01:02:20.360843] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:06.119 [2024-11-28 01:02:20.360924] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1927910 ] 00:08:06.119 EAL: No free 2048 kB hugepages reported on node 1 00:08:06.119 [2024-11-28 01:02:20.425187] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:06.119 [2024-11-28 01:02:20.519474] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:07.491 01:02:21 -- accel/accel.sh@18 -- # out='Preparing input file... 00:08:07.491 00:08:07.491 SPDK Configuration: 00:08:07.491 Core mask: 0x1 00:08:07.491 00:08:07.491 Accel Perf Configuration: 00:08:07.491 Workload Type: decompress 00:08:07.491 Transfer size: 4096 bytes 00:08:07.491 Vector count 1 00:08:07.491 Module: software 00:08:07.491 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:07.491 Queue depth: 32 00:08:07.491 Allocate depth: 32 00:08:07.491 # threads/core: 2 00:08:07.491 Run time: 1 seconds 00:08:07.491 Verify: Yes 00:08:07.491 00:08:07.491 Running for 1 seconds... 00:08:07.491 00:08:07.491 Core,Thread Transfers Bandwidth Failed Miscompares 00:08:07.491 ------------------------------------------------------------------------------------ 00:08:07.491 0,1 28096/s 51 MiB/s 0 0 00:08:07.491 0,0 27968/s 51 MiB/s 0 0 00:08:07.491 ==================================================================================== 00:08:07.491 Total 56064/s 219 MiB/s 0 0' 00:08:07.491 01:02:21 -- accel/accel.sh@20 -- # IFS=: 00:08:07.491 01:02:21 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:08:07.491 01:02:21 -- accel/accel.sh@20 -- # read -r var val 00:08:07.492 01:02:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:08:07.492 01:02:21 -- accel/accel.sh@12 -- # build_accel_config 00:08:07.492 01:02:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:07.492 01:02:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:07.492 01:02:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:07.492 01:02:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:07.492 01:02:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:07.492 01:02:21 -- accel/accel.sh@41 -- # local IFS=, 00:08:07.492 01:02:21 -- accel/accel.sh@42 -- # jq -r . 00:08:07.492 [2024-11-28 01:02:21.784838] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:07.492 [2024-11-28 01:02:21.784920] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1928054 ] 00:08:07.492 EAL: No free 2048 kB hugepages reported on node 1 00:08:07.492 [2024-11-28 01:02:21.848870] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:07.492 [2024-11-28 01:02:21.940890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:07.492 01:02:22 -- accel/accel.sh@21 -- # val= 00:08:07.492 01:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # IFS=: 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # read -r var val 00:08:07.492 01:02:22 -- accel/accel.sh@21 -- # val= 00:08:07.492 01:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # IFS=: 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # read -r var val 00:08:07.492 01:02:22 -- accel/accel.sh@21 -- # val= 00:08:07.492 01:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # IFS=: 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # read -r var val 00:08:07.492 01:02:22 -- accel/accel.sh@21 -- # val=0x1 00:08:07.492 01:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # IFS=: 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # read -r var val 00:08:07.492 01:02:22 -- accel/accel.sh@21 -- # val= 00:08:07.492 01:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # IFS=: 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # read -r var val 00:08:07.492 01:02:22 -- accel/accel.sh@21 -- # val= 00:08:07.492 01:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # IFS=: 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # read -r var val 00:08:07.492 01:02:22 -- accel/accel.sh@21 -- # val=decompress 00:08:07.492 01:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:08:07.492 01:02:22 -- accel/accel.sh@24 -- # accel_opc=decompress 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # IFS=: 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # read -r var val 00:08:07.492 01:02:22 -- accel/accel.sh@21 -- # val='4096 bytes' 00:08:07.492 01:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # IFS=: 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # read -r var val 00:08:07.492 01:02:22 -- accel/accel.sh@21 -- # val= 00:08:07.492 01:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # IFS=: 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # read -r var val 00:08:07.492 01:02:22 -- accel/accel.sh@21 -- # val=software 00:08:07.492 01:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:08:07.492 01:02:22 -- accel/accel.sh@23 -- # accel_module=software 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # IFS=: 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # read -r var val 00:08:07.492 01:02:22 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:07.492 01:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # IFS=: 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # read -r var val 00:08:07.492 01:02:22 -- accel/accel.sh@21 -- # val=32 00:08:07.492 01:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # IFS=: 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # read -r var val 00:08:07.492 01:02:22 -- accel/accel.sh@21 -- # val=32 00:08:07.492 01:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # IFS=: 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # read -r var val 00:08:07.492 01:02:22 -- accel/accel.sh@21 -- # val=2 00:08:07.492 01:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # IFS=: 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # read -r var val 00:08:07.492 01:02:22 -- accel/accel.sh@21 -- # val='1 seconds' 00:08:07.492 01:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # IFS=: 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # read -r var val 00:08:07.492 01:02:22 -- accel/accel.sh@21 -- # val=Yes 00:08:07.492 01:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # IFS=: 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # read -r var val 00:08:07.492 01:02:22 -- accel/accel.sh@21 -- # val= 00:08:07.492 01:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # IFS=: 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # read -r var val 00:08:07.492 01:02:22 -- accel/accel.sh@21 -- # val= 00:08:07.492 01:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # IFS=: 00:08:07.492 01:02:22 -- accel/accel.sh@20 -- # read -r var val 00:08:08.920 01:02:23 -- accel/accel.sh@21 -- # val= 00:08:08.920 01:02:23 -- accel/accel.sh@22 -- # case "$var" in 00:08:08.920 01:02:23 -- accel/accel.sh@20 -- # IFS=: 00:08:08.920 01:02:23 -- accel/accel.sh@20 -- # read -r var val 00:08:08.920 01:02:23 -- accel/accel.sh@21 -- # val= 00:08:08.920 01:02:23 -- accel/accel.sh@22 -- # case "$var" in 00:08:08.920 01:02:23 -- accel/accel.sh@20 -- # IFS=: 00:08:08.920 01:02:23 -- accel/accel.sh@20 -- # read -r var val 00:08:08.920 01:02:23 -- accel/accel.sh@21 -- # val= 00:08:08.920 01:02:23 -- accel/accel.sh@22 -- # case "$var" in 00:08:08.920 01:02:23 -- accel/accel.sh@20 -- # IFS=: 00:08:08.920 01:02:23 -- accel/accel.sh@20 -- # read -r var val 00:08:08.921 01:02:23 -- accel/accel.sh@21 -- # val= 00:08:08.921 01:02:23 -- accel/accel.sh@22 -- # case "$var" in 00:08:08.921 01:02:23 -- accel/accel.sh@20 -- # IFS=: 00:08:08.921 01:02:23 -- accel/accel.sh@20 -- # read -r var val 00:08:08.921 01:02:23 -- accel/accel.sh@21 -- # val= 00:08:08.921 01:02:23 -- accel/accel.sh@22 -- # case "$var" in 00:08:08.921 01:02:23 -- accel/accel.sh@20 -- # IFS=: 00:08:08.921 01:02:23 -- accel/accel.sh@20 -- # read -r var val 00:08:08.921 01:02:23 -- accel/accel.sh@21 -- # val= 00:08:08.921 01:02:23 -- accel/accel.sh@22 -- # case "$var" in 00:08:08.921 01:02:23 -- accel/accel.sh@20 -- # IFS=: 00:08:08.921 01:02:23 -- accel/accel.sh@20 -- # read -r var val 00:08:08.921 01:02:23 -- accel/accel.sh@21 -- # val= 00:08:08.921 01:02:23 -- accel/accel.sh@22 -- # case "$var" in 00:08:08.921 01:02:23 -- accel/accel.sh@20 -- # IFS=: 00:08:08.921 01:02:23 -- accel/accel.sh@20 -- # read -r var val 00:08:08.921 01:02:23 -- accel/accel.sh@28 -- # [[ -n software ]] 00:08:08.921 01:02:23 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:08:08.921 01:02:23 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:08.921 00:08:08.921 real 0m2.844s 00:08:08.921 user 0m2.530s 00:08:08.921 sys 0m0.308s 00:08:08.921 01:02:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:08.921 01:02:23 -- common/autotest_common.sh@10 -- # set +x 00:08:08.921 ************************************ 00:08:08.921 END TEST accel_decomp_mthread 00:08:08.921 ************************************ 00:08:08.921 01:02:23 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:08.921 01:02:23 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:08:08.921 01:02:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:08.921 01:02:23 -- common/autotest_common.sh@10 -- # set +x 00:08:08.921 ************************************ 00:08:08.921 START TEST accel_deomp_full_mthread 00:08:08.921 ************************************ 00:08:08.921 01:02:23 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:08.921 01:02:23 -- accel/accel.sh@16 -- # local accel_opc 00:08:08.921 01:02:23 -- accel/accel.sh@17 -- # local accel_module 00:08:08.921 01:02:23 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:08.921 01:02:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:08.921 01:02:23 -- accel/accel.sh@12 -- # build_accel_config 00:08:08.921 01:02:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:08.921 01:02:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:08.921 01:02:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:08.921 01:02:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:08.921 01:02:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:08.921 01:02:23 -- accel/accel.sh@41 -- # local IFS=, 00:08:08.921 01:02:23 -- accel/accel.sh@42 -- # jq -r . 00:08:08.921 [2024-11-28 01:02:23.230954] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:08.921 [2024-11-28 01:02:23.231036] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1928331 ] 00:08:08.921 EAL: No free 2048 kB hugepages reported on node 1 00:08:08.921 [2024-11-28 01:02:23.293627] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:08.921 [2024-11-28 01:02:23.387464] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:10.310 01:02:24 -- accel/accel.sh@18 -- # out='Preparing input file... 00:08:10.310 00:08:10.310 SPDK Configuration: 00:08:10.310 Core mask: 0x1 00:08:10.310 00:08:10.310 Accel Perf Configuration: 00:08:10.310 Workload Type: decompress 00:08:10.310 Transfer size: 111250 bytes 00:08:10.310 Vector count 1 00:08:10.310 Module: software 00:08:10.310 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:10.310 Queue depth: 32 00:08:10.310 Allocate depth: 32 00:08:10.310 # threads/core: 2 00:08:10.310 Run time: 1 seconds 00:08:10.310 Verify: Yes 00:08:10.310 00:08:10.310 Running for 1 seconds... 00:08:10.310 00:08:10.310 Core,Thread Transfers Bandwidth Failed Miscompares 00:08:10.310 ------------------------------------------------------------------------------------ 00:08:10.310 0,1 1952/s 80 MiB/s 0 0 00:08:10.310 0,0 1920/s 79 MiB/s 0 0 00:08:10.310 ==================================================================================== 00:08:10.310 Total 3872/s 410 MiB/s 0 0' 00:08:10.310 01:02:24 -- accel/accel.sh@20 -- # IFS=: 00:08:10.310 01:02:24 -- accel/accel.sh@20 -- # read -r var val 00:08:10.310 01:02:24 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:10.310 01:02:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:10.310 01:02:24 -- accel/accel.sh@12 -- # build_accel_config 00:08:10.310 01:02:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:10.310 01:02:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:10.310 01:02:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:10.310 01:02:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:10.310 01:02:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:10.310 01:02:24 -- accel/accel.sh@41 -- # local IFS=, 00:08:10.310 01:02:24 -- accel/accel.sh@42 -- # jq -r . 00:08:10.310 [2024-11-28 01:02:24.677593] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:10.310 [2024-11-28 01:02:24.677676] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1928473 ] 00:08:10.310 EAL: No free 2048 kB hugepages reported on node 1 00:08:10.310 [2024-11-28 01:02:24.740368] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:10.310 [2024-11-28 01:02:24.843403] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:10.310 01:02:24 -- accel/accel.sh@21 -- # val= 00:08:10.310 01:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.310 01:02:24 -- accel/accel.sh@20 -- # IFS=: 00:08:10.310 01:02:24 -- accel/accel.sh@20 -- # read -r var val 00:08:10.310 01:02:24 -- accel/accel.sh@21 -- # val= 00:08:10.310 01:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.310 01:02:24 -- accel/accel.sh@20 -- # IFS=: 00:08:10.310 01:02:24 -- accel/accel.sh@20 -- # read -r var val 00:08:10.310 01:02:24 -- accel/accel.sh@21 -- # val= 00:08:10.310 01:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.310 01:02:24 -- accel/accel.sh@20 -- # IFS=: 00:08:10.310 01:02:24 -- accel/accel.sh@20 -- # read -r var val 00:08:10.310 01:02:24 -- accel/accel.sh@21 -- # val=0x1 00:08:10.310 01:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.310 01:02:24 -- accel/accel.sh@20 -- # IFS=: 00:08:10.310 01:02:24 -- accel/accel.sh@20 -- # read -r var val 00:08:10.310 01:02:24 -- accel/accel.sh@21 -- # val= 00:08:10.310 01:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.310 01:02:24 -- accel/accel.sh@20 -- # IFS=: 00:08:10.310 01:02:24 -- accel/accel.sh@20 -- # read -r var val 00:08:10.310 01:02:24 -- accel/accel.sh@21 -- # val= 00:08:10.310 01:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.310 01:02:24 -- accel/accel.sh@20 -- # IFS=: 00:08:10.310 01:02:24 -- accel/accel.sh@20 -- # read -r var val 00:08:10.310 01:02:24 -- accel/accel.sh@21 -- # val=decompress 00:08:10.310 01:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.310 01:02:24 -- accel/accel.sh@24 -- # accel_opc=decompress 00:08:10.566 01:02:24 -- accel/accel.sh@20 -- # IFS=: 00:08:10.566 01:02:24 -- accel/accel.sh@20 -- # read -r var val 00:08:10.566 01:02:24 -- accel/accel.sh@21 -- # val='111250 bytes' 00:08:10.566 01:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.566 01:02:24 -- accel/accel.sh@20 -- # IFS=: 00:08:10.566 01:02:24 -- accel/accel.sh@20 -- # read -r var val 00:08:10.566 01:02:24 -- accel/accel.sh@21 -- # val= 00:08:10.566 01:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.567 01:02:24 -- accel/accel.sh@20 -- # IFS=: 00:08:10.567 01:02:24 -- accel/accel.sh@20 -- # read -r var val 00:08:10.567 01:02:24 -- accel/accel.sh@21 -- # val=software 00:08:10.567 01:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.567 01:02:24 -- accel/accel.sh@23 -- # accel_module=software 00:08:10.567 01:02:24 -- accel/accel.sh@20 -- # IFS=: 00:08:10.567 01:02:24 -- accel/accel.sh@20 -- # read -r var val 00:08:10.567 01:02:24 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:08:10.567 01:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.567 01:02:24 -- accel/accel.sh@20 -- # IFS=: 00:08:10.567 01:02:24 -- accel/accel.sh@20 -- # read -r var val 00:08:10.567 01:02:24 -- accel/accel.sh@21 -- # val=32 00:08:10.567 01:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.567 01:02:24 -- accel/accel.sh@20 -- # IFS=: 00:08:10.567 01:02:24 -- accel/accel.sh@20 -- # read -r var val 00:08:10.567 01:02:24 -- accel/accel.sh@21 -- # val=32 00:08:10.567 01:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.567 01:02:24 -- accel/accel.sh@20 -- # IFS=: 00:08:10.567 01:02:24 -- accel/accel.sh@20 -- # read -r var val 00:08:10.567 01:02:24 -- accel/accel.sh@21 -- # val=2 00:08:10.567 01:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.567 01:02:24 -- accel/accel.sh@20 -- # IFS=: 00:08:10.567 01:02:24 -- accel/accel.sh@20 -- # read -r var val 00:08:10.567 01:02:24 -- accel/accel.sh@21 -- # val='1 seconds' 00:08:10.567 01:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.567 01:02:24 -- accel/accel.sh@20 -- # IFS=: 00:08:10.567 01:02:24 -- accel/accel.sh@20 -- # read -r var val 00:08:10.567 01:02:24 -- accel/accel.sh@21 -- # val=Yes 00:08:10.567 01:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.567 01:02:24 -- accel/accel.sh@20 -- # IFS=: 00:08:10.567 01:02:24 -- accel/accel.sh@20 -- # read -r var val 00:08:10.567 01:02:24 -- accel/accel.sh@21 -- # val= 00:08:10.567 01:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.567 01:02:24 -- accel/accel.sh@20 -- # IFS=: 00:08:10.567 01:02:24 -- accel/accel.sh@20 -- # read -r var val 00:08:10.567 01:02:24 -- accel/accel.sh@21 -- # val= 00:08:10.567 01:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:08:10.567 01:02:24 -- accel/accel.sh@20 -- # IFS=: 00:08:10.567 01:02:24 -- accel/accel.sh@20 -- # read -r var val 00:08:11.935 01:02:26 -- accel/accel.sh@21 -- # val= 00:08:11.935 01:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:11.935 01:02:26 -- accel/accel.sh@20 -- # IFS=: 00:08:11.935 01:02:26 -- accel/accel.sh@20 -- # read -r var val 00:08:11.935 01:02:26 -- accel/accel.sh@21 -- # val= 00:08:11.935 01:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:11.935 01:02:26 -- accel/accel.sh@20 -- # IFS=: 00:08:11.935 01:02:26 -- accel/accel.sh@20 -- # read -r var val 00:08:11.935 01:02:26 -- accel/accel.sh@21 -- # val= 00:08:11.935 01:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:11.935 01:02:26 -- accel/accel.sh@20 -- # IFS=: 00:08:11.935 01:02:26 -- accel/accel.sh@20 -- # read -r var val 00:08:11.935 01:02:26 -- accel/accel.sh@21 -- # val= 00:08:11.935 01:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:11.935 01:02:26 -- accel/accel.sh@20 -- # IFS=: 00:08:11.935 01:02:26 -- accel/accel.sh@20 -- # read -r var val 00:08:11.935 01:02:26 -- accel/accel.sh@21 -- # val= 00:08:11.935 01:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:11.935 01:02:26 -- accel/accel.sh@20 -- # IFS=: 00:08:11.935 01:02:26 -- accel/accel.sh@20 -- # read -r var val 00:08:11.935 01:02:26 -- accel/accel.sh@21 -- # val= 00:08:11.935 01:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:11.935 01:02:26 -- accel/accel.sh@20 -- # IFS=: 00:08:11.935 01:02:26 -- accel/accel.sh@20 -- # read -r var val 00:08:11.935 01:02:26 -- accel/accel.sh@21 -- # val= 00:08:11.935 01:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:08:11.935 01:02:26 -- accel/accel.sh@20 -- # IFS=: 00:08:11.935 01:02:26 -- accel/accel.sh@20 -- # read -r var val 00:08:11.935 01:02:26 -- accel/accel.sh@28 -- # [[ -n software ]] 00:08:11.935 01:02:26 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:08:11.935 01:02:26 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:11.935 00:08:11.935 real 0m2.895s 00:08:11.935 user 0m2.597s 00:08:11.935 sys 0m0.291s 00:08:11.935 01:02:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:11.935 01:02:26 -- common/autotest_common.sh@10 -- # set +x 00:08:11.935 ************************************ 00:08:11.935 END TEST accel_deomp_full_mthread 00:08:11.935 ************************************ 00:08:11.935 01:02:26 -- accel/accel.sh@116 -- # [[ n == y ]] 00:08:11.935 01:02:26 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:08:11.935 01:02:26 -- accel/accel.sh@129 -- # build_accel_config 00:08:11.935 01:02:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:08:11.935 01:02:26 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:11.935 01:02:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:11.935 01:02:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:11.935 01:02:26 -- common/autotest_common.sh@10 -- # set +x 00:08:11.935 01:02:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:11.935 01:02:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:08:11.935 01:02:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:08:11.935 01:02:26 -- accel/accel.sh@41 -- # local IFS=, 00:08:11.935 01:02:26 -- accel/accel.sh@42 -- # jq -r . 00:08:11.935 ************************************ 00:08:11.935 START TEST accel_dif_functional_tests 00:08:11.935 ************************************ 00:08:11.935 01:02:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:08:11.935 [2024-11-28 01:02:26.174876] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:11.935 [2024-11-28 01:02:26.174961] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1928642 ] 00:08:11.935 EAL: No free 2048 kB hugepages reported on node 1 00:08:11.935 [2024-11-28 01:02:26.242704] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:08:11.935 [2024-11-28 01:02:26.339375] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:11.935 [2024-11-28 01:02:26.339434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:11.935 [2024-11-28 01:02:26.339431] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:11.935 00:08:11.935 00:08:11.935 CUnit - A unit testing framework for C - Version 2.1-3 00:08:11.935 http://cunit.sourceforge.net/ 00:08:11.935 00:08:11.935 00:08:11.935 Suite: accel_dif 00:08:11.935 Test: verify: DIF generated, GUARD check ...passed 00:08:11.935 Test: verify: DIF generated, APPTAG check ...passed 00:08:11.935 Test: verify: DIF generated, REFTAG check ...passed 00:08:11.935 Test: verify: DIF not generated, GUARD check ...[2024-11-28 01:02:26.435801] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:08:11.935 [2024-11-28 01:02:26.435879] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:08:11.935 passed 00:08:11.935 Test: verify: DIF not generated, APPTAG check ...[2024-11-28 01:02:26.435921] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:08:11.935 [2024-11-28 01:02:26.435950] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:08:11.935 passed 00:08:11.935 Test: verify: DIF not generated, REFTAG check ...[2024-11-28 01:02:26.435984] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:08:11.935 [2024-11-28 01:02:26.436012] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:08:11.935 passed 00:08:11.935 Test: verify: APPTAG correct, APPTAG check ...passed 00:08:11.935 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-28 01:02:26.436081] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:08:11.935 passed 00:08:11.935 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:08:11.935 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:08:11.935 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:08:11.935 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-28 01:02:26.436231] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:08:11.935 passed 00:08:11.935 Test: generate copy: DIF generated, GUARD check ...passed 00:08:11.935 Test: generate copy: DIF generated, APTTAG check ...passed 00:08:11.935 Test: generate copy: DIF generated, REFTAG check ...passed 00:08:11.935 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:08:11.935 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:08:11.935 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:08:11.935 Test: generate copy: iovecs-len validate ...[2024-11-28 01:02:26.436482] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:08:11.935 passed 00:08:11.935 Test: generate copy: buffer alignment validate ...passed 00:08:11.935 00:08:11.935 Run Summary: Type Total Ran Passed Failed Inactive 00:08:11.935 suites 1 1 n/a 0 0 00:08:11.935 tests 20 20 20 0 0 00:08:11.935 asserts 204 204 204 0 n/a 00:08:11.935 00:08:11.935 Elapsed time = 0.003 seconds 00:08:12.193 00:08:12.193 real 0m0.522s 00:08:12.193 user 0m0.811s 00:08:12.193 sys 0m0.186s 00:08:12.193 01:02:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:12.193 01:02:26 -- common/autotest_common.sh@10 -- # set +x 00:08:12.193 ************************************ 00:08:12.193 END TEST accel_dif_functional_tests 00:08:12.193 ************************************ 00:08:12.193 00:08:12.193 real 1m0.105s 00:08:12.193 user 1m7.826s 00:08:12.193 sys 0m7.339s 00:08:12.193 01:02:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:12.193 01:02:26 -- common/autotest_common.sh@10 -- # set +x 00:08:12.193 ************************************ 00:08:12.193 END TEST accel 00:08:12.193 ************************************ 00:08:12.193 01:02:26 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:08:12.193 01:02:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:12.193 01:02:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:12.193 01:02:26 -- common/autotest_common.sh@10 -- # set +x 00:08:12.193 ************************************ 00:08:12.193 START TEST accel_rpc 00:08:12.193 ************************************ 00:08:12.193 01:02:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:08:12.194 * Looking for test storage... 00:08:12.194 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:08:12.194 01:02:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:12.194 01:02:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:12.194 01:02:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:12.451 01:02:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:12.452 01:02:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:12.452 01:02:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:12.452 01:02:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:12.452 01:02:26 -- scripts/common.sh@335 -- # IFS=.-: 00:08:12.452 01:02:26 -- scripts/common.sh@335 -- # read -ra ver1 00:08:12.452 01:02:26 -- scripts/common.sh@336 -- # IFS=.-: 00:08:12.452 01:02:26 -- scripts/common.sh@336 -- # read -ra ver2 00:08:12.452 01:02:26 -- scripts/common.sh@337 -- # local 'op=<' 00:08:12.452 01:02:26 -- scripts/common.sh@339 -- # ver1_l=2 00:08:12.452 01:02:26 -- scripts/common.sh@340 -- # ver2_l=1 00:08:12.452 01:02:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:12.452 01:02:26 -- scripts/common.sh@343 -- # case "$op" in 00:08:12.452 01:02:26 -- scripts/common.sh@344 -- # : 1 00:08:12.452 01:02:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:12.452 01:02:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:12.452 01:02:26 -- scripts/common.sh@364 -- # decimal 1 00:08:12.452 01:02:26 -- scripts/common.sh@352 -- # local d=1 00:08:12.452 01:02:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:12.452 01:02:26 -- scripts/common.sh@354 -- # echo 1 00:08:12.452 01:02:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:12.452 01:02:26 -- scripts/common.sh@365 -- # decimal 2 00:08:12.452 01:02:26 -- scripts/common.sh@352 -- # local d=2 00:08:12.452 01:02:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:12.452 01:02:26 -- scripts/common.sh@354 -- # echo 2 00:08:12.452 01:02:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:12.452 01:02:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:12.452 01:02:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:12.452 01:02:26 -- scripts/common.sh@367 -- # return 0 00:08:12.452 01:02:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:12.452 01:02:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:12.452 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:12.452 --rc genhtml_branch_coverage=1 00:08:12.452 --rc genhtml_function_coverage=1 00:08:12.452 --rc genhtml_legend=1 00:08:12.452 --rc geninfo_all_blocks=1 00:08:12.452 --rc geninfo_unexecuted_blocks=1 00:08:12.452 00:08:12.452 ' 00:08:12.452 01:02:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:12.452 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:12.452 --rc genhtml_branch_coverage=1 00:08:12.452 --rc genhtml_function_coverage=1 00:08:12.452 --rc genhtml_legend=1 00:08:12.452 --rc geninfo_all_blocks=1 00:08:12.452 --rc geninfo_unexecuted_blocks=1 00:08:12.452 00:08:12.452 ' 00:08:12.452 01:02:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:12.452 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:12.452 --rc genhtml_branch_coverage=1 00:08:12.452 --rc genhtml_function_coverage=1 00:08:12.452 --rc genhtml_legend=1 00:08:12.452 --rc geninfo_all_blocks=1 00:08:12.452 --rc geninfo_unexecuted_blocks=1 00:08:12.452 00:08:12.452 ' 00:08:12.452 01:02:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:12.452 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:12.452 --rc genhtml_branch_coverage=1 00:08:12.452 --rc genhtml_function_coverage=1 00:08:12.452 --rc genhtml_legend=1 00:08:12.452 --rc geninfo_all_blocks=1 00:08:12.452 --rc geninfo_unexecuted_blocks=1 00:08:12.452 00:08:12.452 ' 00:08:12.452 01:02:26 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:08:12.452 01:02:26 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=1928833 00:08:12.452 01:02:26 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:08:12.452 01:02:26 -- accel/accel_rpc.sh@15 -- # waitforlisten 1928833 00:08:12.452 01:02:26 -- common/autotest_common.sh@829 -- # '[' -z 1928833 ']' 00:08:12.452 01:02:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:12.452 01:02:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:12.452 01:02:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:12.452 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:12.452 01:02:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:12.452 01:02:26 -- common/autotest_common.sh@10 -- # set +x 00:08:12.452 [2024-11-28 01:02:26.908396] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:12.452 [2024-11-28 01:02:26.908497] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1928833 ] 00:08:12.452 EAL: No free 2048 kB hugepages reported on node 1 00:08:12.452 [2024-11-28 01:02:26.967229] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:12.710 [2024-11-28 01:02:27.054966] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:12.710 [2024-11-28 01:02:27.055135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:12.710 01:02:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:12.710 01:02:27 -- common/autotest_common.sh@862 -- # return 0 00:08:12.710 01:02:27 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:08:12.710 01:02:27 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:08:12.710 01:02:27 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:08:12.710 01:02:27 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:08:12.710 01:02:27 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:08:12.710 01:02:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:12.710 01:02:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:12.710 01:02:27 -- common/autotest_common.sh@10 -- # set +x 00:08:12.710 ************************************ 00:08:12.710 START TEST accel_assign_opcode 00:08:12.710 ************************************ 00:08:12.710 01:02:27 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:08:12.710 01:02:27 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:08:12.710 01:02:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:12.710 01:02:27 -- common/autotest_common.sh@10 -- # set +x 00:08:12.710 [2024-11-28 01:02:27.127725] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:08:12.710 01:02:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:12.710 01:02:27 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:08:12.710 01:02:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:12.710 01:02:27 -- common/autotest_common.sh@10 -- # set +x 00:08:12.710 [2024-11-28 01:02:27.135742] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:08:12.710 01:02:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:12.710 01:02:27 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:08:12.710 01:02:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:12.710 01:02:27 -- common/autotest_common.sh@10 -- # set +x 00:08:12.968 01:02:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:12.968 01:02:27 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:08:12.968 01:02:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:12.968 01:02:27 -- common/autotest_common.sh@10 -- # set +x 00:08:12.968 01:02:27 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:08:12.968 01:02:27 -- accel/accel_rpc.sh@42 -- # grep software 00:08:12.968 01:02:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:12.968 software 00:08:12.968 00:08:12.968 real 0m0.287s 00:08:12.968 user 0m0.036s 00:08:12.968 sys 0m0.010s 00:08:12.968 01:02:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:12.968 01:02:27 -- common/autotest_common.sh@10 -- # set +x 00:08:12.968 ************************************ 00:08:12.968 END TEST accel_assign_opcode 00:08:12.968 ************************************ 00:08:12.968 01:02:27 -- accel/accel_rpc.sh@55 -- # killprocess 1928833 00:08:12.968 01:02:27 -- common/autotest_common.sh@936 -- # '[' -z 1928833 ']' 00:08:12.968 01:02:27 -- common/autotest_common.sh@940 -- # kill -0 1928833 00:08:12.968 01:02:27 -- common/autotest_common.sh@941 -- # uname 00:08:12.968 01:02:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:12.968 01:02:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1928833 00:08:12.968 01:02:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:12.968 01:02:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:12.968 01:02:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1928833' 00:08:12.968 killing process with pid 1928833 00:08:12.968 01:02:27 -- common/autotest_common.sh@955 -- # kill 1928833 00:08:12.968 01:02:27 -- common/autotest_common.sh@960 -- # wait 1928833 00:08:13.536 00:08:13.536 real 0m1.177s 00:08:13.536 user 0m1.120s 00:08:13.536 sys 0m0.418s 00:08:13.536 01:02:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:13.536 01:02:27 -- common/autotest_common.sh@10 -- # set +x 00:08:13.536 ************************************ 00:08:13.536 END TEST accel_rpc 00:08:13.536 ************************************ 00:08:13.536 01:02:27 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:08:13.536 01:02:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:13.536 01:02:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:13.536 01:02:27 -- common/autotest_common.sh@10 -- # set +x 00:08:13.536 ************************************ 00:08:13.536 START TEST app_cmdline 00:08:13.536 ************************************ 00:08:13.536 01:02:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:08:13.536 * Looking for test storage... 00:08:13.536 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:13.536 01:02:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:13.536 01:02:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:13.536 01:02:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:13.536 01:02:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:13.536 01:02:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:13.536 01:02:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:13.536 01:02:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:13.536 01:02:28 -- scripts/common.sh@335 -- # IFS=.-: 00:08:13.536 01:02:28 -- scripts/common.sh@335 -- # read -ra ver1 00:08:13.536 01:02:28 -- scripts/common.sh@336 -- # IFS=.-: 00:08:13.536 01:02:28 -- scripts/common.sh@336 -- # read -ra ver2 00:08:13.536 01:02:28 -- scripts/common.sh@337 -- # local 'op=<' 00:08:13.536 01:02:28 -- scripts/common.sh@339 -- # ver1_l=2 00:08:13.536 01:02:28 -- scripts/common.sh@340 -- # ver2_l=1 00:08:13.536 01:02:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:13.536 01:02:28 -- scripts/common.sh@343 -- # case "$op" in 00:08:13.536 01:02:28 -- scripts/common.sh@344 -- # : 1 00:08:13.536 01:02:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:13.536 01:02:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:13.536 01:02:28 -- scripts/common.sh@364 -- # decimal 1 00:08:13.536 01:02:28 -- scripts/common.sh@352 -- # local d=1 00:08:13.536 01:02:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:13.536 01:02:28 -- scripts/common.sh@354 -- # echo 1 00:08:13.536 01:02:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:13.536 01:02:28 -- scripts/common.sh@365 -- # decimal 2 00:08:13.536 01:02:28 -- scripts/common.sh@352 -- # local d=2 00:08:13.536 01:02:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:13.536 01:02:28 -- scripts/common.sh@354 -- # echo 2 00:08:13.536 01:02:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:13.536 01:02:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:13.536 01:02:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:13.536 01:02:28 -- scripts/common.sh@367 -- # return 0 00:08:13.536 01:02:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:13.536 01:02:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:13.536 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:13.536 --rc genhtml_branch_coverage=1 00:08:13.536 --rc genhtml_function_coverage=1 00:08:13.536 --rc genhtml_legend=1 00:08:13.536 --rc geninfo_all_blocks=1 00:08:13.536 --rc geninfo_unexecuted_blocks=1 00:08:13.536 00:08:13.536 ' 00:08:13.536 01:02:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:13.536 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:13.536 --rc genhtml_branch_coverage=1 00:08:13.536 --rc genhtml_function_coverage=1 00:08:13.536 --rc genhtml_legend=1 00:08:13.536 --rc geninfo_all_blocks=1 00:08:13.536 --rc geninfo_unexecuted_blocks=1 00:08:13.536 00:08:13.536 ' 00:08:13.536 01:02:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:13.536 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:13.536 --rc genhtml_branch_coverage=1 00:08:13.536 --rc genhtml_function_coverage=1 00:08:13.536 --rc genhtml_legend=1 00:08:13.536 --rc geninfo_all_blocks=1 00:08:13.536 --rc geninfo_unexecuted_blocks=1 00:08:13.536 00:08:13.536 ' 00:08:13.536 01:02:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:13.536 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:13.536 --rc genhtml_branch_coverage=1 00:08:13.536 --rc genhtml_function_coverage=1 00:08:13.536 --rc genhtml_legend=1 00:08:13.536 --rc geninfo_all_blocks=1 00:08:13.536 --rc geninfo_unexecuted_blocks=1 00:08:13.536 00:08:13.536 ' 00:08:13.536 01:02:28 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:08:13.536 01:02:28 -- app/cmdline.sh@17 -- # spdk_tgt_pid=1929046 00:08:13.536 01:02:28 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:08:13.536 01:02:28 -- app/cmdline.sh@18 -- # waitforlisten 1929046 00:08:13.536 01:02:28 -- common/autotest_common.sh@829 -- # '[' -z 1929046 ']' 00:08:13.536 01:02:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:13.536 01:02:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:13.536 01:02:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:13.536 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:13.536 01:02:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:13.536 01:02:28 -- common/autotest_common.sh@10 -- # set +x 00:08:13.536 [2024-11-28 01:02:28.116460] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:13.536 [2024-11-28 01:02:28.116558] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1929046 ] 00:08:13.794 EAL: No free 2048 kB hugepages reported on node 1 00:08:13.794 [2024-11-28 01:02:28.175893] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:13.794 [2024-11-28 01:02:28.262285] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:13.794 [2024-11-28 01:02:28.262464] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:14.728 01:02:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:14.728 01:02:29 -- common/autotest_common.sh@862 -- # return 0 00:08:14.728 01:02:29 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:08:14.986 { 00:08:14.986 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:08:14.986 "fields": { 00:08:14.986 "major": 24, 00:08:14.986 "minor": 1, 00:08:14.986 "patch": 1, 00:08:14.986 "suffix": "-pre", 00:08:14.986 "commit": "c13c99a5e" 00:08:14.986 } 00:08:14.986 } 00:08:14.986 01:02:29 -- app/cmdline.sh@22 -- # expected_methods=() 00:08:14.986 01:02:29 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:08:14.986 01:02:29 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:08:14.986 01:02:29 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:08:14.986 01:02:29 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:08:14.986 01:02:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:14.986 01:02:29 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:08:14.986 01:02:29 -- common/autotest_common.sh@10 -- # set +x 00:08:14.986 01:02:29 -- app/cmdline.sh@26 -- # sort 00:08:14.986 01:02:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:14.986 01:02:29 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:08:14.986 01:02:29 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:08:14.986 01:02:29 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:14.986 01:02:29 -- common/autotest_common.sh@650 -- # local es=0 00:08:14.986 01:02:29 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:14.986 01:02:29 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:08:14.986 01:02:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:14.986 01:02:29 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:08:14.986 01:02:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:14.986 01:02:29 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:08:14.986 01:02:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:14.986 01:02:29 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:08:14.986 01:02:29 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:08:14.986 01:02:29 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:15.245 request: 00:08:15.245 { 00:08:15.245 "method": "env_dpdk_get_mem_stats", 00:08:15.245 "req_id": 1 00:08:15.245 } 00:08:15.245 Got JSON-RPC error response 00:08:15.245 response: 00:08:15.245 { 00:08:15.245 "code": -32601, 00:08:15.245 "message": "Method not found" 00:08:15.245 } 00:08:15.245 01:02:29 -- common/autotest_common.sh@653 -- # es=1 00:08:15.245 01:02:29 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:15.245 01:02:29 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:08:15.245 01:02:29 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:15.245 01:02:29 -- app/cmdline.sh@1 -- # killprocess 1929046 00:08:15.245 01:02:29 -- common/autotest_common.sh@936 -- # '[' -z 1929046 ']' 00:08:15.245 01:02:29 -- common/autotest_common.sh@940 -- # kill -0 1929046 00:08:15.245 01:02:29 -- common/autotest_common.sh@941 -- # uname 00:08:15.245 01:02:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:15.245 01:02:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1929046 00:08:15.245 01:02:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:15.245 01:02:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:15.245 01:02:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1929046' 00:08:15.245 killing process with pid 1929046 00:08:15.245 01:02:29 -- common/autotest_common.sh@955 -- # kill 1929046 00:08:15.245 01:02:29 -- common/autotest_common.sh@960 -- # wait 1929046 00:08:15.811 00:08:15.811 real 0m2.262s 00:08:15.811 user 0m2.904s 00:08:15.811 sys 0m0.506s 00:08:15.811 01:02:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:15.811 01:02:30 -- common/autotest_common.sh@10 -- # set +x 00:08:15.811 ************************************ 00:08:15.811 END TEST app_cmdline 00:08:15.811 ************************************ 00:08:15.811 01:02:30 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:08:15.811 01:02:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:15.811 01:02:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:15.811 01:02:30 -- common/autotest_common.sh@10 -- # set +x 00:08:15.811 ************************************ 00:08:15.811 START TEST version 00:08:15.811 ************************************ 00:08:15.811 01:02:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:08:15.812 * Looking for test storage... 00:08:15.812 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:15.812 01:02:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:15.812 01:02:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:15.812 01:02:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:15.812 01:02:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:15.812 01:02:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:15.812 01:02:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:15.812 01:02:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:15.812 01:02:30 -- scripts/common.sh@335 -- # IFS=.-: 00:08:15.812 01:02:30 -- scripts/common.sh@335 -- # read -ra ver1 00:08:15.812 01:02:30 -- scripts/common.sh@336 -- # IFS=.-: 00:08:15.812 01:02:30 -- scripts/common.sh@336 -- # read -ra ver2 00:08:15.812 01:02:30 -- scripts/common.sh@337 -- # local 'op=<' 00:08:15.812 01:02:30 -- scripts/common.sh@339 -- # ver1_l=2 00:08:15.812 01:02:30 -- scripts/common.sh@340 -- # ver2_l=1 00:08:15.812 01:02:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:15.812 01:02:30 -- scripts/common.sh@343 -- # case "$op" in 00:08:15.812 01:02:30 -- scripts/common.sh@344 -- # : 1 00:08:15.812 01:02:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:15.812 01:02:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:15.812 01:02:30 -- scripts/common.sh@364 -- # decimal 1 00:08:15.812 01:02:30 -- scripts/common.sh@352 -- # local d=1 00:08:15.812 01:02:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:15.812 01:02:30 -- scripts/common.sh@354 -- # echo 1 00:08:15.812 01:02:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:15.812 01:02:30 -- scripts/common.sh@365 -- # decimal 2 00:08:15.812 01:02:30 -- scripts/common.sh@352 -- # local d=2 00:08:15.812 01:02:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:15.812 01:02:30 -- scripts/common.sh@354 -- # echo 2 00:08:15.812 01:02:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:15.812 01:02:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:15.812 01:02:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:15.812 01:02:30 -- scripts/common.sh@367 -- # return 0 00:08:15.812 01:02:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:15.812 01:02:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:15.812 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:15.812 --rc genhtml_branch_coverage=1 00:08:15.812 --rc genhtml_function_coverage=1 00:08:15.812 --rc genhtml_legend=1 00:08:15.812 --rc geninfo_all_blocks=1 00:08:15.812 --rc geninfo_unexecuted_blocks=1 00:08:15.812 00:08:15.812 ' 00:08:15.812 01:02:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:15.812 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:15.812 --rc genhtml_branch_coverage=1 00:08:15.812 --rc genhtml_function_coverage=1 00:08:15.812 --rc genhtml_legend=1 00:08:15.812 --rc geninfo_all_blocks=1 00:08:15.812 --rc geninfo_unexecuted_blocks=1 00:08:15.812 00:08:15.812 ' 00:08:15.812 01:02:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:15.812 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:15.812 --rc genhtml_branch_coverage=1 00:08:15.812 --rc genhtml_function_coverage=1 00:08:15.812 --rc genhtml_legend=1 00:08:15.812 --rc geninfo_all_blocks=1 00:08:15.812 --rc geninfo_unexecuted_blocks=1 00:08:15.812 00:08:15.812 ' 00:08:15.812 01:02:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:15.812 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:15.812 --rc genhtml_branch_coverage=1 00:08:15.812 --rc genhtml_function_coverage=1 00:08:15.812 --rc genhtml_legend=1 00:08:15.812 --rc geninfo_all_blocks=1 00:08:15.812 --rc geninfo_unexecuted_blocks=1 00:08:15.812 00:08:15.812 ' 00:08:15.812 01:02:30 -- app/version.sh@17 -- # get_header_version major 00:08:15.812 01:02:30 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:08:15.812 01:02:30 -- app/version.sh@14 -- # cut -f2 00:08:15.812 01:02:30 -- app/version.sh@14 -- # tr -d '"' 00:08:15.812 01:02:30 -- app/version.sh@17 -- # major=24 00:08:15.812 01:02:30 -- app/version.sh@18 -- # get_header_version minor 00:08:15.812 01:02:30 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:08:15.812 01:02:30 -- app/version.sh@14 -- # cut -f2 00:08:15.812 01:02:30 -- app/version.sh@14 -- # tr -d '"' 00:08:15.812 01:02:30 -- app/version.sh@18 -- # minor=1 00:08:15.812 01:02:30 -- app/version.sh@19 -- # get_header_version patch 00:08:15.812 01:02:30 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:08:15.812 01:02:30 -- app/version.sh@14 -- # cut -f2 00:08:15.812 01:02:30 -- app/version.sh@14 -- # tr -d '"' 00:08:15.812 01:02:30 -- app/version.sh@19 -- # patch=1 00:08:15.812 01:02:30 -- app/version.sh@20 -- # get_header_version suffix 00:08:15.812 01:02:30 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:08:15.812 01:02:30 -- app/version.sh@14 -- # cut -f2 00:08:15.812 01:02:30 -- app/version.sh@14 -- # tr -d '"' 00:08:15.812 01:02:30 -- app/version.sh@20 -- # suffix=-pre 00:08:15.812 01:02:30 -- app/version.sh@22 -- # version=24.1 00:08:15.812 01:02:30 -- app/version.sh@25 -- # (( patch != 0 )) 00:08:15.812 01:02:30 -- app/version.sh@25 -- # version=24.1.1 00:08:15.812 01:02:30 -- app/version.sh@28 -- # version=24.1.1rc0 00:08:15.812 01:02:30 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:15.812 01:02:30 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:08:16.071 01:02:30 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:08:16.071 01:02:30 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:08:16.071 00:08:16.071 real 0m0.212s 00:08:16.071 user 0m0.140s 00:08:16.071 sys 0m0.098s 00:08:16.071 01:02:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:16.071 01:02:30 -- common/autotest_common.sh@10 -- # set +x 00:08:16.071 ************************************ 00:08:16.071 END TEST version 00:08:16.071 ************************************ 00:08:16.071 01:02:30 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:08:16.071 01:02:30 -- spdk/autotest.sh@191 -- # uname -s 00:08:16.071 01:02:30 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:08:16.071 01:02:30 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:08:16.071 01:02:30 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:08:16.071 01:02:30 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:08:16.071 01:02:30 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:08:16.071 01:02:30 -- spdk/autotest.sh@255 -- # timing_exit lib 00:08:16.071 01:02:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:16.071 01:02:30 -- common/autotest_common.sh@10 -- # set +x 00:08:16.071 01:02:30 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:08:16.071 01:02:30 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:08:16.071 01:02:30 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:08:16.071 01:02:30 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:08:16.071 01:02:30 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:08:16.071 01:02:30 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:08:16.071 01:02:30 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:08:16.071 01:02:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:16.071 01:02:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:16.071 01:02:30 -- common/autotest_common.sh@10 -- # set +x 00:08:16.071 ************************************ 00:08:16.071 START TEST nvmf_tcp 00:08:16.071 ************************************ 00:08:16.071 01:02:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:08:16.071 * Looking for test storage... 00:08:16.071 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:08:16.071 01:02:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:16.071 01:02:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:16.071 01:02:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:16.071 01:02:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:16.071 01:02:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:16.071 01:02:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:16.071 01:02:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:16.071 01:02:30 -- scripts/common.sh@335 -- # IFS=.-: 00:08:16.071 01:02:30 -- scripts/common.sh@335 -- # read -ra ver1 00:08:16.071 01:02:30 -- scripts/common.sh@336 -- # IFS=.-: 00:08:16.071 01:02:30 -- scripts/common.sh@336 -- # read -ra ver2 00:08:16.071 01:02:30 -- scripts/common.sh@337 -- # local 'op=<' 00:08:16.071 01:02:30 -- scripts/common.sh@339 -- # ver1_l=2 00:08:16.071 01:02:30 -- scripts/common.sh@340 -- # ver2_l=1 00:08:16.071 01:02:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:16.071 01:02:30 -- scripts/common.sh@343 -- # case "$op" in 00:08:16.071 01:02:30 -- scripts/common.sh@344 -- # : 1 00:08:16.071 01:02:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:16.071 01:02:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:16.071 01:02:30 -- scripts/common.sh@364 -- # decimal 1 00:08:16.071 01:02:30 -- scripts/common.sh@352 -- # local d=1 00:08:16.071 01:02:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:16.071 01:02:30 -- scripts/common.sh@354 -- # echo 1 00:08:16.071 01:02:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:16.071 01:02:30 -- scripts/common.sh@365 -- # decimal 2 00:08:16.071 01:02:30 -- scripts/common.sh@352 -- # local d=2 00:08:16.071 01:02:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:16.071 01:02:30 -- scripts/common.sh@354 -- # echo 2 00:08:16.071 01:02:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:16.071 01:02:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:16.071 01:02:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:16.071 01:02:30 -- scripts/common.sh@367 -- # return 0 00:08:16.071 01:02:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:16.071 01:02:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:16.071 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:16.071 --rc genhtml_branch_coverage=1 00:08:16.071 --rc genhtml_function_coverage=1 00:08:16.071 --rc genhtml_legend=1 00:08:16.071 --rc geninfo_all_blocks=1 00:08:16.071 --rc geninfo_unexecuted_blocks=1 00:08:16.071 00:08:16.071 ' 00:08:16.071 01:02:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:16.071 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:16.071 --rc genhtml_branch_coverage=1 00:08:16.071 --rc genhtml_function_coverage=1 00:08:16.071 --rc genhtml_legend=1 00:08:16.071 --rc geninfo_all_blocks=1 00:08:16.071 --rc geninfo_unexecuted_blocks=1 00:08:16.071 00:08:16.071 ' 00:08:16.071 01:02:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:16.071 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:16.071 --rc genhtml_branch_coverage=1 00:08:16.071 --rc genhtml_function_coverage=1 00:08:16.071 --rc genhtml_legend=1 00:08:16.071 --rc geninfo_all_blocks=1 00:08:16.071 --rc geninfo_unexecuted_blocks=1 00:08:16.071 00:08:16.071 ' 00:08:16.071 01:02:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:16.071 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:16.071 --rc genhtml_branch_coverage=1 00:08:16.071 --rc genhtml_function_coverage=1 00:08:16.071 --rc genhtml_legend=1 00:08:16.071 --rc geninfo_all_blocks=1 00:08:16.071 --rc geninfo_unexecuted_blocks=1 00:08:16.071 00:08:16.071 ' 00:08:16.071 01:02:30 -- nvmf/nvmf.sh@10 -- # uname -s 00:08:16.071 01:02:30 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:08:16.071 01:02:30 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:16.071 01:02:30 -- nvmf/common.sh@7 -- # uname -s 00:08:16.071 01:02:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:16.071 01:02:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:16.071 01:02:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:16.071 01:02:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:16.071 01:02:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:16.071 01:02:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:16.071 01:02:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:16.071 01:02:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:16.071 01:02:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:16.071 01:02:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:16.071 01:02:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:16.071 01:02:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:16.071 01:02:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:16.071 01:02:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:16.071 01:02:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:16.071 01:02:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:16.071 01:02:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:16.071 01:02:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:16.071 01:02:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:16.072 01:02:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:16.072 01:02:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:16.072 01:02:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:16.072 01:02:30 -- paths/export.sh@5 -- # export PATH 00:08:16.072 01:02:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:16.072 01:02:30 -- nvmf/common.sh@46 -- # : 0 00:08:16.072 01:02:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:16.072 01:02:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:16.072 01:02:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:16.072 01:02:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:16.072 01:02:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:16.072 01:02:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:16.072 01:02:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:16.072 01:02:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:16.072 01:02:30 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:08:16.072 01:02:30 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:08:16.072 01:02:30 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:08:16.072 01:02:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:16.072 01:02:30 -- common/autotest_common.sh@10 -- # set +x 00:08:16.072 01:02:30 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:08:16.072 01:02:30 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:08:16.072 01:02:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:16.072 01:02:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:16.072 01:02:30 -- common/autotest_common.sh@10 -- # set +x 00:08:16.072 ************************************ 00:08:16.072 START TEST nvmf_example 00:08:16.072 ************************************ 00:08:16.072 01:02:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:08:16.331 * Looking for test storage... 00:08:16.331 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:16.331 01:02:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:16.331 01:02:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:16.331 01:02:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:16.331 01:02:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:16.331 01:02:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:16.331 01:02:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:16.331 01:02:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:16.331 01:02:30 -- scripts/common.sh@335 -- # IFS=.-: 00:08:16.331 01:02:30 -- scripts/common.sh@335 -- # read -ra ver1 00:08:16.331 01:02:30 -- scripts/common.sh@336 -- # IFS=.-: 00:08:16.331 01:02:30 -- scripts/common.sh@336 -- # read -ra ver2 00:08:16.331 01:02:30 -- scripts/common.sh@337 -- # local 'op=<' 00:08:16.331 01:02:30 -- scripts/common.sh@339 -- # ver1_l=2 00:08:16.331 01:02:30 -- scripts/common.sh@340 -- # ver2_l=1 00:08:16.331 01:02:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:16.331 01:02:30 -- scripts/common.sh@343 -- # case "$op" in 00:08:16.331 01:02:30 -- scripts/common.sh@344 -- # : 1 00:08:16.331 01:02:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:16.331 01:02:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:16.331 01:02:30 -- scripts/common.sh@364 -- # decimal 1 00:08:16.331 01:02:30 -- scripts/common.sh@352 -- # local d=1 00:08:16.331 01:02:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:16.331 01:02:30 -- scripts/common.sh@354 -- # echo 1 00:08:16.331 01:02:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:16.331 01:02:30 -- scripts/common.sh@365 -- # decimal 2 00:08:16.331 01:02:30 -- scripts/common.sh@352 -- # local d=2 00:08:16.331 01:02:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:16.331 01:02:30 -- scripts/common.sh@354 -- # echo 2 00:08:16.331 01:02:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:16.331 01:02:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:16.331 01:02:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:16.331 01:02:30 -- scripts/common.sh@367 -- # return 0 00:08:16.331 01:02:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:16.331 01:02:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:16.331 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:16.331 --rc genhtml_branch_coverage=1 00:08:16.331 --rc genhtml_function_coverage=1 00:08:16.331 --rc genhtml_legend=1 00:08:16.331 --rc geninfo_all_blocks=1 00:08:16.331 --rc geninfo_unexecuted_blocks=1 00:08:16.331 00:08:16.331 ' 00:08:16.331 01:02:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:16.331 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:16.331 --rc genhtml_branch_coverage=1 00:08:16.331 --rc genhtml_function_coverage=1 00:08:16.331 --rc genhtml_legend=1 00:08:16.331 --rc geninfo_all_blocks=1 00:08:16.331 --rc geninfo_unexecuted_blocks=1 00:08:16.331 00:08:16.331 ' 00:08:16.331 01:02:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:16.331 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:16.331 --rc genhtml_branch_coverage=1 00:08:16.331 --rc genhtml_function_coverage=1 00:08:16.331 --rc genhtml_legend=1 00:08:16.331 --rc geninfo_all_blocks=1 00:08:16.331 --rc geninfo_unexecuted_blocks=1 00:08:16.331 00:08:16.331 ' 00:08:16.331 01:02:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:16.331 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:16.331 --rc genhtml_branch_coverage=1 00:08:16.331 --rc genhtml_function_coverage=1 00:08:16.331 --rc genhtml_legend=1 00:08:16.331 --rc geninfo_all_blocks=1 00:08:16.331 --rc geninfo_unexecuted_blocks=1 00:08:16.331 00:08:16.331 ' 00:08:16.331 01:02:30 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:16.331 01:02:30 -- nvmf/common.sh@7 -- # uname -s 00:08:16.331 01:02:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:16.331 01:02:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:16.331 01:02:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:16.331 01:02:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:16.331 01:02:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:16.331 01:02:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:16.331 01:02:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:16.331 01:02:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:16.331 01:02:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:16.331 01:02:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:16.331 01:02:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:16.331 01:02:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:16.331 01:02:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:16.331 01:02:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:16.331 01:02:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:16.331 01:02:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:16.331 01:02:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:16.331 01:02:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:16.331 01:02:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:16.332 01:02:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:16.332 01:02:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:16.332 01:02:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:16.332 01:02:30 -- paths/export.sh@5 -- # export PATH 00:08:16.332 01:02:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:16.332 01:02:30 -- nvmf/common.sh@46 -- # : 0 00:08:16.332 01:02:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:16.332 01:02:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:16.332 01:02:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:16.332 01:02:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:16.332 01:02:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:16.332 01:02:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:16.332 01:02:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:16.332 01:02:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:16.332 01:02:30 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:08:16.332 01:02:30 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:08:16.332 01:02:30 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:08:16.332 01:02:30 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:08:16.332 01:02:30 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:08:16.332 01:02:30 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:08:16.332 01:02:30 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:08:16.332 01:02:30 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:08:16.332 01:02:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:16.332 01:02:30 -- common/autotest_common.sh@10 -- # set +x 00:08:16.332 01:02:30 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:08:16.332 01:02:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:16.332 01:02:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:16.332 01:02:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:16.332 01:02:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:16.332 01:02:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:16.332 01:02:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:16.332 01:02:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:16.332 01:02:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:16.332 01:02:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:16.332 01:02:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:16.332 01:02:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:16.332 01:02:30 -- common/autotest_common.sh@10 -- # set +x 00:08:18.864 01:02:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:18.864 01:02:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:18.864 01:02:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:18.864 01:02:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:18.864 01:02:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:18.864 01:02:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:18.864 01:02:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:18.864 01:02:32 -- nvmf/common.sh@294 -- # net_devs=() 00:08:18.864 01:02:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:18.864 01:02:32 -- nvmf/common.sh@295 -- # e810=() 00:08:18.864 01:02:32 -- nvmf/common.sh@295 -- # local -ga e810 00:08:18.864 01:02:32 -- nvmf/common.sh@296 -- # x722=() 00:08:18.864 01:02:32 -- nvmf/common.sh@296 -- # local -ga x722 00:08:18.864 01:02:32 -- nvmf/common.sh@297 -- # mlx=() 00:08:18.864 01:02:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:18.864 01:02:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:18.864 01:02:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:18.864 01:02:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:18.864 01:02:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:18.864 01:02:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:18.864 01:02:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:18.864 01:02:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:18.864 01:02:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:18.864 01:02:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:18.864 01:02:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:18.864 01:02:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:18.864 01:02:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:18.864 01:02:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:18.864 01:02:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:18.864 01:02:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:18.864 01:02:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:18.864 01:02:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:18.864 01:02:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:18.864 01:02:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:18.864 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:18.864 01:02:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:18.864 01:02:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:18.864 01:02:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:18.864 01:02:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:18.864 01:02:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:18.864 01:02:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:18.864 01:02:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:18.864 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:18.864 01:02:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:18.864 01:02:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:18.864 01:02:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:18.864 01:02:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:18.864 01:02:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:18.864 01:02:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:18.864 01:02:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:18.864 01:02:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:18.864 01:02:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:18.864 01:02:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:18.864 01:02:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:18.864 01:02:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:18.864 01:02:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:18.864 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:18.864 01:02:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:18.864 01:02:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:18.864 01:02:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:18.864 01:02:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:18.864 01:02:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:18.864 01:02:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:18.864 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:18.864 01:02:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:18.864 01:02:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:18.864 01:02:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:18.864 01:02:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:18.864 01:02:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:18.864 01:02:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:18.864 01:02:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:18.864 01:02:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:18.864 01:02:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:18.864 01:02:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:18.864 01:02:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:18.864 01:02:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:18.864 01:02:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:18.864 01:02:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:18.864 01:02:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:18.864 01:02:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:18.864 01:02:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:18.864 01:02:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:18.864 01:02:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:18.864 01:02:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:18.864 01:02:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:18.864 01:02:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:18.864 01:02:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:18.864 01:02:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:18.864 01:02:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:18.864 01:02:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:18.864 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:18.864 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.269 ms 00:08:18.864 00:08:18.864 --- 10.0.0.2 ping statistics --- 00:08:18.864 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:18.864 rtt min/avg/max/mdev = 0.269/0.269/0.269/0.000 ms 00:08:18.864 01:02:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:18.864 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:18.864 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:08:18.864 00:08:18.864 --- 10.0.0.1 ping statistics --- 00:08:18.864 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:18.864 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:08:18.864 01:02:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:18.864 01:02:33 -- nvmf/common.sh@410 -- # return 0 00:08:18.865 01:02:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:18.865 01:02:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:18.865 01:02:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:18.865 01:02:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:18.865 01:02:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:18.865 01:02:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:18.865 01:02:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:18.865 01:02:33 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:08:18.865 01:02:33 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:08:18.865 01:02:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:18.865 01:02:33 -- common/autotest_common.sh@10 -- # set +x 00:08:18.865 01:02:33 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:08:18.865 01:02:33 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:08:18.865 01:02:33 -- target/nvmf_example.sh@34 -- # nvmfpid=1931118 00:08:18.865 01:02:33 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:08:18.865 01:02:33 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:08:18.865 01:02:33 -- target/nvmf_example.sh@36 -- # waitforlisten 1931118 00:08:18.865 01:02:33 -- common/autotest_common.sh@829 -- # '[' -z 1931118 ']' 00:08:18.865 01:02:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:18.865 01:02:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:18.865 01:02:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:18.865 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:18.865 01:02:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:18.865 01:02:33 -- common/autotest_common.sh@10 -- # set +x 00:08:18.865 EAL: No free 2048 kB hugepages reported on node 1 00:08:18.865 01:02:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:18.865 01:02:33 -- common/autotest_common.sh@862 -- # return 0 00:08:18.865 01:02:33 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:08:18.865 01:02:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:18.865 01:02:33 -- common/autotest_common.sh@10 -- # set +x 00:08:18.865 01:02:33 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:18.865 01:02:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:18.865 01:02:33 -- common/autotest_common.sh@10 -- # set +x 00:08:18.865 01:02:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:18.865 01:02:33 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:08:18.865 01:02:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:18.865 01:02:33 -- common/autotest_common.sh@10 -- # set +x 00:08:18.865 01:02:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:18.865 01:02:33 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:08:18.865 01:02:33 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:18.865 01:02:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:18.865 01:02:33 -- common/autotest_common.sh@10 -- # set +x 00:08:18.865 01:02:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:18.865 01:02:33 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:08:18.865 01:02:33 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:18.865 01:02:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:18.865 01:02:33 -- common/autotest_common.sh@10 -- # set +x 00:08:18.865 01:02:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:18.865 01:02:33 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:18.865 01:02:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:18.865 01:02:33 -- common/autotest_common.sh@10 -- # set +x 00:08:18.865 01:02:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:18.865 01:02:33 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:08:18.865 01:02:33 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:08:18.865 EAL: No free 2048 kB hugepages reported on node 1 00:08:31.068 Initializing NVMe Controllers 00:08:31.068 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:08:31.068 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:08:31.068 Initialization complete. Launching workers. 00:08:31.068 ======================================================== 00:08:31.068 Latency(us) 00:08:31.068 Device Information : IOPS MiB/s Average min max 00:08:31.068 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15728.25 61.44 4070.28 869.69 15262.61 00:08:31.068 ======================================================== 00:08:31.068 Total : 15728.25 61.44 4070.28 869.69 15262.61 00:08:31.068 00:08:31.068 01:02:43 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:08:31.068 01:02:43 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:08:31.068 01:02:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:31.068 01:02:43 -- nvmf/common.sh@116 -- # sync 00:08:31.068 01:02:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:31.068 01:02:43 -- nvmf/common.sh@119 -- # set +e 00:08:31.068 01:02:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:31.068 01:02:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:31.068 rmmod nvme_tcp 00:08:31.068 rmmod nvme_fabrics 00:08:31.068 rmmod nvme_keyring 00:08:31.068 01:02:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:31.068 01:02:43 -- nvmf/common.sh@123 -- # set -e 00:08:31.068 01:02:43 -- nvmf/common.sh@124 -- # return 0 00:08:31.068 01:02:43 -- nvmf/common.sh@477 -- # '[' -n 1931118 ']' 00:08:31.068 01:02:43 -- nvmf/common.sh@478 -- # killprocess 1931118 00:08:31.068 01:02:43 -- common/autotest_common.sh@936 -- # '[' -z 1931118 ']' 00:08:31.068 01:02:43 -- common/autotest_common.sh@940 -- # kill -0 1931118 00:08:31.068 01:02:43 -- common/autotest_common.sh@941 -- # uname 00:08:31.068 01:02:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:31.068 01:02:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1931118 00:08:31.068 01:02:43 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:08:31.068 01:02:43 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:08:31.068 01:02:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1931118' 00:08:31.068 killing process with pid 1931118 00:08:31.068 01:02:43 -- common/autotest_common.sh@955 -- # kill 1931118 00:08:31.068 01:02:43 -- common/autotest_common.sh@960 -- # wait 1931118 00:08:31.068 nvmf threads initialize successfully 00:08:31.068 bdev subsystem init successfully 00:08:31.068 created a nvmf target service 00:08:31.068 create targets's poll groups done 00:08:31.068 all subsystems of target started 00:08:31.068 nvmf target is running 00:08:31.068 all subsystems of target stopped 00:08:31.068 destroy targets's poll groups done 00:08:31.068 destroyed the nvmf target service 00:08:31.068 bdev subsystem finish successfully 00:08:31.068 nvmf threads destroy successfully 00:08:31.068 01:02:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:31.068 01:02:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:31.068 01:02:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:31.068 01:02:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:31.068 01:02:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:31.068 01:02:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:31.068 01:02:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:31.068 01:02:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:31.636 01:02:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:31.636 01:02:46 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:08:31.636 01:02:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:31.636 01:02:46 -- common/autotest_common.sh@10 -- # set +x 00:08:31.636 00:08:31.636 real 0m15.461s 00:08:31.636 user 0m42.736s 00:08:31.636 sys 0m3.252s 00:08:31.636 01:02:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:31.637 01:02:46 -- common/autotest_common.sh@10 -- # set +x 00:08:31.637 ************************************ 00:08:31.637 END TEST nvmf_example 00:08:31.637 ************************************ 00:08:31.637 01:02:46 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:31.637 01:02:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:31.637 01:02:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:31.637 01:02:46 -- common/autotest_common.sh@10 -- # set +x 00:08:31.637 ************************************ 00:08:31.637 START TEST nvmf_filesystem 00:08:31.637 ************************************ 00:08:31.637 01:02:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:31.637 * Looking for test storage... 00:08:31.637 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:31.637 01:02:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:31.637 01:02:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:31.637 01:02:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:31.897 01:02:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:31.897 01:02:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:31.897 01:02:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:31.897 01:02:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:31.898 01:02:46 -- scripts/common.sh@335 -- # IFS=.-: 00:08:31.898 01:02:46 -- scripts/common.sh@335 -- # read -ra ver1 00:08:31.898 01:02:46 -- scripts/common.sh@336 -- # IFS=.-: 00:08:31.898 01:02:46 -- scripts/common.sh@336 -- # read -ra ver2 00:08:31.898 01:02:46 -- scripts/common.sh@337 -- # local 'op=<' 00:08:31.898 01:02:46 -- scripts/common.sh@339 -- # ver1_l=2 00:08:31.898 01:02:46 -- scripts/common.sh@340 -- # ver2_l=1 00:08:31.898 01:02:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:31.898 01:02:46 -- scripts/common.sh@343 -- # case "$op" in 00:08:31.898 01:02:46 -- scripts/common.sh@344 -- # : 1 00:08:31.898 01:02:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:31.898 01:02:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:31.898 01:02:46 -- scripts/common.sh@364 -- # decimal 1 00:08:31.898 01:02:46 -- scripts/common.sh@352 -- # local d=1 00:08:31.898 01:02:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:31.898 01:02:46 -- scripts/common.sh@354 -- # echo 1 00:08:31.898 01:02:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:31.898 01:02:46 -- scripts/common.sh@365 -- # decimal 2 00:08:31.898 01:02:46 -- scripts/common.sh@352 -- # local d=2 00:08:31.898 01:02:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:31.898 01:02:46 -- scripts/common.sh@354 -- # echo 2 00:08:31.898 01:02:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:31.898 01:02:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:31.898 01:02:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:31.898 01:02:46 -- scripts/common.sh@367 -- # return 0 00:08:31.898 01:02:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:31.898 01:02:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:31.898 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:31.898 --rc genhtml_branch_coverage=1 00:08:31.898 --rc genhtml_function_coverage=1 00:08:31.898 --rc genhtml_legend=1 00:08:31.898 --rc geninfo_all_blocks=1 00:08:31.898 --rc geninfo_unexecuted_blocks=1 00:08:31.898 00:08:31.898 ' 00:08:31.898 01:02:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:31.898 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:31.898 --rc genhtml_branch_coverage=1 00:08:31.898 --rc genhtml_function_coverage=1 00:08:31.898 --rc genhtml_legend=1 00:08:31.898 --rc geninfo_all_blocks=1 00:08:31.898 --rc geninfo_unexecuted_blocks=1 00:08:31.898 00:08:31.898 ' 00:08:31.898 01:02:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:31.898 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:31.898 --rc genhtml_branch_coverage=1 00:08:31.898 --rc genhtml_function_coverage=1 00:08:31.898 --rc genhtml_legend=1 00:08:31.898 --rc geninfo_all_blocks=1 00:08:31.898 --rc geninfo_unexecuted_blocks=1 00:08:31.898 00:08:31.898 ' 00:08:31.898 01:02:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:31.898 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:31.898 --rc genhtml_branch_coverage=1 00:08:31.898 --rc genhtml_function_coverage=1 00:08:31.898 --rc genhtml_legend=1 00:08:31.898 --rc geninfo_all_blocks=1 00:08:31.898 --rc geninfo_unexecuted_blocks=1 00:08:31.898 00:08:31.898 ' 00:08:31.898 01:02:46 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:08:31.898 01:02:46 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:08:31.898 01:02:46 -- common/autotest_common.sh@34 -- # set -e 00:08:31.898 01:02:46 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:08:31.898 01:02:46 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:08:31.898 01:02:46 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:08:31.898 01:02:46 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:08:31.898 01:02:46 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:08:31.898 01:02:46 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:08:31.898 01:02:46 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:08:31.898 01:02:46 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:08:31.898 01:02:46 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:08:31.898 01:02:46 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:08:31.898 01:02:46 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:08:31.898 01:02:46 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:08:31.898 01:02:46 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:08:31.898 01:02:46 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:08:31.898 01:02:46 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:08:31.898 01:02:46 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:08:31.898 01:02:46 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:08:31.898 01:02:46 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:08:31.898 01:02:46 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:08:31.898 01:02:46 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:08:31.898 01:02:46 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:08:31.898 01:02:46 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:08:31.898 01:02:46 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:31.898 01:02:46 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:08:31.898 01:02:46 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:08:31.898 01:02:46 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:08:31.898 01:02:46 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:08:31.898 01:02:46 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:08:31.898 01:02:46 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:08:31.898 01:02:46 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:08:31.898 01:02:46 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:08:31.898 01:02:46 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:08:31.898 01:02:46 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:08:31.898 01:02:46 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:08:31.898 01:02:46 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:08:31.898 01:02:46 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:08:31.898 01:02:46 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:08:31.898 01:02:46 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:08:31.898 01:02:46 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:08:31.898 01:02:46 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:31.898 01:02:46 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:08:31.898 01:02:46 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:08:31.898 01:02:46 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:08:31.898 01:02:46 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:08:31.898 01:02:46 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR=//var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:31.898 01:02:46 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:08:31.898 01:02:46 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:08:31.898 01:02:46 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:08:31.898 01:02:46 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:08:31.898 01:02:46 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:08:31.898 01:02:46 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:08:31.898 01:02:46 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:08:31.898 01:02:46 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:08:31.898 01:02:46 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:08:31.898 01:02:46 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:08:31.898 01:02:46 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:08:31.898 01:02:46 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:08:31.899 01:02:46 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:08:31.899 01:02:46 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:08:31.899 01:02:46 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:08:31.899 01:02:46 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:08:31.899 01:02:46 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:08:31.899 01:02:46 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:08:31.899 01:02:46 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:08:31.899 01:02:46 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:31.899 01:02:46 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:08:31.899 01:02:46 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:08:31.899 01:02:46 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:08:31.899 01:02:46 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:08:31.899 01:02:46 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:08:31.899 01:02:46 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:08:31.899 01:02:46 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:08:31.899 01:02:46 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:08:31.899 01:02:46 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:08:31.899 01:02:46 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:08:31.899 01:02:46 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:08:31.899 01:02:46 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:08:31.899 01:02:46 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:08:31.899 01:02:46 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:08:31.899 01:02:46 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:08:31.899 01:02:46 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:08:31.899 01:02:46 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:08:31.899 01:02:46 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:08:31.899 01:02:46 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:31.899 01:02:46 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:31.899 01:02:46 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:31.899 01:02:46 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:31.899 01:02:46 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:31.899 01:02:46 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:31.899 01:02:46 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:31.899 01:02:46 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:31.899 01:02:46 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:08:31.899 01:02:46 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:08:31.899 01:02:46 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:08:31.899 01:02:46 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:08:31.899 01:02:46 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:08:31.899 01:02:46 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:08:31.899 01:02:46 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:08:31.899 01:02:46 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:08:31.899 #define SPDK_CONFIG_H 00:08:31.899 #define SPDK_CONFIG_APPS 1 00:08:31.899 #define SPDK_CONFIG_ARCH native 00:08:31.899 #undef SPDK_CONFIG_ASAN 00:08:31.899 #undef SPDK_CONFIG_AVAHI 00:08:31.899 #undef SPDK_CONFIG_CET 00:08:31.899 #define SPDK_CONFIG_COVERAGE 1 00:08:31.899 #define SPDK_CONFIG_CROSS_PREFIX 00:08:31.899 #undef SPDK_CONFIG_CRYPTO 00:08:31.899 #undef SPDK_CONFIG_CRYPTO_MLX5 00:08:31.899 #undef SPDK_CONFIG_CUSTOMOCF 00:08:31.899 #undef SPDK_CONFIG_DAOS 00:08:31.899 #define SPDK_CONFIG_DAOS_DIR 00:08:31.899 #define SPDK_CONFIG_DEBUG 1 00:08:31.899 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:08:31.899 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:31.899 #define SPDK_CONFIG_DPDK_INC_DIR //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:31.899 #define SPDK_CONFIG_DPDK_LIB_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:31.899 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:08:31.899 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:31.899 #define SPDK_CONFIG_EXAMPLES 1 00:08:31.899 #undef SPDK_CONFIG_FC 00:08:31.899 #define SPDK_CONFIG_FC_PATH 00:08:31.899 #define SPDK_CONFIG_FIO_PLUGIN 1 00:08:31.899 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:08:31.899 #undef SPDK_CONFIG_FUSE 00:08:31.899 #undef SPDK_CONFIG_FUZZER 00:08:31.899 #define SPDK_CONFIG_FUZZER_LIB 00:08:31.899 #undef SPDK_CONFIG_GOLANG 00:08:31.899 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:08:31.899 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:08:31.899 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:08:31.899 #undef SPDK_CONFIG_HAVE_LIBBSD 00:08:31.899 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:08:31.899 #define SPDK_CONFIG_IDXD 1 00:08:31.899 #define SPDK_CONFIG_IDXD_KERNEL 1 00:08:31.899 #undef SPDK_CONFIG_IPSEC_MB 00:08:31.899 #define SPDK_CONFIG_IPSEC_MB_DIR 00:08:31.899 #define SPDK_CONFIG_ISAL 1 00:08:31.899 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:08:31.899 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:08:31.899 #define SPDK_CONFIG_LIBDIR 00:08:31.899 #undef SPDK_CONFIG_LTO 00:08:31.899 #define SPDK_CONFIG_MAX_LCORES 00:08:31.899 #define SPDK_CONFIG_NVME_CUSE 1 00:08:31.899 #undef SPDK_CONFIG_OCF 00:08:31.899 #define SPDK_CONFIG_OCF_PATH 00:08:31.899 #define SPDK_CONFIG_OPENSSL_PATH 00:08:31.899 #undef SPDK_CONFIG_PGO_CAPTURE 00:08:31.899 #undef SPDK_CONFIG_PGO_USE 00:08:31.899 #define SPDK_CONFIG_PREFIX /usr/local 00:08:31.899 #undef SPDK_CONFIG_RAID5F 00:08:31.899 #undef SPDK_CONFIG_RBD 00:08:31.899 #define SPDK_CONFIG_RDMA 1 00:08:31.899 #define SPDK_CONFIG_RDMA_PROV verbs 00:08:31.899 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:08:31.899 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:08:31.899 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:08:31.899 #define SPDK_CONFIG_SHARED 1 00:08:31.899 #undef SPDK_CONFIG_SMA 00:08:31.899 #define SPDK_CONFIG_TESTS 1 00:08:31.899 #undef SPDK_CONFIG_TSAN 00:08:31.899 #define SPDK_CONFIG_UBLK 1 00:08:31.899 #define SPDK_CONFIG_UBSAN 1 00:08:31.899 #undef SPDK_CONFIG_UNIT_TESTS 00:08:31.899 #undef SPDK_CONFIG_URING 00:08:31.899 #define SPDK_CONFIG_URING_PATH 00:08:31.899 #undef SPDK_CONFIG_URING_ZNS 00:08:31.899 #undef SPDK_CONFIG_USDT 00:08:31.899 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:08:31.899 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:08:31.899 #define SPDK_CONFIG_VFIO_USER 1 00:08:31.899 #define SPDK_CONFIG_VFIO_USER_DIR 00:08:31.899 #define SPDK_CONFIG_VHOST 1 00:08:31.899 #define SPDK_CONFIG_VIRTIO 1 00:08:31.899 #undef SPDK_CONFIG_VTUNE 00:08:31.899 #define SPDK_CONFIG_VTUNE_DIR 00:08:31.899 #define SPDK_CONFIG_WERROR 1 00:08:31.899 #define SPDK_CONFIG_WPDK_DIR 00:08:31.899 #undef SPDK_CONFIG_XNVME 00:08:31.899 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:08:31.899 01:02:46 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:08:31.899 01:02:46 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:31.900 01:02:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:31.900 01:02:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:31.900 01:02:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:31.900 01:02:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:31.900 01:02:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:31.900 01:02:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:31.900 01:02:46 -- paths/export.sh@5 -- # export PATH 00:08:31.900 01:02:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:31.900 01:02:46 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:31.900 01:02:46 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:31.900 01:02:46 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:31.900 01:02:46 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:31.900 01:02:46 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:08:31.900 01:02:46 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:31.900 01:02:46 -- pm/common@16 -- # TEST_TAG=N/A 00:08:31.900 01:02:46 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:08:31.900 01:02:46 -- common/autotest_common.sh@52 -- # : 1 00:08:31.900 01:02:46 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:08:31.900 01:02:46 -- common/autotest_common.sh@56 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:08:31.900 01:02:46 -- common/autotest_common.sh@58 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:08:31.900 01:02:46 -- common/autotest_common.sh@60 -- # : 1 00:08:31.900 01:02:46 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:08:31.900 01:02:46 -- common/autotest_common.sh@62 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:08:31.900 01:02:46 -- common/autotest_common.sh@64 -- # : 00:08:31.900 01:02:46 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:08:31.900 01:02:46 -- common/autotest_common.sh@66 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:08:31.900 01:02:46 -- common/autotest_common.sh@68 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:08:31.900 01:02:46 -- common/autotest_common.sh@70 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:08:31.900 01:02:46 -- common/autotest_common.sh@72 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:08:31.900 01:02:46 -- common/autotest_common.sh@74 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:08:31.900 01:02:46 -- common/autotest_common.sh@76 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:08:31.900 01:02:46 -- common/autotest_common.sh@78 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:08:31.900 01:02:46 -- common/autotest_common.sh@80 -- # : 1 00:08:31.900 01:02:46 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:08:31.900 01:02:46 -- common/autotest_common.sh@82 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:08:31.900 01:02:46 -- common/autotest_common.sh@84 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:08:31.900 01:02:46 -- common/autotest_common.sh@86 -- # : 1 00:08:31.900 01:02:46 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:08:31.900 01:02:46 -- common/autotest_common.sh@88 -- # : 1 00:08:31.900 01:02:46 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:08:31.900 01:02:46 -- common/autotest_common.sh@90 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:08:31.900 01:02:46 -- common/autotest_common.sh@92 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:08:31.900 01:02:46 -- common/autotest_common.sh@94 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:08:31.900 01:02:46 -- common/autotest_common.sh@96 -- # : tcp 00:08:31.900 01:02:46 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:08:31.900 01:02:46 -- common/autotest_common.sh@98 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:08:31.900 01:02:46 -- common/autotest_common.sh@100 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:08:31.900 01:02:46 -- common/autotest_common.sh@102 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:08:31.900 01:02:46 -- common/autotest_common.sh@104 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:08:31.900 01:02:46 -- common/autotest_common.sh@106 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:08:31.900 01:02:46 -- common/autotest_common.sh@108 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:08:31.900 01:02:46 -- common/autotest_common.sh@110 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:08:31.900 01:02:46 -- common/autotest_common.sh@112 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:08:31.900 01:02:46 -- common/autotest_common.sh@114 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:08:31.900 01:02:46 -- common/autotest_common.sh@116 -- # : 1 00:08:31.900 01:02:46 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:08:31.900 01:02:46 -- common/autotest_common.sh@118 -- # : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:31.900 01:02:46 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:08:31.900 01:02:46 -- common/autotest_common.sh@120 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:08:31.900 01:02:46 -- common/autotest_common.sh@122 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:08:31.900 01:02:46 -- common/autotest_common.sh@124 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:08:31.900 01:02:46 -- common/autotest_common.sh@126 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:08:31.900 01:02:46 -- common/autotest_common.sh@128 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:08:31.900 01:02:46 -- common/autotest_common.sh@130 -- # : 0 00:08:31.900 01:02:46 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:08:31.900 01:02:46 -- common/autotest_common.sh@132 -- # : v23.11 00:08:31.900 01:02:46 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:08:31.901 01:02:46 -- common/autotest_common.sh@134 -- # : true 00:08:31.901 01:02:46 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:08:31.901 01:02:46 -- common/autotest_common.sh@136 -- # : 0 00:08:31.901 01:02:46 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:08:31.901 01:02:46 -- common/autotest_common.sh@138 -- # : 0 00:08:31.901 01:02:46 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:08:31.901 01:02:46 -- common/autotest_common.sh@140 -- # : 0 00:08:31.901 01:02:46 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:08:31.901 01:02:46 -- common/autotest_common.sh@142 -- # : 0 00:08:31.901 01:02:46 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:08:31.901 01:02:46 -- common/autotest_common.sh@144 -- # : 0 00:08:31.901 01:02:46 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:08:31.901 01:02:46 -- common/autotest_common.sh@146 -- # : 0 00:08:31.901 01:02:46 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:08:31.901 01:02:46 -- common/autotest_common.sh@148 -- # : e810 00:08:31.901 01:02:46 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:08:31.901 01:02:46 -- common/autotest_common.sh@150 -- # : 0 00:08:31.901 01:02:46 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:08:31.901 01:02:46 -- common/autotest_common.sh@152 -- # : 0 00:08:31.901 01:02:46 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:08:31.901 01:02:46 -- common/autotest_common.sh@154 -- # : 0 00:08:31.901 01:02:46 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:08:31.901 01:02:46 -- common/autotest_common.sh@156 -- # : 0 00:08:31.901 01:02:46 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:08:31.901 01:02:46 -- common/autotest_common.sh@158 -- # : 0 00:08:31.901 01:02:46 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:08:31.901 01:02:46 -- common/autotest_common.sh@160 -- # : 0 00:08:31.901 01:02:46 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:08:31.901 01:02:46 -- common/autotest_common.sh@163 -- # : 00:08:31.901 01:02:46 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:08:31.901 01:02:46 -- common/autotest_common.sh@165 -- # : 0 00:08:31.901 01:02:46 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:08:31.901 01:02:46 -- common/autotest_common.sh@167 -- # : 0 00:08:31.901 01:02:46 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:08:31.901 01:02:46 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:31.901 01:02:46 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:31.901 01:02:46 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:31.901 01:02:46 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:31.901 01:02:46 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:31.901 01:02:46 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:31.901 01:02:46 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:31.901 01:02:46 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:31.901 01:02:46 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:08:31.901 01:02:46 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:08:31.901 01:02:46 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:31.901 01:02:46 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:31.901 01:02:46 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:08:31.901 01:02:46 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:08:31.901 01:02:46 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:31.901 01:02:46 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:31.901 01:02:46 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:31.901 01:02:46 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:31.901 01:02:46 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:08:31.901 01:02:46 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:08:31.901 01:02:46 -- common/autotest_common.sh@196 -- # cat 00:08:31.901 01:02:46 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:08:31.901 01:02:46 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:31.901 01:02:46 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:31.901 01:02:46 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:31.901 01:02:46 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:31.901 01:02:46 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:08:31.901 01:02:46 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:08:31.901 01:02:46 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:31.901 01:02:46 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:31.901 01:02:46 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:31.901 01:02:46 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:31.901 01:02:46 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:31.901 01:02:46 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:31.901 01:02:46 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:31.901 01:02:46 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:31.901 01:02:46 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:31.901 01:02:46 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:31.901 01:02:46 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:31.902 01:02:46 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:31.902 01:02:46 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:08:31.902 01:02:46 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:08:31.902 01:02:46 -- common/autotest_common.sh@249 -- # _LCOV= 00:08:31.902 01:02:46 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:08:31.902 01:02:46 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:08:31.902 01:02:46 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:08:31.902 01:02:46 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:08:31.902 01:02:46 -- common/autotest_common.sh@255 -- # lcov_opt= 00:08:31.902 01:02:46 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:08:31.902 01:02:46 -- common/autotest_common.sh@259 -- # export valgrind= 00:08:31.902 01:02:46 -- common/autotest_common.sh@259 -- # valgrind= 00:08:31.902 01:02:46 -- common/autotest_common.sh@265 -- # uname -s 00:08:31.902 01:02:46 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:08:31.902 01:02:46 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:08:31.902 01:02:46 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:08:31.902 01:02:46 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:08:31.902 01:02:46 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:31.902 01:02:46 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:31.902 01:02:46 -- common/autotest_common.sh@275 -- # MAKE=make 00:08:31.902 01:02:46 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:08:31.902 01:02:46 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:08:31.902 01:02:46 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:08:31.902 01:02:46 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:08:31.902 01:02:46 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:08:31.902 01:02:46 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:08:31.902 01:02:46 -- common/autotest_common.sh@301 -- # for i in "$@" 00:08:31.902 01:02:46 -- common/autotest_common.sh@302 -- # case "$i" in 00:08:31.902 01:02:46 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:08:31.902 01:02:46 -- common/autotest_common.sh@319 -- # [[ -z 1932855 ]] 00:08:31.902 01:02:46 -- common/autotest_common.sh@319 -- # kill -0 1932855 00:08:31.902 01:02:46 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:08:31.902 01:02:46 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:08:31.902 01:02:46 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:08:31.902 01:02:46 -- common/autotest_common.sh@332 -- # local mount target_dir 00:08:31.902 01:02:46 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:08:31.902 01:02:46 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:08:31.902 01:02:46 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:08:31.902 01:02:46 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:08:31.902 01:02:46 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.ZDXx1L 00:08:31.902 01:02:46 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:08:31.902 01:02:46 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:08:31.902 01:02:46 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:08:31.902 01:02:46 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.ZDXx1L/tests/target /tmp/spdk.ZDXx1L 00:08:31.902 01:02:46 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:08:31.902 01:02:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:31.902 01:02:46 -- common/autotest_common.sh@328 -- # df -T 00:08:31.902 01:02:46 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:08:31.902 01:02:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:08:31.902 01:02:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:08:31.902 01:02:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:08:31.902 01:02:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:08:31.902 01:02:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:08:31.902 01:02:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:31.902 01:02:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:08:31.902 01:02:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:08:31.902 01:02:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:08:31.902 01:02:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:08:31.902 01:02:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:08:31.902 01:02:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:31.902 01:02:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:08:31.902 01:02:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:08:31.902 01:02:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=52732084224 00:08:31.902 01:02:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988503552 00:08:31.902 01:02:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=9256419328 00:08:31.902 01:02:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:31.902 01:02:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:31.902 01:02:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:31.902 01:02:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991659008 00:08:31.902 01:02:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994251776 00:08:31.902 01:02:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:08:31.902 01:02:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:31.902 01:02:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:31.902 01:02:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:31.902 01:02:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388913152 00:08:31.902 01:02:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397703168 00:08:31.902 01:02:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:08:31.902 01:02:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:31.902 01:02:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:31.902 01:02:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:31.902 01:02:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993321984 00:08:31.902 01:02:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994251776 00:08:31.902 01:02:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=929792 00:08:31.902 01:02:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:31.902 01:02:46 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:31.902 01:02:46 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:31.902 01:02:46 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:08:31.902 01:02:46 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:08:31.902 01:02:46 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:08:31.902 01:02:46 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:31.902 01:02:46 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:08:31.902 * Looking for test storage... 00:08:31.902 01:02:46 -- common/autotest_common.sh@369 -- # local target_space new_size 00:08:31.902 01:02:46 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:08:31.902 01:02:46 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:31.902 01:02:46 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:08:31.902 01:02:46 -- common/autotest_common.sh@373 -- # mount=/ 00:08:31.902 01:02:46 -- common/autotest_common.sh@375 -- # target_space=52732084224 00:08:31.902 01:02:46 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:08:31.902 01:02:46 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:08:31.903 01:02:46 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:08:31.903 01:02:46 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:08:31.903 01:02:46 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:08:31.903 01:02:46 -- common/autotest_common.sh@382 -- # new_size=11471011840 00:08:31.903 01:02:46 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:08:31.903 01:02:46 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:31.903 01:02:46 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:31.903 01:02:46 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:31.903 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:31.903 01:02:46 -- common/autotest_common.sh@390 -- # return 0 00:08:31.903 01:02:46 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:08:31.903 01:02:46 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:08:31.903 01:02:46 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:08:31.903 01:02:46 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:08:31.903 01:02:46 -- common/autotest_common.sh@1682 -- # true 00:08:31.903 01:02:46 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:08:31.903 01:02:46 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:08:31.903 01:02:46 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:08:31.903 01:02:46 -- common/autotest_common.sh@27 -- # exec 00:08:31.903 01:02:46 -- common/autotest_common.sh@29 -- # exec 00:08:31.903 01:02:46 -- common/autotest_common.sh@31 -- # xtrace_restore 00:08:31.903 01:02:46 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:08:31.903 01:02:46 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:08:31.903 01:02:46 -- common/autotest_common.sh@18 -- # set -x 00:08:31.903 01:02:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:31.903 01:02:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:31.903 01:02:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:31.903 01:02:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:31.903 01:02:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:31.903 01:02:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:31.903 01:02:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:31.903 01:02:46 -- scripts/common.sh@335 -- # IFS=.-: 00:08:31.903 01:02:46 -- scripts/common.sh@335 -- # read -ra ver1 00:08:31.903 01:02:46 -- scripts/common.sh@336 -- # IFS=.-: 00:08:31.903 01:02:46 -- scripts/common.sh@336 -- # read -ra ver2 00:08:31.903 01:02:46 -- scripts/common.sh@337 -- # local 'op=<' 00:08:31.903 01:02:46 -- scripts/common.sh@339 -- # ver1_l=2 00:08:31.903 01:02:46 -- scripts/common.sh@340 -- # ver2_l=1 00:08:31.903 01:02:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:31.903 01:02:46 -- scripts/common.sh@343 -- # case "$op" in 00:08:31.903 01:02:46 -- scripts/common.sh@344 -- # : 1 00:08:31.903 01:02:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:31.903 01:02:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:31.903 01:02:46 -- scripts/common.sh@364 -- # decimal 1 00:08:31.903 01:02:46 -- scripts/common.sh@352 -- # local d=1 00:08:31.903 01:02:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:31.903 01:02:46 -- scripts/common.sh@354 -- # echo 1 00:08:31.903 01:02:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:31.903 01:02:46 -- scripts/common.sh@365 -- # decimal 2 00:08:31.903 01:02:46 -- scripts/common.sh@352 -- # local d=2 00:08:31.903 01:02:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:31.903 01:02:46 -- scripts/common.sh@354 -- # echo 2 00:08:31.903 01:02:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:31.903 01:02:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:31.903 01:02:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:31.903 01:02:46 -- scripts/common.sh@367 -- # return 0 00:08:31.903 01:02:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:31.903 01:02:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:31.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:31.903 --rc genhtml_branch_coverage=1 00:08:31.903 --rc genhtml_function_coverage=1 00:08:31.903 --rc genhtml_legend=1 00:08:31.903 --rc geninfo_all_blocks=1 00:08:31.903 --rc geninfo_unexecuted_blocks=1 00:08:31.903 00:08:31.903 ' 00:08:31.903 01:02:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:31.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:31.903 --rc genhtml_branch_coverage=1 00:08:31.903 --rc genhtml_function_coverage=1 00:08:31.903 --rc genhtml_legend=1 00:08:31.903 --rc geninfo_all_blocks=1 00:08:31.903 --rc geninfo_unexecuted_blocks=1 00:08:31.903 00:08:31.903 ' 00:08:31.903 01:02:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:31.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:31.903 --rc genhtml_branch_coverage=1 00:08:31.903 --rc genhtml_function_coverage=1 00:08:31.903 --rc genhtml_legend=1 00:08:31.903 --rc geninfo_all_blocks=1 00:08:31.903 --rc geninfo_unexecuted_blocks=1 00:08:31.903 00:08:31.903 ' 00:08:31.903 01:02:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:31.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:31.903 --rc genhtml_branch_coverage=1 00:08:31.903 --rc genhtml_function_coverage=1 00:08:31.903 --rc genhtml_legend=1 00:08:31.903 --rc geninfo_all_blocks=1 00:08:31.903 --rc geninfo_unexecuted_blocks=1 00:08:31.903 00:08:31.903 ' 00:08:31.903 01:02:46 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:31.903 01:02:46 -- nvmf/common.sh@7 -- # uname -s 00:08:31.903 01:02:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:31.903 01:02:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:31.903 01:02:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:31.903 01:02:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:31.903 01:02:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:31.903 01:02:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:31.903 01:02:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:31.903 01:02:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:31.903 01:02:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:31.903 01:02:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:31.903 01:02:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:31.903 01:02:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:31.903 01:02:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:31.903 01:02:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:31.903 01:02:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:31.903 01:02:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:31.903 01:02:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:31.903 01:02:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:31.903 01:02:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:31.904 01:02:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:31.904 01:02:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:31.904 01:02:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:31.904 01:02:46 -- paths/export.sh@5 -- # export PATH 00:08:31.904 01:02:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:31.904 01:02:46 -- nvmf/common.sh@46 -- # : 0 00:08:31.904 01:02:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:31.904 01:02:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:31.904 01:02:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:31.904 01:02:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:32.162 01:02:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:32.162 01:02:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:32.162 01:02:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:32.162 01:02:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:32.162 01:02:46 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:08:32.162 01:02:46 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:08:32.162 01:02:46 -- target/filesystem.sh@15 -- # nvmftestinit 00:08:32.162 01:02:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:32.162 01:02:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:32.162 01:02:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:32.162 01:02:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:32.162 01:02:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:32.162 01:02:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:32.162 01:02:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:32.162 01:02:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:32.162 01:02:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:32.162 01:02:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:32.162 01:02:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:32.162 01:02:46 -- common/autotest_common.sh@10 -- # set +x 00:08:34.067 01:02:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:34.067 01:02:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:34.067 01:02:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:34.067 01:02:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:34.067 01:02:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:34.067 01:02:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:34.067 01:02:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:34.067 01:02:48 -- nvmf/common.sh@294 -- # net_devs=() 00:08:34.067 01:02:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:34.067 01:02:48 -- nvmf/common.sh@295 -- # e810=() 00:08:34.067 01:02:48 -- nvmf/common.sh@295 -- # local -ga e810 00:08:34.067 01:02:48 -- nvmf/common.sh@296 -- # x722=() 00:08:34.067 01:02:48 -- nvmf/common.sh@296 -- # local -ga x722 00:08:34.067 01:02:48 -- nvmf/common.sh@297 -- # mlx=() 00:08:34.067 01:02:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:34.067 01:02:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:34.067 01:02:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:34.067 01:02:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:34.067 01:02:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:34.067 01:02:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:34.067 01:02:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:34.067 01:02:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:34.067 01:02:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:34.067 01:02:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:34.067 01:02:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:34.067 01:02:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:34.067 01:02:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:34.067 01:02:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:34.067 01:02:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:34.067 01:02:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:34.067 01:02:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:34.067 01:02:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:34.067 01:02:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:34.067 01:02:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:34.067 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:34.067 01:02:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:34.067 01:02:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:34.067 01:02:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:34.067 01:02:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:34.067 01:02:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:34.067 01:02:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:34.067 01:02:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:34.067 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:34.067 01:02:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:34.067 01:02:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:34.067 01:02:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:34.067 01:02:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:34.067 01:02:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:34.067 01:02:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:34.067 01:02:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:34.067 01:02:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:34.067 01:02:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:34.067 01:02:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:34.067 01:02:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:34.067 01:02:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:34.067 01:02:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:34.067 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:34.067 01:02:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:34.067 01:02:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:34.067 01:02:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:34.067 01:02:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:34.067 01:02:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:34.067 01:02:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:34.067 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:34.067 01:02:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:34.067 01:02:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:34.067 01:02:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:34.067 01:02:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:34.067 01:02:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:34.067 01:02:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:34.067 01:02:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:34.067 01:02:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:34.067 01:02:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:34.067 01:02:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:34.067 01:02:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:34.067 01:02:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:34.067 01:02:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:34.067 01:02:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:34.068 01:02:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:34.068 01:02:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:34.068 01:02:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:34.068 01:02:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:34.068 01:02:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:34.068 01:02:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:34.068 01:02:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:34.068 01:02:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:34.068 01:02:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:34.068 01:02:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:34.068 01:02:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:34.326 01:02:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:34.326 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:34.326 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.232 ms 00:08:34.326 00:08:34.326 --- 10.0.0.2 ping statistics --- 00:08:34.326 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:34.326 rtt min/avg/max/mdev = 0.232/0.232/0.232/0.000 ms 00:08:34.326 01:02:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:34.326 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:34.326 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:08:34.326 00:08:34.326 --- 10.0.0.1 ping statistics --- 00:08:34.326 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:34.326 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:08:34.326 01:02:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:34.326 01:02:48 -- nvmf/common.sh@410 -- # return 0 00:08:34.326 01:02:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:34.326 01:02:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:34.326 01:02:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:34.326 01:02:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:34.326 01:02:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:34.326 01:02:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:34.326 01:02:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:34.326 01:02:48 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:08:34.326 01:02:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:34.326 01:02:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:34.326 01:02:48 -- common/autotest_common.sh@10 -- # set +x 00:08:34.326 ************************************ 00:08:34.326 START TEST nvmf_filesystem_no_in_capsule 00:08:34.326 ************************************ 00:08:34.326 01:02:48 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:08:34.326 01:02:48 -- target/filesystem.sh@47 -- # in_capsule=0 00:08:34.326 01:02:48 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:34.326 01:02:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:34.326 01:02:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:34.326 01:02:48 -- common/autotest_common.sh@10 -- # set +x 00:08:34.326 01:02:48 -- nvmf/common.sh@469 -- # nvmfpid=1934501 00:08:34.326 01:02:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:34.326 01:02:48 -- nvmf/common.sh@470 -- # waitforlisten 1934501 00:08:34.326 01:02:48 -- common/autotest_common.sh@829 -- # '[' -z 1934501 ']' 00:08:34.326 01:02:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:34.327 01:02:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:34.327 01:02:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:34.327 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:34.327 01:02:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:34.327 01:02:48 -- common/autotest_common.sh@10 -- # set +x 00:08:34.327 [2024-11-28 01:02:48.759062] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:34.327 [2024-11-28 01:02:48.759146] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:34.327 EAL: No free 2048 kB hugepages reported on node 1 00:08:34.327 [2024-11-28 01:02:48.829495] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:34.327 [2024-11-28 01:02:48.924137] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:34.327 [2024-11-28 01:02:48.924328] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:34.327 [2024-11-28 01:02:48.924352] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:34.327 [2024-11-28 01:02:48.924367] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:34.327 [2024-11-28 01:02:48.924455] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:34.327 [2024-11-28 01:02:48.924538] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:34.327 [2024-11-28 01:02:48.924579] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:34.327 [2024-11-28 01:02:48.924583] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:35.259 01:02:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:35.260 01:02:49 -- common/autotest_common.sh@862 -- # return 0 00:08:35.260 01:02:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:35.260 01:02:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:35.260 01:02:49 -- common/autotest_common.sh@10 -- # set +x 00:08:35.260 01:02:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:35.260 01:02:49 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:35.260 01:02:49 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:35.260 01:02:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:35.260 01:02:49 -- common/autotest_common.sh@10 -- # set +x 00:08:35.260 [2024-11-28 01:02:49.791343] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:35.260 01:02:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:35.260 01:02:49 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:35.260 01:02:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:35.260 01:02:49 -- common/autotest_common.sh@10 -- # set +x 00:08:35.518 Malloc1 00:08:35.518 01:02:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:35.518 01:02:49 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:35.518 01:02:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:35.518 01:02:49 -- common/autotest_common.sh@10 -- # set +x 00:08:35.518 01:02:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:35.518 01:02:49 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:35.518 01:02:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:35.518 01:02:49 -- common/autotest_common.sh@10 -- # set +x 00:08:35.518 01:02:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:35.518 01:02:49 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:35.518 01:02:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:35.518 01:02:49 -- common/autotest_common.sh@10 -- # set +x 00:08:35.518 [2024-11-28 01:02:49.974018] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:35.518 01:02:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:35.518 01:02:49 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:35.518 01:02:49 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:35.518 01:02:49 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:35.518 01:02:49 -- common/autotest_common.sh@1369 -- # local bs 00:08:35.518 01:02:49 -- common/autotest_common.sh@1370 -- # local nb 00:08:35.518 01:02:49 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:35.518 01:02:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:35.518 01:02:49 -- common/autotest_common.sh@10 -- # set +x 00:08:35.518 01:02:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:35.518 01:02:49 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:35.518 { 00:08:35.518 "name": "Malloc1", 00:08:35.518 "aliases": [ 00:08:35.518 "7a1bffe8-d861-4c84-aa57-92b4e97acf5f" 00:08:35.518 ], 00:08:35.518 "product_name": "Malloc disk", 00:08:35.518 "block_size": 512, 00:08:35.518 "num_blocks": 1048576, 00:08:35.518 "uuid": "7a1bffe8-d861-4c84-aa57-92b4e97acf5f", 00:08:35.518 "assigned_rate_limits": { 00:08:35.518 "rw_ios_per_sec": 0, 00:08:35.518 "rw_mbytes_per_sec": 0, 00:08:35.518 "r_mbytes_per_sec": 0, 00:08:35.518 "w_mbytes_per_sec": 0 00:08:35.518 }, 00:08:35.518 "claimed": true, 00:08:35.518 "claim_type": "exclusive_write", 00:08:35.518 "zoned": false, 00:08:35.518 "supported_io_types": { 00:08:35.518 "read": true, 00:08:35.518 "write": true, 00:08:35.518 "unmap": true, 00:08:35.518 "write_zeroes": true, 00:08:35.518 "flush": true, 00:08:35.518 "reset": true, 00:08:35.518 "compare": false, 00:08:35.518 "compare_and_write": false, 00:08:35.518 "abort": true, 00:08:35.518 "nvme_admin": false, 00:08:35.518 "nvme_io": false 00:08:35.518 }, 00:08:35.518 "memory_domains": [ 00:08:35.518 { 00:08:35.518 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:35.518 "dma_device_type": 2 00:08:35.518 } 00:08:35.518 ], 00:08:35.518 "driver_specific": {} 00:08:35.518 } 00:08:35.518 ]' 00:08:35.518 01:02:49 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:35.518 01:02:50 -- common/autotest_common.sh@1372 -- # bs=512 00:08:35.518 01:02:50 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:35.518 01:02:50 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:35.518 01:02:50 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:35.518 01:02:50 -- common/autotest_common.sh@1377 -- # echo 512 00:08:35.518 01:02:50 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:35.518 01:02:50 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:36.083 01:02:50 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:36.083 01:02:50 -- common/autotest_common.sh@1187 -- # local i=0 00:08:36.083 01:02:50 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:36.083 01:02:50 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:36.083 01:02:50 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:38.608 01:02:52 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:38.608 01:02:52 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:38.608 01:02:52 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:38.608 01:02:52 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:38.608 01:02:52 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:38.608 01:02:52 -- common/autotest_common.sh@1197 -- # return 0 00:08:38.609 01:02:52 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:38.609 01:02:52 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:38.609 01:02:52 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:38.609 01:02:52 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:38.609 01:02:52 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:38.609 01:02:52 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:38.609 01:02:52 -- setup/common.sh@80 -- # echo 536870912 00:08:38.609 01:02:52 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:38.609 01:02:52 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:38.609 01:02:52 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:38.609 01:02:52 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:38.609 01:02:52 -- target/filesystem.sh@69 -- # partprobe 00:08:39.542 01:02:53 -- target/filesystem.sh@70 -- # sleep 1 00:08:40.475 01:02:54 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:08:40.475 01:02:54 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:40.475 01:02:54 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:40.475 01:02:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:40.475 01:02:54 -- common/autotest_common.sh@10 -- # set +x 00:08:40.475 ************************************ 00:08:40.475 START TEST filesystem_ext4 00:08:40.475 ************************************ 00:08:40.475 01:02:54 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:40.475 01:02:54 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:40.475 01:02:54 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:40.475 01:02:54 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:40.475 01:02:54 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:40.475 01:02:54 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:40.475 01:02:54 -- common/autotest_common.sh@914 -- # local i=0 00:08:40.475 01:02:54 -- common/autotest_common.sh@915 -- # local force 00:08:40.475 01:02:54 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:40.475 01:02:54 -- common/autotest_common.sh@918 -- # force=-F 00:08:40.475 01:02:54 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:40.475 mke2fs 1.47.0 (5-Feb-2023) 00:08:40.475 Discarding device blocks: 0/522240 done 00:08:40.731 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:40.731 Filesystem UUID: 3a18b858-aa76-406d-a409-aa077bcfd6e9 00:08:40.731 Superblock backups stored on blocks: 00:08:40.731 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:40.731 00:08:40.731 Allocating group tables: 0/64 done 00:08:40.731 Writing inode tables: 0/64 done 00:08:41.293 Creating journal (8192 blocks): done 00:08:41.551 Writing superblocks and filesystem accounting information: 0/6428/64 done 00:08:41.551 00:08:41.551 01:02:56 -- common/autotest_common.sh@931 -- # return 0 00:08:41.551 01:02:56 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:46.813 01:03:01 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:46.813 01:03:01 -- target/filesystem.sh@25 -- # sync 00:08:46.813 01:03:01 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:46.813 01:03:01 -- target/filesystem.sh@27 -- # sync 00:08:46.813 01:03:01 -- target/filesystem.sh@29 -- # i=0 00:08:46.813 01:03:01 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:47.104 01:03:01 -- target/filesystem.sh@37 -- # kill -0 1934501 00:08:47.104 01:03:01 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:47.104 01:03:01 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:47.104 01:03:01 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:47.104 01:03:01 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:47.104 00:08:47.104 real 0m6.514s 00:08:47.104 user 0m0.022s 00:08:47.104 sys 0m0.055s 00:08:47.104 01:03:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:47.104 01:03:01 -- common/autotest_common.sh@10 -- # set +x 00:08:47.104 ************************************ 00:08:47.104 END TEST filesystem_ext4 00:08:47.104 ************************************ 00:08:47.104 01:03:01 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:47.104 01:03:01 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:47.104 01:03:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:47.104 01:03:01 -- common/autotest_common.sh@10 -- # set +x 00:08:47.104 ************************************ 00:08:47.104 START TEST filesystem_btrfs 00:08:47.104 ************************************ 00:08:47.104 01:03:01 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:47.104 01:03:01 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:47.104 01:03:01 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:47.104 01:03:01 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:47.104 01:03:01 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:47.104 01:03:01 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:47.104 01:03:01 -- common/autotest_common.sh@914 -- # local i=0 00:08:47.104 01:03:01 -- common/autotest_common.sh@915 -- # local force 00:08:47.104 01:03:01 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:47.104 01:03:01 -- common/autotest_common.sh@920 -- # force=-f 00:08:47.104 01:03:01 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:47.393 btrfs-progs v6.8.1 00:08:47.393 See https://btrfs.readthedocs.io for more information. 00:08:47.393 00:08:47.393 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:47.393 NOTE: several default settings have changed in version 5.15, please make sure 00:08:47.393 this does not affect your deployments: 00:08:47.393 - DUP for metadata (-m dup) 00:08:47.393 - enabled no-holes (-O no-holes) 00:08:47.393 - enabled free-space-tree (-R free-space-tree) 00:08:47.393 00:08:47.393 Label: (null) 00:08:47.393 UUID: e150b7a3-d645-4be0-93ed-ede420e606eb 00:08:47.393 Node size: 16384 00:08:47.393 Sector size: 4096 (CPU page size: 4096) 00:08:47.393 Filesystem size: 510.00MiB 00:08:47.393 Block group profiles: 00:08:47.393 Data: single 8.00MiB 00:08:47.393 Metadata: DUP 32.00MiB 00:08:47.393 System: DUP 8.00MiB 00:08:47.393 SSD detected: yes 00:08:47.393 Zoned device: no 00:08:47.393 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:47.393 Checksum: crc32c 00:08:47.393 Number of devices: 1 00:08:47.393 Devices: 00:08:47.393 ID SIZE PATH 00:08:47.393 1 510.00MiB /dev/nvme0n1p1 00:08:47.393 00:08:47.393 01:03:01 -- common/autotest_common.sh@931 -- # return 0 00:08:47.393 01:03:01 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:47.960 01:03:02 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:47.960 01:03:02 -- target/filesystem.sh@25 -- # sync 00:08:47.960 01:03:02 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:47.960 01:03:02 -- target/filesystem.sh@27 -- # sync 00:08:47.960 01:03:02 -- target/filesystem.sh@29 -- # i=0 00:08:47.960 01:03:02 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:47.960 01:03:02 -- target/filesystem.sh@37 -- # kill -0 1934501 00:08:47.960 01:03:02 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:47.960 01:03:02 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:47.960 01:03:02 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:47.960 01:03:02 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:47.960 00:08:47.960 real 0m0.988s 00:08:47.960 user 0m0.021s 00:08:47.960 sys 0m0.095s 00:08:47.960 01:03:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:47.960 01:03:02 -- common/autotest_common.sh@10 -- # set +x 00:08:47.960 ************************************ 00:08:47.960 END TEST filesystem_btrfs 00:08:47.960 ************************************ 00:08:47.960 01:03:02 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:47.960 01:03:02 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:47.960 01:03:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:47.960 01:03:02 -- common/autotest_common.sh@10 -- # set +x 00:08:47.960 ************************************ 00:08:47.960 START TEST filesystem_xfs 00:08:47.960 ************************************ 00:08:47.960 01:03:02 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:47.960 01:03:02 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:47.960 01:03:02 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:47.960 01:03:02 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:47.960 01:03:02 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:47.960 01:03:02 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:47.960 01:03:02 -- common/autotest_common.sh@914 -- # local i=0 00:08:47.960 01:03:02 -- common/autotest_common.sh@915 -- # local force 00:08:47.960 01:03:02 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:47.960 01:03:02 -- common/autotest_common.sh@920 -- # force=-f 00:08:47.960 01:03:02 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:47.960 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:47.960 = sectsz=512 attr=2, projid32bit=1 00:08:47.960 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:47.960 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:47.960 data = bsize=4096 blocks=130560, imaxpct=25 00:08:47.960 = sunit=0 swidth=0 blks 00:08:47.960 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:47.960 log =internal log bsize=4096 blocks=16384, version=2 00:08:47.960 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:47.960 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:48.893 Discarding blocks...Done. 00:08:48.893 01:03:03 -- common/autotest_common.sh@931 -- # return 0 00:08:48.893 01:03:03 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:51.423 01:03:05 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:51.423 01:03:05 -- target/filesystem.sh@25 -- # sync 00:08:51.423 01:03:05 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:51.423 01:03:05 -- target/filesystem.sh@27 -- # sync 00:08:51.423 01:03:05 -- target/filesystem.sh@29 -- # i=0 00:08:51.423 01:03:05 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:51.423 01:03:05 -- target/filesystem.sh@37 -- # kill -0 1934501 00:08:51.423 01:03:05 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:51.423 01:03:05 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:51.423 01:03:05 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:51.423 01:03:05 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:51.423 00:08:51.423 real 0m3.264s 00:08:51.423 user 0m0.013s 00:08:51.423 sys 0m0.066s 00:08:51.423 01:03:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:51.423 01:03:05 -- common/autotest_common.sh@10 -- # set +x 00:08:51.423 ************************************ 00:08:51.423 END TEST filesystem_xfs 00:08:51.423 ************************************ 00:08:51.423 01:03:05 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:51.423 01:03:05 -- target/filesystem.sh@93 -- # sync 00:08:51.423 01:03:05 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:51.423 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:51.423 01:03:05 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:51.423 01:03:05 -- common/autotest_common.sh@1208 -- # local i=0 00:08:51.423 01:03:05 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:51.423 01:03:05 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:51.423 01:03:05 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:51.423 01:03:05 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:51.423 01:03:05 -- common/autotest_common.sh@1220 -- # return 0 00:08:51.423 01:03:05 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:51.423 01:03:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.424 01:03:05 -- common/autotest_common.sh@10 -- # set +x 00:08:51.424 01:03:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.424 01:03:05 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:51.424 01:03:05 -- target/filesystem.sh@101 -- # killprocess 1934501 00:08:51.424 01:03:05 -- common/autotest_common.sh@936 -- # '[' -z 1934501 ']' 00:08:51.424 01:03:05 -- common/autotest_common.sh@940 -- # kill -0 1934501 00:08:51.424 01:03:05 -- common/autotest_common.sh@941 -- # uname 00:08:51.424 01:03:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:51.424 01:03:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1934501 00:08:51.424 01:03:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:51.424 01:03:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:51.424 01:03:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1934501' 00:08:51.424 killing process with pid 1934501 00:08:51.424 01:03:05 -- common/autotest_common.sh@955 -- # kill 1934501 00:08:51.424 01:03:05 -- common/autotest_common.sh@960 -- # wait 1934501 00:08:51.990 01:03:06 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:51.990 00:08:51.990 real 0m17.712s 00:08:51.990 user 1m8.532s 00:08:51.990 sys 0m2.267s 00:08:51.990 01:03:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:51.990 01:03:06 -- common/autotest_common.sh@10 -- # set +x 00:08:51.990 ************************************ 00:08:51.990 END TEST nvmf_filesystem_no_in_capsule 00:08:51.990 ************************************ 00:08:51.990 01:03:06 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:51.990 01:03:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:51.990 01:03:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:51.990 01:03:06 -- common/autotest_common.sh@10 -- # set +x 00:08:51.990 ************************************ 00:08:51.990 START TEST nvmf_filesystem_in_capsule 00:08:51.990 ************************************ 00:08:51.990 01:03:06 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:08:51.990 01:03:06 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:51.990 01:03:06 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:51.990 01:03:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:51.990 01:03:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:51.990 01:03:06 -- common/autotest_common.sh@10 -- # set +x 00:08:51.990 01:03:06 -- nvmf/common.sh@469 -- # nvmfpid=1937039 00:08:51.990 01:03:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:51.990 01:03:06 -- nvmf/common.sh@470 -- # waitforlisten 1937039 00:08:51.990 01:03:06 -- common/autotest_common.sh@829 -- # '[' -z 1937039 ']' 00:08:51.990 01:03:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:51.990 01:03:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:51.990 01:03:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:51.990 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:51.990 01:03:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:51.990 01:03:06 -- common/autotest_common.sh@10 -- # set +x 00:08:51.990 [2024-11-28 01:03:06.499938] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:51.990 [2024-11-28 01:03:06.500031] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:51.990 EAL: No free 2048 kB hugepages reported on node 1 00:08:51.990 [2024-11-28 01:03:06.569916] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:52.248 [2024-11-28 01:03:06.661326] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:52.248 [2024-11-28 01:03:06.661492] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:52.248 [2024-11-28 01:03:06.661512] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:52.248 [2024-11-28 01:03:06.661534] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:52.248 [2024-11-28 01:03:06.661597] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:52.248 [2024-11-28 01:03:06.661665] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:52.248 [2024-11-28 01:03:06.661715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:52.248 [2024-11-28 01:03:06.661718] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:53.183 01:03:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:53.183 01:03:07 -- common/autotest_common.sh@862 -- # return 0 00:08:53.183 01:03:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:53.183 01:03:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:53.183 01:03:07 -- common/autotest_common.sh@10 -- # set +x 00:08:53.183 01:03:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:53.183 01:03:07 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:53.183 01:03:07 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:08:53.183 01:03:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.183 01:03:07 -- common/autotest_common.sh@10 -- # set +x 00:08:53.183 [2024-11-28 01:03:07.518260] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:53.183 01:03:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.183 01:03:07 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:53.183 01:03:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.183 01:03:07 -- common/autotest_common.sh@10 -- # set +x 00:08:53.183 Malloc1 00:08:53.183 01:03:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.183 01:03:07 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:53.183 01:03:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.183 01:03:07 -- common/autotest_common.sh@10 -- # set +x 00:08:53.183 01:03:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.183 01:03:07 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:53.183 01:03:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.183 01:03:07 -- common/autotest_common.sh@10 -- # set +x 00:08:53.183 01:03:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.183 01:03:07 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:53.183 01:03:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.183 01:03:07 -- common/autotest_common.sh@10 -- # set +x 00:08:53.183 [2024-11-28 01:03:07.693033] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:53.183 01:03:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.183 01:03:07 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:53.183 01:03:07 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:53.183 01:03:07 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:53.183 01:03:07 -- common/autotest_common.sh@1369 -- # local bs 00:08:53.183 01:03:07 -- common/autotest_common.sh@1370 -- # local nb 00:08:53.183 01:03:07 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:53.183 01:03:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:53.183 01:03:07 -- common/autotest_common.sh@10 -- # set +x 00:08:53.183 01:03:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:53.183 01:03:07 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:53.183 { 00:08:53.183 "name": "Malloc1", 00:08:53.183 "aliases": [ 00:08:53.183 "b6585bea-208f-4dab-934f-838534517ac5" 00:08:53.183 ], 00:08:53.183 "product_name": "Malloc disk", 00:08:53.183 "block_size": 512, 00:08:53.183 "num_blocks": 1048576, 00:08:53.183 "uuid": "b6585bea-208f-4dab-934f-838534517ac5", 00:08:53.183 "assigned_rate_limits": { 00:08:53.183 "rw_ios_per_sec": 0, 00:08:53.183 "rw_mbytes_per_sec": 0, 00:08:53.183 "r_mbytes_per_sec": 0, 00:08:53.183 "w_mbytes_per_sec": 0 00:08:53.183 }, 00:08:53.183 "claimed": true, 00:08:53.183 "claim_type": "exclusive_write", 00:08:53.183 "zoned": false, 00:08:53.183 "supported_io_types": { 00:08:53.183 "read": true, 00:08:53.183 "write": true, 00:08:53.183 "unmap": true, 00:08:53.183 "write_zeroes": true, 00:08:53.183 "flush": true, 00:08:53.183 "reset": true, 00:08:53.183 "compare": false, 00:08:53.183 "compare_and_write": false, 00:08:53.183 "abort": true, 00:08:53.183 "nvme_admin": false, 00:08:53.183 "nvme_io": false 00:08:53.183 }, 00:08:53.183 "memory_domains": [ 00:08:53.183 { 00:08:53.183 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:53.183 "dma_device_type": 2 00:08:53.183 } 00:08:53.183 ], 00:08:53.183 "driver_specific": {} 00:08:53.183 } 00:08:53.183 ]' 00:08:53.183 01:03:07 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:53.183 01:03:07 -- common/autotest_common.sh@1372 -- # bs=512 00:08:53.183 01:03:07 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:53.441 01:03:07 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:53.441 01:03:07 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:53.441 01:03:07 -- common/autotest_common.sh@1377 -- # echo 512 00:08:53.441 01:03:07 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:53.441 01:03:07 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:54.008 01:03:08 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:54.008 01:03:08 -- common/autotest_common.sh@1187 -- # local i=0 00:08:54.008 01:03:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:54.008 01:03:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:54.008 01:03:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:55.906 01:03:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:55.906 01:03:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:55.906 01:03:10 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:55.906 01:03:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:55.906 01:03:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:55.906 01:03:10 -- common/autotest_common.sh@1197 -- # return 0 00:08:55.906 01:03:10 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:55.906 01:03:10 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:56.164 01:03:10 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:56.164 01:03:10 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:56.164 01:03:10 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:56.164 01:03:10 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:56.164 01:03:10 -- setup/common.sh@80 -- # echo 536870912 00:08:56.164 01:03:10 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:56.164 01:03:10 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:56.164 01:03:10 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:56.164 01:03:10 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:56.164 01:03:10 -- target/filesystem.sh@69 -- # partprobe 00:08:56.423 01:03:11 -- target/filesystem.sh@70 -- # sleep 1 00:08:57.798 01:03:12 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:57.798 01:03:12 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:57.798 01:03:12 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:57.798 01:03:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:57.798 01:03:12 -- common/autotest_common.sh@10 -- # set +x 00:08:57.798 ************************************ 00:08:57.798 START TEST filesystem_in_capsule_ext4 00:08:57.798 ************************************ 00:08:57.798 01:03:12 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:57.798 01:03:12 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:57.798 01:03:12 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:57.798 01:03:12 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:57.798 01:03:12 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:57.798 01:03:12 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:57.798 01:03:12 -- common/autotest_common.sh@914 -- # local i=0 00:08:57.798 01:03:12 -- common/autotest_common.sh@915 -- # local force 00:08:57.798 01:03:12 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:57.798 01:03:12 -- common/autotest_common.sh@918 -- # force=-F 00:08:57.798 01:03:12 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:57.798 mke2fs 1.47.0 (5-Feb-2023) 00:08:57.798 Discarding device blocks: 0/522240 done 00:08:57.798 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:57.798 Filesystem UUID: f00a13dc-2b2a-4502-9b97-7e5891659e9d 00:08:57.798 Superblock backups stored on blocks: 00:08:57.798 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:57.798 00:08:57.798 Allocating group tables: 0/64 done 00:08:57.798 Writing inode tables: 0/64 done 00:08:59.693 Creating journal (8192 blocks): done 00:08:59.693 Writing superblocks and filesystem accounting information: 0/64 done 00:08:59.693 00:08:59.693 01:03:14 -- common/autotest_common.sh@931 -- # return 0 00:08:59.693 01:03:14 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:09:06.246 01:03:20 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:09:06.246 01:03:20 -- target/filesystem.sh@25 -- # sync 00:09:06.246 01:03:20 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:09:06.246 01:03:20 -- target/filesystem.sh@27 -- # sync 00:09:06.246 01:03:20 -- target/filesystem.sh@29 -- # i=0 00:09:06.246 01:03:20 -- target/filesystem.sh@30 -- # umount /mnt/device 00:09:06.246 01:03:20 -- target/filesystem.sh@37 -- # kill -0 1937039 00:09:06.246 01:03:20 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:09:06.246 01:03:20 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:09:06.246 01:03:20 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:09:06.246 01:03:20 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:09:06.246 00:09:06.246 real 0m8.112s 00:09:06.246 user 0m0.017s 00:09:06.246 sys 0m0.069s 00:09:06.246 01:03:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:06.246 01:03:20 -- common/autotest_common.sh@10 -- # set +x 00:09:06.246 ************************************ 00:09:06.246 END TEST filesystem_in_capsule_ext4 00:09:06.246 ************************************ 00:09:06.246 01:03:20 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:09:06.246 01:03:20 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:09:06.246 01:03:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:06.246 01:03:20 -- common/autotest_common.sh@10 -- # set +x 00:09:06.246 ************************************ 00:09:06.246 START TEST filesystem_in_capsule_btrfs 00:09:06.246 ************************************ 00:09:06.246 01:03:20 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:09:06.246 01:03:20 -- target/filesystem.sh@18 -- # fstype=btrfs 00:09:06.246 01:03:20 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:09:06.246 01:03:20 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:09:06.246 01:03:20 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:09:06.246 01:03:20 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:09:06.246 01:03:20 -- common/autotest_common.sh@914 -- # local i=0 00:09:06.246 01:03:20 -- common/autotest_common.sh@915 -- # local force 00:09:06.246 01:03:20 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:09:06.246 01:03:20 -- common/autotest_common.sh@920 -- # force=-f 00:09:06.246 01:03:20 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:09:06.246 btrfs-progs v6.8.1 00:09:06.246 See https://btrfs.readthedocs.io for more information. 00:09:06.246 00:09:06.246 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:09:06.246 NOTE: several default settings have changed in version 5.15, please make sure 00:09:06.246 this does not affect your deployments: 00:09:06.246 - DUP for metadata (-m dup) 00:09:06.246 - enabled no-holes (-O no-holes) 00:09:06.246 - enabled free-space-tree (-R free-space-tree) 00:09:06.246 00:09:06.246 Label: (null) 00:09:06.246 UUID: f4b15c73-8bb1-4878-bed1-373827e10a65 00:09:06.246 Node size: 16384 00:09:06.246 Sector size: 4096 (CPU page size: 4096) 00:09:06.246 Filesystem size: 510.00MiB 00:09:06.246 Block group profiles: 00:09:06.246 Data: single 8.00MiB 00:09:06.246 Metadata: DUP 32.00MiB 00:09:06.246 System: DUP 8.00MiB 00:09:06.246 SSD detected: yes 00:09:06.246 Zoned device: no 00:09:06.246 Features: extref, skinny-metadata, no-holes, free-space-tree 00:09:06.246 Checksum: crc32c 00:09:06.246 Number of devices: 1 00:09:06.246 Devices: 00:09:06.246 ID SIZE PATH 00:09:06.246 1 510.00MiB /dev/nvme0n1p1 00:09:06.246 00:09:06.247 01:03:20 -- common/autotest_common.sh@931 -- # return 0 00:09:06.247 01:03:20 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:09:06.247 01:03:20 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:09:06.247 01:03:20 -- target/filesystem.sh@25 -- # sync 00:09:06.247 01:03:20 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:09:06.247 01:03:20 -- target/filesystem.sh@27 -- # sync 00:09:06.247 01:03:20 -- target/filesystem.sh@29 -- # i=0 00:09:06.247 01:03:20 -- target/filesystem.sh@30 -- # umount /mnt/device 00:09:06.247 01:03:20 -- target/filesystem.sh@37 -- # kill -0 1937039 00:09:06.247 01:03:20 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:09:06.247 01:03:20 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:09:06.247 01:03:20 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:09:06.247 01:03:20 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:09:06.247 00:09:06.247 real 0m0.368s 00:09:06.247 user 0m0.023s 00:09:06.247 sys 0m0.087s 00:09:06.247 01:03:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:06.247 01:03:20 -- common/autotest_common.sh@10 -- # set +x 00:09:06.247 ************************************ 00:09:06.247 END TEST filesystem_in_capsule_btrfs 00:09:06.247 ************************************ 00:09:06.247 01:03:20 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:09:06.247 01:03:20 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:09:06.247 01:03:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:06.247 01:03:20 -- common/autotest_common.sh@10 -- # set +x 00:09:06.247 ************************************ 00:09:06.247 START TEST filesystem_in_capsule_xfs 00:09:06.247 ************************************ 00:09:06.247 01:03:20 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:09:06.247 01:03:20 -- target/filesystem.sh@18 -- # fstype=xfs 00:09:06.247 01:03:20 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:09:06.247 01:03:20 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:09:06.247 01:03:20 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:09:06.247 01:03:20 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:09:06.247 01:03:20 -- common/autotest_common.sh@914 -- # local i=0 00:09:06.247 01:03:20 -- common/autotest_common.sh@915 -- # local force 00:09:06.247 01:03:20 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:09:06.247 01:03:20 -- common/autotest_common.sh@920 -- # force=-f 00:09:06.247 01:03:20 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:09:06.505 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:09:06.505 = sectsz=512 attr=2, projid32bit=1 00:09:06.505 = crc=1 finobt=1, sparse=1, rmapbt=0 00:09:06.505 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:09:06.505 data = bsize=4096 blocks=130560, imaxpct=25 00:09:06.505 = sunit=0 swidth=0 blks 00:09:06.505 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:09:06.505 log =internal log bsize=4096 blocks=16384, version=2 00:09:06.505 = sectsz=512 sunit=0 blks, lazy-count=1 00:09:06.505 realtime =none extsz=4096 blocks=0, rtextents=0 00:09:07.440 Discarding blocks...Done. 00:09:07.440 01:03:21 -- common/autotest_common.sh@931 -- # return 0 00:09:07.440 01:03:21 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:09:09.339 01:03:23 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:09:09.597 01:03:23 -- target/filesystem.sh@25 -- # sync 00:09:09.597 01:03:23 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:09:09.597 01:03:23 -- target/filesystem.sh@27 -- # sync 00:09:09.597 01:03:23 -- target/filesystem.sh@29 -- # i=0 00:09:09.597 01:03:23 -- target/filesystem.sh@30 -- # umount /mnt/device 00:09:09.597 01:03:23 -- target/filesystem.sh@37 -- # kill -0 1937039 00:09:09.597 01:03:23 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:09:09.597 01:03:23 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:09:09.597 01:03:23 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:09:09.597 01:03:23 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:09:09.597 00:09:09.597 real 0m3.442s 00:09:09.597 user 0m0.019s 00:09:09.597 sys 0m0.058s 00:09:09.597 01:03:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:09.597 01:03:24 -- common/autotest_common.sh@10 -- # set +x 00:09:09.597 ************************************ 00:09:09.597 END TEST filesystem_in_capsule_xfs 00:09:09.597 ************************************ 00:09:09.597 01:03:24 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:09:09.597 01:03:24 -- target/filesystem.sh@93 -- # sync 00:09:09.597 01:03:24 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:09.597 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:09.597 01:03:24 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:09.597 01:03:24 -- common/autotest_common.sh@1208 -- # local i=0 00:09:09.855 01:03:24 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:09:09.855 01:03:24 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:09.855 01:03:24 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:09:09.855 01:03:24 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:09.855 01:03:24 -- common/autotest_common.sh@1220 -- # return 0 00:09:09.855 01:03:24 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:09.855 01:03:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.855 01:03:24 -- common/autotest_common.sh@10 -- # set +x 00:09:09.855 01:03:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.855 01:03:24 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:09:09.855 01:03:24 -- target/filesystem.sh@101 -- # killprocess 1937039 00:09:09.855 01:03:24 -- common/autotest_common.sh@936 -- # '[' -z 1937039 ']' 00:09:09.855 01:03:24 -- common/autotest_common.sh@940 -- # kill -0 1937039 00:09:09.855 01:03:24 -- common/autotest_common.sh@941 -- # uname 00:09:09.855 01:03:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:09.855 01:03:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1937039 00:09:09.855 01:03:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:09.855 01:03:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:09.855 01:03:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1937039' 00:09:09.855 killing process with pid 1937039 00:09:09.855 01:03:24 -- common/autotest_common.sh@955 -- # kill 1937039 00:09:09.855 01:03:24 -- common/autotest_common.sh@960 -- # wait 1937039 00:09:10.114 01:03:24 -- target/filesystem.sh@102 -- # nvmfpid= 00:09:10.114 00:09:10.114 real 0m18.257s 00:09:10.114 user 1m10.814s 00:09:10.114 sys 0m2.186s 00:09:10.114 01:03:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:10.114 01:03:24 -- common/autotest_common.sh@10 -- # set +x 00:09:10.114 ************************************ 00:09:10.114 END TEST nvmf_filesystem_in_capsule 00:09:10.114 ************************************ 00:09:10.374 01:03:24 -- target/filesystem.sh@108 -- # nvmftestfini 00:09:10.374 01:03:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:09:10.374 01:03:24 -- nvmf/common.sh@116 -- # sync 00:09:10.374 01:03:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:09:10.374 01:03:24 -- nvmf/common.sh@119 -- # set +e 00:09:10.374 01:03:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:09:10.374 01:03:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:09:10.374 rmmod nvme_tcp 00:09:10.374 rmmod nvme_fabrics 00:09:10.374 rmmod nvme_keyring 00:09:10.374 01:03:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:09:10.374 01:03:24 -- nvmf/common.sh@123 -- # set -e 00:09:10.374 01:03:24 -- nvmf/common.sh@124 -- # return 0 00:09:10.374 01:03:24 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:09:10.374 01:03:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:09:10.374 01:03:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:09:10.374 01:03:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:09:10.374 01:03:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:10.374 01:03:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:09:10.374 01:03:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:10.374 01:03:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:10.374 01:03:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:12.288 01:03:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:09:12.288 00:09:12.288 real 0m40.695s 00:09:12.288 user 2m20.402s 00:09:12.288 sys 0m6.144s 00:09:12.288 01:03:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:12.288 01:03:26 -- common/autotest_common.sh@10 -- # set +x 00:09:12.288 ************************************ 00:09:12.288 END TEST nvmf_filesystem 00:09:12.288 ************************************ 00:09:12.288 01:03:26 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:09:12.288 01:03:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:12.288 01:03:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:12.288 01:03:26 -- common/autotest_common.sh@10 -- # set +x 00:09:12.288 ************************************ 00:09:12.288 START TEST nvmf_discovery 00:09:12.288 ************************************ 00:09:12.288 01:03:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:09:12.548 * Looking for test storage... 00:09:12.548 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:12.548 01:03:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:09:12.548 01:03:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:09:12.548 01:03:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:09:12.548 01:03:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:09:12.548 01:03:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:09:12.548 01:03:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:09:12.548 01:03:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:09:12.548 01:03:26 -- scripts/common.sh@335 -- # IFS=.-: 00:09:12.548 01:03:26 -- scripts/common.sh@335 -- # read -ra ver1 00:09:12.548 01:03:26 -- scripts/common.sh@336 -- # IFS=.-: 00:09:12.548 01:03:26 -- scripts/common.sh@336 -- # read -ra ver2 00:09:12.548 01:03:26 -- scripts/common.sh@337 -- # local 'op=<' 00:09:12.548 01:03:26 -- scripts/common.sh@339 -- # ver1_l=2 00:09:12.548 01:03:26 -- scripts/common.sh@340 -- # ver2_l=1 00:09:12.548 01:03:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:09:12.548 01:03:26 -- scripts/common.sh@343 -- # case "$op" in 00:09:12.548 01:03:26 -- scripts/common.sh@344 -- # : 1 00:09:12.548 01:03:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:09:12.548 01:03:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:12.548 01:03:26 -- scripts/common.sh@364 -- # decimal 1 00:09:12.548 01:03:26 -- scripts/common.sh@352 -- # local d=1 00:09:12.548 01:03:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:12.548 01:03:26 -- scripts/common.sh@354 -- # echo 1 00:09:12.548 01:03:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:09:12.548 01:03:26 -- scripts/common.sh@365 -- # decimal 2 00:09:12.548 01:03:26 -- scripts/common.sh@352 -- # local d=2 00:09:12.548 01:03:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:12.548 01:03:26 -- scripts/common.sh@354 -- # echo 2 00:09:12.548 01:03:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:09:12.548 01:03:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:09:12.548 01:03:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:09:12.548 01:03:26 -- scripts/common.sh@367 -- # return 0 00:09:12.548 01:03:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:12.548 01:03:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:09:12.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:12.548 --rc genhtml_branch_coverage=1 00:09:12.548 --rc genhtml_function_coverage=1 00:09:12.548 --rc genhtml_legend=1 00:09:12.548 --rc geninfo_all_blocks=1 00:09:12.548 --rc geninfo_unexecuted_blocks=1 00:09:12.548 00:09:12.548 ' 00:09:12.548 01:03:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:09:12.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:12.548 --rc genhtml_branch_coverage=1 00:09:12.548 --rc genhtml_function_coverage=1 00:09:12.548 --rc genhtml_legend=1 00:09:12.548 --rc geninfo_all_blocks=1 00:09:12.548 --rc geninfo_unexecuted_blocks=1 00:09:12.548 00:09:12.548 ' 00:09:12.548 01:03:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:09:12.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:12.548 --rc genhtml_branch_coverage=1 00:09:12.548 --rc genhtml_function_coverage=1 00:09:12.548 --rc genhtml_legend=1 00:09:12.548 --rc geninfo_all_blocks=1 00:09:12.548 --rc geninfo_unexecuted_blocks=1 00:09:12.548 00:09:12.548 ' 00:09:12.548 01:03:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:09:12.548 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:12.548 --rc genhtml_branch_coverage=1 00:09:12.548 --rc genhtml_function_coverage=1 00:09:12.548 --rc genhtml_legend=1 00:09:12.548 --rc geninfo_all_blocks=1 00:09:12.548 --rc geninfo_unexecuted_blocks=1 00:09:12.548 00:09:12.548 ' 00:09:12.548 01:03:26 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:12.548 01:03:26 -- nvmf/common.sh@7 -- # uname -s 00:09:12.548 01:03:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:12.548 01:03:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:12.548 01:03:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:12.548 01:03:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:12.548 01:03:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:12.549 01:03:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:12.549 01:03:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:12.549 01:03:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:12.549 01:03:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:12.549 01:03:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:12.549 01:03:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:09:12.549 01:03:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:09:12.549 01:03:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:12.549 01:03:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:12.549 01:03:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:12.549 01:03:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:12.549 01:03:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:12.549 01:03:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:12.549 01:03:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:12.549 01:03:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:12.549 01:03:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:12.549 01:03:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:12.549 01:03:27 -- paths/export.sh@5 -- # export PATH 00:09:12.549 01:03:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:12.549 01:03:27 -- nvmf/common.sh@46 -- # : 0 00:09:12.549 01:03:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:09:12.549 01:03:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:09:12.549 01:03:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:09:12.549 01:03:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:12.549 01:03:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:12.549 01:03:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:09:12.549 01:03:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:09:12.549 01:03:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:09:12.549 01:03:27 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:09:12.549 01:03:27 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:09:12.549 01:03:27 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:09:12.549 01:03:27 -- target/discovery.sh@15 -- # hash nvme 00:09:12.549 01:03:27 -- target/discovery.sh@20 -- # nvmftestinit 00:09:12.549 01:03:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:09:12.549 01:03:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:12.549 01:03:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:09:12.549 01:03:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:09:12.549 01:03:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:09:12.549 01:03:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:12.549 01:03:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:12.549 01:03:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:12.549 01:03:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:09:12.549 01:03:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:09:12.549 01:03:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:09:12.549 01:03:27 -- common/autotest_common.sh@10 -- # set +x 00:09:15.083 01:03:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:15.083 01:03:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:15.083 01:03:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:15.083 01:03:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:15.083 01:03:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:15.083 01:03:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:15.083 01:03:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:15.083 01:03:29 -- nvmf/common.sh@294 -- # net_devs=() 00:09:15.083 01:03:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:15.083 01:03:29 -- nvmf/common.sh@295 -- # e810=() 00:09:15.083 01:03:29 -- nvmf/common.sh@295 -- # local -ga e810 00:09:15.083 01:03:29 -- nvmf/common.sh@296 -- # x722=() 00:09:15.083 01:03:29 -- nvmf/common.sh@296 -- # local -ga x722 00:09:15.083 01:03:29 -- nvmf/common.sh@297 -- # mlx=() 00:09:15.083 01:03:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:15.083 01:03:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:15.083 01:03:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:15.083 01:03:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:15.083 01:03:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:15.083 01:03:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:15.083 01:03:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:15.083 01:03:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:15.083 01:03:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:15.083 01:03:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:15.083 01:03:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:15.083 01:03:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:15.083 01:03:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:15.083 01:03:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:15.083 01:03:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:15.083 01:03:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:15.083 01:03:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:15.083 01:03:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:15.083 01:03:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:15.083 01:03:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:15.083 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:15.083 01:03:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:15.083 01:03:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:15.083 01:03:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:15.083 01:03:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:15.083 01:03:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:15.083 01:03:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:15.083 01:03:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:15.083 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:15.083 01:03:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:15.083 01:03:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:15.083 01:03:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:15.083 01:03:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:15.083 01:03:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:15.083 01:03:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:15.083 01:03:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:15.083 01:03:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:15.083 01:03:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:15.083 01:03:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:15.083 01:03:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:15.083 01:03:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:15.083 01:03:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:15.083 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:15.083 01:03:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:15.083 01:03:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:15.083 01:03:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:15.083 01:03:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:15.083 01:03:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:15.083 01:03:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:15.083 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:15.083 01:03:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:15.083 01:03:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:15.083 01:03:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:15.083 01:03:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:15.083 01:03:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:15.083 01:03:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:15.083 01:03:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:15.083 01:03:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:15.083 01:03:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:15.083 01:03:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:15.083 01:03:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:15.084 01:03:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:15.084 01:03:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:15.084 01:03:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:15.084 01:03:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:15.084 01:03:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:15.084 01:03:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:15.084 01:03:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:15.084 01:03:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:15.084 01:03:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:15.084 01:03:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:15.084 01:03:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:15.084 01:03:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:15.084 01:03:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:15.084 01:03:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:15.084 01:03:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:15.084 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:15.084 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:09:15.084 00:09:15.084 --- 10.0.0.2 ping statistics --- 00:09:15.084 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:15.084 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:09:15.084 01:03:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:15.084 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:15.084 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:09:15.084 00:09:15.084 --- 10.0.0.1 ping statistics --- 00:09:15.084 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:15.084 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:09:15.084 01:03:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:15.084 01:03:29 -- nvmf/common.sh@410 -- # return 0 00:09:15.084 01:03:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:15.084 01:03:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:15.084 01:03:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:15.084 01:03:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:15.084 01:03:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:15.084 01:03:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:15.084 01:03:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:15.084 01:03:29 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:09:15.084 01:03:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:15.084 01:03:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:15.084 01:03:29 -- common/autotest_common.sh@10 -- # set +x 00:09:15.084 01:03:29 -- nvmf/common.sh@469 -- # nvmfpid=1941922 00:09:15.084 01:03:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:15.084 01:03:29 -- nvmf/common.sh@470 -- # waitforlisten 1941922 00:09:15.084 01:03:29 -- common/autotest_common.sh@829 -- # '[' -z 1941922 ']' 00:09:15.084 01:03:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:15.084 01:03:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:15.084 01:03:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:15.084 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:15.084 01:03:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:15.084 01:03:29 -- common/autotest_common.sh@10 -- # set +x 00:09:15.084 [2024-11-28 01:03:29.271095] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:09:15.084 [2024-11-28 01:03:29.271196] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:15.084 EAL: No free 2048 kB hugepages reported on node 1 00:09:15.084 [2024-11-28 01:03:29.343013] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:15.084 [2024-11-28 01:03:29.435755] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:15.084 [2024-11-28 01:03:29.435926] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:15.084 [2024-11-28 01:03:29.435946] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:15.084 [2024-11-28 01:03:29.435961] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:15.084 [2024-11-28 01:03:29.436064] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:15.084 [2024-11-28 01:03:29.436122] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:15.084 [2024-11-28 01:03:29.436173] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:15.084 [2024-11-28 01:03:29.436176] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:15.649 01:03:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:15.649 01:03:30 -- common/autotest_common.sh@862 -- # return 0 00:09:15.649 01:03:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:15.649 01:03:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:15.649 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:15.907 01:03:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:15.907 01:03:30 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:15.907 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.907 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:15.907 [2024-11-28 01:03:30.269229] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:15.907 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.907 01:03:30 -- target/discovery.sh@26 -- # seq 1 4 00:09:15.907 01:03:30 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:15.907 01:03:30 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:09:15.907 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.907 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:15.907 Null1 00:09:15.907 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.907 01:03:30 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:09:15.907 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.907 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:15.907 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.907 01:03:30 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:09:15.907 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.907 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:15.907 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.907 01:03:30 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:15.907 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.907 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:15.907 [2024-11-28 01:03:30.309503] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:15.907 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.907 01:03:30 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:15.907 01:03:30 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:09:15.907 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.907 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:15.907 Null2 00:09:15.907 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.907 01:03:30 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:09:15.907 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.907 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:15.907 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.907 01:03:30 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:09:15.907 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.907 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:15.907 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.907 01:03:30 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:09:15.907 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.907 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:15.907 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.907 01:03:30 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:15.907 01:03:30 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:09:15.907 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.907 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:15.907 Null3 00:09:15.907 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.907 01:03:30 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:09:15.907 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.907 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:15.907 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.907 01:03:30 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:09:15.907 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.907 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:15.907 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.907 01:03:30 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:09:15.907 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.907 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:15.907 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.907 01:03:30 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:15.907 01:03:30 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:09:15.907 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.907 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:15.907 Null4 00:09:15.907 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.907 01:03:30 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:09:15.907 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.907 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:15.907 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.907 01:03:30 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:09:15.907 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.907 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:15.907 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.907 01:03:30 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:09:15.907 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.907 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:15.907 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.907 01:03:30 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:09:15.907 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.907 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:15.907 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.907 01:03:30 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:09:15.907 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:15.907 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:15.907 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.907 01:03:30 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:09:16.166 00:09:16.166 Discovery Log Number of Records 6, Generation counter 6 00:09:16.166 =====Discovery Log Entry 0====== 00:09:16.166 trtype: tcp 00:09:16.166 adrfam: ipv4 00:09:16.166 subtype: current discovery subsystem 00:09:16.166 treq: not required 00:09:16.166 portid: 0 00:09:16.166 trsvcid: 4420 00:09:16.166 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:09:16.166 traddr: 10.0.0.2 00:09:16.166 eflags: explicit discovery connections, duplicate discovery information 00:09:16.166 sectype: none 00:09:16.166 =====Discovery Log Entry 1====== 00:09:16.166 trtype: tcp 00:09:16.166 adrfam: ipv4 00:09:16.166 subtype: nvme subsystem 00:09:16.166 treq: not required 00:09:16.166 portid: 0 00:09:16.166 trsvcid: 4420 00:09:16.166 subnqn: nqn.2016-06.io.spdk:cnode1 00:09:16.166 traddr: 10.0.0.2 00:09:16.166 eflags: none 00:09:16.166 sectype: none 00:09:16.166 =====Discovery Log Entry 2====== 00:09:16.166 trtype: tcp 00:09:16.166 adrfam: ipv4 00:09:16.166 subtype: nvme subsystem 00:09:16.166 treq: not required 00:09:16.166 portid: 0 00:09:16.166 trsvcid: 4420 00:09:16.166 subnqn: nqn.2016-06.io.spdk:cnode2 00:09:16.166 traddr: 10.0.0.2 00:09:16.166 eflags: none 00:09:16.166 sectype: none 00:09:16.166 =====Discovery Log Entry 3====== 00:09:16.166 trtype: tcp 00:09:16.166 adrfam: ipv4 00:09:16.166 subtype: nvme subsystem 00:09:16.166 treq: not required 00:09:16.166 portid: 0 00:09:16.166 trsvcid: 4420 00:09:16.166 subnqn: nqn.2016-06.io.spdk:cnode3 00:09:16.166 traddr: 10.0.0.2 00:09:16.166 eflags: none 00:09:16.166 sectype: none 00:09:16.166 =====Discovery Log Entry 4====== 00:09:16.166 trtype: tcp 00:09:16.166 adrfam: ipv4 00:09:16.166 subtype: nvme subsystem 00:09:16.166 treq: not required 00:09:16.166 portid: 0 00:09:16.166 trsvcid: 4420 00:09:16.166 subnqn: nqn.2016-06.io.spdk:cnode4 00:09:16.166 traddr: 10.0.0.2 00:09:16.166 eflags: none 00:09:16.166 sectype: none 00:09:16.166 =====Discovery Log Entry 5====== 00:09:16.166 trtype: tcp 00:09:16.166 adrfam: ipv4 00:09:16.166 subtype: discovery subsystem referral 00:09:16.166 treq: not required 00:09:16.166 portid: 0 00:09:16.166 trsvcid: 4430 00:09:16.166 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:09:16.166 traddr: 10.0.0.2 00:09:16.166 eflags: none 00:09:16.166 sectype: none 00:09:16.166 01:03:30 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:09:16.166 Perform nvmf subsystem discovery via RPC 00:09:16.166 01:03:30 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:09:16.166 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.166 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:16.166 [2024-11-28 01:03:30.666611] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:09:16.166 [ 00:09:16.166 { 00:09:16.166 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:09:16.166 "subtype": "Discovery", 00:09:16.166 "listen_addresses": [ 00:09:16.166 { 00:09:16.166 "transport": "TCP", 00:09:16.166 "trtype": "TCP", 00:09:16.166 "adrfam": "IPv4", 00:09:16.166 "traddr": "10.0.0.2", 00:09:16.166 "trsvcid": "4420" 00:09:16.166 } 00:09:16.166 ], 00:09:16.166 "allow_any_host": true, 00:09:16.166 "hosts": [] 00:09:16.166 }, 00:09:16.166 { 00:09:16.166 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:09:16.166 "subtype": "NVMe", 00:09:16.166 "listen_addresses": [ 00:09:16.166 { 00:09:16.166 "transport": "TCP", 00:09:16.166 "trtype": "TCP", 00:09:16.166 "adrfam": "IPv4", 00:09:16.166 "traddr": "10.0.0.2", 00:09:16.166 "trsvcid": "4420" 00:09:16.166 } 00:09:16.166 ], 00:09:16.166 "allow_any_host": true, 00:09:16.166 "hosts": [], 00:09:16.166 "serial_number": "SPDK00000000000001", 00:09:16.166 "model_number": "SPDK bdev Controller", 00:09:16.166 "max_namespaces": 32, 00:09:16.166 "min_cntlid": 1, 00:09:16.166 "max_cntlid": 65519, 00:09:16.166 "namespaces": [ 00:09:16.166 { 00:09:16.166 "nsid": 1, 00:09:16.166 "bdev_name": "Null1", 00:09:16.166 "name": "Null1", 00:09:16.166 "nguid": "D2A86FF9F5AA434AB0E8DE74C26FE73F", 00:09:16.166 "uuid": "d2a86ff9-f5aa-434a-b0e8-de74c26fe73f" 00:09:16.166 } 00:09:16.166 ] 00:09:16.166 }, 00:09:16.166 { 00:09:16.166 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:09:16.166 "subtype": "NVMe", 00:09:16.166 "listen_addresses": [ 00:09:16.166 { 00:09:16.166 "transport": "TCP", 00:09:16.166 "trtype": "TCP", 00:09:16.166 "adrfam": "IPv4", 00:09:16.166 "traddr": "10.0.0.2", 00:09:16.166 "trsvcid": "4420" 00:09:16.166 } 00:09:16.166 ], 00:09:16.166 "allow_any_host": true, 00:09:16.166 "hosts": [], 00:09:16.166 "serial_number": "SPDK00000000000002", 00:09:16.166 "model_number": "SPDK bdev Controller", 00:09:16.166 "max_namespaces": 32, 00:09:16.166 "min_cntlid": 1, 00:09:16.166 "max_cntlid": 65519, 00:09:16.166 "namespaces": [ 00:09:16.166 { 00:09:16.166 "nsid": 1, 00:09:16.166 "bdev_name": "Null2", 00:09:16.166 "name": "Null2", 00:09:16.166 "nguid": "8E3AE1125C5C406C9A1535763E48C588", 00:09:16.166 "uuid": "8e3ae112-5c5c-406c-9a15-35763e48c588" 00:09:16.166 } 00:09:16.166 ] 00:09:16.166 }, 00:09:16.166 { 00:09:16.166 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:09:16.166 "subtype": "NVMe", 00:09:16.166 "listen_addresses": [ 00:09:16.166 { 00:09:16.166 "transport": "TCP", 00:09:16.166 "trtype": "TCP", 00:09:16.166 "adrfam": "IPv4", 00:09:16.166 "traddr": "10.0.0.2", 00:09:16.166 "trsvcid": "4420" 00:09:16.166 } 00:09:16.166 ], 00:09:16.166 "allow_any_host": true, 00:09:16.166 "hosts": [], 00:09:16.166 "serial_number": "SPDK00000000000003", 00:09:16.166 "model_number": "SPDK bdev Controller", 00:09:16.166 "max_namespaces": 32, 00:09:16.166 "min_cntlid": 1, 00:09:16.166 "max_cntlid": 65519, 00:09:16.166 "namespaces": [ 00:09:16.166 { 00:09:16.166 "nsid": 1, 00:09:16.166 "bdev_name": "Null3", 00:09:16.166 "name": "Null3", 00:09:16.166 "nguid": "C390FD8F690A45659275D0191AAC400F", 00:09:16.166 "uuid": "c390fd8f-690a-4565-9275-d0191aac400f" 00:09:16.166 } 00:09:16.166 ] 00:09:16.166 }, 00:09:16.166 { 00:09:16.166 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:09:16.166 "subtype": "NVMe", 00:09:16.166 "listen_addresses": [ 00:09:16.166 { 00:09:16.166 "transport": "TCP", 00:09:16.166 "trtype": "TCP", 00:09:16.166 "adrfam": "IPv4", 00:09:16.166 "traddr": "10.0.0.2", 00:09:16.166 "trsvcid": "4420" 00:09:16.166 } 00:09:16.166 ], 00:09:16.166 "allow_any_host": true, 00:09:16.166 "hosts": [], 00:09:16.166 "serial_number": "SPDK00000000000004", 00:09:16.166 "model_number": "SPDK bdev Controller", 00:09:16.166 "max_namespaces": 32, 00:09:16.166 "min_cntlid": 1, 00:09:16.166 "max_cntlid": 65519, 00:09:16.166 "namespaces": [ 00:09:16.166 { 00:09:16.166 "nsid": 1, 00:09:16.166 "bdev_name": "Null4", 00:09:16.166 "name": "Null4", 00:09:16.166 "nguid": "C88B1611D5914350878F8C7A5C8A55FF", 00:09:16.166 "uuid": "c88b1611-d591-4350-878f-8c7a5c8a55ff" 00:09:16.166 } 00:09:16.166 ] 00:09:16.166 } 00:09:16.166 ] 00:09:16.166 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.166 01:03:30 -- target/discovery.sh@42 -- # seq 1 4 00:09:16.166 01:03:30 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:16.166 01:03:30 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:16.166 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.166 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:16.166 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.166 01:03:30 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:09:16.166 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.166 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:16.166 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.166 01:03:30 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:16.166 01:03:30 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:09:16.166 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.166 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:16.166 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.166 01:03:30 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:09:16.166 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.166 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:16.166 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.166 01:03:30 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:16.166 01:03:30 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:09:16.166 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.166 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:16.166 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.166 01:03:30 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:09:16.166 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.166 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:16.166 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.166 01:03:30 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:16.166 01:03:30 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:09:16.166 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.166 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:16.166 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.166 01:03:30 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:09:16.166 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.166 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:16.166 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.166 01:03:30 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:09:16.166 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.166 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:16.166 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.166 01:03:30 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:09:16.166 01:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.166 01:03:30 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:09:16.166 01:03:30 -- common/autotest_common.sh@10 -- # set +x 00:09:16.424 01:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.424 01:03:30 -- target/discovery.sh@49 -- # check_bdevs= 00:09:16.424 01:03:30 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:09:16.424 01:03:30 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:09:16.424 01:03:30 -- target/discovery.sh@57 -- # nvmftestfini 00:09:16.424 01:03:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:09:16.424 01:03:30 -- nvmf/common.sh@116 -- # sync 00:09:16.424 01:03:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:09:16.424 01:03:30 -- nvmf/common.sh@119 -- # set +e 00:09:16.424 01:03:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:09:16.424 01:03:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:09:16.424 rmmod nvme_tcp 00:09:16.424 rmmod nvme_fabrics 00:09:16.424 rmmod nvme_keyring 00:09:16.424 01:03:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:09:16.424 01:03:30 -- nvmf/common.sh@123 -- # set -e 00:09:16.424 01:03:30 -- nvmf/common.sh@124 -- # return 0 00:09:16.424 01:03:30 -- nvmf/common.sh@477 -- # '[' -n 1941922 ']' 00:09:16.424 01:03:30 -- nvmf/common.sh@478 -- # killprocess 1941922 00:09:16.424 01:03:30 -- common/autotest_common.sh@936 -- # '[' -z 1941922 ']' 00:09:16.424 01:03:30 -- common/autotest_common.sh@940 -- # kill -0 1941922 00:09:16.424 01:03:30 -- common/autotest_common.sh@941 -- # uname 00:09:16.424 01:03:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:16.424 01:03:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1941922 00:09:16.424 01:03:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:16.424 01:03:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:16.424 01:03:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1941922' 00:09:16.424 killing process with pid 1941922 00:09:16.424 01:03:30 -- common/autotest_common.sh@955 -- # kill 1941922 00:09:16.424 [2024-11-28 01:03:30.895476] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:09:16.424 01:03:30 -- common/autotest_common.sh@960 -- # wait 1941922 00:09:16.694 01:03:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:09:16.694 01:03:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:09:16.694 01:03:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:09:16.694 01:03:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:16.694 01:03:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:09:16.694 01:03:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:16.694 01:03:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:16.694 01:03:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:18.597 01:03:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:09:18.597 00:09:18.597 real 0m6.315s 00:09:18.597 user 0m7.860s 00:09:18.597 sys 0m1.903s 00:09:18.597 01:03:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:18.597 01:03:33 -- common/autotest_common.sh@10 -- # set +x 00:09:18.597 ************************************ 00:09:18.597 END TEST nvmf_discovery 00:09:18.597 ************************************ 00:09:18.597 01:03:33 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:09:18.597 01:03:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:18.597 01:03:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:18.597 01:03:33 -- common/autotest_common.sh@10 -- # set +x 00:09:18.856 ************************************ 00:09:18.856 START TEST nvmf_referrals 00:09:18.856 ************************************ 00:09:18.856 01:03:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:09:18.856 * Looking for test storage... 00:09:18.856 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:18.856 01:03:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:09:18.856 01:03:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:09:18.856 01:03:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:09:18.856 01:03:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:09:18.856 01:03:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:09:18.856 01:03:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:09:18.856 01:03:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:09:18.856 01:03:33 -- scripts/common.sh@335 -- # IFS=.-: 00:09:18.856 01:03:33 -- scripts/common.sh@335 -- # read -ra ver1 00:09:18.856 01:03:33 -- scripts/common.sh@336 -- # IFS=.-: 00:09:18.856 01:03:33 -- scripts/common.sh@336 -- # read -ra ver2 00:09:18.856 01:03:33 -- scripts/common.sh@337 -- # local 'op=<' 00:09:18.856 01:03:33 -- scripts/common.sh@339 -- # ver1_l=2 00:09:18.856 01:03:33 -- scripts/common.sh@340 -- # ver2_l=1 00:09:18.856 01:03:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:09:18.856 01:03:33 -- scripts/common.sh@343 -- # case "$op" in 00:09:18.856 01:03:33 -- scripts/common.sh@344 -- # : 1 00:09:18.856 01:03:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:09:18.856 01:03:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:18.856 01:03:33 -- scripts/common.sh@364 -- # decimal 1 00:09:18.856 01:03:33 -- scripts/common.sh@352 -- # local d=1 00:09:18.856 01:03:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:18.856 01:03:33 -- scripts/common.sh@354 -- # echo 1 00:09:18.856 01:03:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:09:18.856 01:03:33 -- scripts/common.sh@365 -- # decimal 2 00:09:18.856 01:03:33 -- scripts/common.sh@352 -- # local d=2 00:09:18.856 01:03:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:18.856 01:03:33 -- scripts/common.sh@354 -- # echo 2 00:09:18.856 01:03:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:09:18.856 01:03:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:09:18.856 01:03:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:09:18.856 01:03:33 -- scripts/common.sh@367 -- # return 0 00:09:18.856 01:03:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:18.856 01:03:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:09:18.856 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:18.856 --rc genhtml_branch_coverage=1 00:09:18.856 --rc genhtml_function_coverage=1 00:09:18.856 --rc genhtml_legend=1 00:09:18.856 --rc geninfo_all_blocks=1 00:09:18.856 --rc geninfo_unexecuted_blocks=1 00:09:18.856 00:09:18.856 ' 00:09:18.856 01:03:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:09:18.856 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:18.856 --rc genhtml_branch_coverage=1 00:09:18.856 --rc genhtml_function_coverage=1 00:09:18.856 --rc genhtml_legend=1 00:09:18.856 --rc geninfo_all_blocks=1 00:09:18.856 --rc geninfo_unexecuted_blocks=1 00:09:18.856 00:09:18.856 ' 00:09:18.856 01:03:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:09:18.856 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:18.856 --rc genhtml_branch_coverage=1 00:09:18.856 --rc genhtml_function_coverage=1 00:09:18.856 --rc genhtml_legend=1 00:09:18.856 --rc geninfo_all_blocks=1 00:09:18.856 --rc geninfo_unexecuted_blocks=1 00:09:18.856 00:09:18.856 ' 00:09:18.856 01:03:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:09:18.856 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:18.856 --rc genhtml_branch_coverage=1 00:09:18.856 --rc genhtml_function_coverage=1 00:09:18.856 --rc genhtml_legend=1 00:09:18.856 --rc geninfo_all_blocks=1 00:09:18.856 --rc geninfo_unexecuted_blocks=1 00:09:18.856 00:09:18.856 ' 00:09:18.856 01:03:33 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:18.856 01:03:33 -- nvmf/common.sh@7 -- # uname -s 00:09:18.856 01:03:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:18.856 01:03:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:18.856 01:03:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:18.856 01:03:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:18.856 01:03:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:18.856 01:03:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:18.856 01:03:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:18.856 01:03:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:18.856 01:03:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:18.856 01:03:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:18.856 01:03:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:09:18.856 01:03:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:09:18.856 01:03:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:18.856 01:03:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:18.856 01:03:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:18.856 01:03:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:18.856 01:03:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:18.856 01:03:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:18.856 01:03:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:18.856 01:03:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:18.856 01:03:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:18.856 01:03:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:18.856 01:03:33 -- paths/export.sh@5 -- # export PATH 00:09:18.856 01:03:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:18.856 01:03:33 -- nvmf/common.sh@46 -- # : 0 00:09:18.856 01:03:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:09:18.856 01:03:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:09:18.856 01:03:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:09:18.856 01:03:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:18.856 01:03:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:18.856 01:03:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:09:18.856 01:03:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:09:18.856 01:03:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:09:18.856 01:03:33 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:09:18.856 01:03:33 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:09:18.856 01:03:33 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:09:18.856 01:03:33 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:09:18.856 01:03:33 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:09:18.856 01:03:33 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:09:18.856 01:03:33 -- target/referrals.sh@37 -- # nvmftestinit 00:09:18.856 01:03:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:09:18.856 01:03:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:18.856 01:03:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:09:18.856 01:03:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:09:18.856 01:03:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:09:18.856 01:03:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:18.856 01:03:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:18.856 01:03:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:18.856 01:03:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:09:18.856 01:03:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:09:18.857 01:03:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:09:18.857 01:03:33 -- common/autotest_common.sh@10 -- # set +x 00:09:21.441 01:03:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:21.441 01:03:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:21.441 01:03:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:21.441 01:03:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:21.441 01:03:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:21.441 01:03:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:21.441 01:03:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:21.441 01:03:35 -- nvmf/common.sh@294 -- # net_devs=() 00:09:21.441 01:03:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:21.441 01:03:35 -- nvmf/common.sh@295 -- # e810=() 00:09:21.441 01:03:35 -- nvmf/common.sh@295 -- # local -ga e810 00:09:21.441 01:03:35 -- nvmf/common.sh@296 -- # x722=() 00:09:21.441 01:03:35 -- nvmf/common.sh@296 -- # local -ga x722 00:09:21.441 01:03:35 -- nvmf/common.sh@297 -- # mlx=() 00:09:21.441 01:03:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:21.441 01:03:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:21.441 01:03:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:21.441 01:03:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:21.441 01:03:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:21.442 01:03:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:21.442 01:03:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:21.442 01:03:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:21.442 01:03:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:21.442 01:03:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:21.442 01:03:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:21.442 01:03:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:21.442 01:03:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:21.442 01:03:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:21.442 01:03:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:21.442 01:03:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:21.442 01:03:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:21.442 01:03:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:21.442 01:03:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:21.442 01:03:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:21.442 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:21.442 01:03:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:21.442 01:03:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:21.442 01:03:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:21.442 01:03:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:21.442 01:03:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:21.442 01:03:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:21.442 01:03:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:21.442 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:21.442 01:03:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:21.442 01:03:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:21.442 01:03:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:21.442 01:03:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:21.442 01:03:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:21.442 01:03:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:21.442 01:03:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:21.442 01:03:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:21.442 01:03:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:21.442 01:03:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:21.442 01:03:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:21.442 01:03:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:21.442 01:03:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:21.442 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:21.442 01:03:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:21.442 01:03:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:21.442 01:03:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:21.442 01:03:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:21.442 01:03:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:21.442 01:03:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:21.442 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:21.442 01:03:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:21.442 01:03:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:21.442 01:03:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:21.442 01:03:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:21.442 01:03:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:21.442 01:03:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:21.442 01:03:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:21.442 01:03:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:21.442 01:03:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:21.442 01:03:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:21.442 01:03:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:21.442 01:03:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:21.442 01:03:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:21.442 01:03:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:21.442 01:03:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:21.442 01:03:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:21.442 01:03:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:21.442 01:03:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:21.442 01:03:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:21.442 01:03:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:21.442 01:03:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:21.442 01:03:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:21.442 01:03:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:21.442 01:03:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:21.442 01:03:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:21.442 01:03:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:21.442 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:21.442 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.395 ms 00:09:21.442 00:09:21.442 --- 10.0.0.2 ping statistics --- 00:09:21.442 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:21.442 rtt min/avg/max/mdev = 0.395/0.395/0.395/0.000 ms 00:09:21.442 01:03:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:21.442 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:21.442 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.159 ms 00:09:21.442 00:09:21.442 --- 10.0.0.1 ping statistics --- 00:09:21.442 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:21.442 rtt min/avg/max/mdev = 0.159/0.159/0.159/0.000 ms 00:09:21.442 01:03:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:21.442 01:03:35 -- nvmf/common.sh@410 -- # return 0 00:09:21.442 01:03:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:21.442 01:03:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:21.442 01:03:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:21.442 01:03:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:21.442 01:03:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:21.442 01:03:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:21.442 01:03:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:21.442 01:03:35 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:09:21.442 01:03:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:21.442 01:03:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:21.442 01:03:35 -- common/autotest_common.sh@10 -- # set +x 00:09:21.442 01:03:35 -- nvmf/common.sh@469 -- # nvmfpid=1944048 00:09:21.442 01:03:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:21.442 01:03:35 -- nvmf/common.sh@470 -- # waitforlisten 1944048 00:09:21.442 01:03:35 -- common/autotest_common.sh@829 -- # '[' -z 1944048 ']' 00:09:21.442 01:03:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:21.442 01:03:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:21.442 01:03:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:21.442 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:21.442 01:03:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:21.442 01:03:35 -- common/autotest_common.sh@10 -- # set +x 00:09:21.442 [2024-11-28 01:03:35.744420] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:09:21.442 [2024-11-28 01:03:35.744490] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:21.442 EAL: No free 2048 kB hugepages reported on node 1 00:09:21.442 [2024-11-28 01:03:35.814132] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:21.442 [2024-11-28 01:03:35.902108] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:21.442 [2024-11-28 01:03:35.902266] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:21.442 [2024-11-28 01:03:35.902290] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:21.442 [2024-11-28 01:03:35.902310] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:21.442 [2024-11-28 01:03:35.902390] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:21.442 [2024-11-28 01:03:35.902462] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:21.442 [2024-11-28 01:03:35.902532] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:21.442 [2024-11-28 01:03:35.902535] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:22.376 01:03:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:22.376 01:03:36 -- common/autotest_common.sh@862 -- # return 0 00:09:22.376 01:03:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:22.376 01:03:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:22.376 01:03:36 -- common/autotest_common.sh@10 -- # set +x 00:09:22.376 01:03:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:22.376 01:03:36 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:22.376 01:03:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:22.376 01:03:36 -- common/autotest_common.sh@10 -- # set +x 00:09:22.376 [2024-11-28 01:03:36.784375] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:22.376 01:03:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:22.376 01:03:36 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:09:22.376 01:03:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:22.376 01:03:36 -- common/autotest_common.sh@10 -- # set +x 00:09:22.376 [2024-11-28 01:03:36.796635] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:09:22.376 01:03:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:22.376 01:03:36 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:09:22.376 01:03:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:22.376 01:03:36 -- common/autotest_common.sh@10 -- # set +x 00:09:22.376 01:03:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:22.376 01:03:36 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:09:22.376 01:03:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:22.376 01:03:36 -- common/autotest_common.sh@10 -- # set +x 00:09:22.377 01:03:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:22.377 01:03:36 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:09:22.377 01:03:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:22.377 01:03:36 -- common/autotest_common.sh@10 -- # set +x 00:09:22.377 01:03:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:22.377 01:03:36 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:22.377 01:03:36 -- target/referrals.sh@48 -- # jq length 00:09:22.377 01:03:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:22.377 01:03:36 -- common/autotest_common.sh@10 -- # set +x 00:09:22.377 01:03:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:22.377 01:03:36 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:09:22.377 01:03:36 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:09:22.377 01:03:36 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:22.377 01:03:36 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:22.377 01:03:36 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:22.377 01:03:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:22.377 01:03:36 -- common/autotest_common.sh@10 -- # set +x 00:09:22.377 01:03:36 -- target/referrals.sh@21 -- # sort 00:09:22.377 01:03:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:22.377 01:03:36 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:22.377 01:03:36 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:22.377 01:03:36 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:09:22.377 01:03:36 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:22.377 01:03:36 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:22.377 01:03:36 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:22.377 01:03:36 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:22.377 01:03:36 -- target/referrals.sh@26 -- # sort 00:09:22.635 01:03:37 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:22.635 01:03:37 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:22.635 01:03:37 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:09:22.635 01:03:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:22.635 01:03:37 -- common/autotest_common.sh@10 -- # set +x 00:09:22.635 01:03:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:22.635 01:03:37 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:09:22.635 01:03:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:22.635 01:03:37 -- common/autotest_common.sh@10 -- # set +x 00:09:22.635 01:03:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:22.635 01:03:37 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:09:22.635 01:03:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:22.635 01:03:37 -- common/autotest_common.sh@10 -- # set +x 00:09:22.635 01:03:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:22.635 01:03:37 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:22.635 01:03:37 -- target/referrals.sh@56 -- # jq length 00:09:22.635 01:03:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:22.635 01:03:37 -- common/autotest_common.sh@10 -- # set +x 00:09:22.635 01:03:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:22.635 01:03:37 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:09:22.635 01:03:37 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:09:22.635 01:03:37 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:22.635 01:03:37 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:22.635 01:03:37 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:22.635 01:03:37 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:22.635 01:03:37 -- target/referrals.sh@26 -- # sort 00:09:22.893 01:03:37 -- target/referrals.sh@26 -- # echo 00:09:22.893 01:03:37 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:09:22.893 01:03:37 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:09:22.893 01:03:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:22.893 01:03:37 -- common/autotest_common.sh@10 -- # set +x 00:09:22.893 01:03:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:22.893 01:03:37 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:22.893 01:03:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:22.893 01:03:37 -- common/autotest_common.sh@10 -- # set +x 00:09:22.893 01:03:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:22.893 01:03:37 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:09:22.893 01:03:37 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:22.893 01:03:37 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:22.893 01:03:37 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:22.893 01:03:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:22.893 01:03:37 -- common/autotest_common.sh@10 -- # set +x 00:09:22.893 01:03:37 -- target/referrals.sh@21 -- # sort 00:09:22.893 01:03:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:22.893 01:03:37 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:09:22.893 01:03:37 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:22.893 01:03:37 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:09:22.893 01:03:37 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:22.893 01:03:37 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:22.893 01:03:37 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:22.893 01:03:37 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:22.893 01:03:37 -- target/referrals.sh@26 -- # sort 00:09:23.151 01:03:37 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:09:23.151 01:03:37 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:23.151 01:03:37 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:09:23.151 01:03:37 -- target/referrals.sh@67 -- # jq -r .subnqn 00:09:23.151 01:03:37 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:23.151 01:03:37 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:23.151 01:03:37 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:23.151 01:03:37 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:09:23.151 01:03:37 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:09:23.151 01:03:37 -- target/referrals.sh@68 -- # jq -r .subnqn 00:09:23.151 01:03:37 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:23.151 01:03:37 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:23.151 01:03:37 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:23.409 01:03:37 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:23.409 01:03:37 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:23.409 01:03:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:23.409 01:03:37 -- common/autotest_common.sh@10 -- # set +x 00:09:23.409 01:03:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:23.409 01:03:37 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:09:23.409 01:03:37 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:23.409 01:03:37 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:23.409 01:03:37 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:23.409 01:03:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:23.409 01:03:37 -- common/autotest_common.sh@10 -- # set +x 00:09:23.409 01:03:37 -- target/referrals.sh@21 -- # sort 00:09:23.409 01:03:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:23.409 01:03:37 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:09:23.409 01:03:37 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:23.409 01:03:37 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:09:23.409 01:03:37 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:23.409 01:03:37 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:23.409 01:03:37 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:23.409 01:03:37 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:23.409 01:03:37 -- target/referrals.sh@26 -- # sort 00:09:23.667 01:03:38 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:09:23.667 01:03:38 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:23.667 01:03:38 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:09:23.667 01:03:38 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:23.667 01:03:38 -- target/referrals.sh@75 -- # jq -r .subnqn 00:09:23.667 01:03:38 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:23.667 01:03:38 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:23.667 01:03:38 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:09:23.667 01:03:38 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:09:23.667 01:03:38 -- target/referrals.sh@76 -- # jq -r .subnqn 00:09:23.667 01:03:38 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:23.667 01:03:38 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:23.667 01:03:38 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:23.925 01:03:38 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:23.925 01:03:38 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:09:23.925 01:03:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:23.925 01:03:38 -- common/autotest_common.sh@10 -- # set +x 00:09:23.925 01:03:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:23.925 01:03:38 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:23.925 01:03:38 -- target/referrals.sh@82 -- # jq length 00:09:23.925 01:03:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:23.925 01:03:38 -- common/autotest_common.sh@10 -- # set +x 00:09:23.925 01:03:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:23.925 01:03:38 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:09:23.925 01:03:38 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:09:23.925 01:03:38 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:23.925 01:03:38 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:23.925 01:03:38 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:23.925 01:03:38 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:23.925 01:03:38 -- target/referrals.sh@26 -- # sort 00:09:24.183 01:03:38 -- target/referrals.sh@26 -- # echo 00:09:24.183 01:03:38 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:09:24.183 01:03:38 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:09:24.183 01:03:38 -- target/referrals.sh@86 -- # nvmftestfini 00:09:24.183 01:03:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:09:24.183 01:03:38 -- nvmf/common.sh@116 -- # sync 00:09:24.183 01:03:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:09:24.183 01:03:38 -- nvmf/common.sh@119 -- # set +e 00:09:24.183 01:03:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:09:24.183 01:03:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:09:24.183 rmmod nvme_tcp 00:09:24.183 rmmod nvme_fabrics 00:09:24.183 rmmod nvme_keyring 00:09:24.183 01:03:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:09:24.183 01:03:38 -- nvmf/common.sh@123 -- # set -e 00:09:24.183 01:03:38 -- nvmf/common.sh@124 -- # return 0 00:09:24.183 01:03:38 -- nvmf/common.sh@477 -- # '[' -n 1944048 ']' 00:09:24.183 01:03:38 -- nvmf/common.sh@478 -- # killprocess 1944048 00:09:24.183 01:03:38 -- common/autotest_common.sh@936 -- # '[' -z 1944048 ']' 00:09:24.183 01:03:38 -- common/autotest_common.sh@940 -- # kill -0 1944048 00:09:24.183 01:03:38 -- common/autotest_common.sh@941 -- # uname 00:09:24.183 01:03:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:24.183 01:03:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1944048 00:09:24.442 01:03:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:24.442 01:03:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:24.442 01:03:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1944048' 00:09:24.442 killing process with pid 1944048 00:09:24.442 01:03:38 -- common/autotest_common.sh@955 -- # kill 1944048 00:09:24.442 01:03:38 -- common/autotest_common.sh@960 -- # wait 1944048 00:09:24.442 01:03:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:09:24.442 01:03:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:09:24.442 01:03:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:09:24.442 01:03:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:24.442 01:03:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:09:24.701 01:03:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:24.701 01:03:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:24.701 01:03:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:26.607 01:03:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:09:26.607 00:09:26.607 real 0m7.883s 00:09:26.607 user 0m14.156s 00:09:26.607 sys 0m2.342s 00:09:26.607 01:03:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:26.607 01:03:41 -- common/autotest_common.sh@10 -- # set +x 00:09:26.607 ************************************ 00:09:26.607 END TEST nvmf_referrals 00:09:26.607 ************************************ 00:09:26.607 01:03:41 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:26.607 01:03:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:26.607 01:03:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:26.607 01:03:41 -- common/autotest_common.sh@10 -- # set +x 00:09:26.607 ************************************ 00:09:26.607 START TEST nvmf_connect_disconnect 00:09:26.607 ************************************ 00:09:26.607 01:03:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:26.608 * Looking for test storage... 00:09:26.608 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:26.608 01:03:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:09:26.608 01:03:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:09:26.608 01:03:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:09:26.867 01:03:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:09:26.867 01:03:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:09:26.867 01:03:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:09:26.867 01:03:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:09:26.867 01:03:41 -- scripts/common.sh@335 -- # IFS=.-: 00:09:26.867 01:03:41 -- scripts/common.sh@335 -- # read -ra ver1 00:09:26.867 01:03:41 -- scripts/common.sh@336 -- # IFS=.-: 00:09:26.867 01:03:41 -- scripts/common.sh@336 -- # read -ra ver2 00:09:26.867 01:03:41 -- scripts/common.sh@337 -- # local 'op=<' 00:09:26.867 01:03:41 -- scripts/common.sh@339 -- # ver1_l=2 00:09:26.867 01:03:41 -- scripts/common.sh@340 -- # ver2_l=1 00:09:26.867 01:03:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:09:26.867 01:03:41 -- scripts/common.sh@343 -- # case "$op" in 00:09:26.867 01:03:41 -- scripts/common.sh@344 -- # : 1 00:09:26.867 01:03:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:09:26.867 01:03:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:26.867 01:03:41 -- scripts/common.sh@364 -- # decimal 1 00:09:26.867 01:03:41 -- scripts/common.sh@352 -- # local d=1 00:09:26.867 01:03:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:26.867 01:03:41 -- scripts/common.sh@354 -- # echo 1 00:09:26.867 01:03:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:09:26.867 01:03:41 -- scripts/common.sh@365 -- # decimal 2 00:09:26.867 01:03:41 -- scripts/common.sh@352 -- # local d=2 00:09:26.867 01:03:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:26.867 01:03:41 -- scripts/common.sh@354 -- # echo 2 00:09:26.867 01:03:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:09:26.867 01:03:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:09:26.867 01:03:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:09:26.867 01:03:41 -- scripts/common.sh@367 -- # return 0 00:09:26.867 01:03:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:26.867 01:03:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:09:26.867 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:26.867 --rc genhtml_branch_coverage=1 00:09:26.867 --rc genhtml_function_coverage=1 00:09:26.867 --rc genhtml_legend=1 00:09:26.867 --rc geninfo_all_blocks=1 00:09:26.867 --rc geninfo_unexecuted_blocks=1 00:09:26.867 00:09:26.867 ' 00:09:26.867 01:03:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:09:26.867 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:26.867 --rc genhtml_branch_coverage=1 00:09:26.867 --rc genhtml_function_coverage=1 00:09:26.867 --rc genhtml_legend=1 00:09:26.867 --rc geninfo_all_blocks=1 00:09:26.867 --rc geninfo_unexecuted_blocks=1 00:09:26.867 00:09:26.867 ' 00:09:26.867 01:03:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:09:26.867 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:26.867 --rc genhtml_branch_coverage=1 00:09:26.867 --rc genhtml_function_coverage=1 00:09:26.867 --rc genhtml_legend=1 00:09:26.867 --rc geninfo_all_blocks=1 00:09:26.867 --rc geninfo_unexecuted_blocks=1 00:09:26.867 00:09:26.867 ' 00:09:26.867 01:03:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:09:26.867 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:26.867 --rc genhtml_branch_coverage=1 00:09:26.867 --rc genhtml_function_coverage=1 00:09:26.867 --rc genhtml_legend=1 00:09:26.867 --rc geninfo_all_blocks=1 00:09:26.867 --rc geninfo_unexecuted_blocks=1 00:09:26.867 00:09:26.867 ' 00:09:26.867 01:03:41 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:26.867 01:03:41 -- nvmf/common.sh@7 -- # uname -s 00:09:26.867 01:03:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:26.867 01:03:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:26.867 01:03:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:26.867 01:03:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:26.867 01:03:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:26.867 01:03:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:26.867 01:03:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:26.867 01:03:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:26.867 01:03:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:26.867 01:03:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:26.867 01:03:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:09:26.867 01:03:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:09:26.867 01:03:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:26.867 01:03:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:26.867 01:03:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:26.867 01:03:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:26.867 01:03:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:26.867 01:03:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:26.867 01:03:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:26.867 01:03:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:26.867 01:03:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:26.867 01:03:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:26.867 01:03:41 -- paths/export.sh@5 -- # export PATH 00:09:26.867 01:03:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:26.867 01:03:41 -- nvmf/common.sh@46 -- # : 0 00:09:26.867 01:03:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:09:26.867 01:03:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:09:26.867 01:03:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:09:26.867 01:03:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:26.867 01:03:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:26.867 01:03:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:09:26.867 01:03:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:09:26.868 01:03:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:09:26.868 01:03:41 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:26.868 01:03:41 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:26.868 01:03:41 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:09:26.868 01:03:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:09:26.868 01:03:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:26.868 01:03:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:09:26.868 01:03:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:09:26.868 01:03:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:09:26.868 01:03:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:26.868 01:03:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:26.868 01:03:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:26.868 01:03:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:09:26.868 01:03:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:09:26.868 01:03:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:09:26.868 01:03:41 -- common/autotest_common.sh@10 -- # set +x 00:09:29.401 01:03:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:29.401 01:03:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:29.401 01:03:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:29.401 01:03:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:29.401 01:03:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:29.401 01:03:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:29.401 01:03:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:29.401 01:03:43 -- nvmf/common.sh@294 -- # net_devs=() 00:09:29.401 01:03:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:29.401 01:03:43 -- nvmf/common.sh@295 -- # e810=() 00:09:29.401 01:03:43 -- nvmf/common.sh@295 -- # local -ga e810 00:09:29.401 01:03:43 -- nvmf/common.sh@296 -- # x722=() 00:09:29.401 01:03:43 -- nvmf/common.sh@296 -- # local -ga x722 00:09:29.401 01:03:43 -- nvmf/common.sh@297 -- # mlx=() 00:09:29.401 01:03:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:29.401 01:03:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:29.401 01:03:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:29.401 01:03:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:29.401 01:03:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:29.401 01:03:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:29.401 01:03:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:29.401 01:03:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:29.401 01:03:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:29.401 01:03:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:29.401 01:03:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:29.401 01:03:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:29.401 01:03:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:29.401 01:03:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:29.401 01:03:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:29.401 01:03:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:29.401 01:03:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:29.401 01:03:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:29.401 01:03:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:29.401 01:03:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:29.401 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:29.401 01:03:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:29.401 01:03:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:29.401 01:03:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:29.401 01:03:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:29.401 01:03:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:29.401 01:03:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:29.401 01:03:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:29.401 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:29.401 01:03:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:29.401 01:03:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:29.401 01:03:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:29.401 01:03:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:29.401 01:03:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:29.401 01:03:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:29.401 01:03:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:29.401 01:03:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:29.401 01:03:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:29.401 01:03:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:29.401 01:03:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:29.401 01:03:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:29.401 01:03:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:29.401 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:29.401 01:03:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:29.401 01:03:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:29.401 01:03:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:29.401 01:03:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:29.401 01:03:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:29.401 01:03:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:29.401 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:29.401 01:03:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:29.401 01:03:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:29.401 01:03:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:29.401 01:03:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:29.401 01:03:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:29.401 01:03:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:29.401 01:03:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:29.401 01:03:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:29.401 01:03:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:29.401 01:03:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:29.401 01:03:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:29.401 01:03:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:29.401 01:03:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:29.401 01:03:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:29.401 01:03:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:29.401 01:03:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:29.401 01:03:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:29.401 01:03:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:29.401 01:03:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:29.401 01:03:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:29.401 01:03:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:29.401 01:03:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:29.401 01:03:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:29.401 01:03:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:29.401 01:03:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:29.401 01:03:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:29.401 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:29.401 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.181 ms 00:09:29.401 00:09:29.401 --- 10.0.0.2 ping statistics --- 00:09:29.401 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:29.401 rtt min/avg/max/mdev = 0.181/0.181/0.181/0.000 ms 00:09:29.401 01:03:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:29.401 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:29.401 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.066 ms 00:09:29.401 00:09:29.401 --- 10.0.0.1 ping statistics --- 00:09:29.401 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:29.401 rtt min/avg/max/mdev = 0.066/0.066/0.066/0.000 ms 00:09:29.401 01:03:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:29.401 01:03:43 -- nvmf/common.sh@410 -- # return 0 00:09:29.401 01:03:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:29.401 01:03:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:29.401 01:03:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:29.401 01:03:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:29.401 01:03:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:29.401 01:03:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:29.402 01:03:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:29.402 01:03:43 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:09:29.402 01:03:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:29.402 01:03:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:29.402 01:03:43 -- common/autotest_common.sh@10 -- # set +x 00:09:29.402 01:03:43 -- nvmf/common.sh@469 -- # nvmfpid=1946551 00:09:29.402 01:03:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:29.402 01:03:43 -- nvmf/common.sh@470 -- # waitforlisten 1946551 00:09:29.402 01:03:43 -- common/autotest_common.sh@829 -- # '[' -z 1946551 ']' 00:09:29.402 01:03:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:29.402 01:03:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:29.402 01:03:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:29.402 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:29.402 01:03:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:29.402 01:03:43 -- common/autotest_common.sh@10 -- # set +x 00:09:29.402 [2024-11-28 01:03:43.742969] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:09:29.402 [2024-11-28 01:03:43.743047] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:29.402 EAL: No free 2048 kB hugepages reported on node 1 00:09:29.402 [2024-11-28 01:03:43.811698] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:29.402 [2024-11-28 01:03:43.902430] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:29.402 [2024-11-28 01:03:43.902591] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:29.402 [2024-11-28 01:03:43.902609] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:29.402 [2024-11-28 01:03:43.902632] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:29.402 [2024-11-28 01:03:43.902696] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:29.402 [2024-11-28 01:03:43.902765] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:29.402 [2024-11-28 01:03:43.902821] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:29.402 [2024-11-28 01:03:43.902823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:30.335 01:03:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:30.335 01:03:44 -- common/autotest_common.sh@862 -- # return 0 00:09:30.335 01:03:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:30.335 01:03:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:30.335 01:03:44 -- common/autotest_common.sh@10 -- # set +x 00:09:30.335 01:03:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:30.335 01:03:44 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:09:30.335 01:03:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:30.335 01:03:44 -- common/autotest_common.sh@10 -- # set +x 00:09:30.335 [2024-11-28 01:03:44.750225] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:30.335 01:03:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:30.335 01:03:44 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:09:30.335 01:03:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:30.335 01:03:44 -- common/autotest_common.sh@10 -- # set +x 00:09:30.335 01:03:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:30.335 01:03:44 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:09:30.335 01:03:44 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:30.335 01:03:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:30.336 01:03:44 -- common/autotest_common.sh@10 -- # set +x 00:09:30.336 01:03:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:30.336 01:03:44 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:30.336 01:03:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:30.336 01:03:44 -- common/autotest_common.sh@10 -- # set +x 00:09:30.336 01:03:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:30.336 01:03:44 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:30.336 01:03:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:30.336 01:03:44 -- common/autotest_common.sh@10 -- # set +x 00:09:30.336 [2024-11-28 01:03:44.803134] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:30.336 01:03:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:30.336 01:03:44 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:09:30.336 01:03:44 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:09:30.336 01:03:44 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:09:30.336 01:03:44 -- target/connect_disconnect.sh@34 -- # set +x 00:09:32.863 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:34.762 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.289 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.814 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.338 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.239 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.764 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.291 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.820 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:53.718 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.314 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.843 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:01.371 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.270 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.798 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:08.326 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.226 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.750 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:15.275 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.802 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.700 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.244 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.158 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.681 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:29.207 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.107 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.676 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:36.202 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.100 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:40.628 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.155 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.680 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.578 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.107 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.634 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.532 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.059 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.586 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.113 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.009 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.536 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.435 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.048 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.575 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:15.474 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.000 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.527 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:23.052 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.948 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.474 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.998 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.895 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.452 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.977 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:38.876 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:41.405 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:43.932 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.524 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:48.447 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:50.978 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.878 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.408 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:57.941 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:59.837 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.365 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:04.890 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:07.417 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:09.316 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:11.848 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:14.376 [2024-11-28 01:06:28.399321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x139ab80 is same with the state(5) to be set 00:12:14.376 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.274 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:18.802 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:21.326 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:23.303 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:25.832 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:28.360 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:30.261 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:32.787 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:35.314 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:37.211 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:39.736 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:41.647 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:44.174 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:46.702 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:48.598 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:51.116 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:53.641 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:55.538 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:58.062 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:00.660 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:02.557 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:05.086 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:07.613 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:09.513 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:12.040 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:14.568 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:16.467 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:19.091 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:21.617 [2024-11-28 01:07:35.631336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x139ab80 is same with the state(5) to be set 00:13:21.617 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:23.516 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:23.516 01:07:37 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:13:23.516 01:07:37 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:13:23.516 01:07:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:23.516 01:07:37 -- nvmf/common.sh@116 -- # sync 00:13:23.516 01:07:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:23.516 01:07:37 -- nvmf/common.sh@119 -- # set +e 00:13:23.516 01:07:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:23.516 01:07:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:23.516 rmmod nvme_tcp 00:13:23.516 rmmod nvme_fabrics 00:13:23.516 rmmod nvme_keyring 00:13:23.516 01:07:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:23.516 01:07:37 -- nvmf/common.sh@123 -- # set -e 00:13:23.516 01:07:37 -- nvmf/common.sh@124 -- # return 0 00:13:23.516 01:07:37 -- nvmf/common.sh@477 -- # '[' -n 1946551 ']' 00:13:23.516 01:07:37 -- nvmf/common.sh@478 -- # killprocess 1946551 00:13:23.516 01:07:37 -- common/autotest_common.sh@936 -- # '[' -z 1946551 ']' 00:13:23.516 01:07:37 -- common/autotest_common.sh@940 -- # kill -0 1946551 00:13:23.516 01:07:37 -- common/autotest_common.sh@941 -- # uname 00:13:23.516 01:07:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:23.516 01:07:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1946551 00:13:23.516 01:07:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:23.516 01:07:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:23.516 01:07:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1946551' 00:13:23.516 killing process with pid 1946551 00:13:23.516 01:07:38 -- common/autotest_common.sh@955 -- # kill 1946551 00:13:23.516 01:07:38 -- common/autotest_common.sh@960 -- # wait 1946551 00:13:23.775 01:07:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:23.775 01:07:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:23.775 01:07:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:23.775 01:07:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:23.775 01:07:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:23.775 01:07:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:23.775 01:07:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:23.775 01:07:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:26.308 01:07:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:26.308 00:13:26.308 real 3m59.211s 00:13:26.308 user 15m12.030s 00:13:26.308 sys 0m34.594s 00:13:26.308 01:07:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:26.308 01:07:40 -- common/autotest_common.sh@10 -- # set +x 00:13:26.308 ************************************ 00:13:26.308 END TEST nvmf_connect_disconnect 00:13:26.308 ************************************ 00:13:26.308 01:07:40 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:13:26.308 01:07:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:26.308 01:07:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:26.308 01:07:40 -- common/autotest_common.sh@10 -- # set +x 00:13:26.308 ************************************ 00:13:26.308 START TEST nvmf_multitarget 00:13:26.308 ************************************ 00:13:26.308 01:07:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:13:26.308 * Looking for test storage... 00:13:26.308 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:26.308 01:07:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:26.308 01:07:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:26.308 01:07:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:26.308 01:07:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:26.308 01:07:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:26.308 01:07:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:26.308 01:07:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:26.308 01:07:40 -- scripts/common.sh@335 -- # IFS=.-: 00:13:26.308 01:07:40 -- scripts/common.sh@335 -- # read -ra ver1 00:13:26.308 01:07:40 -- scripts/common.sh@336 -- # IFS=.-: 00:13:26.308 01:07:40 -- scripts/common.sh@336 -- # read -ra ver2 00:13:26.308 01:07:40 -- scripts/common.sh@337 -- # local 'op=<' 00:13:26.308 01:07:40 -- scripts/common.sh@339 -- # ver1_l=2 00:13:26.308 01:07:40 -- scripts/common.sh@340 -- # ver2_l=1 00:13:26.308 01:07:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:26.308 01:07:40 -- scripts/common.sh@343 -- # case "$op" in 00:13:26.308 01:07:40 -- scripts/common.sh@344 -- # : 1 00:13:26.308 01:07:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:26.308 01:07:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:26.308 01:07:40 -- scripts/common.sh@364 -- # decimal 1 00:13:26.308 01:07:40 -- scripts/common.sh@352 -- # local d=1 00:13:26.308 01:07:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:26.308 01:07:40 -- scripts/common.sh@354 -- # echo 1 00:13:26.308 01:07:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:26.308 01:07:40 -- scripts/common.sh@365 -- # decimal 2 00:13:26.308 01:07:40 -- scripts/common.sh@352 -- # local d=2 00:13:26.308 01:07:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:26.308 01:07:40 -- scripts/common.sh@354 -- # echo 2 00:13:26.308 01:07:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:26.308 01:07:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:26.308 01:07:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:26.308 01:07:40 -- scripts/common.sh@367 -- # return 0 00:13:26.308 01:07:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:26.308 01:07:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:26.308 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:26.308 --rc genhtml_branch_coverage=1 00:13:26.308 --rc genhtml_function_coverage=1 00:13:26.308 --rc genhtml_legend=1 00:13:26.308 --rc geninfo_all_blocks=1 00:13:26.308 --rc geninfo_unexecuted_blocks=1 00:13:26.308 00:13:26.308 ' 00:13:26.308 01:07:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:26.308 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:26.308 --rc genhtml_branch_coverage=1 00:13:26.308 --rc genhtml_function_coverage=1 00:13:26.308 --rc genhtml_legend=1 00:13:26.308 --rc geninfo_all_blocks=1 00:13:26.308 --rc geninfo_unexecuted_blocks=1 00:13:26.308 00:13:26.308 ' 00:13:26.308 01:07:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:26.308 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:26.308 --rc genhtml_branch_coverage=1 00:13:26.308 --rc genhtml_function_coverage=1 00:13:26.308 --rc genhtml_legend=1 00:13:26.308 --rc geninfo_all_blocks=1 00:13:26.308 --rc geninfo_unexecuted_blocks=1 00:13:26.308 00:13:26.308 ' 00:13:26.309 01:07:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:26.309 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:26.309 --rc genhtml_branch_coverage=1 00:13:26.309 --rc genhtml_function_coverage=1 00:13:26.309 --rc genhtml_legend=1 00:13:26.309 --rc geninfo_all_blocks=1 00:13:26.309 --rc geninfo_unexecuted_blocks=1 00:13:26.309 00:13:26.309 ' 00:13:26.309 01:07:40 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:26.309 01:07:40 -- nvmf/common.sh@7 -- # uname -s 00:13:26.309 01:07:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:26.309 01:07:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:26.309 01:07:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:26.309 01:07:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:26.309 01:07:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:26.309 01:07:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:26.309 01:07:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:26.309 01:07:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:26.309 01:07:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:26.309 01:07:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:26.309 01:07:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:26.309 01:07:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:26.309 01:07:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:26.309 01:07:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:26.309 01:07:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:26.309 01:07:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:26.309 01:07:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:26.309 01:07:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:26.309 01:07:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:26.309 01:07:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:26.309 01:07:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:26.309 01:07:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:26.309 01:07:40 -- paths/export.sh@5 -- # export PATH 00:13:26.309 01:07:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:26.309 01:07:40 -- nvmf/common.sh@46 -- # : 0 00:13:26.309 01:07:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:26.309 01:07:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:26.309 01:07:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:26.309 01:07:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:26.309 01:07:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:26.309 01:07:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:26.309 01:07:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:26.309 01:07:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:26.309 01:07:40 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:26.309 01:07:40 -- target/multitarget.sh@15 -- # nvmftestinit 00:13:26.309 01:07:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:26.309 01:07:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:26.309 01:07:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:26.309 01:07:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:26.309 01:07:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:26.309 01:07:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:26.309 01:07:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:26.309 01:07:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:26.309 01:07:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:26.309 01:07:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:26.309 01:07:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:26.309 01:07:40 -- common/autotest_common.sh@10 -- # set +x 00:13:28.211 01:07:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:28.211 01:07:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:28.211 01:07:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:28.211 01:07:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:28.211 01:07:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:28.211 01:07:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:28.211 01:07:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:28.211 01:07:42 -- nvmf/common.sh@294 -- # net_devs=() 00:13:28.211 01:07:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:28.211 01:07:42 -- nvmf/common.sh@295 -- # e810=() 00:13:28.211 01:07:42 -- nvmf/common.sh@295 -- # local -ga e810 00:13:28.211 01:07:42 -- nvmf/common.sh@296 -- # x722=() 00:13:28.211 01:07:42 -- nvmf/common.sh@296 -- # local -ga x722 00:13:28.211 01:07:42 -- nvmf/common.sh@297 -- # mlx=() 00:13:28.211 01:07:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:28.211 01:07:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:28.211 01:07:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:28.211 01:07:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:28.211 01:07:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:28.211 01:07:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:28.211 01:07:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:28.211 01:07:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:28.211 01:07:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:28.211 01:07:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:28.211 01:07:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:28.211 01:07:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:28.211 01:07:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:28.211 01:07:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:28.211 01:07:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:28.211 01:07:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:28.211 01:07:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:28.211 01:07:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:28.211 01:07:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:28.211 01:07:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:28.211 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:28.211 01:07:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:28.211 01:07:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:28.211 01:07:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:28.211 01:07:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:28.211 01:07:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:28.211 01:07:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:28.211 01:07:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:28.211 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:28.211 01:07:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:28.211 01:07:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:28.211 01:07:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:28.211 01:07:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:28.211 01:07:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:28.211 01:07:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:28.211 01:07:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:28.211 01:07:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:28.211 01:07:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:28.211 01:07:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:28.212 01:07:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:28.212 01:07:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:28.212 01:07:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:28.212 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:28.212 01:07:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:28.212 01:07:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:28.212 01:07:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:28.212 01:07:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:28.212 01:07:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:28.212 01:07:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:28.212 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:28.212 01:07:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:28.212 01:07:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:28.212 01:07:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:28.212 01:07:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:28.212 01:07:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:28.212 01:07:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:28.212 01:07:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:28.212 01:07:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:28.212 01:07:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:28.212 01:07:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:28.212 01:07:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:28.212 01:07:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:28.212 01:07:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:28.212 01:07:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:28.212 01:07:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:28.212 01:07:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:28.212 01:07:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:28.212 01:07:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:28.212 01:07:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:28.212 01:07:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:28.212 01:07:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:28.212 01:07:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:28.212 01:07:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:28.212 01:07:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:28.471 01:07:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:28.471 01:07:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:28.471 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:28.471 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.244 ms 00:13:28.471 00:13:28.471 --- 10.0.0.2 ping statistics --- 00:13:28.471 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:28.471 rtt min/avg/max/mdev = 0.244/0.244/0.244/0.000 ms 00:13:28.471 01:07:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:28.471 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:28.471 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.048 ms 00:13:28.471 00:13:28.471 --- 10.0.0.1 ping statistics --- 00:13:28.471 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:28.471 rtt min/avg/max/mdev = 0.048/0.048/0.048/0.000 ms 00:13:28.471 01:07:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:28.471 01:07:42 -- nvmf/common.sh@410 -- # return 0 00:13:28.471 01:07:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:28.471 01:07:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:28.471 01:07:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:28.471 01:07:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:28.471 01:07:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:28.471 01:07:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:28.471 01:07:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:28.471 01:07:42 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:13:28.471 01:07:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:28.471 01:07:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:28.471 01:07:42 -- common/autotest_common.sh@10 -- # set +x 00:13:28.471 01:07:42 -- nvmf/common.sh@469 -- # nvmfpid=1978793 00:13:28.471 01:07:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:28.471 01:07:42 -- nvmf/common.sh@470 -- # waitforlisten 1978793 00:13:28.471 01:07:42 -- common/autotest_common.sh@829 -- # '[' -z 1978793 ']' 00:13:28.471 01:07:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:28.471 01:07:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:28.471 01:07:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:28.471 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:28.471 01:07:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:28.471 01:07:42 -- common/autotest_common.sh@10 -- # set +x 00:13:28.471 [2024-11-28 01:07:42.897573] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:28.471 [2024-11-28 01:07:42.897661] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:28.471 EAL: No free 2048 kB hugepages reported on node 1 00:13:28.471 [2024-11-28 01:07:42.970897] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:28.471 [2024-11-28 01:07:43.067153] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:28.471 [2024-11-28 01:07:43.067335] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:28.471 [2024-11-28 01:07:43.067355] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:28.471 [2024-11-28 01:07:43.067370] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:28.471 [2024-11-28 01:07:43.067427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:28.471 [2024-11-28 01:07:43.067459] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:28.471 [2024-11-28 01:07:43.067511] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:28.471 [2024-11-28 01:07:43.067514] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:29.406 01:07:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:29.406 01:07:43 -- common/autotest_common.sh@862 -- # return 0 00:13:29.406 01:07:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:29.406 01:07:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:29.406 01:07:43 -- common/autotest_common.sh@10 -- # set +x 00:13:29.406 01:07:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:29.406 01:07:43 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:29.406 01:07:43 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:29.406 01:07:43 -- target/multitarget.sh@21 -- # jq length 00:13:29.664 01:07:44 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:13:29.664 01:07:44 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:13:29.664 "nvmf_tgt_1" 00:13:29.664 01:07:44 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:13:29.923 "nvmf_tgt_2" 00:13:29.923 01:07:44 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:29.923 01:07:44 -- target/multitarget.sh@28 -- # jq length 00:13:29.923 01:07:44 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:13:29.923 01:07:44 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:13:30.181 true 00:13:30.181 01:07:44 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:13:30.181 true 00:13:30.181 01:07:44 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:30.181 01:07:44 -- target/multitarget.sh@35 -- # jq length 00:13:30.439 01:07:44 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:13:30.439 01:07:44 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:13:30.439 01:07:44 -- target/multitarget.sh@41 -- # nvmftestfini 00:13:30.439 01:07:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:30.439 01:07:44 -- nvmf/common.sh@116 -- # sync 00:13:30.439 01:07:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:30.439 01:07:44 -- nvmf/common.sh@119 -- # set +e 00:13:30.439 01:07:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:30.439 01:07:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:30.439 rmmod nvme_tcp 00:13:30.439 rmmod nvme_fabrics 00:13:30.439 rmmod nvme_keyring 00:13:30.439 01:07:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:30.439 01:07:44 -- nvmf/common.sh@123 -- # set -e 00:13:30.439 01:07:44 -- nvmf/common.sh@124 -- # return 0 00:13:30.439 01:07:44 -- nvmf/common.sh@477 -- # '[' -n 1978793 ']' 00:13:30.439 01:07:44 -- nvmf/common.sh@478 -- # killprocess 1978793 00:13:30.439 01:07:44 -- common/autotest_common.sh@936 -- # '[' -z 1978793 ']' 00:13:30.439 01:07:44 -- common/autotest_common.sh@940 -- # kill -0 1978793 00:13:30.439 01:07:44 -- common/autotest_common.sh@941 -- # uname 00:13:30.439 01:07:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:30.439 01:07:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1978793 00:13:30.439 01:07:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:30.439 01:07:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:30.439 01:07:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1978793' 00:13:30.439 killing process with pid 1978793 00:13:30.439 01:07:44 -- common/autotest_common.sh@955 -- # kill 1978793 00:13:30.439 01:07:44 -- common/autotest_common.sh@960 -- # wait 1978793 00:13:30.698 01:07:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:30.698 01:07:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:30.698 01:07:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:30.698 01:07:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:30.698 01:07:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:30.698 01:07:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:30.698 01:07:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:30.698 01:07:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:32.606 01:07:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:32.606 00:13:32.606 real 0m6.800s 00:13:32.606 user 0m10.074s 00:13:32.606 sys 0m2.083s 00:13:32.606 01:07:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:32.606 01:07:47 -- common/autotest_common.sh@10 -- # set +x 00:13:32.606 ************************************ 00:13:32.606 END TEST nvmf_multitarget 00:13:32.606 ************************************ 00:13:32.606 01:07:47 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:32.606 01:07:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:32.606 01:07:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:32.606 01:07:47 -- common/autotest_common.sh@10 -- # set +x 00:13:32.606 ************************************ 00:13:32.606 START TEST nvmf_rpc 00:13:32.606 ************************************ 00:13:32.606 01:07:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:32.865 * Looking for test storage... 00:13:32.865 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:32.865 01:07:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:32.865 01:07:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:32.865 01:07:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:32.865 01:07:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:32.865 01:07:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:32.865 01:07:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:32.865 01:07:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:32.865 01:07:47 -- scripts/common.sh@335 -- # IFS=.-: 00:13:32.865 01:07:47 -- scripts/common.sh@335 -- # read -ra ver1 00:13:32.865 01:07:47 -- scripts/common.sh@336 -- # IFS=.-: 00:13:32.865 01:07:47 -- scripts/common.sh@336 -- # read -ra ver2 00:13:32.865 01:07:47 -- scripts/common.sh@337 -- # local 'op=<' 00:13:32.865 01:07:47 -- scripts/common.sh@339 -- # ver1_l=2 00:13:32.865 01:07:47 -- scripts/common.sh@340 -- # ver2_l=1 00:13:32.865 01:07:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:32.865 01:07:47 -- scripts/common.sh@343 -- # case "$op" in 00:13:32.865 01:07:47 -- scripts/common.sh@344 -- # : 1 00:13:32.865 01:07:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:32.865 01:07:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:32.865 01:07:47 -- scripts/common.sh@364 -- # decimal 1 00:13:32.865 01:07:47 -- scripts/common.sh@352 -- # local d=1 00:13:32.865 01:07:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:32.865 01:07:47 -- scripts/common.sh@354 -- # echo 1 00:13:32.865 01:07:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:32.865 01:07:47 -- scripts/common.sh@365 -- # decimal 2 00:13:32.865 01:07:47 -- scripts/common.sh@352 -- # local d=2 00:13:32.865 01:07:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:32.865 01:07:47 -- scripts/common.sh@354 -- # echo 2 00:13:32.865 01:07:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:32.865 01:07:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:32.865 01:07:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:32.865 01:07:47 -- scripts/common.sh@367 -- # return 0 00:13:32.865 01:07:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:32.865 01:07:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:32.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:32.865 --rc genhtml_branch_coverage=1 00:13:32.865 --rc genhtml_function_coverage=1 00:13:32.865 --rc genhtml_legend=1 00:13:32.865 --rc geninfo_all_blocks=1 00:13:32.865 --rc geninfo_unexecuted_blocks=1 00:13:32.865 00:13:32.865 ' 00:13:32.865 01:07:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:32.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:32.865 --rc genhtml_branch_coverage=1 00:13:32.865 --rc genhtml_function_coverage=1 00:13:32.865 --rc genhtml_legend=1 00:13:32.865 --rc geninfo_all_blocks=1 00:13:32.865 --rc geninfo_unexecuted_blocks=1 00:13:32.865 00:13:32.865 ' 00:13:32.865 01:07:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:32.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:32.865 --rc genhtml_branch_coverage=1 00:13:32.865 --rc genhtml_function_coverage=1 00:13:32.865 --rc genhtml_legend=1 00:13:32.865 --rc geninfo_all_blocks=1 00:13:32.865 --rc geninfo_unexecuted_blocks=1 00:13:32.865 00:13:32.865 ' 00:13:32.865 01:07:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:32.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:32.865 --rc genhtml_branch_coverage=1 00:13:32.865 --rc genhtml_function_coverage=1 00:13:32.865 --rc genhtml_legend=1 00:13:32.865 --rc geninfo_all_blocks=1 00:13:32.866 --rc geninfo_unexecuted_blocks=1 00:13:32.866 00:13:32.866 ' 00:13:32.866 01:07:47 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:32.866 01:07:47 -- nvmf/common.sh@7 -- # uname -s 00:13:32.866 01:07:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:32.866 01:07:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:32.866 01:07:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:32.866 01:07:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:32.866 01:07:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:32.866 01:07:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:32.866 01:07:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:32.866 01:07:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:32.866 01:07:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:32.866 01:07:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:32.866 01:07:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:32.866 01:07:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:32.866 01:07:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:32.866 01:07:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:32.866 01:07:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:32.866 01:07:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:32.866 01:07:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:32.866 01:07:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:32.866 01:07:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:32.866 01:07:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.866 01:07:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.866 01:07:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.866 01:07:47 -- paths/export.sh@5 -- # export PATH 00:13:32.866 01:07:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.866 01:07:47 -- nvmf/common.sh@46 -- # : 0 00:13:32.866 01:07:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:32.866 01:07:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:32.866 01:07:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:32.866 01:07:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:32.866 01:07:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:32.866 01:07:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:32.866 01:07:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:32.866 01:07:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:32.866 01:07:47 -- target/rpc.sh@11 -- # loops=5 00:13:32.866 01:07:47 -- target/rpc.sh@23 -- # nvmftestinit 00:13:32.866 01:07:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:32.866 01:07:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:32.866 01:07:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:32.866 01:07:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:32.866 01:07:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:32.866 01:07:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:32.866 01:07:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:32.866 01:07:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:32.866 01:07:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:32.866 01:07:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:32.866 01:07:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:32.866 01:07:47 -- common/autotest_common.sh@10 -- # set +x 00:13:34.770 01:07:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:34.770 01:07:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:34.770 01:07:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:34.770 01:07:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:34.770 01:07:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:34.770 01:07:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:34.770 01:07:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:34.770 01:07:49 -- nvmf/common.sh@294 -- # net_devs=() 00:13:34.770 01:07:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:34.770 01:07:49 -- nvmf/common.sh@295 -- # e810=() 00:13:34.770 01:07:49 -- nvmf/common.sh@295 -- # local -ga e810 00:13:34.770 01:07:49 -- nvmf/common.sh@296 -- # x722=() 00:13:34.770 01:07:49 -- nvmf/common.sh@296 -- # local -ga x722 00:13:34.770 01:07:49 -- nvmf/common.sh@297 -- # mlx=() 00:13:34.770 01:07:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:34.770 01:07:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:34.770 01:07:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:34.770 01:07:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:34.770 01:07:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:34.770 01:07:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:34.770 01:07:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:34.770 01:07:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:34.770 01:07:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:34.770 01:07:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:34.770 01:07:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:34.770 01:07:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:34.770 01:07:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:34.770 01:07:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:34.771 01:07:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:34.771 01:07:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:34.771 01:07:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:34.771 01:07:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:34.771 01:07:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:34.771 01:07:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:34.771 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:34.771 01:07:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:34.771 01:07:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:34.771 01:07:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:34.771 01:07:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:34.771 01:07:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:34.771 01:07:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:34.771 01:07:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:34.771 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:34.771 01:07:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:34.771 01:07:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:34.771 01:07:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:34.771 01:07:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:34.771 01:07:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:34.771 01:07:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:34.771 01:07:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:34.771 01:07:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:34.771 01:07:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:34.771 01:07:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:34.771 01:07:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:34.771 01:07:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:34.771 01:07:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:34.771 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:34.771 01:07:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:34.771 01:07:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:34.771 01:07:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:34.771 01:07:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:34.771 01:07:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:34.771 01:07:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:34.771 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:34.771 01:07:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:34.771 01:07:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:34.771 01:07:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:34.771 01:07:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:34.771 01:07:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:34.771 01:07:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:34.771 01:07:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:34.771 01:07:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:34.771 01:07:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:34.771 01:07:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:34.771 01:07:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:34.771 01:07:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:34.771 01:07:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:34.771 01:07:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:34.771 01:07:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:34.771 01:07:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:34.771 01:07:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:34.771 01:07:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:34.771 01:07:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:34.771 01:07:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:34.771 01:07:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:34.771 01:07:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:34.771 01:07:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:35.030 01:07:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:35.030 01:07:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:35.030 01:07:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:35.030 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:35.030 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.373 ms 00:13:35.030 00:13:35.030 --- 10.0.0.2 ping statistics --- 00:13:35.030 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:35.030 rtt min/avg/max/mdev = 0.373/0.373/0.373/0.000 ms 00:13:35.030 01:07:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:35.030 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:35.030 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.150 ms 00:13:35.030 00:13:35.030 --- 10.0.0.1 ping statistics --- 00:13:35.030 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:35.030 rtt min/avg/max/mdev = 0.150/0.150/0.150/0.000 ms 00:13:35.030 01:07:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:35.030 01:07:49 -- nvmf/common.sh@410 -- # return 0 00:13:35.030 01:07:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:35.030 01:07:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:35.030 01:07:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:35.030 01:07:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:35.030 01:07:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:35.030 01:07:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:35.030 01:07:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:35.030 01:07:49 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:13:35.030 01:07:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:35.030 01:07:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:35.030 01:07:49 -- common/autotest_common.sh@10 -- # set +x 00:13:35.030 01:07:49 -- nvmf/common.sh@469 -- # nvmfpid=1981045 00:13:35.030 01:07:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:35.030 01:07:49 -- nvmf/common.sh@470 -- # waitforlisten 1981045 00:13:35.030 01:07:49 -- common/autotest_common.sh@829 -- # '[' -z 1981045 ']' 00:13:35.030 01:07:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:35.030 01:07:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:35.030 01:07:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:35.030 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:35.030 01:07:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:35.030 01:07:49 -- common/autotest_common.sh@10 -- # set +x 00:13:35.030 [2024-11-28 01:07:49.483043] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:35.030 [2024-11-28 01:07:49.483132] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:35.030 EAL: No free 2048 kB hugepages reported on node 1 00:13:35.030 [2024-11-28 01:07:49.561912] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:35.289 [2024-11-28 01:07:49.662680] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:35.289 [2024-11-28 01:07:49.662813] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:35.289 [2024-11-28 01:07:49.662830] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:35.289 [2024-11-28 01:07:49.662842] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:35.289 [2024-11-28 01:07:49.662890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:35.289 [2024-11-28 01:07:49.662918] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:35.289 [2024-11-28 01:07:49.662975] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:35.289 [2024-11-28 01:07:49.662978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:36.222 01:07:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:36.222 01:07:50 -- common/autotest_common.sh@862 -- # return 0 00:13:36.222 01:07:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:36.222 01:07:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:36.222 01:07:50 -- common/autotest_common.sh@10 -- # set +x 00:13:36.222 01:07:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:36.222 01:07:50 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:13:36.222 01:07:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.222 01:07:50 -- common/autotest_common.sh@10 -- # set +x 00:13:36.222 01:07:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.222 01:07:50 -- target/rpc.sh@26 -- # stats='{ 00:13:36.222 "tick_rate": 2700000000, 00:13:36.222 "poll_groups": [ 00:13:36.222 { 00:13:36.222 "name": "nvmf_tgt_poll_group_0", 00:13:36.222 "admin_qpairs": 0, 00:13:36.222 "io_qpairs": 0, 00:13:36.222 "current_admin_qpairs": 0, 00:13:36.222 "current_io_qpairs": 0, 00:13:36.222 "pending_bdev_io": 0, 00:13:36.222 "completed_nvme_io": 0, 00:13:36.222 "transports": [] 00:13:36.222 }, 00:13:36.222 { 00:13:36.222 "name": "nvmf_tgt_poll_group_1", 00:13:36.222 "admin_qpairs": 0, 00:13:36.222 "io_qpairs": 0, 00:13:36.222 "current_admin_qpairs": 0, 00:13:36.222 "current_io_qpairs": 0, 00:13:36.222 "pending_bdev_io": 0, 00:13:36.222 "completed_nvme_io": 0, 00:13:36.222 "transports": [] 00:13:36.222 }, 00:13:36.222 { 00:13:36.222 "name": "nvmf_tgt_poll_group_2", 00:13:36.222 "admin_qpairs": 0, 00:13:36.222 "io_qpairs": 0, 00:13:36.222 "current_admin_qpairs": 0, 00:13:36.222 "current_io_qpairs": 0, 00:13:36.222 "pending_bdev_io": 0, 00:13:36.222 "completed_nvme_io": 0, 00:13:36.222 "transports": [] 00:13:36.222 }, 00:13:36.222 { 00:13:36.222 "name": "nvmf_tgt_poll_group_3", 00:13:36.222 "admin_qpairs": 0, 00:13:36.222 "io_qpairs": 0, 00:13:36.222 "current_admin_qpairs": 0, 00:13:36.222 "current_io_qpairs": 0, 00:13:36.222 "pending_bdev_io": 0, 00:13:36.222 "completed_nvme_io": 0, 00:13:36.222 "transports": [] 00:13:36.222 } 00:13:36.222 ] 00:13:36.222 }' 00:13:36.222 01:07:50 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:13:36.222 01:07:50 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:13:36.222 01:07:50 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:13:36.222 01:07:50 -- target/rpc.sh@15 -- # wc -l 00:13:36.222 01:07:50 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:13:36.222 01:07:50 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:13:36.222 01:07:50 -- target/rpc.sh@29 -- # [[ null == null ]] 00:13:36.222 01:07:50 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:36.222 01:07:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.222 01:07:50 -- common/autotest_common.sh@10 -- # set +x 00:13:36.222 [2024-11-28 01:07:50.693912] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:36.223 01:07:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.223 01:07:50 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:13:36.223 01:07:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.223 01:07:50 -- common/autotest_common.sh@10 -- # set +x 00:13:36.223 01:07:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.223 01:07:50 -- target/rpc.sh@33 -- # stats='{ 00:13:36.223 "tick_rate": 2700000000, 00:13:36.223 "poll_groups": [ 00:13:36.223 { 00:13:36.223 "name": "nvmf_tgt_poll_group_0", 00:13:36.223 "admin_qpairs": 0, 00:13:36.223 "io_qpairs": 0, 00:13:36.223 "current_admin_qpairs": 0, 00:13:36.223 "current_io_qpairs": 0, 00:13:36.223 "pending_bdev_io": 0, 00:13:36.223 "completed_nvme_io": 0, 00:13:36.223 "transports": [ 00:13:36.223 { 00:13:36.223 "trtype": "TCP" 00:13:36.223 } 00:13:36.223 ] 00:13:36.223 }, 00:13:36.223 { 00:13:36.223 "name": "nvmf_tgt_poll_group_1", 00:13:36.223 "admin_qpairs": 0, 00:13:36.223 "io_qpairs": 0, 00:13:36.223 "current_admin_qpairs": 0, 00:13:36.223 "current_io_qpairs": 0, 00:13:36.223 "pending_bdev_io": 0, 00:13:36.223 "completed_nvme_io": 0, 00:13:36.223 "transports": [ 00:13:36.223 { 00:13:36.223 "trtype": "TCP" 00:13:36.223 } 00:13:36.223 ] 00:13:36.223 }, 00:13:36.223 { 00:13:36.223 "name": "nvmf_tgt_poll_group_2", 00:13:36.223 "admin_qpairs": 0, 00:13:36.223 "io_qpairs": 0, 00:13:36.223 "current_admin_qpairs": 0, 00:13:36.223 "current_io_qpairs": 0, 00:13:36.223 "pending_bdev_io": 0, 00:13:36.223 "completed_nvme_io": 0, 00:13:36.223 "transports": [ 00:13:36.223 { 00:13:36.223 "trtype": "TCP" 00:13:36.223 } 00:13:36.223 ] 00:13:36.223 }, 00:13:36.223 { 00:13:36.223 "name": "nvmf_tgt_poll_group_3", 00:13:36.223 "admin_qpairs": 0, 00:13:36.223 "io_qpairs": 0, 00:13:36.223 "current_admin_qpairs": 0, 00:13:36.223 "current_io_qpairs": 0, 00:13:36.223 "pending_bdev_io": 0, 00:13:36.223 "completed_nvme_io": 0, 00:13:36.223 "transports": [ 00:13:36.223 { 00:13:36.223 "trtype": "TCP" 00:13:36.223 } 00:13:36.223 ] 00:13:36.223 } 00:13:36.223 ] 00:13:36.223 }' 00:13:36.223 01:07:50 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:13:36.223 01:07:50 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:36.223 01:07:50 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:36.223 01:07:50 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:36.223 01:07:50 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:13:36.223 01:07:50 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:13:36.223 01:07:50 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:36.223 01:07:50 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:36.223 01:07:50 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:36.223 01:07:50 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:13:36.223 01:07:50 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:13:36.223 01:07:50 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:13:36.223 01:07:50 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:13:36.223 01:07:50 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:36.223 01:07:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.223 01:07:50 -- common/autotest_common.sh@10 -- # set +x 00:13:36.223 Malloc1 00:13:36.223 01:07:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.223 01:07:50 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:36.223 01:07:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.223 01:07:50 -- common/autotest_common.sh@10 -- # set +x 00:13:36.480 01:07:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.480 01:07:50 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:36.481 01:07:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.481 01:07:50 -- common/autotest_common.sh@10 -- # set +x 00:13:36.481 01:07:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.481 01:07:50 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:13:36.481 01:07:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.481 01:07:50 -- common/autotest_common.sh@10 -- # set +x 00:13:36.481 01:07:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.481 01:07:50 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:36.481 01:07:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.481 01:07:50 -- common/autotest_common.sh@10 -- # set +x 00:13:36.481 [2024-11-28 01:07:50.850116] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:36.481 01:07:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.481 01:07:50 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:36.481 01:07:50 -- common/autotest_common.sh@650 -- # local es=0 00:13:36.481 01:07:50 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:36.481 01:07:50 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:36.481 01:07:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:36.481 01:07:50 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:36.481 01:07:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:36.481 01:07:50 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:36.481 01:07:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:36.481 01:07:50 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:36.481 01:07:50 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:36.481 01:07:50 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:36.481 [2024-11-28 01:07:50.872673] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:36.481 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:36.481 could not add new controller: failed to write to nvme-fabrics device 00:13:36.481 01:07:50 -- common/autotest_common.sh@653 -- # es=1 00:13:36.481 01:07:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:36.481 01:07:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:36.481 01:07:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:36.481 01:07:50 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:36.481 01:07:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.481 01:07:50 -- common/autotest_common.sh@10 -- # set +x 00:13:36.481 01:07:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.481 01:07:50 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:37.046 01:07:51 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:13:37.046 01:07:51 -- common/autotest_common.sh@1187 -- # local i=0 00:13:37.046 01:07:51 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:37.046 01:07:51 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:37.047 01:07:51 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:39.574 01:07:53 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:39.574 01:07:53 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:39.574 01:07:53 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:39.574 01:07:53 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:39.574 01:07:53 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:39.574 01:07:53 -- common/autotest_common.sh@1197 -- # return 0 00:13:39.574 01:07:53 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:39.574 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:39.574 01:07:53 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:39.574 01:07:53 -- common/autotest_common.sh@1208 -- # local i=0 00:13:39.574 01:07:53 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:39.574 01:07:53 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:39.574 01:07:53 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:39.574 01:07:53 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:39.574 01:07:53 -- common/autotest_common.sh@1220 -- # return 0 00:13:39.574 01:07:53 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:39.574 01:07:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.574 01:07:53 -- common/autotest_common.sh@10 -- # set +x 00:13:39.574 01:07:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.574 01:07:53 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:39.574 01:07:53 -- common/autotest_common.sh@650 -- # local es=0 00:13:39.574 01:07:53 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:39.574 01:07:53 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:39.574 01:07:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:39.574 01:07:53 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:39.574 01:07:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:39.574 01:07:53 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:39.574 01:07:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:39.574 01:07:53 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:39.575 01:07:53 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:39.575 01:07:53 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:39.575 [2024-11-28 01:07:53.711508] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:39.575 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:39.575 could not add new controller: failed to write to nvme-fabrics device 00:13:39.575 01:07:53 -- common/autotest_common.sh@653 -- # es=1 00:13:39.575 01:07:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:39.575 01:07:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:39.575 01:07:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:39.575 01:07:53 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:13:39.575 01:07:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.575 01:07:53 -- common/autotest_common.sh@10 -- # set +x 00:13:39.575 01:07:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.575 01:07:53 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:39.832 01:07:54 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:13:39.833 01:07:54 -- common/autotest_common.sh@1187 -- # local i=0 00:13:39.833 01:07:54 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:39.833 01:07:54 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:39.833 01:07:54 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:42.357 01:07:56 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:42.357 01:07:56 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:42.357 01:07:56 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:42.357 01:07:56 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:42.357 01:07:56 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:42.357 01:07:56 -- common/autotest_common.sh@1197 -- # return 0 00:13:42.357 01:07:56 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:42.357 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:42.357 01:07:56 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:42.357 01:07:56 -- common/autotest_common.sh@1208 -- # local i=0 00:13:42.357 01:07:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:42.357 01:07:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:42.357 01:07:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:42.357 01:07:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:42.357 01:07:56 -- common/autotest_common.sh@1220 -- # return 0 00:13:42.357 01:07:56 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:42.357 01:07:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.357 01:07:56 -- common/autotest_common.sh@10 -- # set +x 00:13:42.357 01:07:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.357 01:07:56 -- target/rpc.sh@81 -- # seq 1 5 00:13:42.357 01:07:56 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:42.357 01:07:56 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:42.357 01:07:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.357 01:07:56 -- common/autotest_common.sh@10 -- # set +x 00:13:42.357 01:07:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.357 01:07:56 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:42.357 01:07:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.357 01:07:56 -- common/autotest_common.sh@10 -- # set +x 00:13:42.357 [2024-11-28 01:07:56.499309] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:42.357 01:07:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.357 01:07:56 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:42.357 01:07:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.357 01:07:56 -- common/autotest_common.sh@10 -- # set +x 00:13:42.357 01:07:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.357 01:07:56 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:42.357 01:07:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.357 01:07:56 -- common/autotest_common.sh@10 -- # set +x 00:13:42.357 01:07:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.358 01:07:56 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:42.615 01:07:57 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:42.615 01:07:57 -- common/autotest_common.sh@1187 -- # local i=0 00:13:42.615 01:07:57 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:42.615 01:07:57 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:42.615 01:07:57 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:45.140 01:07:59 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:45.140 01:07:59 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:45.140 01:07:59 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:45.140 01:07:59 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:45.140 01:07:59 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:45.140 01:07:59 -- common/autotest_common.sh@1197 -- # return 0 00:13:45.140 01:07:59 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:45.140 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:45.140 01:07:59 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:45.140 01:07:59 -- common/autotest_common.sh@1208 -- # local i=0 00:13:45.140 01:07:59 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:45.140 01:07:59 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:45.140 01:07:59 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:45.140 01:07:59 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:45.140 01:07:59 -- common/autotest_common.sh@1220 -- # return 0 00:13:45.140 01:07:59 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:45.140 01:07:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.140 01:07:59 -- common/autotest_common.sh@10 -- # set +x 00:13:45.140 01:07:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.140 01:07:59 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:45.140 01:07:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.140 01:07:59 -- common/autotest_common.sh@10 -- # set +x 00:13:45.140 01:07:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.140 01:07:59 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:45.140 01:07:59 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:45.140 01:07:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.140 01:07:59 -- common/autotest_common.sh@10 -- # set +x 00:13:45.140 01:07:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.140 01:07:59 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:45.140 01:07:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.140 01:07:59 -- common/autotest_common.sh@10 -- # set +x 00:13:45.140 [2024-11-28 01:07:59.328140] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:45.140 01:07:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.140 01:07:59 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:45.140 01:07:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.140 01:07:59 -- common/autotest_common.sh@10 -- # set +x 00:13:45.140 01:07:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.140 01:07:59 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:45.140 01:07:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.140 01:07:59 -- common/autotest_common.sh@10 -- # set +x 00:13:45.140 01:07:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.140 01:07:59 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:45.398 01:07:59 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:45.398 01:07:59 -- common/autotest_common.sh@1187 -- # local i=0 00:13:45.398 01:07:59 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:45.398 01:07:59 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:45.398 01:07:59 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:47.926 01:08:01 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:47.926 01:08:01 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:47.926 01:08:01 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:47.926 01:08:01 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:47.926 01:08:01 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:47.926 01:08:01 -- common/autotest_common.sh@1197 -- # return 0 00:13:47.926 01:08:01 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:47.926 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:47.926 01:08:02 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:47.926 01:08:02 -- common/autotest_common.sh@1208 -- # local i=0 00:13:47.926 01:08:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:47.926 01:08:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:47.926 01:08:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:47.926 01:08:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:47.926 01:08:02 -- common/autotest_common.sh@1220 -- # return 0 00:13:47.926 01:08:02 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:47.926 01:08:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:47.926 01:08:02 -- common/autotest_common.sh@10 -- # set +x 00:13:47.926 01:08:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:47.926 01:08:02 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:47.926 01:08:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:47.926 01:08:02 -- common/autotest_common.sh@10 -- # set +x 00:13:47.926 01:08:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:47.926 01:08:02 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:47.926 01:08:02 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:47.926 01:08:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:47.926 01:08:02 -- common/autotest_common.sh@10 -- # set +x 00:13:47.926 01:08:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:47.926 01:08:02 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:47.926 01:08:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:47.926 01:08:02 -- common/autotest_common.sh@10 -- # set +x 00:13:47.926 [2024-11-28 01:08:02.088264] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:47.926 01:08:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:47.926 01:08:02 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:47.926 01:08:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:47.926 01:08:02 -- common/autotest_common.sh@10 -- # set +x 00:13:47.926 01:08:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:47.926 01:08:02 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:47.926 01:08:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:47.926 01:08:02 -- common/autotest_common.sh@10 -- # set +x 00:13:47.926 01:08:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:47.926 01:08:02 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:48.185 01:08:02 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:48.185 01:08:02 -- common/autotest_common.sh@1187 -- # local i=0 00:13:48.185 01:08:02 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:48.185 01:08:02 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:48.185 01:08:02 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:50.711 01:08:04 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:50.711 01:08:04 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:50.711 01:08:04 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:50.711 01:08:04 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:50.711 01:08:04 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:50.711 01:08:04 -- common/autotest_common.sh@1197 -- # return 0 00:13:50.711 01:08:04 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:50.711 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:50.711 01:08:04 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:50.711 01:08:04 -- common/autotest_common.sh@1208 -- # local i=0 00:13:50.711 01:08:04 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:50.711 01:08:04 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:50.711 01:08:04 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:50.711 01:08:04 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:50.711 01:08:04 -- common/autotest_common.sh@1220 -- # return 0 00:13:50.711 01:08:04 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:50.711 01:08:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.711 01:08:04 -- common/autotest_common.sh@10 -- # set +x 00:13:50.711 01:08:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.711 01:08:04 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:50.711 01:08:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.711 01:08:04 -- common/autotest_common.sh@10 -- # set +x 00:13:50.711 01:08:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.711 01:08:04 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:50.711 01:08:04 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:50.711 01:08:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.711 01:08:04 -- common/autotest_common.sh@10 -- # set +x 00:13:50.711 01:08:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.711 01:08:04 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:50.711 01:08:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.711 01:08:04 -- common/autotest_common.sh@10 -- # set +x 00:13:50.711 [2024-11-28 01:08:04.847043] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:50.711 01:08:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.711 01:08:04 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:50.711 01:08:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.711 01:08:04 -- common/autotest_common.sh@10 -- # set +x 00:13:50.711 01:08:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.711 01:08:04 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:50.711 01:08:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.711 01:08:04 -- common/autotest_common.sh@10 -- # set +x 00:13:50.711 01:08:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.711 01:08:04 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:50.968 01:08:05 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:50.968 01:08:05 -- common/autotest_common.sh@1187 -- # local i=0 00:13:50.968 01:08:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:50.968 01:08:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:50.968 01:08:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:53.494 01:08:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:53.494 01:08:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:53.494 01:08:07 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:53.494 01:08:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:53.494 01:08:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:53.494 01:08:07 -- common/autotest_common.sh@1197 -- # return 0 00:13:53.494 01:08:07 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:53.494 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:53.494 01:08:07 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:53.494 01:08:07 -- common/autotest_common.sh@1208 -- # local i=0 00:13:53.494 01:08:07 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:53.494 01:08:07 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:53.494 01:08:07 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:53.494 01:08:07 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:53.494 01:08:07 -- common/autotest_common.sh@1220 -- # return 0 00:13:53.494 01:08:07 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:53.494 01:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.494 01:08:07 -- common/autotest_common.sh@10 -- # set +x 00:13:53.494 01:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.494 01:08:07 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:53.494 01:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.494 01:08:07 -- common/autotest_common.sh@10 -- # set +x 00:13:53.494 01:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.494 01:08:07 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:53.494 01:08:07 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:53.494 01:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.494 01:08:07 -- common/autotest_common.sh@10 -- # set +x 00:13:53.494 01:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.494 01:08:07 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:53.494 01:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.494 01:08:07 -- common/autotest_common.sh@10 -- # set +x 00:13:53.494 [2024-11-28 01:08:07.721800] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:53.494 01:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.494 01:08:07 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:53.494 01:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.494 01:08:07 -- common/autotest_common.sh@10 -- # set +x 00:13:53.494 01:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.495 01:08:07 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:53.495 01:08:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.495 01:08:07 -- common/autotest_common.sh@10 -- # set +x 00:13:53.495 01:08:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.495 01:08:07 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:54.060 01:08:08 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:54.060 01:08:08 -- common/autotest_common.sh@1187 -- # local i=0 00:13:54.060 01:08:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:54.060 01:08:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:54.060 01:08:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:55.959 01:08:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:55.959 01:08:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:55.959 01:08:10 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:55.959 01:08:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:55.959 01:08:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:55.959 01:08:10 -- common/autotest_common.sh@1197 -- # return 0 00:13:55.959 01:08:10 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:55.959 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:55.959 01:08:10 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:55.959 01:08:10 -- common/autotest_common.sh@1208 -- # local i=0 00:13:55.959 01:08:10 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:55.959 01:08:10 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:55.959 01:08:10 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:55.959 01:08:10 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:55.959 01:08:10 -- common/autotest_common.sh@1220 -- # return 0 00:13:55.959 01:08:10 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:55.959 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:55.959 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.216 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.216 01:08:10 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:56.216 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.216 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.216 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.216 01:08:10 -- target/rpc.sh@99 -- # seq 1 5 00:13:56.216 01:08:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:56.216 01:08:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:56.216 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.216 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.216 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.216 01:08:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:56.216 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.216 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.216 [2024-11-28 01:08:10.593075] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:56.216 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.216 01:08:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:56.216 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.216 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.216 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.216 01:08:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:56.216 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.216 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.216 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.216 01:08:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:56.216 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.216 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.216 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.216 01:08:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:56.216 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.216 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.216 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.216 01:08:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:56.216 01:08:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:56.216 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.216 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.216 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.216 01:08:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:56.216 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.216 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.216 [2024-11-28 01:08:10.641131] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:56.216 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.216 01:08:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:56.216 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.216 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.216 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:56.217 01:08:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 [2024-11-28 01:08:10.689311] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:56.217 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:56.217 01:08:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 [2024-11-28 01:08:10.737471] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:56.217 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:56.217 01:08:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 [2024-11-28 01:08:10.785687] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:56.217 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.217 01:08:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:56.217 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.217 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.474 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.474 01:08:10 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:13:56.474 01:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.474 01:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.474 01:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.474 01:08:10 -- target/rpc.sh@110 -- # stats='{ 00:13:56.474 "tick_rate": 2700000000, 00:13:56.474 "poll_groups": [ 00:13:56.474 { 00:13:56.474 "name": "nvmf_tgt_poll_group_0", 00:13:56.474 "admin_qpairs": 2, 00:13:56.474 "io_qpairs": 84, 00:13:56.474 "current_admin_qpairs": 0, 00:13:56.474 "current_io_qpairs": 0, 00:13:56.474 "pending_bdev_io": 0, 00:13:56.474 "completed_nvme_io": 135, 00:13:56.474 "transports": [ 00:13:56.474 { 00:13:56.474 "trtype": "TCP" 00:13:56.474 } 00:13:56.474 ] 00:13:56.474 }, 00:13:56.474 { 00:13:56.474 "name": "nvmf_tgt_poll_group_1", 00:13:56.474 "admin_qpairs": 2, 00:13:56.474 "io_qpairs": 84, 00:13:56.474 "current_admin_qpairs": 0, 00:13:56.474 "current_io_qpairs": 0, 00:13:56.474 "pending_bdev_io": 0, 00:13:56.474 "completed_nvme_io": 148, 00:13:56.474 "transports": [ 00:13:56.474 { 00:13:56.474 "trtype": "TCP" 00:13:56.474 } 00:13:56.474 ] 00:13:56.474 }, 00:13:56.474 { 00:13:56.474 "name": "nvmf_tgt_poll_group_2", 00:13:56.474 "admin_qpairs": 1, 00:13:56.474 "io_qpairs": 84, 00:13:56.474 "current_admin_qpairs": 0, 00:13:56.474 "current_io_qpairs": 0, 00:13:56.474 "pending_bdev_io": 0, 00:13:56.474 "completed_nvme_io": 220, 00:13:56.474 "transports": [ 00:13:56.474 { 00:13:56.474 "trtype": "TCP" 00:13:56.474 } 00:13:56.474 ] 00:13:56.474 }, 00:13:56.474 { 00:13:56.474 "name": "nvmf_tgt_poll_group_3", 00:13:56.474 "admin_qpairs": 2, 00:13:56.474 "io_qpairs": 84, 00:13:56.474 "current_admin_qpairs": 0, 00:13:56.474 "current_io_qpairs": 0, 00:13:56.474 "pending_bdev_io": 0, 00:13:56.474 "completed_nvme_io": 183, 00:13:56.474 "transports": [ 00:13:56.474 { 00:13:56.474 "trtype": "TCP" 00:13:56.474 } 00:13:56.474 ] 00:13:56.474 } 00:13:56.474 ] 00:13:56.474 }' 00:13:56.474 01:08:10 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:13:56.474 01:08:10 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:56.474 01:08:10 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:56.474 01:08:10 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:56.474 01:08:10 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:13:56.474 01:08:10 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:13:56.474 01:08:10 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:56.474 01:08:10 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:56.474 01:08:10 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:56.474 01:08:10 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:13:56.474 01:08:10 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:13:56.474 01:08:10 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:13:56.474 01:08:10 -- target/rpc.sh@123 -- # nvmftestfini 00:13:56.474 01:08:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:56.474 01:08:10 -- nvmf/common.sh@116 -- # sync 00:13:56.474 01:08:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:56.474 01:08:10 -- nvmf/common.sh@119 -- # set +e 00:13:56.474 01:08:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:56.474 01:08:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:56.474 rmmod nvme_tcp 00:13:56.474 rmmod nvme_fabrics 00:13:56.474 rmmod nvme_keyring 00:13:56.474 01:08:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:56.474 01:08:10 -- nvmf/common.sh@123 -- # set -e 00:13:56.474 01:08:10 -- nvmf/common.sh@124 -- # return 0 00:13:56.474 01:08:10 -- nvmf/common.sh@477 -- # '[' -n 1981045 ']' 00:13:56.474 01:08:10 -- nvmf/common.sh@478 -- # killprocess 1981045 00:13:56.474 01:08:10 -- common/autotest_common.sh@936 -- # '[' -z 1981045 ']' 00:13:56.474 01:08:10 -- common/autotest_common.sh@940 -- # kill -0 1981045 00:13:56.474 01:08:10 -- common/autotest_common.sh@941 -- # uname 00:13:56.474 01:08:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:56.474 01:08:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1981045 00:13:56.474 01:08:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:56.474 01:08:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:56.474 01:08:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1981045' 00:13:56.474 killing process with pid 1981045 00:13:56.474 01:08:11 -- common/autotest_common.sh@955 -- # kill 1981045 00:13:56.474 01:08:11 -- common/autotest_common.sh@960 -- # wait 1981045 00:13:56.732 01:08:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:56.732 01:08:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:56.732 01:08:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:56.732 01:08:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:56.732 01:08:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:56.732 01:08:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:56.732 01:08:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:56.732 01:08:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:59.272 01:08:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:59.272 00:13:59.272 real 0m26.146s 00:13:59.272 user 1m25.991s 00:13:59.272 sys 0m4.179s 00:13:59.272 01:08:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:59.272 01:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:59.272 ************************************ 00:13:59.272 END TEST nvmf_rpc 00:13:59.272 ************************************ 00:13:59.272 01:08:13 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:59.272 01:08:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:59.272 01:08:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:59.272 01:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:59.272 ************************************ 00:13:59.272 START TEST nvmf_invalid 00:13:59.272 ************************************ 00:13:59.272 01:08:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:59.272 * Looking for test storage... 00:13:59.272 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:59.272 01:08:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:59.272 01:08:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:59.272 01:08:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:59.272 01:08:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:59.272 01:08:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:59.272 01:08:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:59.272 01:08:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:59.272 01:08:13 -- scripts/common.sh@335 -- # IFS=.-: 00:13:59.272 01:08:13 -- scripts/common.sh@335 -- # read -ra ver1 00:13:59.272 01:08:13 -- scripts/common.sh@336 -- # IFS=.-: 00:13:59.272 01:08:13 -- scripts/common.sh@336 -- # read -ra ver2 00:13:59.272 01:08:13 -- scripts/common.sh@337 -- # local 'op=<' 00:13:59.272 01:08:13 -- scripts/common.sh@339 -- # ver1_l=2 00:13:59.272 01:08:13 -- scripts/common.sh@340 -- # ver2_l=1 00:13:59.272 01:08:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:59.272 01:08:13 -- scripts/common.sh@343 -- # case "$op" in 00:13:59.272 01:08:13 -- scripts/common.sh@344 -- # : 1 00:13:59.272 01:08:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:59.272 01:08:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:59.272 01:08:13 -- scripts/common.sh@364 -- # decimal 1 00:13:59.272 01:08:13 -- scripts/common.sh@352 -- # local d=1 00:13:59.272 01:08:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:59.272 01:08:13 -- scripts/common.sh@354 -- # echo 1 00:13:59.272 01:08:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:59.272 01:08:13 -- scripts/common.sh@365 -- # decimal 2 00:13:59.272 01:08:13 -- scripts/common.sh@352 -- # local d=2 00:13:59.272 01:08:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:59.272 01:08:13 -- scripts/common.sh@354 -- # echo 2 00:13:59.272 01:08:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:59.272 01:08:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:59.272 01:08:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:59.272 01:08:13 -- scripts/common.sh@367 -- # return 0 00:13:59.272 01:08:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:59.273 01:08:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:59.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:59.273 --rc genhtml_branch_coverage=1 00:13:59.273 --rc genhtml_function_coverage=1 00:13:59.273 --rc genhtml_legend=1 00:13:59.273 --rc geninfo_all_blocks=1 00:13:59.273 --rc geninfo_unexecuted_blocks=1 00:13:59.273 00:13:59.273 ' 00:13:59.273 01:08:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:59.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:59.273 --rc genhtml_branch_coverage=1 00:13:59.273 --rc genhtml_function_coverage=1 00:13:59.273 --rc genhtml_legend=1 00:13:59.273 --rc geninfo_all_blocks=1 00:13:59.273 --rc geninfo_unexecuted_blocks=1 00:13:59.273 00:13:59.273 ' 00:13:59.273 01:08:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:59.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:59.273 --rc genhtml_branch_coverage=1 00:13:59.273 --rc genhtml_function_coverage=1 00:13:59.273 --rc genhtml_legend=1 00:13:59.273 --rc geninfo_all_blocks=1 00:13:59.273 --rc geninfo_unexecuted_blocks=1 00:13:59.273 00:13:59.273 ' 00:13:59.273 01:08:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:59.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:59.273 --rc genhtml_branch_coverage=1 00:13:59.273 --rc genhtml_function_coverage=1 00:13:59.273 --rc genhtml_legend=1 00:13:59.273 --rc geninfo_all_blocks=1 00:13:59.273 --rc geninfo_unexecuted_blocks=1 00:13:59.273 00:13:59.273 ' 00:13:59.273 01:08:13 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:59.273 01:08:13 -- nvmf/common.sh@7 -- # uname -s 00:13:59.273 01:08:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:59.273 01:08:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:59.273 01:08:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:59.273 01:08:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:59.273 01:08:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:59.273 01:08:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:59.273 01:08:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:59.273 01:08:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:59.273 01:08:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:59.273 01:08:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:59.273 01:08:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:59.273 01:08:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:59.273 01:08:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:59.273 01:08:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:59.273 01:08:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:59.273 01:08:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:59.273 01:08:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:59.273 01:08:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:59.273 01:08:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:59.273 01:08:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:59.273 01:08:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:59.273 01:08:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:59.273 01:08:13 -- paths/export.sh@5 -- # export PATH 00:13:59.273 01:08:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:59.273 01:08:13 -- nvmf/common.sh@46 -- # : 0 00:13:59.273 01:08:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:59.273 01:08:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:59.273 01:08:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:59.273 01:08:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:59.273 01:08:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:59.273 01:08:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:59.273 01:08:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:59.273 01:08:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:59.273 01:08:13 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:59.273 01:08:13 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:59.273 01:08:13 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:13:59.273 01:08:13 -- target/invalid.sh@14 -- # target=foobar 00:13:59.273 01:08:13 -- target/invalid.sh@16 -- # RANDOM=0 00:13:59.273 01:08:13 -- target/invalid.sh@34 -- # nvmftestinit 00:13:59.273 01:08:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:59.273 01:08:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:59.273 01:08:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:59.273 01:08:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:59.273 01:08:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:59.273 01:08:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:59.273 01:08:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:59.273 01:08:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:59.273 01:08:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:59.273 01:08:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:59.273 01:08:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:59.273 01:08:13 -- common/autotest_common.sh@10 -- # set +x 00:14:01.176 01:08:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:01.176 01:08:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:01.176 01:08:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:01.176 01:08:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:01.176 01:08:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:01.176 01:08:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:01.176 01:08:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:01.176 01:08:15 -- nvmf/common.sh@294 -- # net_devs=() 00:14:01.176 01:08:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:01.176 01:08:15 -- nvmf/common.sh@295 -- # e810=() 00:14:01.176 01:08:15 -- nvmf/common.sh@295 -- # local -ga e810 00:14:01.176 01:08:15 -- nvmf/common.sh@296 -- # x722=() 00:14:01.176 01:08:15 -- nvmf/common.sh@296 -- # local -ga x722 00:14:01.176 01:08:15 -- nvmf/common.sh@297 -- # mlx=() 00:14:01.176 01:08:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:01.176 01:08:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:01.176 01:08:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:01.176 01:08:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:01.176 01:08:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:01.176 01:08:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:01.176 01:08:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:01.176 01:08:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:01.176 01:08:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:01.176 01:08:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:01.176 01:08:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:01.176 01:08:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:01.176 01:08:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:01.176 01:08:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:01.176 01:08:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:01.176 01:08:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:01.176 01:08:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:01.176 01:08:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:01.176 01:08:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:01.176 01:08:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:01.176 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:01.176 01:08:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:01.176 01:08:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:01.176 01:08:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:01.176 01:08:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:01.176 01:08:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:01.176 01:08:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:01.176 01:08:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:01.176 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:01.176 01:08:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:01.176 01:08:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:01.176 01:08:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:01.176 01:08:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:01.176 01:08:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:01.176 01:08:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:01.176 01:08:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:01.176 01:08:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:01.176 01:08:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:01.176 01:08:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:01.176 01:08:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:01.176 01:08:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:01.176 01:08:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:01.176 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:01.176 01:08:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:01.176 01:08:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:01.176 01:08:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:01.176 01:08:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:01.176 01:08:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:01.176 01:08:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:01.176 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:01.176 01:08:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:01.176 01:08:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:01.176 01:08:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:01.176 01:08:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:01.176 01:08:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:01.176 01:08:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:01.176 01:08:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:01.176 01:08:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:01.176 01:08:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:01.176 01:08:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:01.176 01:08:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:01.176 01:08:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:01.176 01:08:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:01.176 01:08:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:01.176 01:08:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:01.176 01:08:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:01.176 01:08:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:01.176 01:08:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:01.176 01:08:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:01.176 01:08:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:01.176 01:08:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:01.176 01:08:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:01.176 01:08:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:01.176 01:08:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:01.176 01:08:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:01.176 01:08:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:01.176 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:01.176 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.257 ms 00:14:01.176 00:14:01.176 --- 10.0.0.2 ping statistics --- 00:14:01.176 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:01.176 rtt min/avg/max/mdev = 0.257/0.257/0.257/0.000 ms 00:14:01.176 01:08:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:01.176 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:01.176 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.125 ms 00:14:01.176 00:14:01.176 --- 10.0.0.1 ping statistics --- 00:14:01.176 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:01.176 rtt min/avg/max/mdev = 0.125/0.125/0.125/0.000 ms 00:14:01.176 01:08:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:01.176 01:08:15 -- nvmf/common.sh@410 -- # return 0 00:14:01.176 01:08:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:01.176 01:08:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:01.176 01:08:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:01.176 01:08:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:01.176 01:08:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:01.176 01:08:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:01.176 01:08:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:01.176 01:08:15 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:14:01.176 01:08:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:01.176 01:08:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:01.176 01:08:15 -- common/autotest_common.sh@10 -- # set +x 00:14:01.176 01:08:15 -- nvmf/common.sh@469 -- # nvmfpid=1985766 00:14:01.177 01:08:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:01.177 01:08:15 -- nvmf/common.sh@470 -- # waitforlisten 1985766 00:14:01.177 01:08:15 -- common/autotest_common.sh@829 -- # '[' -z 1985766 ']' 00:14:01.177 01:08:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:01.177 01:08:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:01.177 01:08:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:01.177 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:01.177 01:08:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:01.177 01:08:15 -- common/autotest_common.sh@10 -- # set +x 00:14:01.177 [2024-11-28 01:08:15.751448] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:01.177 [2024-11-28 01:08:15.751519] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:01.435 EAL: No free 2048 kB hugepages reported on node 1 00:14:01.435 [2024-11-28 01:08:15.822580] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:01.435 [2024-11-28 01:08:15.917798] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:01.435 [2024-11-28 01:08:15.917985] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:01.435 [2024-11-28 01:08:15.918005] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:01.435 [2024-11-28 01:08:15.918019] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:01.435 [2024-11-28 01:08:15.918084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:01.435 [2024-11-28 01:08:15.918124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:01.435 [2024-11-28 01:08:15.918179] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:01.435 [2024-11-28 01:08:15.918182] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:02.370 01:08:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:02.370 01:08:16 -- common/autotest_common.sh@862 -- # return 0 00:14:02.370 01:08:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:02.370 01:08:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:02.370 01:08:16 -- common/autotest_common.sh@10 -- # set +x 00:14:02.370 01:08:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:02.370 01:08:16 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:14:02.370 01:08:16 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode8086 00:14:02.628 [2024-11-28 01:08:17.068283] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:14:02.628 01:08:17 -- target/invalid.sh@40 -- # out='request: 00:14:02.628 { 00:14:02.628 "nqn": "nqn.2016-06.io.spdk:cnode8086", 00:14:02.628 "tgt_name": "foobar", 00:14:02.628 "method": "nvmf_create_subsystem", 00:14:02.628 "req_id": 1 00:14:02.628 } 00:14:02.628 Got JSON-RPC error response 00:14:02.628 response: 00:14:02.628 { 00:14:02.628 "code": -32603, 00:14:02.628 "message": "Unable to find target foobar" 00:14:02.628 }' 00:14:02.628 01:08:17 -- target/invalid.sh@41 -- # [[ request: 00:14:02.628 { 00:14:02.628 "nqn": "nqn.2016-06.io.spdk:cnode8086", 00:14:02.628 "tgt_name": "foobar", 00:14:02.628 "method": "nvmf_create_subsystem", 00:14:02.628 "req_id": 1 00:14:02.628 } 00:14:02.628 Got JSON-RPC error response 00:14:02.628 response: 00:14:02.628 { 00:14:02.628 "code": -32603, 00:14:02.628 "message": "Unable to find target foobar" 00:14:02.628 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:14:02.628 01:08:17 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:14:02.628 01:08:17 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode29727 00:14:02.886 [2024-11-28 01:08:17.325170] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode29727: invalid serial number 'SPDKISFASTANDAWESOME' 00:14:02.886 01:08:17 -- target/invalid.sh@45 -- # out='request: 00:14:02.886 { 00:14:02.886 "nqn": "nqn.2016-06.io.spdk:cnode29727", 00:14:02.886 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:14:02.886 "method": "nvmf_create_subsystem", 00:14:02.886 "req_id": 1 00:14:02.886 } 00:14:02.886 Got JSON-RPC error response 00:14:02.886 response: 00:14:02.886 { 00:14:02.886 "code": -32602, 00:14:02.886 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:14:02.886 }' 00:14:02.886 01:08:17 -- target/invalid.sh@46 -- # [[ request: 00:14:02.886 { 00:14:02.886 "nqn": "nqn.2016-06.io.spdk:cnode29727", 00:14:02.886 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:14:02.886 "method": "nvmf_create_subsystem", 00:14:02.886 "req_id": 1 00:14:02.886 } 00:14:02.886 Got JSON-RPC error response 00:14:02.886 response: 00:14:02.886 { 00:14:02.886 "code": -32602, 00:14:02.886 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:14:02.886 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:14:02.886 01:08:17 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:14:02.886 01:08:17 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode30610 00:14:03.145 [2024-11-28 01:08:17.577974] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode30610: invalid model number 'SPDK_Controller' 00:14:03.145 01:08:17 -- target/invalid.sh@50 -- # out='request: 00:14:03.145 { 00:14:03.145 "nqn": "nqn.2016-06.io.spdk:cnode30610", 00:14:03.145 "model_number": "SPDK_Controller\u001f", 00:14:03.145 "method": "nvmf_create_subsystem", 00:14:03.145 "req_id": 1 00:14:03.145 } 00:14:03.145 Got JSON-RPC error response 00:14:03.145 response: 00:14:03.145 { 00:14:03.145 "code": -32602, 00:14:03.145 "message": "Invalid MN SPDK_Controller\u001f" 00:14:03.145 }' 00:14:03.145 01:08:17 -- target/invalid.sh@51 -- # [[ request: 00:14:03.145 { 00:14:03.145 "nqn": "nqn.2016-06.io.spdk:cnode30610", 00:14:03.145 "model_number": "SPDK_Controller\u001f", 00:14:03.145 "method": "nvmf_create_subsystem", 00:14:03.145 "req_id": 1 00:14:03.145 } 00:14:03.145 Got JSON-RPC error response 00:14:03.145 response: 00:14:03.145 { 00:14:03.145 "code": -32602, 00:14:03.145 "message": "Invalid MN SPDK_Controller\u001f" 00:14:03.145 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:14:03.145 01:08:17 -- target/invalid.sh@54 -- # gen_random_s 21 00:14:03.145 01:08:17 -- target/invalid.sh@19 -- # local length=21 ll 00:14:03.145 01:08:17 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:14:03.145 01:08:17 -- target/invalid.sh@21 -- # local chars 00:14:03.145 01:08:17 -- target/invalid.sh@22 -- # local string 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 33 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x21' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+='!' 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 40 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x28' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+='(' 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 110 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+=n 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 109 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+=m 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 119 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x77' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+=w 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 80 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x50' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+=P 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 112 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x70' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+=p 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 86 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x56' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+=V 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 127 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+=$'\177' 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 111 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+=o 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 78 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+=N 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 39 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x27' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+=\' 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 60 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+='<' 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 122 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+=z 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 113 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x71' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+=q 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 69 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x45' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+=E 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 64 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x40' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+=@ 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 88 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x58' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+=X 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 120 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x78' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+=x 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 99 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x63' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+=c 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # printf %x 32 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # echo -e '\x20' 00:14:03.145 01:08:17 -- target/invalid.sh@25 -- # string+=' ' 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:03.145 01:08:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:03.145 01:08:17 -- target/invalid.sh@28 -- # [[ ! == \- ]] 00:14:03.145 01:08:17 -- target/invalid.sh@31 -- # echo '!(nmwPpVoN'\'',qCvI)m_i6/pWL^%tiQ_.%bst,qCvI)m_i6/pWL^%tiQ_.%bst,qCvI)m_i6/pWL^%tiQ_.%bst,qCvI)m_i6/pWL^%tiQ_.%bst,qCvI)m_i6/pWL^%tiQ_.%bst /dev/null' 00:14:06.509 01:08:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:08.420 01:08:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:08.420 00:14:08.421 real 0m9.548s 00:14:08.421 user 0m23.797s 00:14:08.421 sys 0m2.465s 00:14:08.421 01:08:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:08.421 01:08:22 -- common/autotest_common.sh@10 -- # set +x 00:14:08.421 ************************************ 00:14:08.421 END TEST nvmf_invalid 00:14:08.421 ************************************ 00:14:08.421 01:08:22 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:14:08.421 01:08:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:08.421 01:08:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:08.421 01:08:22 -- common/autotest_common.sh@10 -- # set +x 00:14:08.421 ************************************ 00:14:08.421 START TEST nvmf_abort 00:14:08.421 ************************************ 00:14:08.421 01:08:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:14:08.421 * Looking for test storage... 00:14:08.421 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:08.421 01:08:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:08.421 01:08:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:08.421 01:08:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:08.680 01:08:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:08.680 01:08:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:08.680 01:08:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:08.680 01:08:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:08.680 01:08:23 -- scripts/common.sh@335 -- # IFS=.-: 00:14:08.680 01:08:23 -- scripts/common.sh@335 -- # read -ra ver1 00:14:08.680 01:08:23 -- scripts/common.sh@336 -- # IFS=.-: 00:14:08.680 01:08:23 -- scripts/common.sh@336 -- # read -ra ver2 00:14:08.680 01:08:23 -- scripts/common.sh@337 -- # local 'op=<' 00:14:08.680 01:08:23 -- scripts/common.sh@339 -- # ver1_l=2 00:14:08.680 01:08:23 -- scripts/common.sh@340 -- # ver2_l=1 00:14:08.680 01:08:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:08.680 01:08:23 -- scripts/common.sh@343 -- # case "$op" in 00:14:08.680 01:08:23 -- scripts/common.sh@344 -- # : 1 00:14:08.680 01:08:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:08.680 01:08:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:08.680 01:08:23 -- scripts/common.sh@364 -- # decimal 1 00:14:08.680 01:08:23 -- scripts/common.sh@352 -- # local d=1 00:14:08.680 01:08:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:08.680 01:08:23 -- scripts/common.sh@354 -- # echo 1 00:14:08.680 01:08:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:08.680 01:08:23 -- scripts/common.sh@365 -- # decimal 2 00:14:08.680 01:08:23 -- scripts/common.sh@352 -- # local d=2 00:14:08.680 01:08:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:08.680 01:08:23 -- scripts/common.sh@354 -- # echo 2 00:14:08.680 01:08:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:08.680 01:08:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:08.680 01:08:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:08.680 01:08:23 -- scripts/common.sh@367 -- # return 0 00:14:08.680 01:08:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:08.680 01:08:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:08.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:08.680 --rc genhtml_branch_coverage=1 00:14:08.680 --rc genhtml_function_coverage=1 00:14:08.680 --rc genhtml_legend=1 00:14:08.680 --rc geninfo_all_blocks=1 00:14:08.680 --rc geninfo_unexecuted_blocks=1 00:14:08.680 00:14:08.680 ' 00:14:08.680 01:08:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:08.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:08.680 --rc genhtml_branch_coverage=1 00:14:08.680 --rc genhtml_function_coverage=1 00:14:08.680 --rc genhtml_legend=1 00:14:08.680 --rc geninfo_all_blocks=1 00:14:08.680 --rc geninfo_unexecuted_blocks=1 00:14:08.680 00:14:08.680 ' 00:14:08.680 01:08:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:08.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:08.680 --rc genhtml_branch_coverage=1 00:14:08.680 --rc genhtml_function_coverage=1 00:14:08.680 --rc genhtml_legend=1 00:14:08.680 --rc geninfo_all_blocks=1 00:14:08.680 --rc geninfo_unexecuted_blocks=1 00:14:08.680 00:14:08.680 ' 00:14:08.680 01:08:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:08.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:08.680 --rc genhtml_branch_coverage=1 00:14:08.680 --rc genhtml_function_coverage=1 00:14:08.680 --rc genhtml_legend=1 00:14:08.680 --rc geninfo_all_blocks=1 00:14:08.680 --rc geninfo_unexecuted_blocks=1 00:14:08.680 00:14:08.680 ' 00:14:08.680 01:08:23 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:08.680 01:08:23 -- nvmf/common.sh@7 -- # uname -s 00:14:08.680 01:08:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:08.680 01:08:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:08.680 01:08:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:08.680 01:08:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:08.680 01:08:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:08.680 01:08:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:08.680 01:08:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:08.680 01:08:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:08.680 01:08:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:08.680 01:08:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:08.680 01:08:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:08.680 01:08:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:08.680 01:08:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:08.680 01:08:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:08.680 01:08:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:08.680 01:08:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:08.680 01:08:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:08.680 01:08:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:08.680 01:08:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:08.680 01:08:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:08.680 01:08:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:08.680 01:08:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:08.680 01:08:23 -- paths/export.sh@5 -- # export PATH 00:14:08.681 01:08:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:08.681 01:08:23 -- nvmf/common.sh@46 -- # : 0 00:14:08.681 01:08:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:08.681 01:08:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:08.681 01:08:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:08.681 01:08:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:08.681 01:08:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:08.681 01:08:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:08.681 01:08:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:08.681 01:08:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:08.681 01:08:23 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:08.681 01:08:23 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:14:08.681 01:08:23 -- target/abort.sh@14 -- # nvmftestinit 00:14:08.681 01:08:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:08.681 01:08:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:08.681 01:08:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:08.681 01:08:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:08.681 01:08:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:08.681 01:08:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:08.681 01:08:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:08.681 01:08:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:08.681 01:08:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:08.681 01:08:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:08.681 01:08:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:08.681 01:08:23 -- common/autotest_common.sh@10 -- # set +x 00:14:11.218 01:08:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:11.218 01:08:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:11.218 01:08:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:11.218 01:08:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:11.218 01:08:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:11.218 01:08:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:11.218 01:08:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:11.218 01:08:25 -- nvmf/common.sh@294 -- # net_devs=() 00:14:11.218 01:08:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:11.218 01:08:25 -- nvmf/common.sh@295 -- # e810=() 00:14:11.218 01:08:25 -- nvmf/common.sh@295 -- # local -ga e810 00:14:11.218 01:08:25 -- nvmf/common.sh@296 -- # x722=() 00:14:11.218 01:08:25 -- nvmf/common.sh@296 -- # local -ga x722 00:14:11.218 01:08:25 -- nvmf/common.sh@297 -- # mlx=() 00:14:11.218 01:08:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:11.218 01:08:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:11.218 01:08:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:11.218 01:08:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:11.218 01:08:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:11.218 01:08:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:11.218 01:08:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:11.218 01:08:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:11.218 01:08:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:11.218 01:08:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:11.218 01:08:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:11.218 01:08:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:11.219 01:08:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:11.219 01:08:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:11.219 01:08:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:11.219 01:08:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:11.219 01:08:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:11.219 01:08:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:11.219 01:08:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:11.219 01:08:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:11.219 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:11.219 01:08:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:11.219 01:08:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:11.219 01:08:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:11.219 01:08:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:11.219 01:08:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:11.219 01:08:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:11.219 01:08:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:11.219 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:11.219 01:08:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:11.219 01:08:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:11.219 01:08:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:11.219 01:08:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:11.219 01:08:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:11.219 01:08:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:11.219 01:08:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:11.219 01:08:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:11.219 01:08:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:11.219 01:08:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:11.219 01:08:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:11.219 01:08:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:11.219 01:08:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:11.219 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:11.219 01:08:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:11.219 01:08:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:11.219 01:08:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:11.219 01:08:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:11.219 01:08:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:11.219 01:08:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:11.219 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:11.219 01:08:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:11.219 01:08:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:11.219 01:08:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:11.219 01:08:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:11.219 01:08:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:11.219 01:08:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:11.219 01:08:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:11.219 01:08:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:11.219 01:08:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:11.219 01:08:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:11.219 01:08:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:11.219 01:08:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:11.219 01:08:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:11.219 01:08:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:11.219 01:08:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:11.219 01:08:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:11.219 01:08:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:11.219 01:08:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:11.219 01:08:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:11.219 01:08:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:11.219 01:08:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:11.219 01:08:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:11.219 01:08:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:11.219 01:08:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:11.219 01:08:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:11.219 01:08:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:11.219 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:11.219 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.257 ms 00:14:11.219 00:14:11.219 --- 10.0.0.2 ping statistics --- 00:14:11.219 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:11.219 rtt min/avg/max/mdev = 0.257/0.257/0.257/0.000 ms 00:14:11.219 01:08:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:11.219 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:11.219 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:14:11.219 00:14:11.219 --- 10.0.0.1 ping statistics --- 00:14:11.219 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:11.219 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:14:11.219 01:08:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:11.219 01:08:25 -- nvmf/common.sh@410 -- # return 0 00:14:11.219 01:08:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:11.219 01:08:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:11.219 01:08:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:11.219 01:08:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:11.219 01:08:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:11.219 01:08:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:11.219 01:08:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:11.219 01:08:25 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:14:11.219 01:08:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:11.219 01:08:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:11.219 01:08:25 -- common/autotest_common.sh@10 -- # set +x 00:14:11.219 01:08:25 -- nvmf/common.sh@469 -- # nvmfpid=1988575 00:14:11.219 01:08:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:11.219 01:08:25 -- nvmf/common.sh@470 -- # waitforlisten 1988575 00:14:11.219 01:08:25 -- common/autotest_common.sh@829 -- # '[' -z 1988575 ']' 00:14:11.219 01:08:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:11.219 01:08:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:11.219 01:08:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:11.219 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:11.219 01:08:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:11.219 01:08:25 -- common/autotest_common.sh@10 -- # set +x 00:14:11.219 [2024-11-28 01:08:25.424283] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:11.219 [2024-11-28 01:08:25.424363] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:11.219 EAL: No free 2048 kB hugepages reported on node 1 00:14:11.219 [2024-11-28 01:08:25.487119] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:11.219 [2024-11-28 01:08:25.568115] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:11.219 [2024-11-28 01:08:25.568277] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:11.219 [2024-11-28 01:08:25.568294] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:11.219 [2024-11-28 01:08:25.568307] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:11.219 [2024-11-28 01:08:25.568367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:11.219 [2024-11-28 01:08:25.568393] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:11.219 [2024-11-28 01:08:25.568395] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:12.153 01:08:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:12.153 01:08:26 -- common/autotest_common.sh@862 -- # return 0 00:14:12.153 01:08:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:12.153 01:08:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:12.153 01:08:26 -- common/autotest_common.sh@10 -- # set +x 00:14:12.153 01:08:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:12.153 01:08:26 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:14:12.153 01:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:12.153 01:08:26 -- common/autotest_common.sh@10 -- # set +x 00:14:12.153 [2024-11-28 01:08:26.452846] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:12.153 01:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:12.153 01:08:26 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:14:12.153 01:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:12.153 01:08:26 -- common/autotest_common.sh@10 -- # set +x 00:14:12.153 Malloc0 00:14:12.153 01:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:12.153 01:08:26 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:12.153 01:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:12.153 01:08:26 -- common/autotest_common.sh@10 -- # set +x 00:14:12.153 Delay0 00:14:12.153 01:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:12.153 01:08:26 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:12.153 01:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:12.154 01:08:26 -- common/autotest_common.sh@10 -- # set +x 00:14:12.154 01:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:12.154 01:08:26 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:14:12.154 01:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:12.154 01:08:26 -- common/autotest_common.sh@10 -- # set +x 00:14:12.154 01:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:12.154 01:08:26 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:12.154 01:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:12.154 01:08:26 -- common/autotest_common.sh@10 -- # set +x 00:14:12.154 [2024-11-28 01:08:26.524966] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:12.154 01:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:12.154 01:08:26 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:12.154 01:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:12.154 01:08:26 -- common/autotest_common.sh@10 -- # set +x 00:14:12.154 01:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:12.154 01:08:26 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:14:12.154 EAL: No free 2048 kB hugepages reported on node 1 00:14:12.154 [2024-11-28 01:08:26.631019] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:14:14.748 Initializing NVMe Controllers 00:14:14.748 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:14.748 controller IO queue size 128 less than required 00:14:14.748 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:14:14.748 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:14:14.748 Initialization complete. Launching workers. 00:14:14.748 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 127, failed: 29940 00:14:14.748 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 30005, failed to submit 62 00:14:14.748 success 29940, unsuccess 65, failed 0 00:14:14.748 01:08:28 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:14.748 01:08:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:14.748 01:08:28 -- common/autotest_common.sh@10 -- # set +x 00:14:14.748 01:08:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:14.748 01:08:28 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:14:14.748 01:08:28 -- target/abort.sh@38 -- # nvmftestfini 00:14:14.748 01:08:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:14.748 01:08:28 -- nvmf/common.sh@116 -- # sync 00:14:14.748 01:08:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:14.748 01:08:28 -- nvmf/common.sh@119 -- # set +e 00:14:14.748 01:08:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:14.748 01:08:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:14.748 rmmod nvme_tcp 00:14:14.748 rmmod nvme_fabrics 00:14:14.748 rmmod nvme_keyring 00:14:14.748 01:08:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:14.748 01:08:28 -- nvmf/common.sh@123 -- # set -e 00:14:14.748 01:08:28 -- nvmf/common.sh@124 -- # return 0 00:14:14.748 01:08:28 -- nvmf/common.sh@477 -- # '[' -n 1988575 ']' 00:14:14.748 01:08:28 -- nvmf/common.sh@478 -- # killprocess 1988575 00:14:14.748 01:08:28 -- common/autotest_common.sh@936 -- # '[' -z 1988575 ']' 00:14:14.748 01:08:28 -- common/autotest_common.sh@940 -- # kill -0 1988575 00:14:14.748 01:08:28 -- common/autotest_common.sh@941 -- # uname 00:14:14.748 01:08:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:14.748 01:08:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1988575 00:14:14.748 01:08:28 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:14.748 01:08:28 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:14.748 01:08:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1988575' 00:14:14.748 killing process with pid 1988575 00:14:14.748 01:08:28 -- common/autotest_common.sh@955 -- # kill 1988575 00:14:14.748 01:08:28 -- common/autotest_common.sh@960 -- # wait 1988575 00:14:14.748 01:08:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:14.748 01:08:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:14.748 01:08:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:14.748 01:08:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:14.748 01:08:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:14.748 01:08:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:14.748 01:08:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:14.748 01:08:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:16.657 01:08:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:16.657 00:14:16.657 real 0m8.243s 00:14:16.657 user 0m13.202s 00:14:16.657 sys 0m2.686s 00:14:16.657 01:08:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:16.657 01:08:31 -- common/autotest_common.sh@10 -- # set +x 00:14:16.657 ************************************ 00:14:16.657 END TEST nvmf_abort 00:14:16.657 ************************************ 00:14:16.657 01:08:31 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:14:16.657 01:08:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:16.657 01:08:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:16.657 01:08:31 -- common/autotest_common.sh@10 -- # set +x 00:14:16.657 ************************************ 00:14:16.657 START TEST nvmf_ns_hotplug_stress 00:14:16.657 ************************************ 00:14:16.657 01:08:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:14:16.657 * Looking for test storage... 00:14:16.657 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:16.657 01:08:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:16.916 01:08:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:16.916 01:08:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:16.916 01:08:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:16.916 01:08:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:16.916 01:08:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:16.916 01:08:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:16.916 01:08:31 -- scripts/common.sh@335 -- # IFS=.-: 00:14:16.916 01:08:31 -- scripts/common.sh@335 -- # read -ra ver1 00:14:16.916 01:08:31 -- scripts/common.sh@336 -- # IFS=.-: 00:14:16.916 01:08:31 -- scripts/common.sh@336 -- # read -ra ver2 00:14:16.916 01:08:31 -- scripts/common.sh@337 -- # local 'op=<' 00:14:16.916 01:08:31 -- scripts/common.sh@339 -- # ver1_l=2 00:14:16.916 01:08:31 -- scripts/common.sh@340 -- # ver2_l=1 00:14:16.916 01:08:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:16.916 01:08:31 -- scripts/common.sh@343 -- # case "$op" in 00:14:16.916 01:08:31 -- scripts/common.sh@344 -- # : 1 00:14:16.916 01:08:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:16.916 01:08:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:16.916 01:08:31 -- scripts/common.sh@364 -- # decimal 1 00:14:16.916 01:08:31 -- scripts/common.sh@352 -- # local d=1 00:14:16.916 01:08:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:16.916 01:08:31 -- scripts/common.sh@354 -- # echo 1 00:14:16.916 01:08:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:16.916 01:08:31 -- scripts/common.sh@365 -- # decimal 2 00:14:16.916 01:08:31 -- scripts/common.sh@352 -- # local d=2 00:14:16.916 01:08:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:16.916 01:08:31 -- scripts/common.sh@354 -- # echo 2 00:14:16.916 01:08:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:16.916 01:08:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:16.916 01:08:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:16.916 01:08:31 -- scripts/common.sh@367 -- # return 0 00:14:16.916 01:08:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:16.916 01:08:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:16.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:16.916 --rc genhtml_branch_coverage=1 00:14:16.916 --rc genhtml_function_coverage=1 00:14:16.916 --rc genhtml_legend=1 00:14:16.916 --rc geninfo_all_blocks=1 00:14:16.916 --rc geninfo_unexecuted_blocks=1 00:14:16.916 00:14:16.916 ' 00:14:16.916 01:08:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:16.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:16.916 --rc genhtml_branch_coverage=1 00:14:16.916 --rc genhtml_function_coverage=1 00:14:16.916 --rc genhtml_legend=1 00:14:16.916 --rc geninfo_all_blocks=1 00:14:16.916 --rc geninfo_unexecuted_blocks=1 00:14:16.916 00:14:16.916 ' 00:14:16.916 01:08:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:16.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:16.916 --rc genhtml_branch_coverage=1 00:14:16.916 --rc genhtml_function_coverage=1 00:14:16.916 --rc genhtml_legend=1 00:14:16.916 --rc geninfo_all_blocks=1 00:14:16.916 --rc geninfo_unexecuted_blocks=1 00:14:16.916 00:14:16.916 ' 00:14:16.916 01:08:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:16.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:16.916 --rc genhtml_branch_coverage=1 00:14:16.916 --rc genhtml_function_coverage=1 00:14:16.916 --rc genhtml_legend=1 00:14:16.916 --rc geninfo_all_blocks=1 00:14:16.916 --rc geninfo_unexecuted_blocks=1 00:14:16.916 00:14:16.916 ' 00:14:16.916 01:08:31 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:16.916 01:08:31 -- nvmf/common.sh@7 -- # uname -s 00:14:16.916 01:08:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:16.916 01:08:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:16.916 01:08:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:16.916 01:08:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:16.916 01:08:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:16.916 01:08:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:16.916 01:08:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:16.916 01:08:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:16.916 01:08:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:16.916 01:08:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:16.916 01:08:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:16.916 01:08:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:16.916 01:08:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:16.916 01:08:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:16.916 01:08:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:16.916 01:08:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:16.916 01:08:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:16.916 01:08:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:16.916 01:08:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:16.916 01:08:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:16.916 01:08:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:16.916 01:08:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:16.916 01:08:31 -- paths/export.sh@5 -- # export PATH 00:14:16.916 01:08:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:16.916 01:08:31 -- nvmf/common.sh@46 -- # : 0 00:14:16.916 01:08:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:16.916 01:08:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:16.916 01:08:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:16.916 01:08:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:16.916 01:08:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:16.916 01:08:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:16.916 01:08:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:16.916 01:08:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:16.916 01:08:31 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:16.916 01:08:31 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:14:16.916 01:08:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:16.916 01:08:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:16.916 01:08:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:16.916 01:08:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:16.916 01:08:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:16.917 01:08:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:16.917 01:08:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:16.917 01:08:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:16.917 01:08:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:16.917 01:08:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:16.917 01:08:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:16.917 01:08:31 -- common/autotest_common.sh@10 -- # set +x 00:14:19.450 01:08:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:19.450 01:08:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:19.450 01:08:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:19.450 01:08:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:19.450 01:08:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:19.450 01:08:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:19.450 01:08:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:19.450 01:08:33 -- nvmf/common.sh@294 -- # net_devs=() 00:14:19.450 01:08:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:19.450 01:08:33 -- nvmf/common.sh@295 -- # e810=() 00:14:19.450 01:08:33 -- nvmf/common.sh@295 -- # local -ga e810 00:14:19.450 01:08:33 -- nvmf/common.sh@296 -- # x722=() 00:14:19.450 01:08:33 -- nvmf/common.sh@296 -- # local -ga x722 00:14:19.450 01:08:33 -- nvmf/common.sh@297 -- # mlx=() 00:14:19.450 01:08:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:19.450 01:08:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:19.450 01:08:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:19.450 01:08:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:19.450 01:08:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:19.450 01:08:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:19.450 01:08:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:19.450 01:08:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:19.450 01:08:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:19.450 01:08:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:19.450 01:08:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:19.450 01:08:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:19.450 01:08:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:19.450 01:08:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:19.450 01:08:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:19.450 01:08:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:19.450 01:08:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:19.450 01:08:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:19.450 01:08:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:19.450 01:08:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:19.450 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:19.450 01:08:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:19.450 01:08:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:19.450 01:08:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:19.450 01:08:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:19.450 01:08:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:19.450 01:08:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:19.450 01:08:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:19.450 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:19.450 01:08:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:19.450 01:08:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:19.450 01:08:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:19.450 01:08:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:19.450 01:08:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:19.450 01:08:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:19.450 01:08:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:19.450 01:08:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:19.450 01:08:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:19.450 01:08:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:19.450 01:08:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:19.450 01:08:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:19.450 01:08:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:19.450 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:19.450 01:08:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:19.450 01:08:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:19.450 01:08:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:19.450 01:08:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:19.450 01:08:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:19.451 01:08:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:19.451 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:19.451 01:08:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:19.451 01:08:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:19.451 01:08:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:19.451 01:08:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:19.451 01:08:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:19.451 01:08:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:19.451 01:08:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:19.451 01:08:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:19.451 01:08:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:19.451 01:08:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:19.451 01:08:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:19.451 01:08:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:19.451 01:08:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:19.451 01:08:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:19.451 01:08:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:19.451 01:08:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:19.451 01:08:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:19.451 01:08:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:19.451 01:08:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:19.451 01:08:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:19.451 01:08:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:19.451 01:08:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:19.451 01:08:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:19.451 01:08:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:19.451 01:08:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:19.451 01:08:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:19.451 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:19.451 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.233 ms 00:14:19.451 00:14:19.451 --- 10.0.0.2 ping statistics --- 00:14:19.451 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:19.451 rtt min/avg/max/mdev = 0.233/0.233/0.233/0.000 ms 00:14:19.451 01:08:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:19.451 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:19.451 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:14:19.451 00:14:19.451 --- 10.0.0.1 ping statistics --- 00:14:19.451 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:19.451 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:14:19.451 01:08:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:19.451 01:08:33 -- nvmf/common.sh@410 -- # return 0 00:14:19.451 01:08:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:19.451 01:08:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:19.451 01:08:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:19.451 01:08:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:19.451 01:08:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:19.451 01:08:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:19.451 01:08:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:19.451 01:08:33 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:14:19.451 01:08:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:19.451 01:08:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:19.451 01:08:33 -- common/autotest_common.sh@10 -- # set +x 00:14:19.451 01:08:33 -- nvmf/common.sh@469 -- # nvmfpid=1990965 00:14:19.451 01:08:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:19.451 01:08:33 -- nvmf/common.sh@470 -- # waitforlisten 1990965 00:14:19.451 01:08:33 -- common/autotest_common.sh@829 -- # '[' -z 1990965 ']' 00:14:19.451 01:08:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:19.451 01:08:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:19.451 01:08:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:19.451 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:19.451 01:08:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:19.451 01:08:33 -- common/autotest_common.sh@10 -- # set +x 00:14:19.451 [2024-11-28 01:08:33.740296] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:19.451 [2024-11-28 01:08:33.740384] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:19.451 EAL: No free 2048 kB hugepages reported on node 1 00:14:19.451 [2024-11-28 01:08:33.808277] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:19.451 [2024-11-28 01:08:33.891824] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:19.451 [2024-11-28 01:08:33.891994] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:19.451 [2024-11-28 01:08:33.892012] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:19.451 [2024-11-28 01:08:33.892025] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:19.451 [2024-11-28 01:08:33.892083] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:19.451 [2024-11-28 01:08:33.892157] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:19.451 [2024-11-28 01:08:33.892160] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:20.385 01:08:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:20.385 01:08:34 -- common/autotest_common.sh@862 -- # return 0 00:14:20.385 01:08:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:20.385 01:08:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:20.385 01:08:34 -- common/autotest_common.sh@10 -- # set +x 00:14:20.385 01:08:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:20.385 01:08:34 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:14:20.385 01:08:34 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:20.653 [2024-11-28 01:08:35.013936] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:20.653 01:08:35 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:20.912 01:08:35 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:21.170 [2024-11-28 01:08:35.524806] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:21.170 01:08:35 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:21.428 01:08:35 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:14:21.686 Malloc0 00:14:21.686 01:08:36 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:21.944 Delay0 00:14:21.944 01:08:36 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:22.202 01:08:36 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:14:22.460 NULL1 00:14:22.460 01:08:36 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:22.718 01:08:37 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=1991409 00:14:22.718 01:08:37 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:14:22.718 01:08:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:22.718 01:08:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:22.718 EAL: No free 2048 kB hugepages reported on node 1 00:14:24.092 Read completed with error (sct=0, sc=11) 00:14:24.092 01:08:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:24.092 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:24.092 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:24.092 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:24.092 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:24.092 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:24.092 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:24.092 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:24.092 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:24.092 01:08:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:14:24.092 01:08:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:14:24.350 true 00:14:24.350 01:08:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:24.350 01:08:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:25.283 01:08:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:25.541 01:08:39 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:14:25.541 01:08:39 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:14:25.799 true 00:14:25.799 01:08:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:25.799 01:08:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:26.057 01:08:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:26.314 01:08:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:14:26.314 01:08:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:14:26.571 true 00:14:26.571 01:08:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:26.571 01:08:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:26.828 01:08:41 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:27.086 01:08:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:14:27.086 01:08:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:14:27.344 true 00:14:27.344 01:08:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:27.344 01:08:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:28.277 01:08:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:28.534 01:08:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:14:28.534 01:08:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:14:28.792 true 00:14:28.792 01:08:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:28.792 01:08:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:29.049 01:08:43 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:29.306 01:08:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:14:29.306 01:08:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:14:29.564 true 00:14:29.564 01:08:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:29.564 01:08:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:29.820 01:08:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:30.078 01:08:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:14:30.078 01:08:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:14:30.335 true 00:14:30.335 01:08:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:30.335 01:08:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:31.267 01:08:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:31.267 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:31.524 01:08:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:14:31.524 01:08:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:14:31.781 true 00:14:31.781 01:08:46 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:31.781 01:08:46 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:32.039 01:08:46 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:32.295 01:08:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:14:32.295 01:08:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:14:32.552 true 00:14:32.552 01:08:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:32.552 01:08:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:33.485 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:33.485 01:08:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:33.485 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:33.742 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:33.999 01:08:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:14:33.999 01:08:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:14:34.257 true 00:14:34.257 01:08:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:34.257 01:08:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:34.515 01:08:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:34.773 01:08:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:14:34.773 01:08:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:14:34.773 true 00:14:34.773 01:08:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:34.773 01:08:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:35.707 01:08:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:35.707 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:35.965 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:35.965 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:35.965 01:08:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:14:35.965 01:08:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:14:36.224 true 00:14:36.224 01:08:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:36.224 01:08:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:36.481 01:08:51 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:36.740 01:08:51 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:14:36.740 01:08:51 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:14:36.998 true 00:14:36.998 01:08:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:36.998 01:08:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:37.931 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:37.931 01:08:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:37.931 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:38.189 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:38.189 01:08:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:14:38.189 01:08:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:14:38.446 true 00:14:38.446 01:08:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:38.446 01:08:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:38.704 01:08:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:38.961 01:08:53 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:14:38.961 01:08:53 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:14:39.218 true 00:14:39.218 01:08:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:39.218 01:08:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:40.215 01:08:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:40.473 01:08:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:14:40.473 01:08:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:14:40.730 true 00:14:40.730 01:08:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:40.730 01:08:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:40.987 01:08:55 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:41.245 01:08:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:14:41.245 01:08:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:14:41.503 true 00:14:41.503 01:08:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:41.503 01:08:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:41.761 01:08:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:42.020 01:08:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:14:42.020 01:08:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:14:42.278 true 00:14:42.278 01:08:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:42.278 01:08:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:43.212 01:08:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:43.471 01:08:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:14:43.471 01:08:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:14:43.729 true 00:14:43.729 01:08:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:43.729 01:08:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:43.986 01:08:58 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:44.245 01:08:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:14:44.245 01:08:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:14:44.503 true 00:14:44.503 01:08:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:44.503 01:08:59 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:45.437 01:08:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:45.437 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:45.695 01:09:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:14:45.695 01:09:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:14:45.952 true 00:14:45.952 01:09:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:45.952 01:09:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:46.210 01:09:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:46.467 01:09:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:14:46.467 01:09:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:14:46.725 true 00:14:46.725 01:09:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:46.725 01:09:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:46.984 01:09:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:47.241 01:09:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:14:47.241 01:09:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:14:47.499 true 00:14:47.499 01:09:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:47.499 01:09:02 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:48.431 01:09:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:48.688 01:09:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:14:48.688 01:09:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:14:48.946 true 00:14:48.946 01:09:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:48.946 01:09:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:49.203 01:09:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:49.461 01:09:04 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:14:49.461 01:09:04 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:14:49.718 true 00:14:49.718 01:09:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:49.718 01:09:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:49.975 01:09:04 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:50.232 01:09:04 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:14:50.232 01:09:04 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:14:50.490 true 00:14:50.747 01:09:05 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:50.747 01:09:05 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:51.681 01:09:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:51.939 01:09:06 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:14:51.939 01:09:06 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:14:52.197 true 00:14:52.197 01:09:06 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:52.197 01:09:06 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:52.455 01:09:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:52.713 01:09:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:14:52.713 01:09:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:14:52.971 true 00:14:52.971 01:09:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:52.971 01:09:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:52.971 Initializing NVMe Controllers 00:14:52.971 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:52.971 Controller IO queue size 128, less than required. 00:14:52.971 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:52.971 Controller IO queue size 128, less than required. 00:14:52.971 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:52.971 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:52.971 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:14:52.971 Initialization complete. Launching workers. 00:14:52.971 ======================================================== 00:14:52.971 Latency(us) 00:14:52.971 Device Information : IOPS MiB/s Average min max 00:14:52.971 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 692.85 0.34 82806.82 2801.10 1058519.27 00:14:52.971 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 10442.32 5.10 12258.83 2599.99 442910.78 00:14:52.971 ======================================================== 00:14:52.971 Total : 11135.17 5.44 16648.42 2599.99 1058519.27 00:14:52.971 00:14:53.229 01:09:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:53.487 01:09:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:14:53.487 01:09:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:14:53.745 true 00:14:53.745 01:09:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1991409 00:14:53.745 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (1991409) - No such process 00:14:53.745 01:09:08 -- target/ns_hotplug_stress.sh@53 -- # wait 1991409 00:14:53.745 01:09:08 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:54.003 01:09:08 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:54.261 01:09:08 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:14:54.261 01:09:08 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:14:54.261 01:09:08 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:14:54.261 01:09:08 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:54.261 01:09:08 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:14:54.520 null0 00:14:54.520 01:09:08 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:54.520 01:09:08 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:54.520 01:09:08 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:14:54.778 null1 00:14:54.778 01:09:09 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:54.778 01:09:09 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:54.778 01:09:09 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:14:55.036 null2 00:14:55.036 01:09:09 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:55.036 01:09:09 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:55.036 01:09:09 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:14:55.294 null3 00:14:55.294 01:09:09 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:55.294 01:09:09 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:55.294 01:09:09 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:14:55.552 null4 00:14:55.552 01:09:09 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:55.552 01:09:09 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:55.552 01:09:09 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:14:55.810 null5 00:14:55.810 01:09:10 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:55.810 01:09:10 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:55.810 01:09:10 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:14:56.068 null6 00:14:56.068 01:09:10 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:56.068 01:09:10 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:56.068 01:09:10 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:14:56.326 null7 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:14:56.326 01:09:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@66 -- # wait 1996193 1996194 1996196 1996198 1996200 1996202 1996204 1996206 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:56.327 01:09:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:56.585 01:09:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:56.585 01:09:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:56.585 01:09:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:56.585 01:09:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:56.585 01:09:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:56.585 01:09:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:56.585 01:09:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:56.585 01:09:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:56.843 01:09:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:57.101 01:09:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:57.101 01:09:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:57.101 01:09:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:57.101 01:09:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:57.101 01:09:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:57.101 01:09:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:57.101 01:09:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:57.101 01:09:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:57.360 01:09:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:57.618 01:09:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:57.618 01:09:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:57.618 01:09:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:57.618 01:09:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:57.618 01:09:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:57.618 01:09:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:57.618 01:09:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:57.618 01:09:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:57.876 01:09:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:57.876 01:09:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:57.876 01:09:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:57.876 01:09:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:57.876 01:09:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:57.876 01:09:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:57.876 01:09:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:57.876 01:09:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:57.876 01:09:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:57.877 01:09:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:57.877 01:09:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:57.877 01:09:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:57.877 01:09:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:57.877 01:09:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:57.877 01:09:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:58.135 01:09:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:58.135 01:09:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:58.135 01:09:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:58.135 01:09:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:58.135 01:09:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:58.135 01:09:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:58.135 01:09:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:58.135 01:09:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:58.135 01:09:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:58.393 01:09:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:58.393 01:09:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:58.393 01:09:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:58.393 01:09:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:58.393 01:09:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:58.393 01:09:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:58.393 01:09:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:58.393 01:09:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:58.652 01:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:58.911 01:09:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:58.911 01:09:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:58.911 01:09:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:58.911 01:09:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:58.911 01:09:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:58.911 01:09:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:58.911 01:09:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:58.911 01:09:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:59.169 01:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:59.427 01:09:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:59.427 01:09:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:59.427 01:09:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:59.427 01:09:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:59.427 01:09:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:59.427 01:09:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:59.427 01:09:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:59.427 01:09:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:59.685 01:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:59.944 01:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:59.944 01:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:59.944 01:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:59.944 01:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:59.944 01:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:59.944 01:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:59.944 01:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:59.944 01:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:00.202 01:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:15:00.461 01:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:15:00.461 01:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:15:00.461 01:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:15:00.461 01:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:15:00.461 01:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:15:00.461 01:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:15:00.461 01:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:00.461 01:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:15:00.717 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:00.717 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:00.717 01:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:15:00.717 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:00.717 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:00.717 01:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:15:00.718 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:00.718 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:00.718 01:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:15:00.718 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:00.718 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:00.718 01:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:15:00.718 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:00.718 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:00.718 01:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:15:00.718 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:00.718 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:00.718 01:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:15:00.718 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:00.718 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:00.718 01:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:15:00.718 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:00.718 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:00.718 01:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:15:00.975 01:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:15:00.975 01:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:15:00.975 01:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:15:00.975 01:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:15:00.975 01:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:15:00.975 01:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:00.975 01:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:15:00.975 01:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:01.233 01:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:15:01.492 01:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:15:01.492 01:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:15:01.492 01:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:15:01.750 01:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:15:01.750 01:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:01.750 01:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:15:01.750 01:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:15:01.750 01:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:15:02.008 01:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:02.008 01:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:02.008 01:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:02.008 01:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:02.008 01:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:02.008 01:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:02.008 01:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:02.008 01:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:02.008 01:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:02.008 01:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:02.008 01:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:02.008 01:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:02.008 01:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:02.008 01:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:02.008 01:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:15:02.008 01:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:15:02.008 01:09:16 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:15:02.008 01:09:16 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:15:02.008 01:09:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:02.008 01:09:16 -- nvmf/common.sh@116 -- # sync 00:15:02.008 01:09:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:02.008 01:09:16 -- nvmf/common.sh@119 -- # set +e 00:15:02.008 01:09:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:02.008 01:09:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:02.008 rmmod nvme_tcp 00:15:02.008 rmmod nvme_fabrics 00:15:02.008 rmmod nvme_keyring 00:15:02.008 01:09:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:02.008 01:09:16 -- nvmf/common.sh@123 -- # set -e 00:15:02.008 01:09:16 -- nvmf/common.sh@124 -- # return 0 00:15:02.008 01:09:16 -- nvmf/common.sh@477 -- # '[' -n 1990965 ']' 00:15:02.008 01:09:16 -- nvmf/common.sh@478 -- # killprocess 1990965 00:15:02.008 01:09:16 -- common/autotest_common.sh@936 -- # '[' -z 1990965 ']' 00:15:02.008 01:09:16 -- common/autotest_common.sh@940 -- # kill -0 1990965 00:15:02.008 01:09:16 -- common/autotest_common.sh@941 -- # uname 00:15:02.008 01:09:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:02.008 01:09:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1990965 00:15:02.008 01:09:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:02.008 01:09:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:02.008 01:09:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1990965' 00:15:02.008 killing process with pid 1990965 00:15:02.008 01:09:16 -- common/autotest_common.sh@955 -- # kill 1990965 00:15:02.008 01:09:16 -- common/autotest_common.sh@960 -- # wait 1990965 00:15:02.268 01:09:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:02.268 01:09:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:02.268 01:09:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:02.268 01:09:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:02.268 01:09:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:02.268 01:09:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:02.268 01:09:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:02.268 01:09:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:04.170 01:09:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:04.170 00:15:04.170 real 0m47.562s 00:15:04.170 user 3m37.256s 00:15:04.170 sys 0m15.402s 00:15:04.170 01:09:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:04.170 01:09:18 -- common/autotest_common.sh@10 -- # set +x 00:15:04.170 ************************************ 00:15:04.170 END TEST nvmf_ns_hotplug_stress 00:15:04.170 ************************************ 00:15:04.429 01:09:18 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:15:04.429 01:09:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:04.429 01:09:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:04.429 01:09:18 -- common/autotest_common.sh@10 -- # set +x 00:15:04.429 ************************************ 00:15:04.429 START TEST nvmf_connect_stress 00:15:04.429 ************************************ 00:15:04.429 01:09:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:15:04.429 * Looking for test storage... 00:15:04.429 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:04.429 01:09:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:04.429 01:09:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:04.429 01:09:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:04.429 01:09:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:04.429 01:09:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:04.429 01:09:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:04.429 01:09:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:04.429 01:09:18 -- scripts/common.sh@335 -- # IFS=.-: 00:15:04.429 01:09:18 -- scripts/common.sh@335 -- # read -ra ver1 00:15:04.429 01:09:18 -- scripts/common.sh@336 -- # IFS=.-: 00:15:04.430 01:09:18 -- scripts/common.sh@336 -- # read -ra ver2 00:15:04.430 01:09:18 -- scripts/common.sh@337 -- # local 'op=<' 00:15:04.430 01:09:18 -- scripts/common.sh@339 -- # ver1_l=2 00:15:04.430 01:09:18 -- scripts/common.sh@340 -- # ver2_l=1 00:15:04.430 01:09:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:04.430 01:09:18 -- scripts/common.sh@343 -- # case "$op" in 00:15:04.430 01:09:18 -- scripts/common.sh@344 -- # : 1 00:15:04.430 01:09:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:04.430 01:09:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:04.430 01:09:18 -- scripts/common.sh@364 -- # decimal 1 00:15:04.430 01:09:18 -- scripts/common.sh@352 -- # local d=1 00:15:04.430 01:09:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:04.430 01:09:18 -- scripts/common.sh@354 -- # echo 1 00:15:04.430 01:09:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:04.430 01:09:18 -- scripts/common.sh@365 -- # decimal 2 00:15:04.430 01:09:18 -- scripts/common.sh@352 -- # local d=2 00:15:04.430 01:09:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:04.430 01:09:18 -- scripts/common.sh@354 -- # echo 2 00:15:04.430 01:09:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:04.430 01:09:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:04.430 01:09:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:04.430 01:09:18 -- scripts/common.sh@367 -- # return 0 00:15:04.430 01:09:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:04.430 01:09:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:04.430 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:04.430 --rc genhtml_branch_coverage=1 00:15:04.430 --rc genhtml_function_coverage=1 00:15:04.430 --rc genhtml_legend=1 00:15:04.430 --rc geninfo_all_blocks=1 00:15:04.430 --rc geninfo_unexecuted_blocks=1 00:15:04.430 00:15:04.430 ' 00:15:04.430 01:09:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:04.430 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:04.430 --rc genhtml_branch_coverage=1 00:15:04.430 --rc genhtml_function_coverage=1 00:15:04.430 --rc genhtml_legend=1 00:15:04.430 --rc geninfo_all_blocks=1 00:15:04.430 --rc geninfo_unexecuted_blocks=1 00:15:04.430 00:15:04.430 ' 00:15:04.430 01:09:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:04.430 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:04.430 --rc genhtml_branch_coverage=1 00:15:04.430 --rc genhtml_function_coverage=1 00:15:04.430 --rc genhtml_legend=1 00:15:04.430 --rc geninfo_all_blocks=1 00:15:04.430 --rc geninfo_unexecuted_blocks=1 00:15:04.430 00:15:04.430 ' 00:15:04.430 01:09:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:04.430 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:04.430 --rc genhtml_branch_coverage=1 00:15:04.430 --rc genhtml_function_coverage=1 00:15:04.430 --rc genhtml_legend=1 00:15:04.430 --rc geninfo_all_blocks=1 00:15:04.430 --rc geninfo_unexecuted_blocks=1 00:15:04.430 00:15:04.430 ' 00:15:04.430 01:09:18 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:04.430 01:09:18 -- nvmf/common.sh@7 -- # uname -s 00:15:04.430 01:09:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:04.430 01:09:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:04.430 01:09:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:04.430 01:09:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:04.430 01:09:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:04.430 01:09:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:04.430 01:09:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:04.430 01:09:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:04.430 01:09:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:04.430 01:09:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:04.430 01:09:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:04.430 01:09:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:04.430 01:09:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:04.430 01:09:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:04.430 01:09:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:04.430 01:09:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:04.430 01:09:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:04.430 01:09:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:04.430 01:09:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:04.430 01:09:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:04.430 01:09:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:04.430 01:09:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:04.430 01:09:18 -- paths/export.sh@5 -- # export PATH 00:15:04.430 01:09:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:04.430 01:09:18 -- nvmf/common.sh@46 -- # : 0 00:15:04.430 01:09:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:04.430 01:09:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:04.430 01:09:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:04.430 01:09:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:04.430 01:09:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:04.430 01:09:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:04.430 01:09:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:04.430 01:09:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:04.430 01:09:18 -- target/connect_stress.sh@12 -- # nvmftestinit 00:15:04.430 01:09:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:04.430 01:09:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:04.430 01:09:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:04.430 01:09:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:04.430 01:09:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:04.430 01:09:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:04.430 01:09:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:04.430 01:09:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:04.430 01:09:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:04.430 01:09:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:04.430 01:09:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:04.430 01:09:18 -- common/autotest_common.sh@10 -- # set +x 00:15:06.964 01:09:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:06.964 01:09:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:06.964 01:09:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:06.964 01:09:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:06.964 01:09:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:06.964 01:09:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:06.964 01:09:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:06.964 01:09:21 -- nvmf/common.sh@294 -- # net_devs=() 00:15:06.964 01:09:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:06.964 01:09:21 -- nvmf/common.sh@295 -- # e810=() 00:15:06.964 01:09:21 -- nvmf/common.sh@295 -- # local -ga e810 00:15:06.964 01:09:21 -- nvmf/common.sh@296 -- # x722=() 00:15:06.964 01:09:21 -- nvmf/common.sh@296 -- # local -ga x722 00:15:06.964 01:09:21 -- nvmf/common.sh@297 -- # mlx=() 00:15:06.964 01:09:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:06.964 01:09:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:06.964 01:09:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:06.964 01:09:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:06.964 01:09:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:06.964 01:09:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:06.964 01:09:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:06.964 01:09:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:06.964 01:09:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:06.964 01:09:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:06.964 01:09:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:06.964 01:09:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:06.964 01:09:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:06.964 01:09:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:06.964 01:09:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:06.964 01:09:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:06.964 01:09:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:06.964 01:09:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:06.964 01:09:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:06.964 01:09:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:06.964 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:06.964 01:09:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:06.964 01:09:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:06.964 01:09:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:06.964 01:09:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:06.964 01:09:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:06.964 01:09:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:06.964 01:09:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:06.964 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:06.964 01:09:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:06.964 01:09:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:06.964 01:09:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:06.964 01:09:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:06.964 01:09:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:06.965 01:09:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:06.965 01:09:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:06.965 01:09:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:06.965 01:09:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:06.965 01:09:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:06.965 01:09:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:06.965 01:09:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:06.965 01:09:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:06.965 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:06.965 01:09:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:06.965 01:09:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:06.965 01:09:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:06.965 01:09:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:06.965 01:09:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:06.965 01:09:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:06.965 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:06.965 01:09:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:06.965 01:09:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:06.965 01:09:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:06.965 01:09:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:06.965 01:09:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:06.965 01:09:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:06.965 01:09:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:06.965 01:09:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:06.965 01:09:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:06.965 01:09:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:06.965 01:09:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:06.965 01:09:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:06.965 01:09:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:06.965 01:09:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:06.965 01:09:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:06.965 01:09:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:06.965 01:09:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:06.965 01:09:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:06.965 01:09:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:06.965 01:09:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:06.965 01:09:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:06.965 01:09:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:06.965 01:09:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:06.965 01:09:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:06.965 01:09:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:06.965 01:09:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:06.965 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:06.965 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.270 ms 00:15:06.965 00:15:06.965 --- 10.0.0.2 ping statistics --- 00:15:06.965 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:06.965 rtt min/avg/max/mdev = 0.270/0.270/0.270/0.000 ms 00:15:06.965 01:09:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:06.965 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:06.965 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.080 ms 00:15:06.965 00:15:06.965 --- 10.0.0.1 ping statistics --- 00:15:06.965 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:06.965 rtt min/avg/max/mdev = 0.080/0.080/0.080/0.000 ms 00:15:06.965 01:09:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:06.965 01:09:21 -- nvmf/common.sh@410 -- # return 0 00:15:06.965 01:09:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:06.965 01:09:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:06.965 01:09:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:06.965 01:09:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:06.965 01:09:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:06.965 01:09:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:06.965 01:09:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:06.965 01:09:21 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:15:06.965 01:09:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:06.965 01:09:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:06.965 01:09:21 -- common/autotest_common.sh@10 -- # set +x 00:15:06.965 01:09:21 -- nvmf/common.sh@469 -- # nvmfpid=1999110 00:15:06.965 01:09:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:15:06.965 01:09:21 -- nvmf/common.sh@470 -- # waitforlisten 1999110 00:15:06.965 01:09:21 -- common/autotest_common.sh@829 -- # '[' -z 1999110 ']' 00:15:06.965 01:09:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:06.965 01:09:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:06.965 01:09:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:06.965 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:06.965 01:09:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:06.965 01:09:21 -- common/autotest_common.sh@10 -- # set +x 00:15:06.965 [2024-11-28 01:09:21.233916] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:06.965 [2024-11-28 01:09:21.233995] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:06.965 EAL: No free 2048 kB hugepages reported on node 1 00:15:06.965 [2024-11-28 01:09:21.303931] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:15:06.965 [2024-11-28 01:09:21.393987] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:06.965 [2024-11-28 01:09:21.394149] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:06.965 [2024-11-28 01:09:21.394168] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:06.965 [2024-11-28 01:09:21.394187] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:06.965 [2024-11-28 01:09:21.394287] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:06.965 [2024-11-28 01:09:21.394359] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:06.965 [2024-11-28 01:09:21.394361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:07.897 01:09:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:07.897 01:09:22 -- common/autotest_common.sh@862 -- # return 0 00:15:07.897 01:09:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:07.897 01:09:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:07.897 01:09:22 -- common/autotest_common.sh@10 -- # set +x 00:15:07.897 01:09:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:07.897 01:09:22 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:07.897 01:09:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.897 01:09:22 -- common/autotest_common.sh@10 -- # set +x 00:15:07.897 [2024-11-28 01:09:22.200079] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:07.897 01:09:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.897 01:09:22 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:07.897 01:09:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.897 01:09:22 -- common/autotest_common.sh@10 -- # set +x 00:15:07.897 01:09:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.897 01:09:22 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:07.897 01:09:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.897 01:09:22 -- common/autotest_common.sh@10 -- # set +x 00:15:07.897 [2024-11-28 01:09:22.231684] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:07.897 01:09:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.897 01:09:22 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:07.897 01:09:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.897 01:09:22 -- common/autotest_common.sh@10 -- # set +x 00:15:07.897 NULL1 00:15:07.897 01:09:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.897 01:09:22 -- target/connect_stress.sh@21 -- # PERF_PID=1999270 00:15:07.897 01:09:22 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:15:07.897 01:09:22 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:15:07.897 01:09:22 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:15:07.897 01:09:22 -- target/connect_stress.sh@27 -- # seq 1 20 00:15:07.897 01:09:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:07.897 01:09:22 -- target/connect_stress.sh@28 -- # cat 00:15:07.897 01:09:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:07.897 01:09:22 -- target/connect_stress.sh@28 -- # cat 00:15:07.897 01:09:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:07.897 01:09:22 -- target/connect_stress.sh@28 -- # cat 00:15:07.897 01:09:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:07.897 01:09:22 -- target/connect_stress.sh@28 -- # cat 00:15:07.897 01:09:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:07.897 01:09:22 -- target/connect_stress.sh@28 -- # cat 00:15:07.897 01:09:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:07.897 01:09:22 -- target/connect_stress.sh@28 -- # cat 00:15:07.897 01:09:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:07.897 01:09:22 -- target/connect_stress.sh@28 -- # cat 00:15:07.897 01:09:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:07.897 01:09:22 -- target/connect_stress.sh@28 -- # cat 00:15:07.897 01:09:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:07.897 01:09:22 -- target/connect_stress.sh@28 -- # cat 00:15:07.897 01:09:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:07.897 01:09:22 -- target/connect_stress.sh@28 -- # cat 00:15:07.897 01:09:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:07.897 01:09:22 -- target/connect_stress.sh@28 -- # cat 00:15:07.897 EAL: No free 2048 kB hugepages reported on node 1 00:15:07.898 01:09:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:07.898 01:09:22 -- target/connect_stress.sh@28 -- # cat 00:15:07.898 01:09:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:07.898 01:09:22 -- target/connect_stress.sh@28 -- # cat 00:15:07.898 01:09:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:07.898 01:09:22 -- target/connect_stress.sh@28 -- # cat 00:15:07.898 01:09:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:07.898 01:09:22 -- target/connect_stress.sh@28 -- # cat 00:15:07.898 01:09:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:07.898 01:09:22 -- target/connect_stress.sh@28 -- # cat 00:15:07.898 01:09:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:07.898 01:09:22 -- target/connect_stress.sh@28 -- # cat 00:15:07.898 01:09:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:07.898 01:09:22 -- target/connect_stress.sh@28 -- # cat 00:15:07.898 01:09:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:07.898 01:09:22 -- target/connect_stress.sh@28 -- # cat 00:15:07.898 01:09:22 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:07.898 01:09:22 -- target/connect_stress.sh@28 -- # cat 00:15:07.898 01:09:22 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:07.898 01:09:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:07.898 01:09:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.898 01:09:22 -- common/autotest_common.sh@10 -- # set +x 00:15:08.155 01:09:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.155 01:09:22 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:08.155 01:09:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:08.155 01:09:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.155 01:09:22 -- common/autotest_common.sh@10 -- # set +x 00:15:08.411 01:09:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.412 01:09:22 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:08.412 01:09:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:08.412 01:09:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.412 01:09:22 -- common/autotest_common.sh@10 -- # set +x 00:15:08.669 01:09:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.669 01:09:23 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:08.669 01:09:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:08.669 01:09:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.669 01:09:23 -- common/autotest_common.sh@10 -- # set +x 00:15:09.233 01:09:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.233 01:09:23 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:09.233 01:09:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:09.233 01:09:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.233 01:09:23 -- common/autotest_common.sh@10 -- # set +x 00:15:09.490 01:09:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.490 01:09:23 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:09.490 01:09:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:09.490 01:09:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.490 01:09:23 -- common/autotest_common.sh@10 -- # set +x 00:15:09.778 01:09:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.778 01:09:24 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:09.778 01:09:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:09.778 01:09:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.778 01:09:24 -- common/autotest_common.sh@10 -- # set +x 00:15:10.036 01:09:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.036 01:09:24 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:10.036 01:09:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:10.036 01:09:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.036 01:09:24 -- common/autotest_common.sh@10 -- # set +x 00:15:10.293 01:09:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.293 01:09:24 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:10.293 01:09:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:10.293 01:09:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.293 01:09:24 -- common/autotest_common.sh@10 -- # set +x 00:15:10.855 01:09:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.855 01:09:25 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:10.855 01:09:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:10.855 01:09:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.855 01:09:25 -- common/autotest_common.sh@10 -- # set +x 00:15:11.113 01:09:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:11.113 01:09:25 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:11.113 01:09:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:11.113 01:09:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:11.113 01:09:25 -- common/autotest_common.sh@10 -- # set +x 00:15:11.409 01:09:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:11.409 01:09:25 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:11.409 01:09:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:11.409 01:09:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:11.409 01:09:25 -- common/autotest_common.sh@10 -- # set +x 00:15:11.691 01:09:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:11.691 01:09:26 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:11.691 01:09:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:11.691 01:09:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:11.691 01:09:26 -- common/autotest_common.sh@10 -- # set +x 00:15:11.948 01:09:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:11.948 01:09:26 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:11.948 01:09:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:11.948 01:09:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:11.948 01:09:26 -- common/autotest_common.sh@10 -- # set +x 00:15:12.205 01:09:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:12.205 01:09:26 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:12.205 01:09:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:12.205 01:09:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:12.205 01:09:26 -- common/autotest_common.sh@10 -- # set +x 00:15:12.769 01:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:12.769 01:09:27 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:12.769 01:09:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:12.769 01:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:12.769 01:09:27 -- common/autotest_common.sh@10 -- # set +x 00:15:13.026 01:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:13.026 01:09:27 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:13.026 01:09:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:13.026 01:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:13.026 01:09:27 -- common/autotest_common.sh@10 -- # set +x 00:15:13.284 01:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:13.284 01:09:27 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:13.284 01:09:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:13.284 01:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:13.284 01:09:27 -- common/autotest_common.sh@10 -- # set +x 00:15:13.542 01:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:13.542 01:09:28 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:13.542 01:09:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:13.542 01:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:13.542 01:09:28 -- common/autotest_common.sh@10 -- # set +x 00:15:13.800 01:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:13.800 01:09:28 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:13.800 01:09:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:13.800 01:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:13.800 01:09:28 -- common/autotest_common.sh@10 -- # set +x 00:15:14.366 01:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:14.366 01:09:28 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:14.366 01:09:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:14.366 01:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:14.366 01:09:28 -- common/autotest_common.sh@10 -- # set +x 00:15:14.624 01:09:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:14.624 01:09:29 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:14.624 01:09:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:14.624 01:09:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:14.624 01:09:29 -- common/autotest_common.sh@10 -- # set +x 00:15:14.882 01:09:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:14.882 01:09:29 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:14.882 01:09:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:14.882 01:09:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:14.882 01:09:29 -- common/autotest_common.sh@10 -- # set +x 00:15:15.140 01:09:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:15.140 01:09:29 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:15.140 01:09:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:15.140 01:09:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:15.140 01:09:29 -- common/autotest_common.sh@10 -- # set +x 00:15:15.706 01:09:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:15.706 01:09:30 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:15.706 01:09:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:15.706 01:09:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:15.706 01:09:30 -- common/autotest_common.sh@10 -- # set +x 00:15:15.963 01:09:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:15.963 01:09:30 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:15.963 01:09:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:15.963 01:09:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:15.963 01:09:30 -- common/autotest_common.sh@10 -- # set +x 00:15:16.221 01:09:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.221 01:09:30 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:16.221 01:09:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:16.221 01:09:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.221 01:09:30 -- common/autotest_common.sh@10 -- # set +x 00:15:16.479 01:09:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.479 01:09:30 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:16.479 01:09:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:16.479 01:09:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.479 01:09:30 -- common/autotest_common.sh@10 -- # set +x 00:15:16.737 01:09:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.737 01:09:31 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:16.737 01:09:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:16.737 01:09:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.737 01:09:31 -- common/autotest_common.sh@10 -- # set +x 00:15:17.303 01:09:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.303 01:09:31 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:17.303 01:09:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:17.303 01:09:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.303 01:09:31 -- common/autotest_common.sh@10 -- # set +x 00:15:17.561 01:09:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.561 01:09:31 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:17.561 01:09:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:17.561 01:09:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.561 01:09:31 -- common/autotest_common.sh@10 -- # set +x 00:15:17.818 01:09:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.818 01:09:32 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:17.818 01:09:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:17.818 01:09:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.818 01:09:32 -- common/autotest_common.sh@10 -- # set +x 00:15:17.818 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:18.076 01:09:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.076 01:09:32 -- target/connect_stress.sh@34 -- # kill -0 1999270 00:15:18.076 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (1999270) - No such process 00:15:18.076 01:09:32 -- target/connect_stress.sh@38 -- # wait 1999270 00:15:18.076 01:09:32 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:15:18.076 01:09:32 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:18.076 01:09:32 -- target/connect_stress.sh@43 -- # nvmftestfini 00:15:18.076 01:09:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:18.076 01:09:32 -- nvmf/common.sh@116 -- # sync 00:15:18.076 01:09:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:18.076 01:09:32 -- nvmf/common.sh@119 -- # set +e 00:15:18.076 01:09:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:18.076 01:09:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:18.076 rmmod nvme_tcp 00:15:18.076 rmmod nvme_fabrics 00:15:18.076 rmmod nvme_keyring 00:15:18.076 01:09:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:18.076 01:09:32 -- nvmf/common.sh@123 -- # set -e 00:15:18.076 01:09:32 -- nvmf/common.sh@124 -- # return 0 00:15:18.076 01:09:32 -- nvmf/common.sh@477 -- # '[' -n 1999110 ']' 00:15:18.076 01:09:32 -- nvmf/common.sh@478 -- # killprocess 1999110 00:15:18.076 01:09:32 -- common/autotest_common.sh@936 -- # '[' -z 1999110 ']' 00:15:18.076 01:09:32 -- common/autotest_common.sh@940 -- # kill -0 1999110 00:15:18.076 01:09:32 -- common/autotest_common.sh@941 -- # uname 00:15:18.076 01:09:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:18.076 01:09:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1999110 00:15:18.076 01:09:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:18.076 01:09:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:18.076 01:09:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1999110' 00:15:18.076 killing process with pid 1999110 00:15:18.076 01:09:32 -- common/autotest_common.sh@955 -- # kill 1999110 00:15:18.076 01:09:32 -- common/autotest_common.sh@960 -- # wait 1999110 00:15:18.335 01:09:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:18.335 01:09:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:18.335 01:09:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:18.335 01:09:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:18.335 01:09:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:18.335 01:09:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:18.335 01:09:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:18.335 01:09:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:20.868 01:09:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:20.868 00:15:20.868 real 0m16.115s 00:15:20.868 user 0m40.844s 00:15:20.868 sys 0m5.794s 00:15:20.868 01:09:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:20.868 01:09:34 -- common/autotest_common.sh@10 -- # set +x 00:15:20.868 ************************************ 00:15:20.868 END TEST nvmf_connect_stress 00:15:20.868 ************************************ 00:15:20.868 01:09:34 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:15:20.868 01:09:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:20.868 01:09:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:20.868 01:09:34 -- common/autotest_common.sh@10 -- # set +x 00:15:20.868 ************************************ 00:15:20.868 START TEST nvmf_fused_ordering 00:15:20.868 ************************************ 00:15:20.868 01:09:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:15:20.868 * Looking for test storage... 00:15:20.868 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:20.868 01:09:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:20.868 01:09:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:20.868 01:09:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:20.868 01:09:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:20.868 01:09:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:20.868 01:09:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:20.868 01:09:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:20.868 01:09:35 -- scripts/common.sh@335 -- # IFS=.-: 00:15:20.868 01:09:35 -- scripts/common.sh@335 -- # read -ra ver1 00:15:20.868 01:09:35 -- scripts/common.sh@336 -- # IFS=.-: 00:15:20.868 01:09:35 -- scripts/common.sh@336 -- # read -ra ver2 00:15:20.868 01:09:35 -- scripts/common.sh@337 -- # local 'op=<' 00:15:20.868 01:09:35 -- scripts/common.sh@339 -- # ver1_l=2 00:15:20.868 01:09:35 -- scripts/common.sh@340 -- # ver2_l=1 00:15:20.868 01:09:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:20.868 01:09:35 -- scripts/common.sh@343 -- # case "$op" in 00:15:20.868 01:09:35 -- scripts/common.sh@344 -- # : 1 00:15:20.868 01:09:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:20.868 01:09:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:20.868 01:09:35 -- scripts/common.sh@364 -- # decimal 1 00:15:20.868 01:09:35 -- scripts/common.sh@352 -- # local d=1 00:15:20.868 01:09:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:20.868 01:09:35 -- scripts/common.sh@354 -- # echo 1 00:15:20.868 01:09:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:20.868 01:09:35 -- scripts/common.sh@365 -- # decimal 2 00:15:20.868 01:09:35 -- scripts/common.sh@352 -- # local d=2 00:15:20.868 01:09:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:20.868 01:09:35 -- scripts/common.sh@354 -- # echo 2 00:15:20.868 01:09:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:20.868 01:09:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:20.868 01:09:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:20.868 01:09:35 -- scripts/common.sh@367 -- # return 0 00:15:20.868 01:09:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:20.868 01:09:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:20.868 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:20.868 --rc genhtml_branch_coverage=1 00:15:20.868 --rc genhtml_function_coverage=1 00:15:20.868 --rc genhtml_legend=1 00:15:20.868 --rc geninfo_all_blocks=1 00:15:20.868 --rc geninfo_unexecuted_blocks=1 00:15:20.868 00:15:20.868 ' 00:15:20.868 01:09:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:20.868 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:20.868 --rc genhtml_branch_coverage=1 00:15:20.868 --rc genhtml_function_coverage=1 00:15:20.868 --rc genhtml_legend=1 00:15:20.868 --rc geninfo_all_blocks=1 00:15:20.868 --rc geninfo_unexecuted_blocks=1 00:15:20.868 00:15:20.868 ' 00:15:20.868 01:09:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:20.868 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:20.868 --rc genhtml_branch_coverage=1 00:15:20.868 --rc genhtml_function_coverage=1 00:15:20.868 --rc genhtml_legend=1 00:15:20.868 --rc geninfo_all_blocks=1 00:15:20.868 --rc geninfo_unexecuted_blocks=1 00:15:20.868 00:15:20.868 ' 00:15:20.868 01:09:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:20.868 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:20.868 --rc genhtml_branch_coverage=1 00:15:20.868 --rc genhtml_function_coverage=1 00:15:20.868 --rc genhtml_legend=1 00:15:20.868 --rc geninfo_all_blocks=1 00:15:20.868 --rc geninfo_unexecuted_blocks=1 00:15:20.868 00:15:20.868 ' 00:15:20.868 01:09:35 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:20.868 01:09:35 -- nvmf/common.sh@7 -- # uname -s 00:15:20.868 01:09:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:20.868 01:09:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:20.868 01:09:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:20.868 01:09:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:20.868 01:09:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:20.868 01:09:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:20.868 01:09:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:20.868 01:09:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:20.868 01:09:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:20.868 01:09:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:20.868 01:09:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:20.868 01:09:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:20.868 01:09:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:20.868 01:09:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:20.868 01:09:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:20.868 01:09:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:20.868 01:09:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:20.868 01:09:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:20.868 01:09:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:20.868 01:09:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:20.869 01:09:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:20.869 01:09:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:20.869 01:09:35 -- paths/export.sh@5 -- # export PATH 00:15:20.869 01:09:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:20.869 01:09:35 -- nvmf/common.sh@46 -- # : 0 00:15:20.869 01:09:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:20.869 01:09:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:20.869 01:09:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:20.869 01:09:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:20.869 01:09:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:20.869 01:09:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:20.869 01:09:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:20.869 01:09:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:20.869 01:09:35 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:15:20.869 01:09:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:20.869 01:09:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:20.869 01:09:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:20.869 01:09:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:20.869 01:09:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:20.869 01:09:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:20.869 01:09:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:20.869 01:09:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:20.869 01:09:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:20.869 01:09:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:20.869 01:09:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:20.869 01:09:35 -- common/autotest_common.sh@10 -- # set +x 00:15:22.770 01:09:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:22.770 01:09:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:22.770 01:09:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:22.770 01:09:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:22.770 01:09:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:22.770 01:09:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:22.770 01:09:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:22.770 01:09:37 -- nvmf/common.sh@294 -- # net_devs=() 00:15:22.770 01:09:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:22.770 01:09:37 -- nvmf/common.sh@295 -- # e810=() 00:15:22.770 01:09:37 -- nvmf/common.sh@295 -- # local -ga e810 00:15:22.770 01:09:37 -- nvmf/common.sh@296 -- # x722=() 00:15:22.770 01:09:37 -- nvmf/common.sh@296 -- # local -ga x722 00:15:22.770 01:09:37 -- nvmf/common.sh@297 -- # mlx=() 00:15:22.770 01:09:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:22.770 01:09:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:22.770 01:09:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:22.770 01:09:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:22.770 01:09:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:22.770 01:09:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:22.770 01:09:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:22.770 01:09:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:22.770 01:09:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:22.770 01:09:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:22.770 01:09:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:22.770 01:09:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:22.770 01:09:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:22.770 01:09:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:22.770 01:09:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:22.770 01:09:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:22.770 01:09:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:22.770 01:09:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:22.770 01:09:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:22.770 01:09:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:22.770 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:22.770 01:09:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:22.770 01:09:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:22.770 01:09:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:22.771 01:09:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:22.771 01:09:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:22.771 01:09:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:22.771 01:09:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:22.771 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:22.771 01:09:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:22.771 01:09:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:22.771 01:09:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:22.771 01:09:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:22.771 01:09:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:22.771 01:09:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:22.771 01:09:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:22.771 01:09:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:22.771 01:09:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:22.771 01:09:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:22.771 01:09:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:22.771 01:09:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:22.771 01:09:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:22.771 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:22.771 01:09:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:22.771 01:09:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:22.771 01:09:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:22.771 01:09:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:22.771 01:09:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:22.771 01:09:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:22.771 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:22.771 01:09:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:22.771 01:09:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:22.771 01:09:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:22.771 01:09:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:22.771 01:09:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:22.771 01:09:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:22.771 01:09:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:22.771 01:09:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:22.771 01:09:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:22.771 01:09:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:22.771 01:09:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:22.771 01:09:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:22.771 01:09:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:22.771 01:09:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:22.771 01:09:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:22.771 01:09:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:22.771 01:09:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:22.771 01:09:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:22.771 01:09:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:22.771 01:09:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:22.771 01:09:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:22.771 01:09:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:22.771 01:09:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:22.771 01:09:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:22.771 01:09:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:22.771 01:09:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:22.771 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:22.771 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.213 ms 00:15:22.771 00:15:22.771 --- 10.0.0.2 ping statistics --- 00:15:22.771 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:22.771 rtt min/avg/max/mdev = 0.213/0.213/0.213/0.000 ms 00:15:22.771 01:09:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:22.771 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:22.771 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.132 ms 00:15:22.771 00:15:22.771 --- 10.0.0.1 ping statistics --- 00:15:22.771 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:22.771 rtt min/avg/max/mdev = 0.132/0.132/0.132/0.000 ms 00:15:22.771 01:09:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:22.771 01:09:37 -- nvmf/common.sh@410 -- # return 0 00:15:22.771 01:09:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:22.771 01:09:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:22.771 01:09:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:22.771 01:09:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:22.771 01:09:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:22.771 01:09:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:22.771 01:09:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:22.771 01:09:37 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:15:22.771 01:09:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:22.771 01:09:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:22.771 01:09:37 -- common/autotest_common.sh@10 -- # set +x 00:15:22.771 01:09:37 -- nvmf/common.sh@469 -- # nvmfpid=2002473 00:15:22.771 01:09:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:22.771 01:09:37 -- nvmf/common.sh@470 -- # waitforlisten 2002473 00:15:22.771 01:09:37 -- common/autotest_common.sh@829 -- # '[' -z 2002473 ']' 00:15:22.771 01:09:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:22.771 01:09:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:22.771 01:09:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:22.771 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:22.771 01:09:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:22.771 01:09:37 -- common/autotest_common.sh@10 -- # set +x 00:15:22.771 [2024-11-28 01:09:37.229483] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:22.771 [2024-11-28 01:09:37.229582] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:22.771 EAL: No free 2048 kB hugepages reported on node 1 00:15:22.771 [2024-11-28 01:09:37.303914] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:23.030 [2024-11-28 01:09:37.392034] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:23.030 [2024-11-28 01:09:37.392201] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:23.030 [2024-11-28 01:09:37.392220] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:23.030 [2024-11-28 01:09:37.392234] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:23.030 [2024-11-28 01:09:37.392271] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:23.596 01:09:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:23.596 01:09:38 -- common/autotest_common.sh@862 -- # return 0 00:15:23.596 01:09:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:23.596 01:09:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:23.596 01:09:38 -- common/autotest_common.sh@10 -- # set +x 00:15:23.596 01:09:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:23.596 01:09:38 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:23.596 01:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:23.596 01:09:38 -- common/autotest_common.sh@10 -- # set +x 00:15:23.596 [2024-11-28 01:09:38.195259] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:23.854 01:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.854 01:09:38 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:23.854 01:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:23.854 01:09:38 -- common/autotest_common.sh@10 -- # set +x 00:15:23.854 01:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.854 01:09:38 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:23.854 01:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:23.854 01:09:38 -- common/autotest_common.sh@10 -- # set +x 00:15:23.854 [2024-11-28 01:09:38.211438] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:23.854 01:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.854 01:09:38 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:23.854 01:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:23.854 01:09:38 -- common/autotest_common.sh@10 -- # set +x 00:15:23.854 NULL1 00:15:23.854 01:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.854 01:09:38 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:15:23.854 01:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:23.854 01:09:38 -- common/autotest_common.sh@10 -- # set +x 00:15:23.854 01:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.854 01:09:38 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:15:23.854 01:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:23.854 01:09:38 -- common/autotest_common.sh@10 -- # set +x 00:15:23.854 01:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.854 01:09:38 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:15:23.854 [2024-11-28 01:09:38.255612] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:23.854 [2024-11-28 01:09:38.255652] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2002629 ] 00:15:23.854 EAL: No free 2048 kB hugepages reported on node 1 00:15:24.113 Attached to nqn.2016-06.io.spdk:cnode1 00:15:24.113 Namespace ID: 1 size: 1GB 00:15:24.113 fused_ordering(0) 00:15:24.113 fused_ordering(1) 00:15:24.113 fused_ordering(2) 00:15:24.113 fused_ordering(3) 00:15:24.113 fused_ordering(4) 00:15:24.113 fused_ordering(5) 00:15:24.113 fused_ordering(6) 00:15:24.113 fused_ordering(7) 00:15:24.113 fused_ordering(8) 00:15:24.113 fused_ordering(9) 00:15:24.113 fused_ordering(10) 00:15:24.113 fused_ordering(11) 00:15:24.113 fused_ordering(12) 00:15:24.113 fused_ordering(13) 00:15:24.113 fused_ordering(14) 00:15:24.113 fused_ordering(15) 00:15:24.113 fused_ordering(16) 00:15:24.113 fused_ordering(17) 00:15:24.113 fused_ordering(18) 00:15:24.113 fused_ordering(19) 00:15:24.113 fused_ordering(20) 00:15:24.113 fused_ordering(21) 00:15:24.113 fused_ordering(22) 00:15:24.113 fused_ordering(23) 00:15:24.113 fused_ordering(24) 00:15:24.113 fused_ordering(25) 00:15:24.113 fused_ordering(26) 00:15:24.113 fused_ordering(27) 00:15:24.113 fused_ordering(28) 00:15:24.113 fused_ordering(29) 00:15:24.113 fused_ordering(30) 00:15:24.113 fused_ordering(31) 00:15:24.113 fused_ordering(32) 00:15:24.113 fused_ordering(33) 00:15:24.113 fused_ordering(34) 00:15:24.113 fused_ordering(35) 00:15:24.113 fused_ordering(36) 00:15:24.113 fused_ordering(37) 00:15:24.113 fused_ordering(38) 00:15:24.113 fused_ordering(39) 00:15:24.113 fused_ordering(40) 00:15:24.113 fused_ordering(41) 00:15:24.113 fused_ordering(42) 00:15:24.113 fused_ordering(43) 00:15:24.113 fused_ordering(44) 00:15:24.113 fused_ordering(45) 00:15:24.113 fused_ordering(46) 00:15:24.113 fused_ordering(47) 00:15:24.113 fused_ordering(48) 00:15:24.113 fused_ordering(49) 00:15:24.113 fused_ordering(50) 00:15:24.113 fused_ordering(51) 00:15:24.113 fused_ordering(52) 00:15:24.113 fused_ordering(53) 00:15:24.113 fused_ordering(54) 00:15:24.113 fused_ordering(55) 00:15:24.113 fused_ordering(56) 00:15:24.113 fused_ordering(57) 00:15:24.113 fused_ordering(58) 00:15:24.113 fused_ordering(59) 00:15:24.113 fused_ordering(60) 00:15:24.113 fused_ordering(61) 00:15:24.113 fused_ordering(62) 00:15:24.113 fused_ordering(63) 00:15:24.113 fused_ordering(64) 00:15:24.113 fused_ordering(65) 00:15:24.113 fused_ordering(66) 00:15:24.113 fused_ordering(67) 00:15:24.113 fused_ordering(68) 00:15:24.113 fused_ordering(69) 00:15:24.113 fused_ordering(70) 00:15:24.113 fused_ordering(71) 00:15:24.113 fused_ordering(72) 00:15:24.113 fused_ordering(73) 00:15:24.113 fused_ordering(74) 00:15:24.113 fused_ordering(75) 00:15:24.113 fused_ordering(76) 00:15:24.113 fused_ordering(77) 00:15:24.113 fused_ordering(78) 00:15:24.113 fused_ordering(79) 00:15:24.113 fused_ordering(80) 00:15:24.113 fused_ordering(81) 00:15:24.113 fused_ordering(82) 00:15:24.113 fused_ordering(83) 00:15:24.113 fused_ordering(84) 00:15:24.113 fused_ordering(85) 00:15:24.113 fused_ordering(86) 00:15:24.113 fused_ordering(87) 00:15:24.113 fused_ordering(88) 00:15:24.113 fused_ordering(89) 00:15:24.113 fused_ordering(90) 00:15:24.113 fused_ordering(91) 00:15:24.113 fused_ordering(92) 00:15:24.113 fused_ordering(93) 00:15:24.113 fused_ordering(94) 00:15:24.113 fused_ordering(95) 00:15:24.113 fused_ordering(96) 00:15:24.113 fused_ordering(97) 00:15:24.113 fused_ordering(98) 00:15:24.113 fused_ordering(99) 00:15:24.113 fused_ordering(100) 00:15:24.113 fused_ordering(101) 00:15:24.113 fused_ordering(102) 00:15:24.113 fused_ordering(103) 00:15:24.113 fused_ordering(104) 00:15:24.113 fused_ordering(105) 00:15:24.113 fused_ordering(106) 00:15:24.113 fused_ordering(107) 00:15:24.113 fused_ordering(108) 00:15:24.113 fused_ordering(109) 00:15:24.113 fused_ordering(110) 00:15:24.113 fused_ordering(111) 00:15:24.113 fused_ordering(112) 00:15:24.113 fused_ordering(113) 00:15:24.113 fused_ordering(114) 00:15:24.113 fused_ordering(115) 00:15:24.113 fused_ordering(116) 00:15:24.113 fused_ordering(117) 00:15:24.113 fused_ordering(118) 00:15:24.113 fused_ordering(119) 00:15:24.113 fused_ordering(120) 00:15:24.113 fused_ordering(121) 00:15:24.113 fused_ordering(122) 00:15:24.113 fused_ordering(123) 00:15:24.113 fused_ordering(124) 00:15:24.113 fused_ordering(125) 00:15:24.113 fused_ordering(126) 00:15:24.113 fused_ordering(127) 00:15:24.113 fused_ordering(128) 00:15:24.113 fused_ordering(129) 00:15:24.113 fused_ordering(130) 00:15:24.113 fused_ordering(131) 00:15:24.113 fused_ordering(132) 00:15:24.113 fused_ordering(133) 00:15:24.113 fused_ordering(134) 00:15:24.113 fused_ordering(135) 00:15:24.113 fused_ordering(136) 00:15:24.113 fused_ordering(137) 00:15:24.113 fused_ordering(138) 00:15:24.113 fused_ordering(139) 00:15:24.113 fused_ordering(140) 00:15:24.113 fused_ordering(141) 00:15:24.113 fused_ordering(142) 00:15:24.113 fused_ordering(143) 00:15:24.113 fused_ordering(144) 00:15:24.113 fused_ordering(145) 00:15:24.113 fused_ordering(146) 00:15:24.113 fused_ordering(147) 00:15:24.113 fused_ordering(148) 00:15:24.113 fused_ordering(149) 00:15:24.113 fused_ordering(150) 00:15:24.113 fused_ordering(151) 00:15:24.113 fused_ordering(152) 00:15:24.113 fused_ordering(153) 00:15:24.114 fused_ordering(154) 00:15:24.114 fused_ordering(155) 00:15:24.114 fused_ordering(156) 00:15:24.114 fused_ordering(157) 00:15:24.114 fused_ordering(158) 00:15:24.114 fused_ordering(159) 00:15:24.114 fused_ordering(160) 00:15:24.114 fused_ordering(161) 00:15:24.114 fused_ordering(162) 00:15:24.114 fused_ordering(163) 00:15:24.114 fused_ordering(164) 00:15:24.114 fused_ordering(165) 00:15:24.114 fused_ordering(166) 00:15:24.114 fused_ordering(167) 00:15:24.114 fused_ordering(168) 00:15:24.114 fused_ordering(169) 00:15:24.114 fused_ordering(170) 00:15:24.114 fused_ordering(171) 00:15:24.114 fused_ordering(172) 00:15:24.114 fused_ordering(173) 00:15:24.114 fused_ordering(174) 00:15:24.114 fused_ordering(175) 00:15:24.114 fused_ordering(176) 00:15:24.114 fused_ordering(177) 00:15:24.114 fused_ordering(178) 00:15:24.114 fused_ordering(179) 00:15:24.114 fused_ordering(180) 00:15:24.114 fused_ordering(181) 00:15:24.114 fused_ordering(182) 00:15:24.114 fused_ordering(183) 00:15:24.114 fused_ordering(184) 00:15:24.114 fused_ordering(185) 00:15:24.114 fused_ordering(186) 00:15:24.114 fused_ordering(187) 00:15:24.114 fused_ordering(188) 00:15:24.114 fused_ordering(189) 00:15:24.114 fused_ordering(190) 00:15:24.114 fused_ordering(191) 00:15:24.114 fused_ordering(192) 00:15:24.114 fused_ordering(193) 00:15:24.114 fused_ordering(194) 00:15:24.114 fused_ordering(195) 00:15:24.114 fused_ordering(196) 00:15:24.114 fused_ordering(197) 00:15:24.114 fused_ordering(198) 00:15:24.114 fused_ordering(199) 00:15:24.114 fused_ordering(200) 00:15:24.114 fused_ordering(201) 00:15:24.114 fused_ordering(202) 00:15:24.114 fused_ordering(203) 00:15:24.114 fused_ordering(204) 00:15:24.114 fused_ordering(205) 00:15:24.679 fused_ordering(206) 00:15:24.679 fused_ordering(207) 00:15:24.679 fused_ordering(208) 00:15:24.679 fused_ordering(209) 00:15:24.679 fused_ordering(210) 00:15:24.679 fused_ordering(211) 00:15:24.679 fused_ordering(212) 00:15:24.679 fused_ordering(213) 00:15:24.679 fused_ordering(214) 00:15:24.679 fused_ordering(215) 00:15:24.679 fused_ordering(216) 00:15:24.679 fused_ordering(217) 00:15:24.679 fused_ordering(218) 00:15:24.679 fused_ordering(219) 00:15:24.679 fused_ordering(220) 00:15:24.679 fused_ordering(221) 00:15:24.679 fused_ordering(222) 00:15:24.679 fused_ordering(223) 00:15:24.679 fused_ordering(224) 00:15:24.679 fused_ordering(225) 00:15:24.679 fused_ordering(226) 00:15:24.680 fused_ordering(227) 00:15:24.680 fused_ordering(228) 00:15:24.680 fused_ordering(229) 00:15:24.680 fused_ordering(230) 00:15:24.680 fused_ordering(231) 00:15:24.680 fused_ordering(232) 00:15:24.680 fused_ordering(233) 00:15:24.680 fused_ordering(234) 00:15:24.680 fused_ordering(235) 00:15:24.680 fused_ordering(236) 00:15:24.680 fused_ordering(237) 00:15:24.680 fused_ordering(238) 00:15:24.680 fused_ordering(239) 00:15:24.680 fused_ordering(240) 00:15:24.680 fused_ordering(241) 00:15:24.680 fused_ordering(242) 00:15:24.680 fused_ordering(243) 00:15:24.680 fused_ordering(244) 00:15:24.680 fused_ordering(245) 00:15:24.680 fused_ordering(246) 00:15:24.680 fused_ordering(247) 00:15:24.680 fused_ordering(248) 00:15:24.680 fused_ordering(249) 00:15:24.680 fused_ordering(250) 00:15:24.680 fused_ordering(251) 00:15:24.680 fused_ordering(252) 00:15:24.680 fused_ordering(253) 00:15:24.680 fused_ordering(254) 00:15:24.680 fused_ordering(255) 00:15:24.680 fused_ordering(256) 00:15:24.680 fused_ordering(257) 00:15:24.680 fused_ordering(258) 00:15:24.680 fused_ordering(259) 00:15:24.680 fused_ordering(260) 00:15:24.680 fused_ordering(261) 00:15:24.680 fused_ordering(262) 00:15:24.680 fused_ordering(263) 00:15:24.680 fused_ordering(264) 00:15:24.680 fused_ordering(265) 00:15:24.680 fused_ordering(266) 00:15:24.680 fused_ordering(267) 00:15:24.680 fused_ordering(268) 00:15:24.680 fused_ordering(269) 00:15:24.680 fused_ordering(270) 00:15:24.680 fused_ordering(271) 00:15:24.680 fused_ordering(272) 00:15:24.680 fused_ordering(273) 00:15:24.680 fused_ordering(274) 00:15:24.680 fused_ordering(275) 00:15:24.680 fused_ordering(276) 00:15:24.680 fused_ordering(277) 00:15:24.680 fused_ordering(278) 00:15:24.680 fused_ordering(279) 00:15:24.680 fused_ordering(280) 00:15:24.680 fused_ordering(281) 00:15:24.680 fused_ordering(282) 00:15:24.680 fused_ordering(283) 00:15:24.680 fused_ordering(284) 00:15:24.680 fused_ordering(285) 00:15:24.680 fused_ordering(286) 00:15:24.680 fused_ordering(287) 00:15:24.680 fused_ordering(288) 00:15:24.680 fused_ordering(289) 00:15:24.680 fused_ordering(290) 00:15:24.680 fused_ordering(291) 00:15:24.680 fused_ordering(292) 00:15:24.680 fused_ordering(293) 00:15:24.680 fused_ordering(294) 00:15:24.680 fused_ordering(295) 00:15:24.680 fused_ordering(296) 00:15:24.680 fused_ordering(297) 00:15:24.680 fused_ordering(298) 00:15:24.680 fused_ordering(299) 00:15:24.680 fused_ordering(300) 00:15:24.680 fused_ordering(301) 00:15:24.680 fused_ordering(302) 00:15:24.680 fused_ordering(303) 00:15:24.680 fused_ordering(304) 00:15:24.680 fused_ordering(305) 00:15:24.680 fused_ordering(306) 00:15:24.680 fused_ordering(307) 00:15:24.680 fused_ordering(308) 00:15:24.680 fused_ordering(309) 00:15:24.680 fused_ordering(310) 00:15:24.680 fused_ordering(311) 00:15:24.680 fused_ordering(312) 00:15:24.680 fused_ordering(313) 00:15:24.680 fused_ordering(314) 00:15:24.680 fused_ordering(315) 00:15:24.680 fused_ordering(316) 00:15:24.680 fused_ordering(317) 00:15:24.680 fused_ordering(318) 00:15:24.680 fused_ordering(319) 00:15:24.680 fused_ordering(320) 00:15:24.680 fused_ordering(321) 00:15:24.680 fused_ordering(322) 00:15:24.680 fused_ordering(323) 00:15:24.680 fused_ordering(324) 00:15:24.680 fused_ordering(325) 00:15:24.680 fused_ordering(326) 00:15:24.680 fused_ordering(327) 00:15:24.680 fused_ordering(328) 00:15:24.680 fused_ordering(329) 00:15:24.680 fused_ordering(330) 00:15:24.680 fused_ordering(331) 00:15:24.680 fused_ordering(332) 00:15:24.680 fused_ordering(333) 00:15:24.680 fused_ordering(334) 00:15:24.680 fused_ordering(335) 00:15:24.680 fused_ordering(336) 00:15:24.680 fused_ordering(337) 00:15:24.680 fused_ordering(338) 00:15:24.680 fused_ordering(339) 00:15:24.680 fused_ordering(340) 00:15:24.680 fused_ordering(341) 00:15:24.680 fused_ordering(342) 00:15:24.680 fused_ordering(343) 00:15:24.680 fused_ordering(344) 00:15:24.680 fused_ordering(345) 00:15:24.680 fused_ordering(346) 00:15:24.680 fused_ordering(347) 00:15:24.680 fused_ordering(348) 00:15:24.680 fused_ordering(349) 00:15:24.680 fused_ordering(350) 00:15:24.680 fused_ordering(351) 00:15:24.680 fused_ordering(352) 00:15:24.680 fused_ordering(353) 00:15:24.680 fused_ordering(354) 00:15:24.680 fused_ordering(355) 00:15:24.680 fused_ordering(356) 00:15:24.680 fused_ordering(357) 00:15:24.680 fused_ordering(358) 00:15:24.680 fused_ordering(359) 00:15:24.680 fused_ordering(360) 00:15:24.680 fused_ordering(361) 00:15:24.680 fused_ordering(362) 00:15:24.680 fused_ordering(363) 00:15:24.680 fused_ordering(364) 00:15:24.680 fused_ordering(365) 00:15:24.680 fused_ordering(366) 00:15:24.680 fused_ordering(367) 00:15:24.680 fused_ordering(368) 00:15:24.680 fused_ordering(369) 00:15:24.680 fused_ordering(370) 00:15:24.680 fused_ordering(371) 00:15:24.680 fused_ordering(372) 00:15:24.680 fused_ordering(373) 00:15:24.680 fused_ordering(374) 00:15:24.680 fused_ordering(375) 00:15:24.680 fused_ordering(376) 00:15:24.680 fused_ordering(377) 00:15:24.680 fused_ordering(378) 00:15:24.680 fused_ordering(379) 00:15:24.680 fused_ordering(380) 00:15:24.680 fused_ordering(381) 00:15:24.680 fused_ordering(382) 00:15:24.680 fused_ordering(383) 00:15:24.680 fused_ordering(384) 00:15:24.680 fused_ordering(385) 00:15:24.680 fused_ordering(386) 00:15:24.680 fused_ordering(387) 00:15:24.680 fused_ordering(388) 00:15:24.680 fused_ordering(389) 00:15:24.680 fused_ordering(390) 00:15:24.680 fused_ordering(391) 00:15:24.680 fused_ordering(392) 00:15:24.680 fused_ordering(393) 00:15:24.680 fused_ordering(394) 00:15:24.680 fused_ordering(395) 00:15:24.680 fused_ordering(396) 00:15:24.680 fused_ordering(397) 00:15:24.680 fused_ordering(398) 00:15:24.680 fused_ordering(399) 00:15:24.680 fused_ordering(400) 00:15:24.680 fused_ordering(401) 00:15:24.680 fused_ordering(402) 00:15:24.680 fused_ordering(403) 00:15:24.680 fused_ordering(404) 00:15:24.680 fused_ordering(405) 00:15:24.680 fused_ordering(406) 00:15:24.680 fused_ordering(407) 00:15:24.680 fused_ordering(408) 00:15:24.680 fused_ordering(409) 00:15:24.680 fused_ordering(410) 00:15:25.246 fused_ordering(411) 00:15:25.246 fused_ordering(412) 00:15:25.246 fused_ordering(413) 00:15:25.246 fused_ordering(414) 00:15:25.246 fused_ordering(415) 00:15:25.246 fused_ordering(416) 00:15:25.246 fused_ordering(417) 00:15:25.246 fused_ordering(418) 00:15:25.246 fused_ordering(419) 00:15:25.246 fused_ordering(420) 00:15:25.246 fused_ordering(421) 00:15:25.246 fused_ordering(422) 00:15:25.246 fused_ordering(423) 00:15:25.246 fused_ordering(424) 00:15:25.246 fused_ordering(425) 00:15:25.246 fused_ordering(426) 00:15:25.246 fused_ordering(427) 00:15:25.246 fused_ordering(428) 00:15:25.246 fused_ordering(429) 00:15:25.246 fused_ordering(430) 00:15:25.246 fused_ordering(431) 00:15:25.246 fused_ordering(432) 00:15:25.246 fused_ordering(433) 00:15:25.246 fused_ordering(434) 00:15:25.246 fused_ordering(435) 00:15:25.246 fused_ordering(436) 00:15:25.246 fused_ordering(437) 00:15:25.246 fused_ordering(438) 00:15:25.246 fused_ordering(439) 00:15:25.246 fused_ordering(440) 00:15:25.246 fused_ordering(441) 00:15:25.246 fused_ordering(442) 00:15:25.246 fused_ordering(443) 00:15:25.246 fused_ordering(444) 00:15:25.246 fused_ordering(445) 00:15:25.246 fused_ordering(446) 00:15:25.246 fused_ordering(447) 00:15:25.246 fused_ordering(448) 00:15:25.246 fused_ordering(449) 00:15:25.246 fused_ordering(450) 00:15:25.246 fused_ordering(451) 00:15:25.246 fused_ordering(452) 00:15:25.246 fused_ordering(453) 00:15:25.246 fused_ordering(454) 00:15:25.246 fused_ordering(455) 00:15:25.246 fused_ordering(456) 00:15:25.246 fused_ordering(457) 00:15:25.246 fused_ordering(458) 00:15:25.246 fused_ordering(459) 00:15:25.246 fused_ordering(460) 00:15:25.246 fused_ordering(461) 00:15:25.246 fused_ordering(462) 00:15:25.246 fused_ordering(463) 00:15:25.246 fused_ordering(464) 00:15:25.246 fused_ordering(465) 00:15:25.246 fused_ordering(466) 00:15:25.246 fused_ordering(467) 00:15:25.246 fused_ordering(468) 00:15:25.246 fused_ordering(469) 00:15:25.246 fused_ordering(470) 00:15:25.246 fused_ordering(471) 00:15:25.246 fused_ordering(472) 00:15:25.246 fused_ordering(473) 00:15:25.246 fused_ordering(474) 00:15:25.246 fused_ordering(475) 00:15:25.246 fused_ordering(476) 00:15:25.246 fused_ordering(477) 00:15:25.246 fused_ordering(478) 00:15:25.246 fused_ordering(479) 00:15:25.246 fused_ordering(480) 00:15:25.246 fused_ordering(481) 00:15:25.246 fused_ordering(482) 00:15:25.246 fused_ordering(483) 00:15:25.246 fused_ordering(484) 00:15:25.246 fused_ordering(485) 00:15:25.246 fused_ordering(486) 00:15:25.246 fused_ordering(487) 00:15:25.246 fused_ordering(488) 00:15:25.246 fused_ordering(489) 00:15:25.246 fused_ordering(490) 00:15:25.246 fused_ordering(491) 00:15:25.246 fused_ordering(492) 00:15:25.246 fused_ordering(493) 00:15:25.246 fused_ordering(494) 00:15:25.246 fused_ordering(495) 00:15:25.246 fused_ordering(496) 00:15:25.246 fused_ordering(497) 00:15:25.246 fused_ordering(498) 00:15:25.246 fused_ordering(499) 00:15:25.246 fused_ordering(500) 00:15:25.246 fused_ordering(501) 00:15:25.246 fused_ordering(502) 00:15:25.246 fused_ordering(503) 00:15:25.246 fused_ordering(504) 00:15:25.246 fused_ordering(505) 00:15:25.246 fused_ordering(506) 00:15:25.246 fused_ordering(507) 00:15:25.246 fused_ordering(508) 00:15:25.246 fused_ordering(509) 00:15:25.246 fused_ordering(510) 00:15:25.246 fused_ordering(511) 00:15:25.246 fused_ordering(512) 00:15:25.246 fused_ordering(513) 00:15:25.246 fused_ordering(514) 00:15:25.246 fused_ordering(515) 00:15:25.246 fused_ordering(516) 00:15:25.246 fused_ordering(517) 00:15:25.246 fused_ordering(518) 00:15:25.246 fused_ordering(519) 00:15:25.246 fused_ordering(520) 00:15:25.246 fused_ordering(521) 00:15:25.246 fused_ordering(522) 00:15:25.246 fused_ordering(523) 00:15:25.246 fused_ordering(524) 00:15:25.246 fused_ordering(525) 00:15:25.246 fused_ordering(526) 00:15:25.246 fused_ordering(527) 00:15:25.246 fused_ordering(528) 00:15:25.246 fused_ordering(529) 00:15:25.246 fused_ordering(530) 00:15:25.246 fused_ordering(531) 00:15:25.246 fused_ordering(532) 00:15:25.246 fused_ordering(533) 00:15:25.246 fused_ordering(534) 00:15:25.246 fused_ordering(535) 00:15:25.246 fused_ordering(536) 00:15:25.246 fused_ordering(537) 00:15:25.246 fused_ordering(538) 00:15:25.246 fused_ordering(539) 00:15:25.246 fused_ordering(540) 00:15:25.246 fused_ordering(541) 00:15:25.246 fused_ordering(542) 00:15:25.246 fused_ordering(543) 00:15:25.246 fused_ordering(544) 00:15:25.246 fused_ordering(545) 00:15:25.246 fused_ordering(546) 00:15:25.246 fused_ordering(547) 00:15:25.246 fused_ordering(548) 00:15:25.246 fused_ordering(549) 00:15:25.246 fused_ordering(550) 00:15:25.246 fused_ordering(551) 00:15:25.247 fused_ordering(552) 00:15:25.247 fused_ordering(553) 00:15:25.247 fused_ordering(554) 00:15:25.247 fused_ordering(555) 00:15:25.247 fused_ordering(556) 00:15:25.247 fused_ordering(557) 00:15:25.247 fused_ordering(558) 00:15:25.247 fused_ordering(559) 00:15:25.247 fused_ordering(560) 00:15:25.247 fused_ordering(561) 00:15:25.247 fused_ordering(562) 00:15:25.247 fused_ordering(563) 00:15:25.247 fused_ordering(564) 00:15:25.247 fused_ordering(565) 00:15:25.247 fused_ordering(566) 00:15:25.247 fused_ordering(567) 00:15:25.247 fused_ordering(568) 00:15:25.247 fused_ordering(569) 00:15:25.247 fused_ordering(570) 00:15:25.247 fused_ordering(571) 00:15:25.247 fused_ordering(572) 00:15:25.247 fused_ordering(573) 00:15:25.247 fused_ordering(574) 00:15:25.247 fused_ordering(575) 00:15:25.247 fused_ordering(576) 00:15:25.247 fused_ordering(577) 00:15:25.247 fused_ordering(578) 00:15:25.247 fused_ordering(579) 00:15:25.247 fused_ordering(580) 00:15:25.247 fused_ordering(581) 00:15:25.247 fused_ordering(582) 00:15:25.247 fused_ordering(583) 00:15:25.247 fused_ordering(584) 00:15:25.247 fused_ordering(585) 00:15:25.247 fused_ordering(586) 00:15:25.247 fused_ordering(587) 00:15:25.247 fused_ordering(588) 00:15:25.247 fused_ordering(589) 00:15:25.247 fused_ordering(590) 00:15:25.247 fused_ordering(591) 00:15:25.247 fused_ordering(592) 00:15:25.247 fused_ordering(593) 00:15:25.247 fused_ordering(594) 00:15:25.247 fused_ordering(595) 00:15:25.247 fused_ordering(596) 00:15:25.247 fused_ordering(597) 00:15:25.247 fused_ordering(598) 00:15:25.247 fused_ordering(599) 00:15:25.247 fused_ordering(600) 00:15:25.247 fused_ordering(601) 00:15:25.247 fused_ordering(602) 00:15:25.247 fused_ordering(603) 00:15:25.247 fused_ordering(604) 00:15:25.247 fused_ordering(605) 00:15:25.247 fused_ordering(606) 00:15:25.247 fused_ordering(607) 00:15:25.247 fused_ordering(608) 00:15:25.247 fused_ordering(609) 00:15:25.247 fused_ordering(610) 00:15:25.247 fused_ordering(611) 00:15:25.247 fused_ordering(612) 00:15:25.247 fused_ordering(613) 00:15:25.247 fused_ordering(614) 00:15:25.247 fused_ordering(615) 00:15:25.813 fused_ordering(616) 00:15:25.813 fused_ordering(617) 00:15:25.813 fused_ordering(618) 00:15:25.813 fused_ordering(619) 00:15:25.813 fused_ordering(620) 00:15:25.813 fused_ordering(621) 00:15:25.813 fused_ordering(622) 00:15:25.813 fused_ordering(623) 00:15:25.813 fused_ordering(624) 00:15:25.813 fused_ordering(625) 00:15:25.813 fused_ordering(626) 00:15:25.813 fused_ordering(627) 00:15:25.813 fused_ordering(628) 00:15:25.813 fused_ordering(629) 00:15:25.813 fused_ordering(630) 00:15:25.813 fused_ordering(631) 00:15:25.813 fused_ordering(632) 00:15:25.813 fused_ordering(633) 00:15:25.814 fused_ordering(634) 00:15:25.814 fused_ordering(635) 00:15:25.814 fused_ordering(636) 00:15:25.814 fused_ordering(637) 00:15:25.814 fused_ordering(638) 00:15:25.814 fused_ordering(639) 00:15:25.814 fused_ordering(640) 00:15:25.814 fused_ordering(641) 00:15:25.814 fused_ordering(642) 00:15:25.814 fused_ordering(643) 00:15:25.814 fused_ordering(644) 00:15:25.814 fused_ordering(645) 00:15:25.814 fused_ordering(646) 00:15:25.814 fused_ordering(647) 00:15:25.814 fused_ordering(648) 00:15:25.814 fused_ordering(649) 00:15:25.814 fused_ordering(650) 00:15:25.814 fused_ordering(651) 00:15:25.814 fused_ordering(652) 00:15:25.814 fused_ordering(653) 00:15:25.814 fused_ordering(654) 00:15:25.814 fused_ordering(655) 00:15:25.814 fused_ordering(656) 00:15:25.814 fused_ordering(657) 00:15:25.814 fused_ordering(658) 00:15:25.814 fused_ordering(659) 00:15:25.814 fused_ordering(660) 00:15:25.814 fused_ordering(661) 00:15:25.814 fused_ordering(662) 00:15:25.814 fused_ordering(663) 00:15:25.814 fused_ordering(664) 00:15:25.814 fused_ordering(665) 00:15:25.814 fused_ordering(666) 00:15:25.814 fused_ordering(667) 00:15:25.814 fused_ordering(668) 00:15:25.814 fused_ordering(669) 00:15:25.814 fused_ordering(670) 00:15:25.814 fused_ordering(671) 00:15:25.814 fused_ordering(672) 00:15:25.814 fused_ordering(673) 00:15:25.814 fused_ordering(674) 00:15:25.814 fused_ordering(675) 00:15:25.814 fused_ordering(676) 00:15:25.814 fused_ordering(677) 00:15:25.814 fused_ordering(678) 00:15:25.814 fused_ordering(679) 00:15:25.814 fused_ordering(680) 00:15:25.814 fused_ordering(681) 00:15:25.814 fused_ordering(682) 00:15:25.814 fused_ordering(683) 00:15:25.814 fused_ordering(684) 00:15:25.814 fused_ordering(685) 00:15:25.814 fused_ordering(686) 00:15:25.814 fused_ordering(687) 00:15:25.814 fused_ordering(688) 00:15:25.814 fused_ordering(689) 00:15:25.814 fused_ordering(690) 00:15:25.814 fused_ordering(691) 00:15:25.814 fused_ordering(692) 00:15:25.814 fused_ordering(693) 00:15:25.814 fused_ordering(694) 00:15:25.814 fused_ordering(695) 00:15:25.814 fused_ordering(696) 00:15:25.814 fused_ordering(697) 00:15:25.814 fused_ordering(698) 00:15:25.814 fused_ordering(699) 00:15:25.814 fused_ordering(700) 00:15:25.814 fused_ordering(701) 00:15:25.814 fused_ordering(702) 00:15:25.814 fused_ordering(703) 00:15:25.814 fused_ordering(704) 00:15:25.814 fused_ordering(705) 00:15:25.814 fused_ordering(706) 00:15:25.814 fused_ordering(707) 00:15:25.814 fused_ordering(708) 00:15:25.814 fused_ordering(709) 00:15:25.814 fused_ordering(710) 00:15:25.814 fused_ordering(711) 00:15:25.814 fused_ordering(712) 00:15:25.814 fused_ordering(713) 00:15:25.814 fused_ordering(714) 00:15:25.814 fused_ordering(715) 00:15:25.814 fused_ordering(716) 00:15:25.814 fused_ordering(717) 00:15:25.814 fused_ordering(718) 00:15:25.814 fused_ordering(719) 00:15:25.814 fused_ordering(720) 00:15:25.814 fused_ordering(721) 00:15:25.814 fused_ordering(722) 00:15:25.814 fused_ordering(723) 00:15:25.814 fused_ordering(724) 00:15:25.814 fused_ordering(725) 00:15:25.814 fused_ordering(726) 00:15:25.814 fused_ordering(727) 00:15:25.814 fused_ordering(728) 00:15:25.814 fused_ordering(729) 00:15:25.814 fused_ordering(730) 00:15:25.814 fused_ordering(731) 00:15:25.814 fused_ordering(732) 00:15:25.814 fused_ordering(733) 00:15:25.814 fused_ordering(734) 00:15:25.814 fused_ordering(735) 00:15:25.814 fused_ordering(736) 00:15:25.814 fused_ordering(737) 00:15:25.814 fused_ordering(738) 00:15:25.814 fused_ordering(739) 00:15:25.814 fused_ordering(740) 00:15:25.814 fused_ordering(741) 00:15:25.814 fused_ordering(742) 00:15:25.814 fused_ordering(743) 00:15:25.814 fused_ordering(744) 00:15:25.814 fused_ordering(745) 00:15:25.814 fused_ordering(746) 00:15:25.814 fused_ordering(747) 00:15:25.814 fused_ordering(748) 00:15:25.814 fused_ordering(749) 00:15:25.814 fused_ordering(750) 00:15:25.814 fused_ordering(751) 00:15:25.814 fused_ordering(752) 00:15:25.814 fused_ordering(753) 00:15:25.814 fused_ordering(754) 00:15:25.814 fused_ordering(755) 00:15:25.814 fused_ordering(756) 00:15:25.814 fused_ordering(757) 00:15:25.814 fused_ordering(758) 00:15:25.814 fused_ordering(759) 00:15:25.814 fused_ordering(760) 00:15:25.814 fused_ordering(761) 00:15:25.814 fused_ordering(762) 00:15:25.814 fused_ordering(763) 00:15:25.814 fused_ordering(764) 00:15:25.814 fused_ordering(765) 00:15:25.814 fused_ordering(766) 00:15:25.814 fused_ordering(767) 00:15:25.814 fused_ordering(768) 00:15:25.814 fused_ordering(769) 00:15:25.814 fused_ordering(770) 00:15:25.814 fused_ordering(771) 00:15:25.814 fused_ordering(772) 00:15:25.814 fused_ordering(773) 00:15:25.814 fused_ordering(774) 00:15:25.814 fused_ordering(775) 00:15:25.814 fused_ordering(776) 00:15:25.814 fused_ordering(777) 00:15:25.814 fused_ordering(778) 00:15:25.814 fused_ordering(779) 00:15:25.814 fused_ordering(780) 00:15:25.814 fused_ordering(781) 00:15:25.814 fused_ordering(782) 00:15:25.814 fused_ordering(783) 00:15:25.814 fused_ordering(784) 00:15:25.814 fused_ordering(785) 00:15:25.814 fused_ordering(786) 00:15:25.814 fused_ordering(787) 00:15:25.814 fused_ordering(788) 00:15:25.814 fused_ordering(789) 00:15:25.814 fused_ordering(790) 00:15:25.814 fused_ordering(791) 00:15:25.814 fused_ordering(792) 00:15:25.814 fused_ordering(793) 00:15:25.814 fused_ordering(794) 00:15:25.814 fused_ordering(795) 00:15:25.814 fused_ordering(796) 00:15:25.814 fused_ordering(797) 00:15:25.814 fused_ordering(798) 00:15:25.814 fused_ordering(799) 00:15:25.814 fused_ordering(800) 00:15:25.814 fused_ordering(801) 00:15:25.814 fused_ordering(802) 00:15:25.814 fused_ordering(803) 00:15:25.814 fused_ordering(804) 00:15:25.814 fused_ordering(805) 00:15:25.814 fused_ordering(806) 00:15:25.814 fused_ordering(807) 00:15:25.814 fused_ordering(808) 00:15:25.814 fused_ordering(809) 00:15:25.814 fused_ordering(810) 00:15:25.814 fused_ordering(811) 00:15:25.814 fused_ordering(812) 00:15:25.814 fused_ordering(813) 00:15:25.814 fused_ordering(814) 00:15:25.814 fused_ordering(815) 00:15:25.814 fused_ordering(816) 00:15:25.814 fused_ordering(817) 00:15:25.814 fused_ordering(818) 00:15:25.814 fused_ordering(819) 00:15:25.814 fused_ordering(820) 00:15:26.380 fused_ordering(821) 00:15:26.380 fused_ordering(822) 00:15:26.380 fused_ordering(823) 00:15:26.380 fused_ordering(824) 00:15:26.380 fused_ordering(825) 00:15:26.380 fused_ordering(826) 00:15:26.380 fused_ordering(827) 00:15:26.380 fused_ordering(828) 00:15:26.380 fused_ordering(829) 00:15:26.380 fused_ordering(830) 00:15:26.380 fused_ordering(831) 00:15:26.380 fused_ordering(832) 00:15:26.380 fused_ordering(833) 00:15:26.380 fused_ordering(834) 00:15:26.380 fused_ordering(835) 00:15:26.380 fused_ordering(836) 00:15:26.380 fused_ordering(837) 00:15:26.380 fused_ordering(838) 00:15:26.380 fused_ordering(839) 00:15:26.380 fused_ordering(840) 00:15:26.380 fused_ordering(841) 00:15:26.380 fused_ordering(842) 00:15:26.380 fused_ordering(843) 00:15:26.380 fused_ordering(844) 00:15:26.380 fused_ordering(845) 00:15:26.380 fused_ordering(846) 00:15:26.380 fused_ordering(847) 00:15:26.380 fused_ordering(848) 00:15:26.380 fused_ordering(849) 00:15:26.380 fused_ordering(850) 00:15:26.380 fused_ordering(851) 00:15:26.380 fused_ordering(852) 00:15:26.380 fused_ordering(853) 00:15:26.380 fused_ordering(854) 00:15:26.380 fused_ordering(855) 00:15:26.380 fused_ordering(856) 00:15:26.380 fused_ordering(857) 00:15:26.380 fused_ordering(858) 00:15:26.380 fused_ordering(859) 00:15:26.380 fused_ordering(860) 00:15:26.380 fused_ordering(861) 00:15:26.380 fused_ordering(862) 00:15:26.380 fused_ordering(863) 00:15:26.380 fused_ordering(864) 00:15:26.380 fused_ordering(865) 00:15:26.380 fused_ordering(866) 00:15:26.380 fused_ordering(867) 00:15:26.380 fused_ordering(868) 00:15:26.380 fused_ordering(869) 00:15:26.380 fused_ordering(870) 00:15:26.380 fused_ordering(871) 00:15:26.380 fused_ordering(872) 00:15:26.380 fused_ordering(873) 00:15:26.380 fused_ordering(874) 00:15:26.380 fused_ordering(875) 00:15:26.380 fused_ordering(876) 00:15:26.380 fused_ordering(877) 00:15:26.380 fused_ordering(878) 00:15:26.380 fused_ordering(879) 00:15:26.380 fused_ordering(880) 00:15:26.380 fused_ordering(881) 00:15:26.380 fused_ordering(882) 00:15:26.380 fused_ordering(883) 00:15:26.380 fused_ordering(884) 00:15:26.380 fused_ordering(885) 00:15:26.380 fused_ordering(886) 00:15:26.380 fused_ordering(887) 00:15:26.380 fused_ordering(888) 00:15:26.380 fused_ordering(889) 00:15:26.380 fused_ordering(890) 00:15:26.380 fused_ordering(891) 00:15:26.380 fused_ordering(892) 00:15:26.380 fused_ordering(893) 00:15:26.380 fused_ordering(894) 00:15:26.380 fused_ordering(895) 00:15:26.380 fused_ordering(896) 00:15:26.380 fused_ordering(897) 00:15:26.380 fused_ordering(898) 00:15:26.380 fused_ordering(899) 00:15:26.380 fused_ordering(900) 00:15:26.380 fused_ordering(901) 00:15:26.380 fused_ordering(902) 00:15:26.380 fused_ordering(903) 00:15:26.380 fused_ordering(904) 00:15:26.380 fused_ordering(905) 00:15:26.381 fused_ordering(906) 00:15:26.381 fused_ordering(907) 00:15:26.381 fused_ordering(908) 00:15:26.381 fused_ordering(909) 00:15:26.381 fused_ordering(910) 00:15:26.381 fused_ordering(911) 00:15:26.381 fused_ordering(912) 00:15:26.381 fused_ordering(913) 00:15:26.381 fused_ordering(914) 00:15:26.381 fused_ordering(915) 00:15:26.381 fused_ordering(916) 00:15:26.381 fused_ordering(917) 00:15:26.381 fused_ordering(918) 00:15:26.381 fused_ordering(919) 00:15:26.381 fused_ordering(920) 00:15:26.381 fused_ordering(921) 00:15:26.381 fused_ordering(922) 00:15:26.381 fused_ordering(923) 00:15:26.381 fused_ordering(924) 00:15:26.381 fused_ordering(925) 00:15:26.381 fused_ordering(926) 00:15:26.381 fused_ordering(927) 00:15:26.381 fused_ordering(928) 00:15:26.381 fused_ordering(929) 00:15:26.381 fused_ordering(930) 00:15:26.381 fused_ordering(931) 00:15:26.381 fused_ordering(932) 00:15:26.381 fused_ordering(933) 00:15:26.381 fused_ordering(934) 00:15:26.381 fused_ordering(935) 00:15:26.381 fused_ordering(936) 00:15:26.381 fused_ordering(937) 00:15:26.381 fused_ordering(938) 00:15:26.381 fused_ordering(939) 00:15:26.381 fused_ordering(940) 00:15:26.381 fused_ordering(941) 00:15:26.381 fused_ordering(942) 00:15:26.381 fused_ordering(943) 00:15:26.381 fused_ordering(944) 00:15:26.381 fused_ordering(945) 00:15:26.381 fused_ordering(946) 00:15:26.381 fused_ordering(947) 00:15:26.381 fused_ordering(948) 00:15:26.381 fused_ordering(949) 00:15:26.381 fused_ordering(950) 00:15:26.381 fused_ordering(951) 00:15:26.381 fused_ordering(952) 00:15:26.381 fused_ordering(953) 00:15:26.381 fused_ordering(954) 00:15:26.381 fused_ordering(955) 00:15:26.381 fused_ordering(956) 00:15:26.381 fused_ordering(957) 00:15:26.381 fused_ordering(958) 00:15:26.381 fused_ordering(959) 00:15:26.381 fused_ordering(960) 00:15:26.381 fused_ordering(961) 00:15:26.381 fused_ordering(962) 00:15:26.381 fused_ordering(963) 00:15:26.381 fused_ordering(964) 00:15:26.381 fused_ordering(965) 00:15:26.381 fused_ordering(966) 00:15:26.381 fused_ordering(967) 00:15:26.381 fused_ordering(968) 00:15:26.381 fused_ordering(969) 00:15:26.381 fused_ordering(970) 00:15:26.381 fused_ordering(971) 00:15:26.381 fused_ordering(972) 00:15:26.381 fused_ordering(973) 00:15:26.381 fused_ordering(974) 00:15:26.381 fused_ordering(975) 00:15:26.381 fused_ordering(976) 00:15:26.381 fused_ordering(977) 00:15:26.381 fused_ordering(978) 00:15:26.381 fused_ordering(979) 00:15:26.381 fused_ordering(980) 00:15:26.381 fused_ordering(981) 00:15:26.381 fused_ordering(982) 00:15:26.381 fused_ordering(983) 00:15:26.381 fused_ordering(984) 00:15:26.381 fused_ordering(985) 00:15:26.381 fused_ordering(986) 00:15:26.381 fused_ordering(987) 00:15:26.381 fused_ordering(988) 00:15:26.381 fused_ordering(989) 00:15:26.381 fused_ordering(990) 00:15:26.381 fused_ordering(991) 00:15:26.381 fused_ordering(992) 00:15:26.381 fused_ordering(993) 00:15:26.381 fused_ordering(994) 00:15:26.381 fused_ordering(995) 00:15:26.381 fused_ordering(996) 00:15:26.381 fused_ordering(997) 00:15:26.381 fused_ordering(998) 00:15:26.381 fused_ordering(999) 00:15:26.381 fused_ordering(1000) 00:15:26.381 fused_ordering(1001) 00:15:26.381 fused_ordering(1002) 00:15:26.381 fused_ordering(1003) 00:15:26.381 fused_ordering(1004) 00:15:26.381 fused_ordering(1005) 00:15:26.381 fused_ordering(1006) 00:15:26.381 fused_ordering(1007) 00:15:26.381 fused_ordering(1008) 00:15:26.381 fused_ordering(1009) 00:15:26.381 fused_ordering(1010) 00:15:26.381 fused_ordering(1011) 00:15:26.381 fused_ordering(1012) 00:15:26.381 fused_ordering(1013) 00:15:26.381 fused_ordering(1014) 00:15:26.381 fused_ordering(1015) 00:15:26.381 fused_ordering(1016) 00:15:26.381 fused_ordering(1017) 00:15:26.381 fused_ordering(1018) 00:15:26.381 fused_ordering(1019) 00:15:26.381 fused_ordering(1020) 00:15:26.381 fused_ordering(1021) 00:15:26.381 fused_ordering(1022) 00:15:26.381 fused_ordering(1023) 00:15:26.381 01:09:40 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:15:26.381 01:09:40 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:15:26.381 01:09:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:26.381 01:09:40 -- nvmf/common.sh@116 -- # sync 00:15:26.381 01:09:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:26.381 01:09:40 -- nvmf/common.sh@119 -- # set +e 00:15:26.381 01:09:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:26.381 01:09:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:26.381 rmmod nvme_tcp 00:15:26.381 rmmod nvme_fabrics 00:15:26.381 rmmod nvme_keyring 00:15:26.381 01:09:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:26.381 01:09:40 -- nvmf/common.sh@123 -- # set -e 00:15:26.381 01:09:40 -- nvmf/common.sh@124 -- # return 0 00:15:26.381 01:09:40 -- nvmf/common.sh@477 -- # '[' -n 2002473 ']' 00:15:26.381 01:09:40 -- nvmf/common.sh@478 -- # killprocess 2002473 00:15:26.381 01:09:40 -- common/autotest_common.sh@936 -- # '[' -z 2002473 ']' 00:15:26.381 01:09:40 -- common/autotest_common.sh@940 -- # kill -0 2002473 00:15:26.381 01:09:40 -- common/autotest_common.sh@941 -- # uname 00:15:26.381 01:09:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:26.381 01:09:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2002473 00:15:26.381 01:09:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:26.381 01:09:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:26.381 01:09:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2002473' 00:15:26.381 killing process with pid 2002473 00:15:26.381 01:09:40 -- common/autotest_common.sh@955 -- # kill 2002473 00:15:26.381 01:09:40 -- common/autotest_common.sh@960 -- # wait 2002473 00:15:26.640 01:09:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:26.640 01:09:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:26.640 01:09:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:26.640 01:09:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:26.640 01:09:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:26.640 01:09:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:26.640 01:09:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:26.640 01:09:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:29.179 01:09:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:29.179 00:15:29.179 real 0m8.287s 00:15:29.179 user 0m6.191s 00:15:29.179 sys 0m3.256s 00:15:29.179 01:09:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:29.179 01:09:43 -- common/autotest_common.sh@10 -- # set +x 00:15:29.179 ************************************ 00:15:29.179 END TEST nvmf_fused_ordering 00:15:29.179 ************************************ 00:15:29.179 01:09:43 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:29.179 01:09:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:29.179 01:09:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:29.179 01:09:43 -- common/autotest_common.sh@10 -- # set +x 00:15:29.179 ************************************ 00:15:29.179 START TEST nvmf_delete_subsystem 00:15:29.179 ************************************ 00:15:29.179 01:09:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:29.179 * Looking for test storage... 00:15:29.179 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:29.179 01:09:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:29.179 01:09:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:29.179 01:09:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:29.179 01:09:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:29.179 01:09:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:29.179 01:09:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:29.179 01:09:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:29.179 01:09:43 -- scripts/common.sh@335 -- # IFS=.-: 00:15:29.179 01:09:43 -- scripts/common.sh@335 -- # read -ra ver1 00:15:29.179 01:09:43 -- scripts/common.sh@336 -- # IFS=.-: 00:15:29.179 01:09:43 -- scripts/common.sh@336 -- # read -ra ver2 00:15:29.179 01:09:43 -- scripts/common.sh@337 -- # local 'op=<' 00:15:29.179 01:09:43 -- scripts/common.sh@339 -- # ver1_l=2 00:15:29.179 01:09:43 -- scripts/common.sh@340 -- # ver2_l=1 00:15:29.179 01:09:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:29.179 01:09:43 -- scripts/common.sh@343 -- # case "$op" in 00:15:29.179 01:09:43 -- scripts/common.sh@344 -- # : 1 00:15:29.179 01:09:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:29.179 01:09:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:29.179 01:09:43 -- scripts/common.sh@364 -- # decimal 1 00:15:29.179 01:09:43 -- scripts/common.sh@352 -- # local d=1 00:15:29.179 01:09:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:29.179 01:09:43 -- scripts/common.sh@354 -- # echo 1 00:15:29.179 01:09:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:29.179 01:09:43 -- scripts/common.sh@365 -- # decimal 2 00:15:29.179 01:09:43 -- scripts/common.sh@352 -- # local d=2 00:15:29.179 01:09:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:29.179 01:09:43 -- scripts/common.sh@354 -- # echo 2 00:15:29.179 01:09:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:29.179 01:09:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:29.179 01:09:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:29.179 01:09:43 -- scripts/common.sh@367 -- # return 0 00:15:29.179 01:09:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:29.179 01:09:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:29.179 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:29.179 --rc genhtml_branch_coverage=1 00:15:29.179 --rc genhtml_function_coverage=1 00:15:29.179 --rc genhtml_legend=1 00:15:29.179 --rc geninfo_all_blocks=1 00:15:29.179 --rc geninfo_unexecuted_blocks=1 00:15:29.179 00:15:29.179 ' 00:15:29.179 01:09:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:29.179 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:29.179 --rc genhtml_branch_coverage=1 00:15:29.179 --rc genhtml_function_coverage=1 00:15:29.179 --rc genhtml_legend=1 00:15:29.179 --rc geninfo_all_blocks=1 00:15:29.179 --rc geninfo_unexecuted_blocks=1 00:15:29.179 00:15:29.179 ' 00:15:29.179 01:09:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:29.179 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:29.179 --rc genhtml_branch_coverage=1 00:15:29.179 --rc genhtml_function_coverage=1 00:15:29.179 --rc genhtml_legend=1 00:15:29.179 --rc geninfo_all_blocks=1 00:15:29.179 --rc geninfo_unexecuted_blocks=1 00:15:29.179 00:15:29.179 ' 00:15:29.179 01:09:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:29.179 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:29.179 --rc genhtml_branch_coverage=1 00:15:29.179 --rc genhtml_function_coverage=1 00:15:29.179 --rc genhtml_legend=1 00:15:29.179 --rc geninfo_all_blocks=1 00:15:29.179 --rc geninfo_unexecuted_blocks=1 00:15:29.179 00:15:29.179 ' 00:15:29.179 01:09:43 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:29.179 01:09:43 -- nvmf/common.sh@7 -- # uname -s 00:15:29.179 01:09:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:29.179 01:09:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:29.179 01:09:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:29.179 01:09:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:29.179 01:09:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:29.179 01:09:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:29.179 01:09:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:29.179 01:09:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:29.179 01:09:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:29.179 01:09:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:29.179 01:09:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:29.179 01:09:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:29.179 01:09:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:29.179 01:09:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:29.179 01:09:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:29.179 01:09:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:29.179 01:09:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:29.179 01:09:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:29.179 01:09:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:29.179 01:09:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:29.179 01:09:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:29.179 01:09:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:29.179 01:09:43 -- paths/export.sh@5 -- # export PATH 00:15:29.179 01:09:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:29.179 01:09:43 -- nvmf/common.sh@46 -- # : 0 00:15:29.180 01:09:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:29.180 01:09:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:29.180 01:09:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:29.180 01:09:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:29.180 01:09:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:29.180 01:09:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:29.180 01:09:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:29.180 01:09:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:29.180 01:09:43 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:15:29.180 01:09:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:29.180 01:09:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:29.180 01:09:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:29.180 01:09:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:29.180 01:09:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:29.180 01:09:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:29.180 01:09:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:29.180 01:09:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:29.180 01:09:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:29.180 01:09:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:29.180 01:09:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:29.180 01:09:43 -- common/autotest_common.sh@10 -- # set +x 00:15:31.083 01:09:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:31.083 01:09:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:31.083 01:09:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:31.083 01:09:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:31.083 01:09:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:31.083 01:09:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:31.083 01:09:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:31.083 01:09:45 -- nvmf/common.sh@294 -- # net_devs=() 00:15:31.083 01:09:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:31.083 01:09:45 -- nvmf/common.sh@295 -- # e810=() 00:15:31.083 01:09:45 -- nvmf/common.sh@295 -- # local -ga e810 00:15:31.083 01:09:45 -- nvmf/common.sh@296 -- # x722=() 00:15:31.083 01:09:45 -- nvmf/common.sh@296 -- # local -ga x722 00:15:31.083 01:09:45 -- nvmf/common.sh@297 -- # mlx=() 00:15:31.083 01:09:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:31.083 01:09:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:31.083 01:09:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:31.083 01:09:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:31.083 01:09:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:31.083 01:09:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:31.083 01:09:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:31.083 01:09:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:31.083 01:09:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:31.083 01:09:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:31.083 01:09:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:31.083 01:09:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:31.083 01:09:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:31.083 01:09:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:31.083 01:09:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:31.083 01:09:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:31.083 01:09:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:31.083 01:09:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:31.083 01:09:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:31.083 01:09:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:31.083 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:31.083 01:09:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:31.083 01:09:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:31.083 01:09:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:31.083 01:09:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:31.083 01:09:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:31.083 01:09:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:31.083 01:09:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:31.083 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:31.083 01:09:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:31.083 01:09:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:31.083 01:09:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:31.083 01:09:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:31.083 01:09:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:31.083 01:09:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:31.083 01:09:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:31.083 01:09:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:31.083 01:09:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:31.083 01:09:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:31.083 01:09:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:31.083 01:09:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:31.083 01:09:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:31.083 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:31.083 01:09:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:31.083 01:09:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:31.083 01:09:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:31.083 01:09:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:31.083 01:09:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:31.083 01:09:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:31.083 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:31.083 01:09:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:31.083 01:09:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:31.083 01:09:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:31.083 01:09:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:31.083 01:09:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:31.083 01:09:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:31.083 01:09:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:31.083 01:09:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:31.083 01:09:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:31.083 01:09:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:31.083 01:09:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:31.083 01:09:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:31.083 01:09:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:31.083 01:09:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:31.083 01:09:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:31.083 01:09:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:31.083 01:09:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:31.083 01:09:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:31.083 01:09:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:31.084 01:09:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:31.084 01:09:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:31.084 01:09:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:31.084 01:09:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:31.084 01:09:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:31.084 01:09:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:31.084 01:09:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:31.084 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:31.084 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.306 ms 00:15:31.084 00:15:31.084 --- 10.0.0.2 ping statistics --- 00:15:31.084 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:31.084 rtt min/avg/max/mdev = 0.306/0.306/0.306/0.000 ms 00:15:31.084 01:09:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:31.084 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:31.084 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.159 ms 00:15:31.084 00:15:31.084 --- 10.0.0.1 ping statistics --- 00:15:31.084 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:31.084 rtt min/avg/max/mdev = 0.159/0.159/0.159/0.000 ms 00:15:31.084 01:09:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:31.084 01:09:45 -- nvmf/common.sh@410 -- # return 0 00:15:31.084 01:09:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:31.084 01:09:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:31.084 01:09:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:31.084 01:09:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:31.084 01:09:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:31.084 01:09:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:31.084 01:09:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:31.343 01:09:45 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:15:31.343 01:09:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:31.343 01:09:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:31.343 01:09:45 -- common/autotest_common.sh@10 -- # set +x 00:15:31.343 01:09:45 -- nvmf/common.sh@469 -- # nvmfpid=2004861 00:15:31.343 01:09:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:15:31.343 01:09:45 -- nvmf/common.sh@470 -- # waitforlisten 2004861 00:15:31.343 01:09:45 -- common/autotest_common.sh@829 -- # '[' -z 2004861 ']' 00:15:31.343 01:09:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:31.343 01:09:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:31.343 01:09:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:31.343 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:31.343 01:09:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:31.343 01:09:45 -- common/autotest_common.sh@10 -- # set +x 00:15:31.343 [2024-11-28 01:09:45.750448] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:31.343 [2024-11-28 01:09:45.750548] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:31.343 EAL: No free 2048 kB hugepages reported on node 1 00:15:31.343 [2024-11-28 01:09:45.816934] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:15:31.343 [2024-11-28 01:09:45.905366] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:31.343 [2024-11-28 01:09:45.905536] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:31.343 [2024-11-28 01:09:45.905555] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:31.343 [2024-11-28 01:09:45.905567] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:31.343 [2024-11-28 01:09:45.905625] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:31.343 [2024-11-28 01:09:45.905630] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:32.277 01:09:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:32.277 01:09:46 -- common/autotest_common.sh@862 -- # return 0 00:15:32.277 01:09:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:32.277 01:09:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:32.277 01:09:46 -- common/autotest_common.sh@10 -- # set +x 00:15:32.277 01:09:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:32.277 01:09:46 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:32.277 01:09:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:32.277 01:09:46 -- common/autotest_common.sh@10 -- # set +x 00:15:32.277 [2024-11-28 01:09:46.751907] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:32.277 01:09:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:32.277 01:09:46 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:32.277 01:09:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:32.277 01:09:46 -- common/autotest_common.sh@10 -- # set +x 00:15:32.277 01:09:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:32.277 01:09:46 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:32.277 01:09:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:32.277 01:09:46 -- common/autotest_common.sh@10 -- # set +x 00:15:32.277 [2024-11-28 01:09:46.768124] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:32.277 01:09:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:32.277 01:09:46 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:32.277 01:09:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:32.277 01:09:46 -- common/autotest_common.sh@10 -- # set +x 00:15:32.277 NULL1 00:15:32.277 01:09:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:32.277 01:09:46 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:32.277 01:09:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:32.277 01:09:46 -- common/autotest_common.sh@10 -- # set +x 00:15:32.277 Delay0 00:15:32.277 01:09:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:32.277 01:09:46 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:32.277 01:09:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:32.277 01:09:46 -- common/autotest_common.sh@10 -- # set +x 00:15:32.277 01:09:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:32.277 01:09:46 -- target/delete_subsystem.sh@28 -- # perf_pid=2005018 00:15:32.277 01:09:46 -- target/delete_subsystem.sh@30 -- # sleep 2 00:15:32.277 01:09:46 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:32.277 EAL: No free 2048 kB hugepages reported on node 1 00:15:32.277 [2024-11-28 01:09:46.842846] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:34.805 01:09:48 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:34.805 01:09:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:34.805 01:09:48 -- common/autotest_common.sh@10 -- # set +x 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 starting I/O failed: -6 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Write completed with error (sct=0, sc=8) 00:15:34.805 starting I/O failed: -6 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Write completed with error (sct=0, sc=8) 00:15:34.805 starting I/O failed: -6 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Write completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 starting I/O failed: -6 00:15:34.805 Write completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Write completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 starting I/O failed: -6 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 starting I/O failed: -6 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 starting I/O failed: -6 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Write completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 starting I/O failed: -6 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Write completed with error (sct=0, sc=8) 00:15:34.805 Write completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 starting I/O failed: -6 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Write completed with error (sct=0, sc=8) 00:15:34.805 Write completed with error (sct=0, sc=8) 00:15:34.805 starting I/O failed: -6 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 starting I/O failed: -6 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Write completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 starting I/O failed: -6 00:15:34.805 [2024-11-28 01:09:48.924346] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f2934000c00 is same with the state(5) to be set 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Write completed with error (sct=0, sc=8) 00:15:34.805 Write completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 starting I/O failed: -6 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Write completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 starting I/O failed: -6 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.805 starting I/O failed: -6 00:15:34.805 Write completed with error (sct=0, sc=8) 00:15:34.805 Write completed with error (sct=0, sc=8) 00:15:34.805 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 Read completed with error (sct=0, sc=8) 00:15:34.806 Write completed with error (sct=0, sc=8) 00:15:34.806 starting I/O failed: -6 00:15:34.806 starting I/O failed: -6 00:15:34.806 starting I/O failed: -6 00:15:34.806 starting I/O failed: -6 00:15:34.806 starting I/O failed: -6 00:15:34.806 starting I/O failed: -6 00:15:35.373 [2024-11-28 01:09:49.898317] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ea8a40 is same with the state(5) to be set 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 [2024-11-28 01:09:49.925067] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f293400c480 is same with the state(5) to be set 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 [2024-11-28 01:09:49.926475] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ea8e10 is same with the state(5) to be set 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Write completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.373 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Write completed with error (sct=0, sc=8) 00:15:35.374 Write completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Write completed with error (sct=0, sc=8) 00:15:35.374 Write completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Write completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Write completed with error (sct=0, sc=8) 00:15:35.374 Write completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Write completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Write completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Write completed with error (sct=0, sc=8) 00:15:35.374 Write completed with error (sct=0, sc=8) 00:15:35.374 Write completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 [2024-11-28 01:09:49.926751] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ea7810 is same with the state(5) to be set 00:15:35.374 Write completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Write completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Write completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 Read completed with error (sct=0, sc=8) 00:15:35.374 [2024-11-28 01:09:49.928229] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f293400bf20 is same with the state(5) to be set 00:15:35.374 [2024-11-28 01:09:49.928768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ea8a40 (9): Bad file descriptor 00:15:35.374 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:15:35.374 01:09:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:35.374 01:09:49 -- target/delete_subsystem.sh@34 -- # delay=0 00:15:35.374 01:09:49 -- target/delete_subsystem.sh@35 -- # kill -0 2005018 00:15:35.374 01:09:49 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:15:35.374 Initializing NVMe Controllers 00:15:35.374 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:35.374 Controller IO queue size 128, less than required. 00:15:35.374 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:35.374 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:35.374 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:35.374 Initialization complete. Launching workers. 00:15:35.374 ======================================================== 00:15:35.374 Latency(us) 00:15:35.374 Device Information : IOPS MiB/s Average min max 00:15:35.374 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 187.56 0.09 901835.47 630.70 1013597.55 00:15:35.374 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 170.69 0.08 892134.04 642.12 1013456.37 00:15:35.374 ======================================================== 00:15:35.374 Total : 358.25 0.17 897213.18 630.70 1013597.55 00:15:35.374 00:15:35.940 01:09:50 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:15:35.940 01:09:50 -- target/delete_subsystem.sh@35 -- # kill -0 2005018 00:15:35.940 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (2005018) - No such process 00:15:35.940 01:09:50 -- target/delete_subsystem.sh@45 -- # NOT wait 2005018 00:15:35.940 01:09:50 -- common/autotest_common.sh@650 -- # local es=0 00:15:35.940 01:09:50 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 2005018 00:15:35.940 01:09:50 -- common/autotest_common.sh@638 -- # local arg=wait 00:15:35.940 01:09:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:35.940 01:09:50 -- common/autotest_common.sh@642 -- # type -t wait 00:15:35.940 01:09:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:35.940 01:09:50 -- common/autotest_common.sh@653 -- # wait 2005018 00:15:35.940 01:09:50 -- common/autotest_common.sh@653 -- # es=1 00:15:35.940 01:09:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:35.940 01:09:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:35.940 01:09:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:35.940 01:09:50 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:35.940 01:09:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:35.940 01:09:50 -- common/autotest_common.sh@10 -- # set +x 00:15:35.940 01:09:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:35.940 01:09:50 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:35.940 01:09:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:35.940 01:09:50 -- common/autotest_common.sh@10 -- # set +x 00:15:35.940 [2024-11-28 01:09:50.448066] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:35.940 01:09:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:35.940 01:09:50 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:35.940 01:09:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:35.940 01:09:50 -- common/autotest_common.sh@10 -- # set +x 00:15:35.940 01:09:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:35.940 01:09:50 -- target/delete_subsystem.sh@54 -- # perf_pid=2005458 00:15:35.940 01:09:50 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:35.940 01:09:50 -- target/delete_subsystem.sh@56 -- # delay=0 00:15:35.940 01:09:50 -- target/delete_subsystem.sh@57 -- # kill -0 2005458 00:15:35.940 01:09:50 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:35.940 EAL: No free 2048 kB hugepages reported on node 1 00:15:35.940 [2024-11-28 01:09:50.505022] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:36.507 01:09:50 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:36.507 01:09:50 -- target/delete_subsystem.sh@57 -- # kill -0 2005458 00:15:36.507 01:09:50 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:37.073 01:09:51 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:37.073 01:09:51 -- target/delete_subsystem.sh@57 -- # kill -0 2005458 00:15:37.073 01:09:51 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:37.640 01:09:51 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:37.640 01:09:51 -- target/delete_subsystem.sh@57 -- # kill -0 2005458 00:15:37.640 01:09:51 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:37.898 01:09:52 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:37.898 01:09:52 -- target/delete_subsystem.sh@57 -- # kill -0 2005458 00:15:37.898 01:09:52 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:38.465 01:09:52 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:38.465 01:09:52 -- target/delete_subsystem.sh@57 -- # kill -0 2005458 00:15:38.465 01:09:52 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:39.031 01:09:53 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:39.031 01:09:53 -- target/delete_subsystem.sh@57 -- # kill -0 2005458 00:15:39.031 01:09:53 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:39.290 Initializing NVMe Controllers 00:15:39.290 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:39.290 Controller IO queue size 128, less than required. 00:15:39.290 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:39.290 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:39.290 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:39.290 Initialization complete. Launching workers. 00:15:39.290 ======================================================== 00:15:39.290 Latency(us) 00:15:39.290 Device Information : IOPS MiB/s Average min max 00:15:39.290 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003993.61 1000189.96 1012033.51 00:15:39.290 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004360.92 1000194.56 1041275.74 00:15:39.290 ======================================================== 00:15:39.290 Total : 256.00 0.12 1004177.26 1000189.96 1041275.74 00:15:39.290 00:15:39.548 01:09:53 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:39.548 01:09:53 -- target/delete_subsystem.sh@57 -- # kill -0 2005458 00:15:39.548 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (2005458) - No such process 00:15:39.548 01:09:53 -- target/delete_subsystem.sh@67 -- # wait 2005458 00:15:39.548 01:09:53 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:15:39.548 01:09:53 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:15:39.548 01:09:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:39.548 01:09:53 -- nvmf/common.sh@116 -- # sync 00:15:39.548 01:09:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:39.548 01:09:53 -- nvmf/common.sh@119 -- # set +e 00:15:39.548 01:09:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:39.548 01:09:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:39.548 rmmod nvme_tcp 00:15:39.548 rmmod nvme_fabrics 00:15:39.548 rmmod nvme_keyring 00:15:39.548 01:09:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:39.548 01:09:54 -- nvmf/common.sh@123 -- # set -e 00:15:39.548 01:09:54 -- nvmf/common.sh@124 -- # return 0 00:15:39.548 01:09:54 -- nvmf/common.sh@477 -- # '[' -n 2004861 ']' 00:15:39.548 01:09:54 -- nvmf/common.sh@478 -- # killprocess 2004861 00:15:39.548 01:09:54 -- common/autotest_common.sh@936 -- # '[' -z 2004861 ']' 00:15:39.548 01:09:54 -- common/autotest_common.sh@940 -- # kill -0 2004861 00:15:39.548 01:09:54 -- common/autotest_common.sh@941 -- # uname 00:15:39.548 01:09:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:39.548 01:09:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2004861 00:15:39.548 01:09:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:39.548 01:09:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:39.548 01:09:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2004861' 00:15:39.548 killing process with pid 2004861 00:15:39.548 01:09:54 -- common/autotest_common.sh@955 -- # kill 2004861 00:15:39.548 01:09:54 -- common/autotest_common.sh@960 -- # wait 2004861 00:15:39.807 01:09:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:39.807 01:09:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:39.807 01:09:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:39.807 01:09:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:39.807 01:09:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:39.807 01:09:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:39.807 01:09:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:39.807 01:09:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:42.339 01:09:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:42.339 00:15:42.339 real 0m13.093s 00:15:42.339 user 0m29.299s 00:15:42.339 sys 0m2.965s 00:15:42.339 01:09:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:42.339 01:09:56 -- common/autotest_common.sh@10 -- # set +x 00:15:42.339 ************************************ 00:15:42.339 END TEST nvmf_delete_subsystem 00:15:42.339 ************************************ 00:15:42.339 01:09:56 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:15:42.339 01:09:56 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:42.339 01:09:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:42.339 01:09:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:42.339 01:09:56 -- common/autotest_common.sh@10 -- # set +x 00:15:42.339 ************************************ 00:15:42.339 START TEST nvmf_nvme_cli 00:15:42.339 ************************************ 00:15:42.339 01:09:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:42.339 * Looking for test storage... 00:15:42.339 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:42.339 01:09:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:42.339 01:09:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:42.339 01:09:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:42.339 01:09:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:42.339 01:09:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:42.339 01:09:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:42.339 01:09:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:42.339 01:09:56 -- scripts/common.sh@335 -- # IFS=.-: 00:15:42.339 01:09:56 -- scripts/common.sh@335 -- # read -ra ver1 00:15:42.339 01:09:56 -- scripts/common.sh@336 -- # IFS=.-: 00:15:42.339 01:09:56 -- scripts/common.sh@336 -- # read -ra ver2 00:15:42.339 01:09:56 -- scripts/common.sh@337 -- # local 'op=<' 00:15:42.339 01:09:56 -- scripts/common.sh@339 -- # ver1_l=2 00:15:42.339 01:09:56 -- scripts/common.sh@340 -- # ver2_l=1 00:15:42.339 01:09:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:42.339 01:09:56 -- scripts/common.sh@343 -- # case "$op" in 00:15:42.339 01:09:56 -- scripts/common.sh@344 -- # : 1 00:15:42.339 01:09:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:42.339 01:09:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:42.339 01:09:56 -- scripts/common.sh@364 -- # decimal 1 00:15:42.339 01:09:56 -- scripts/common.sh@352 -- # local d=1 00:15:42.339 01:09:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:42.339 01:09:56 -- scripts/common.sh@354 -- # echo 1 00:15:42.339 01:09:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:42.339 01:09:56 -- scripts/common.sh@365 -- # decimal 2 00:15:42.339 01:09:56 -- scripts/common.sh@352 -- # local d=2 00:15:42.339 01:09:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:42.339 01:09:56 -- scripts/common.sh@354 -- # echo 2 00:15:42.339 01:09:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:42.339 01:09:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:42.339 01:09:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:42.339 01:09:56 -- scripts/common.sh@367 -- # return 0 00:15:42.339 01:09:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:42.339 01:09:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:42.339 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:42.339 --rc genhtml_branch_coverage=1 00:15:42.339 --rc genhtml_function_coverage=1 00:15:42.339 --rc genhtml_legend=1 00:15:42.339 --rc geninfo_all_blocks=1 00:15:42.339 --rc geninfo_unexecuted_blocks=1 00:15:42.339 00:15:42.339 ' 00:15:42.339 01:09:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:42.339 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:42.339 --rc genhtml_branch_coverage=1 00:15:42.339 --rc genhtml_function_coverage=1 00:15:42.339 --rc genhtml_legend=1 00:15:42.339 --rc geninfo_all_blocks=1 00:15:42.339 --rc geninfo_unexecuted_blocks=1 00:15:42.339 00:15:42.339 ' 00:15:42.339 01:09:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:42.339 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:42.339 --rc genhtml_branch_coverage=1 00:15:42.339 --rc genhtml_function_coverage=1 00:15:42.339 --rc genhtml_legend=1 00:15:42.339 --rc geninfo_all_blocks=1 00:15:42.339 --rc geninfo_unexecuted_blocks=1 00:15:42.339 00:15:42.339 ' 00:15:42.339 01:09:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:42.339 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:42.339 --rc genhtml_branch_coverage=1 00:15:42.339 --rc genhtml_function_coverage=1 00:15:42.339 --rc genhtml_legend=1 00:15:42.339 --rc geninfo_all_blocks=1 00:15:42.339 --rc geninfo_unexecuted_blocks=1 00:15:42.339 00:15:42.339 ' 00:15:42.339 01:09:56 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:42.339 01:09:56 -- nvmf/common.sh@7 -- # uname -s 00:15:42.339 01:09:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:42.339 01:09:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:42.339 01:09:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:42.339 01:09:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:42.339 01:09:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:42.339 01:09:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:42.339 01:09:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:42.339 01:09:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:42.339 01:09:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:42.339 01:09:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:42.339 01:09:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:42.339 01:09:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:42.339 01:09:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:42.339 01:09:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:42.339 01:09:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:42.339 01:09:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:42.339 01:09:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:42.339 01:09:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:42.339 01:09:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:42.339 01:09:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:42.340 01:09:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:42.340 01:09:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:42.340 01:09:56 -- paths/export.sh@5 -- # export PATH 00:15:42.340 01:09:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:42.340 01:09:56 -- nvmf/common.sh@46 -- # : 0 00:15:42.340 01:09:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:42.340 01:09:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:42.340 01:09:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:42.340 01:09:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:42.340 01:09:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:42.340 01:09:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:42.340 01:09:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:42.340 01:09:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:42.340 01:09:56 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:42.340 01:09:56 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:42.340 01:09:56 -- target/nvme_cli.sh@14 -- # devs=() 00:15:42.340 01:09:56 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:15:42.340 01:09:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:42.340 01:09:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:42.340 01:09:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:42.340 01:09:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:42.340 01:09:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:42.340 01:09:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:42.340 01:09:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:42.340 01:09:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:42.340 01:09:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:42.340 01:09:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:42.340 01:09:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:42.340 01:09:56 -- common/autotest_common.sh@10 -- # set +x 00:15:44.239 01:09:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:44.239 01:09:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:44.239 01:09:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:44.239 01:09:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:44.239 01:09:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:44.239 01:09:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:44.239 01:09:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:44.239 01:09:58 -- nvmf/common.sh@294 -- # net_devs=() 00:15:44.239 01:09:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:44.239 01:09:58 -- nvmf/common.sh@295 -- # e810=() 00:15:44.239 01:09:58 -- nvmf/common.sh@295 -- # local -ga e810 00:15:44.239 01:09:58 -- nvmf/common.sh@296 -- # x722=() 00:15:44.239 01:09:58 -- nvmf/common.sh@296 -- # local -ga x722 00:15:44.239 01:09:58 -- nvmf/common.sh@297 -- # mlx=() 00:15:44.239 01:09:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:44.239 01:09:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:44.239 01:09:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:44.239 01:09:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:44.239 01:09:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:44.239 01:09:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:44.239 01:09:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:44.239 01:09:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:44.239 01:09:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:44.239 01:09:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:44.239 01:09:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:44.239 01:09:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:44.239 01:09:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:44.239 01:09:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:44.239 01:09:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:44.239 01:09:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:44.239 01:09:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:44.239 01:09:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:44.239 01:09:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:44.239 01:09:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:44.239 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:44.239 01:09:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:44.239 01:09:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:44.239 01:09:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:44.239 01:09:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:44.239 01:09:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:44.239 01:09:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:44.239 01:09:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:44.239 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:44.239 01:09:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:44.239 01:09:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:44.239 01:09:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:44.239 01:09:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:44.239 01:09:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:44.239 01:09:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:44.239 01:09:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:44.239 01:09:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:44.239 01:09:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:44.239 01:09:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:44.239 01:09:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:44.239 01:09:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:44.239 01:09:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:44.239 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:44.239 01:09:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:44.239 01:09:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:44.239 01:09:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:44.239 01:09:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:44.239 01:09:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:44.239 01:09:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:44.239 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:44.239 01:09:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:44.239 01:09:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:44.239 01:09:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:44.239 01:09:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:44.239 01:09:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:44.239 01:09:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:44.239 01:09:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:44.239 01:09:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:44.239 01:09:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:44.239 01:09:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:44.239 01:09:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:44.239 01:09:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:44.239 01:09:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:44.239 01:09:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:44.239 01:09:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:44.239 01:09:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:44.239 01:09:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:44.239 01:09:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:44.239 01:09:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:44.239 01:09:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:44.239 01:09:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:44.239 01:09:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:44.239 01:09:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:44.239 01:09:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:44.239 01:09:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:44.239 01:09:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:44.239 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:44.239 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.245 ms 00:15:44.239 00:15:44.239 --- 10.0.0.2 ping statistics --- 00:15:44.239 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:44.239 rtt min/avg/max/mdev = 0.245/0.245/0.245/0.000 ms 00:15:44.239 01:09:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:44.239 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:44.239 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:15:44.239 00:15:44.239 --- 10.0.0.1 ping statistics --- 00:15:44.239 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:44.239 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:15:44.239 01:09:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:44.239 01:09:58 -- nvmf/common.sh@410 -- # return 0 00:15:44.239 01:09:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:44.239 01:09:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:44.239 01:09:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:44.239 01:09:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:44.239 01:09:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:44.239 01:09:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:44.239 01:09:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:44.240 01:09:58 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:15:44.240 01:09:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:44.240 01:09:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:44.240 01:09:58 -- common/autotest_common.sh@10 -- # set +x 00:15:44.240 01:09:58 -- nvmf/common.sh@469 -- # nvmfpid=2007919 00:15:44.240 01:09:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:44.240 01:09:58 -- nvmf/common.sh@470 -- # waitforlisten 2007919 00:15:44.240 01:09:58 -- common/autotest_common.sh@829 -- # '[' -z 2007919 ']' 00:15:44.240 01:09:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:44.240 01:09:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:44.240 01:09:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:44.240 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:44.240 01:09:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:44.240 01:09:58 -- common/autotest_common.sh@10 -- # set +x 00:15:44.240 [2024-11-28 01:09:58.735663] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:44.240 [2024-11-28 01:09:58.735744] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:44.240 EAL: No free 2048 kB hugepages reported on node 1 00:15:44.240 [2024-11-28 01:09:58.804681] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:44.525 [2024-11-28 01:09:58.897788] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:44.525 [2024-11-28 01:09:58.897962] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:44.525 [2024-11-28 01:09:58.897981] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:44.525 [2024-11-28 01:09:58.897996] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:44.525 [2024-11-28 01:09:58.898111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:44.525 [2024-11-28 01:09:58.898170] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:44.525 [2024-11-28 01:09:58.898261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:44.525 [2024-11-28 01:09:58.898263] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:45.170 01:09:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:45.170 01:09:59 -- common/autotest_common.sh@862 -- # return 0 00:15:45.170 01:09:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:45.170 01:09:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:45.170 01:09:59 -- common/autotest_common.sh@10 -- # set +x 00:15:45.170 01:09:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:45.170 01:09:59 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:45.170 01:09:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:45.170 01:09:59 -- common/autotest_common.sh@10 -- # set +x 00:15:45.170 [2024-11-28 01:09:59.744270] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:45.170 01:09:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:45.170 01:09:59 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:45.170 01:09:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:45.170 01:09:59 -- common/autotest_common.sh@10 -- # set +x 00:15:45.427 Malloc0 00:15:45.427 01:09:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:45.427 01:09:59 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:15:45.427 01:09:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:45.427 01:09:59 -- common/autotest_common.sh@10 -- # set +x 00:15:45.427 Malloc1 00:15:45.427 01:09:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:45.427 01:09:59 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:15:45.427 01:09:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:45.427 01:09:59 -- common/autotest_common.sh@10 -- # set +x 00:15:45.427 01:09:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:45.427 01:09:59 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:45.427 01:09:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:45.428 01:09:59 -- common/autotest_common.sh@10 -- # set +x 00:15:45.428 01:09:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:45.428 01:09:59 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:45.428 01:09:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:45.428 01:09:59 -- common/autotest_common.sh@10 -- # set +x 00:15:45.428 01:09:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:45.428 01:09:59 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:45.428 01:09:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:45.428 01:09:59 -- common/autotest_common.sh@10 -- # set +x 00:15:45.428 [2024-11-28 01:09:59.830246] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:45.428 01:09:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:45.428 01:09:59 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:45.428 01:09:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:45.428 01:09:59 -- common/autotest_common.sh@10 -- # set +x 00:15:45.428 01:09:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:45.428 01:09:59 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:15:45.428 00:15:45.428 Discovery Log Number of Records 2, Generation counter 2 00:15:45.428 =====Discovery Log Entry 0====== 00:15:45.428 trtype: tcp 00:15:45.428 adrfam: ipv4 00:15:45.428 subtype: current discovery subsystem 00:15:45.428 treq: not required 00:15:45.428 portid: 0 00:15:45.428 trsvcid: 4420 00:15:45.428 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:15:45.428 traddr: 10.0.0.2 00:15:45.428 eflags: explicit discovery connections, duplicate discovery information 00:15:45.428 sectype: none 00:15:45.428 =====Discovery Log Entry 1====== 00:15:45.428 trtype: tcp 00:15:45.428 adrfam: ipv4 00:15:45.428 subtype: nvme subsystem 00:15:45.428 treq: not required 00:15:45.428 portid: 0 00:15:45.428 trsvcid: 4420 00:15:45.428 subnqn: nqn.2016-06.io.spdk:cnode1 00:15:45.428 traddr: 10.0.0.2 00:15:45.428 eflags: none 00:15:45.428 sectype: none 00:15:45.428 01:10:00 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:15:45.428 01:10:00 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:15:45.428 01:10:00 -- nvmf/common.sh@510 -- # local dev _ 00:15:45.428 01:10:00 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:45.428 01:10:00 -- nvmf/common.sh@509 -- # nvme list 00:15:45.428 01:10:00 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:45.428 01:10:00 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:45.428 01:10:00 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:45.428 01:10:00 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:45.428 01:10:00 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:15:45.428 01:10:00 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:46.357 01:10:00 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:15:46.357 01:10:00 -- common/autotest_common.sh@1187 -- # local i=0 00:15:46.357 01:10:00 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:15:46.357 01:10:00 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:15:46.357 01:10:00 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:15:46.357 01:10:00 -- common/autotest_common.sh@1194 -- # sleep 2 00:15:48.255 01:10:02 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:15:48.255 01:10:02 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:15:48.255 01:10:02 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:15:48.256 01:10:02 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:15:48.256 01:10:02 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:15:48.256 01:10:02 -- common/autotest_common.sh@1197 -- # return 0 00:15:48.256 01:10:02 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:15:48.256 01:10:02 -- nvmf/common.sh@510 -- # local dev _ 00:15:48.256 01:10:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:48.256 01:10:02 -- nvmf/common.sh@509 -- # nvme list 00:15:48.256 01:10:02 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:48.256 01:10:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:48.256 01:10:02 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:48.256 01:10:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:48.256 01:10:02 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:48.256 01:10:02 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:48.256 01:10:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:48.256 01:10:02 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:48.256 01:10:02 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:48.256 01:10:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:48.256 01:10:02 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:15:48.256 /dev/nvme0n2 ]] 00:15:48.256 01:10:02 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:15:48.256 01:10:02 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:15:48.256 01:10:02 -- nvmf/common.sh@510 -- # local dev _ 00:15:48.256 01:10:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:48.256 01:10:02 -- nvmf/common.sh@509 -- # nvme list 00:15:48.513 01:10:02 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:48.513 01:10:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:48.513 01:10:02 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:48.513 01:10:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:48.513 01:10:02 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:48.513 01:10:02 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:48.513 01:10:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:48.513 01:10:02 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:48.513 01:10:02 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:48.513 01:10:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:48.513 01:10:02 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:15:48.513 01:10:02 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:48.771 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:48.771 01:10:03 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:48.771 01:10:03 -- common/autotest_common.sh@1208 -- # local i=0 00:15:48.771 01:10:03 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:15:48.771 01:10:03 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:48.771 01:10:03 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:15:48.771 01:10:03 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:48.771 01:10:03 -- common/autotest_common.sh@1220 -- # return 0 00:15:48.771 01:10:03 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:15:48.771 01:10:03 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:48.771 01:10:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:48.771 01:10:03 -- common/autotest_common.sh@10 -- # set +x 00:15:48.771 01:10:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:48.771 01:10:03 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:15:48.771 01:10:03 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:15:48.771 01:10:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:48.771 01:10:03 -- nvmf/common.sh@116 -- # sync 00:15:48.771 01:10:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:48.771 01:10:03 -- nvmf/common.sh@119 -- # set +e 00:15:48.771 01:10:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:48.771 01:10:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:48.771 rmmod nvme_tcp 00:15:48.771 rmmod nvme_fabrics 00:15:48.771 rmmod nvme_keyring 00:15:48.771 01:10:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:48.771 01:10:03 -- nvmf/common.sh@123 -- # set -e 00:15:48.771 01:10:03 -- nvmf/common.sh@124 -- # return 0 00:15:48.772 01:10:03 -- nvmf/common.sh@477 -- # '[' -n 2007919 ']' 00:15:48.772 01:10:03 -- nvmf/common.sh@478 -- # killprocess 2007919 00:15:48.772 01:10:03 -- common/autotest_common.sh@936 -- # '[' -z 2007919 ']' 00:15:48.772 01:10:03 -- common/autotest_common.sh@940 -- # kill -0 2007919 00:15:48.772 01:10:03 -- common/autotest_common.sh@941 -- # uname 00:15:48.772 01:10:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:48.772 01:10:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2007919 00:15:48.772 01:10:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:48.772 01:10:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:48.772 01:10:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2007919' 00:15:48.772 killing process with pid 2007919 00:15:48.772 01:10:03 -- common/autotest_common.sh@955 -- # kill 2007919 00:15:48.772 01:10:03 -- common/autotest_common.sh@960 -- # wait 2007919 00:15:49.030 01:10:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:49.030 01:10:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:49.030 01:10:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:49.030 01:10:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:49.030 01:10:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:49.030 01:10:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:49.030 01:10:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:49.030 01:10:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:51.561 01:10:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:51.561 00:15:51.561 real 0m9.284s 00:15:51.561 user 0m19.474s 00:15:51.561 sys 0m2.337s 00:15:51.561 01:10:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:51.561 01:10:05 -- common/autotest_common.sh@10 -- # set +x 00:15:51.561 ************************************ 00:15:51.561 END TEST nvmf_nvme_cli 00:15:51.561 ************************************ 00:15:51.561 01:10:05 -- nvmf/nvmf.sh@39 -- # [[ 1 -eq 1 ]] 00:15:51.561 01:10:05 -- nvmf/nvmf.sh@40 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:51.561 01:10:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:51.561 01:10:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:51.562 01:10:05 -- common/autotest_common.sh@10 -- # set +x 00:15:51.562 ************************************ 00:15:51.562 START TEST nvmf_vfio_user 00:15:51.562 ************************************ 00:15:51.562 01:10:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:51.562 * Looking for test storage... 00:15:51.562 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:51.562 01:10:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:51.562 01:10:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:51.562 01:10:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:51.562 01:10:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:51.562 01:10:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:51.562 01:10:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:51.562 01:10:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:51.562 01:10:05 -- scripts/common.sh@335 -- # IFS=.-: 00:15:51.562 01:10:05 -- scripts/common.sh@335 -- # read -ra ver1 00:15:51.562 01:10:05 -- scripts/common.sh@336 -- # IFS=.-: 00:15:51.562 01:10:05 -- scripts/common.sh@336 -- # read -ra ver2 00:15:51.562 01:10:05 -- scripts/common.sh@337 -- # local 'op=<' 00:15:51.562 01:10:05 -- scripts/common.sh@339 -- # ver1_l=2 00:15:51.562 01:10:05 -- scripts/common.sh@340 -- # ver2_l=1 00:15:51.562 01:10:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:51.562 01:10:05 -- scripts/common.sh@343 -- # case "$op" in 00:15:51.562 01:10:05 -- scripts/common.sh@344 -- # : 1 00:15:51.562 01:10:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:51.562 01:10:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:51.562 01:10:05 -- scripts/common.sh@364 -- # decimal 1 00:15:51.562 01:10:05 -- scripts/common.sh@352 -- # local d=1 00:15:51.562 01:10:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:51.562 01:10:05 -- scripts/common.sh@354 -- # echo 1 00:15:51.562 01:10:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:51.562 01:10:05 -- scripts/common.sh@365 -- # decimal 2 00:15:51.562 01:10:05 -- scripts/common.sh@352 -- # local d=2 00:15:51.562 01:10:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:51.562 01:10:05 -- scripts/common.sh@354 -- # echo 2 00:15:51.562 01:10:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:51.562 01:10:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:51.562 01:10:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:51.562 01:10:05 -- scripts/common.sh@367 -- # return 0 00:15:51.562 01:10:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:51.562 01:10:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:51.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:51.562 --rc genhtml_branch_coverage=1 00:15:51.562 --rc genhtml_function_coverage=1 00:15:51.562 --rc genhtml_legend=1 00:15:51.562 --rc geninfo_all_blocks=1 00:15:51.562 --rc geninfo_unexecuted_blocks=1 00:15:51.562 00:15:51.562 ' 00:15:51.562 01:10:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:51.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:51.562 --rc genhtml_branch_coverage=1 00:15:51.562 --rc genhtml_function_coverage=1 00:15:51.562 --rc genhtml_legend=1 00:15:51.562 --rc geninfo_all_blocks=1 00:15:51.562 --rc geninfo_unexecuted_blocks=1 00:15:51.562 00:15:51.562 ' 00:15:51.562 01:10:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:51.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:51.562 --rc genhtml_branch_coverage=1 00:15:51.562 --rc genhtml_function_coverage=1 00:15:51.562 --rc genhtml_legend=1 00:15:51.562 --rc geninfo_all_blocks=1 00:15:51.562 --rc geninfo_unexecuted_blocks=1 00:15:51.562 00:15:51.562 ' 00:15:51.562 01:10:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:51.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:51.562 --rc genhtml_branch_coverage=1 00:15:51.562 --rc genhtml_function_coverage=1 00:15:51.562 --rc genhtml_legend=1 00:15:51.562 --rc geninfo_all_blocks=1 00:15:51.562 --rc geninfo_unexecuted_blocks=1 00:15:51.562 00:15:51.562 ' 00:15:51.562 01:10:05 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:51.562 01:10:05 -- nvmf/common.sh@7 -- # uname -s 00:15:51.562 01:10:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:51.562 01:10:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:51.562 01:10:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:51.562 01:10:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:51.562 01:10:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:51.562 01:10:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:51.562 01:10:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:51.562 01:10:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:51.562 01:10:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:51.562 01:10:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:51.562 01:10:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:51.562 01:10:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:51.562 01:10:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:51.562 01:10:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:51.562 01:10:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:51.562 01:10:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:51.562 01:10:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:51.562 01:10:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:51.562 01:10:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:51.562 01:10:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:51.562 01:10:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:51.562 01:10:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:51.562 01:10:05 -- paths/export.sh@5 -- # export PATH 00:15:51.562 01:10:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:51.562 01:10:05 -- nvmf/common.sh@46 -- # : 0 00:15:51.562 01:10:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:51.562 01:10:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:51.562 01:10:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:51.562 01:10:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:51.562 01:10:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:51.562 01:10:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:51.562 01:10:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:51.562 01:10:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:51.562 01:10:05 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:15:51.562 01:10:05 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:15:51.562 01:10:05 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:15:51.562 01:10:05 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:51.562 01:10:05 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:15:51.562 01:10:05 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:15:51.562 01:10:05 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:15:51.562 01:10:05 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:15:51.562 01:10:05 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:15:51.562 01:10:05 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:15:51.562 01:10:05 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=2008891 00:15:51.562 01:10:05 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:15:51.562 01:10:05 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 2008891' 00:15:51.562 Process pid: 2008891 00:15:51.562 01:10:05 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:51.562 01:10:05 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 2008891 00:15:51.562 01:10:05 -- common/autotest_common.sh@829 -- # '[' -z 2008891 ']' 00:15:51.562 01:10:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:51.562 01:10:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:51.562 01:10:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:51.562 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:51.562 01:10:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:51.562 01:10:05 -- common/autotest_common.sh@10 -- # set +x 00:15:51.562 [2024-11-28 01:10:05.901690] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:51.562 [2024-11-28 01:10:05.901782] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:51.562 EAL: No free 2048 kB hugepages reported on node 1 00:15:51.562 [2024-11-28 01:10:05.964834] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:51.562 [2024-11-28 01:10:06.054813] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:51.562 [2024-11-28 01:10:06.054977] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:51.562 [2024-11-28 01:10:06.054995] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:51.562 [2024-11-28 01:10:06.055007] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:51.562 [2024-11-28 01:10:06.055153] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:51.562 [2024-11-28 01:10:06.055219] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:51.562 [2024-11-28 01:10:06.055284] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:51.562 [2024-11-28 01:10:06.055286] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:52.493 01:10:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:52.493 01:10:06 -- common/autotest_common.sh@862 -- # return 0 00:15:52.493 01:10:06 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:53.426 01:10:07 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:15:53.683 01:10:08 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:53.683 01:10:08 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:53.683 01:10:08 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:53.683 01:10:08 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:53.683 01:10:08 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:53.940 Malloc1 00:15:53.940 01:10:08 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:54.197 01:10:08 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:54.455 01:10:08 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:54.713 01:10:09 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:54.713 01:10:09 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:54.713 01:10:09 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:54.970 Malloc2 00:15:54.971 01:10:09 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:55.228 01:10:09 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:55.485 01:10:09 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:55.742 01:10:10 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:15:55.742 01:10:10 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:15:55.742 01:10:10 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:55.742 01:10:10 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:55.742 01:10:10 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:15:55.742 01:10:10 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:55.742 [2024-11-28 01:10:10.277082] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:55.742 [2024-11-28 01:10:10.277124] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2009460 ] 00:15:55.742 EAL: No free 2048 kB hugepages reported on node 1 00:15:55.742 [2024-11-28 01:10:10.312165] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:15:55.742 [2024-11-28 01:10:10.320130] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:55.742 [2024-11-28 01:10:10.320174] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7fc0112eb000 00:15:55.742 [2024-11-28 01:10:10.321105] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:55.742 [2024-11-28 01:10:10.322110] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:55.742 [2024-11-28 01:10:10.323111] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:55.742 [2024-11-28 01:10:10.324134] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:55.742 [2024-11-28 01:10:10.325124] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:55.742 [2024-11-28 01:10:10.326131] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:55.742 [2024-11-28 01:10:10.327133] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:55.742 [2024-11-28 01:10:10.328134] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:55.742 [2024-11-28 01:10:10.329143] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:55.742 [2024-11-28 01:10:10.329163] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7fc00ffe3000 00:15:55.742 [2024-11-28 01:10:10.330284] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:56.001 [2024-11-28 01:10:10.350467] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:15:56.001 [2024-11-28 01:10:10.350530] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:15:56.001 [2024-11-28 01:10:10.353309] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:56.001 [2024-11-28 01:10:10.353370] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:56.001 [2024-11-28 01:10:10.353473] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:15:56.001 [2024-11-28 01:10:10.353511] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:15:56.001 [2024-11-28 01:10:10.353545] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:15:56.001 [2024-11-28 01:10:10.354296] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:15:56.001 [2024-11-28 01:10:10.354315] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:15:56.001 [2024-11-28 01:10:10.354327] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:15:56.001 [2024-11-28 01:10:10.355316] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:56.001 [2024-11-28 01:10:10.355336] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:15:56.001 [2024-11-28 01:10:10.355351] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:15:56.001 [2024-11-28 01:10:10.356308] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:15:56.001 [2024-11-28 01:10:10.356325] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:56.001 [2024-11-28 01:10:10.357316] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:15:56.001 [2024-11-28 01:10:10.357334] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:15:56.001 [2024-11-28 01:10:10.357343] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:15:56.001 [2024-11-28 01:10:10.357354] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:56.001 [2024-11-28 01:10:10.357463] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:15:56.001 [2024-11-28 01:10:10.357472] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:56.001 [2024-11-28 01:10:10.357481] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:15:56.001 [2024-11-28 01:10:10.358323] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:15:56.001 [2024-11-28 01:10:10.359327] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:15:56.001 [2024-11-28 01:10:10.360332] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:56.001 [2024-11-28 01:10:10.361380] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:56.001 [2024-11-28 01:10:10.362348] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:15:56.001 [2024-11-28 01:10:10.362365] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:56.001 [2024-11-28 01:10:10.362374] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:15:56.001 [2024-11-28 01:10:10.362397] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:15:56.001 [2024-11-28 01:10:10.362410] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:15:56.001 [2024-11-28 01:10:10.362436] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:56.001 [2024-11-28 01:10:10.362445] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:56.001 [2024-11-28 01:10:10.362468] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:56.001 [2024-11-28 01:10:10.362556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:56.001 [2024-11-28 01:10:10.362577] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:15:56.001 [2024-11-28 01:10:10.362586] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:15:56.001 [2024-11-28 01:10:10.362593] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:15:56.001 [2024-11-28 01:10:10.362601] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:56.001 [2024-11-28 01:10:10.362610] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:15:56.001 [2024-11-28 01:10:10.362617] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:15:56.001 [2024-11-28 01:10:10.362625] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:15:56.001 [2024-11-28 01:10:10.362642] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:15:56.001 [2024-11-28 01:10:10.362659] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:56.001 [2024-11-28 01:10:10.362673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:56.001 [2024-11-28 01:10:10.362695] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:56.001 [2024-11-28 01:10:10.362708] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:56.001 [2024-11-28 01:10:10.362720] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:56.001 [2024-11-28 01:10:10.362731] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:56.001 [2024-11-28 01:10:10.362739] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:15:56.001 [2024-11-28 01:10:10.362754] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:56.001 [2024-11-28 01:10:10.362772] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:56.001 [2024-11-28 01:10:10.362801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:56.001 [2024-11-28 01:10:10.362813] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:15:56.001 [2024-11-28 01:10:10.362821] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:56.001 [2024-11-28 01:10:10.362832] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:15:56.001 [2024-11-28 01:10:10.362847] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:15:56.001 [2024-11-28 01:10:10.362861] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:56.001 [2024-11-28 01:10:10.362873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:56.001 [2024-11-28 01:10:10.362938] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:15:56.001 [2024-11-28 01:10:10.362952] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:15:56.001 [2024-11-28 01:10:10.362965] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:56.001 [2024-11-28 01:10:10.362973] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:56.001 [2024-11-28 01:10:10.362983] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:56.001 [2024-11-28 01:10:10.362999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:56.001 [2024-11-28 01:10:10.363025] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:15:56.002 [2024-11-28 01:10:10.363045] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:15:56.002 [2024-11-28 01:10:10.363060] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:15:56.002 [2024-11-28 01:10:10.363072] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:56.002 [2024-11-28 01:10:10.363080] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:56.002 [2024-11-28 01:10:10.363104] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:56.002 [2024-11-28 01:10:10.363133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:56.002 [2024-11-28 01:10:10.363170] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:56.002 [2024-11-28 01:10:10.363186] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:56.002 [2024-11-28 01:10:10.363197] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:56.002 [2024-11-28 01:10:10.363205] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:56.002 [2024-11-28 01:10:10.363218] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:56.002 [2024-11-28 01:10:10.363229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:56.002 [2024-11-28 01:10:10.363243] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:56.002 [2024-11-28 01:10:10.363254] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:15:56.002 [2024-11-28 01:10:10.363268] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:15:56.002 [2024-11-28 01:10:10.363278] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:56.002 [2024-11-28 01:10:10.363286] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:15:56.002 [2024-11-28 01:10:10.363294] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:15:56.002 [2024-11-28 01:10:10.363302] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:15:56.002 [2024-11-28 01:10:10.363309] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:15:56.002 [2024-11-28 01:10:10.363334] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:56.002 [2024-11-28 01:10:10.363352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:56.002 [2024-11-28 01:10:10.363371] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:56.002 [2024-11-28 01:10:10.363382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:56.002 [2024-11-28 01:10:10.363397] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:56.002 [2024-11-28 01:10:10.363407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:56.002 [2024-11-28 01:10:10.363422] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:56.002 [2024-11-28 01:10:10.363436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:56.002 [2024-11-28 01:10:10.363454] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:56.002 [2024-11-28 01:10:10.363462] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:56.002 [2024-11-28 01:10:10.363468] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:56.002 [2024-11-28 01:10:10.363473] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:56.002 [2024-11-28 01:10:10.363482] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:56.002 [2024-11-28 01:10:10.363493] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:56.002 [2024-11-28 01:10:10.363500] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:56.002 [2024-11-28 01:10:10.363533] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:56.002 [2024-11-28 01:10:10.363550] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:56.002 [2024-11-28 01:10:10.363559] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:56.002 [2024-11-28 01:10:10.363568] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:56.002 [2024-11-28 01:10:10.363580] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:56.002 [2024-11-28 01:10:10.363587] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:56.002 [2024-11-28 01:10:10.363596] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:56.002 [2024-11-28 01:10:10.363608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:56.002 [2024-11-28 01:10:10.363630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:56.002 [2024-11-28 01:10:10.363645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:56.002 [2024-11-28 01:10:10.363656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:56.002 ===================================================== 00:15:56.002 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:56.002 ===================================================== 00:15:56.002 Controller Capabilities/Features 00:15:56.002 ================================ 00:15:56.002 Vendor ID: 4e58 00:15:56.002 Subsystem Vendor ID: 4e58 00:15:56.002 Serial Number: SPDK1 00:15:56.002 Model Number: SPDK bdev Controller 00:15:56.002 Firmware Version: 24.01.1 00:15:56.002 Recommended Arb Burst: 6 00:15:56.002 IEEE OUI Identifier: 8d 6b 50 00:15:56.002 Multi-path I/O 00:15:56.002 May have multiple subsystem ports: Yes 00:15:56.002 May have multiple controllers: Yes 00:15:56.002 Associated with SR-IOV VF: No 00:15:56.002 Max Data Transfer Size: 131072 00:15:56.002 Max Number of Namespaces: 32 00:15:56.002 Max Number of I/O Queues: 127 00:15:56.002 NVMe Specification Version (VS): 1.3 00:15:56.002 NVMe Specification Version (Identify): 1.3 00:15:56.002 Maximum Queue Entries: 256 00:15:56.002 Contiguous Queues Required: Yes 00:15:56.002 Arbitration Mechanisms Supported 00:15:56.002 Weighted Round Robin: Not Supported 00:15:56.002 Vendor Specific: Not Supported 00:15:56.002 Reset Timeout: 15000 ms 00:15:56.002 Doorbell Stride: 4 bytes 00:15:56.002 NVM Subsystem Reset: Not Supported 00:15:56.002 Command Sets Supported 00:15:56.002 NVM Command Set: Supported 00:15:56.002 Boot Partition: Not Supported 00:15:56.002 Memory Page Size Minimum: 4096 bytes 00:15:56.002 Memory Page Size Maximum: 4096 bytes 00:15:56.002 Persistent Memory Region: Not Supported 00:15:56.002 Optional Asynchronous Events Supported 00:15:56.002 Namespace Attribute Notices: Supported 00:15:56.002 Firmware Activation Notices: Not Supported 00:15:56.002 ANA Change Notices: Not Supported 00:15:56.002 PLE Aggregate Log Change Notices: Not Supported 00:15:56.002 LBA Status Info Alert Notices: Not Supported 00:15:56.002 EGE Aggregate Log Change Notices: Not Supported 00:15:56.002 Normal NVM Subsystem Shutdown event: Not Supported 00:15:56.002 Zone Descriptor Change Notices: Not Supported 00:15:56.002 Discovery Log Change Notices: Not Supported 00:15:56.002 Controller Attributes 00:15:56.002 128-bit Host Identifier: Supported 00:15:56.002 Non-Operational Permissive Mode: Not Supported 00:15:56.002 NVM Sets: Not Supported 00:15:56.002 Read Recovery Levels: Not Supported 00:15:56.002 Endurance Groups: Not Supported 00:15:56.002 Predictable Latency Mode: Not Supported 00:15:56.002 Traffic Based Keep ALive: Not Supported 00:15:56.002 Namespace Granularity: Not Supported 00:15:56.002 SQ Associations: Not Supported 00:15:56.002 UUID List: Not Supported 00:15:56.002 Multi-Domain Subsystem: Not Supported 00:15:56.002 Fixed Capacity Management: Not Supported 00:15:56.002 Variable Capacity Management: Not Supported 00:15:56.002 Delete Endurance Group: Not Supported 00:15:56.002 Delete NVM Set: Not Supported 00:15:56.002 Extended LBA Formats Supported: Not Supported 00:15:56.002 Flexible Data Placement Supported: Not Supported 00:15:56.002 00:15:56.002 Controller Memory Buffer Support 00:15:56.002 ================================ 00:15:56.002 Supported: No 00:15:56.002 00:15:56.002 Persistent Memory Region Support 00:15:56.002 ================================ 00:15:56.002 Supported: No 00:15:56.002 00:15:56.002 Admin Command Set Attributes 00:15:56.002 ============================ 00:15:56.002 Security Send/Receive: Not Supported 00:15:56.002 Format NVM: Not Supported 00:15:56.002 Firmware Activate/Download: Not Supported 00:15:56.002 Namespace Management: Not Supported 00:15:56.002 Device Self-Test: Not Supported 00:15:56.002 Directives: Not Supported 00:15:56.002 NVMe-MI: Not Supported 00:15:56.002 Virtualization Management: Not Supported 00:15:56.002 Doorbell Buffer Config: Not Supported 00:15:56.002 Get LBA Status Capability: Not Supported 00:15:56.003 Command & Feature Lockdown Capability: Not Supported 00:15:56.003 Abort Command Limit: 4 00:15:56.003 Async Event Request Limit: 4 00:15:56.003 Number of Firmware Slots: N/A 00:15:56.003 Firmware Slot 1 Read-Only: N/A 00:15:56.003 Firmware Activation Without Reset: N/A 00:15:56.003 Multiple Update Detection Support: N/A 00:15:56.003 Firmware Update Granularity: No Information Provided 00:15:56.003 Per-Namespace SMART Log: No 00:15:56.003 Asymmetric Namespace Access Log Page: Not Supported 00:15:56.003 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:15:56.003 Command Effects Log Page: Supported 00:15:56.003 Get Log Page Extended Data: Supported 00:15:56.003 Telemetry Log Pages: Not Supported 00:15:56.003 Persistent Event Log Pages: Not Supported 00:15:56.003 Supported Log Pages Log Page: May Support 00:15:56.003 Commands Supported & Effects Log Page: Not Supported 00:15:56.003 Feature Identifiers & Effects Log Page:May Support 00:15:56.003 NVMe-MI Commands & Effects Log Page: May Support 00:15:56.003 Data Area 4 for Telemetry Log: Not Supported 00:15:56.003 Error Log Page Entries Supported: 128 00:15:56.003 Keep Alive: Supported 00:15:56.003 Keep Alive Granularity: 10000 ms 00:15:56.003 00:15:56.003 NVM Command Set Attributes 00:15:56.003 ========================== 00:15:56.003 Submission Queue Entry Size 00:15:56.003 Max: 64 00:15:56.003 Min: 64 00:15:56.003 Completion Queue Entry Size 00:15:56.003 Max: 16 00:15:56.003 Min: 16 00:15:56.003 Number of Namespaces: 32 00:15:56.003 Compare Command: Supported 00:15:56.003 Write Uncorrectable Command: Not Supported 00:15:56.003 Dataset Management Command: Supported 00:15:56.003 Write Zeroes Command: Supported 00:15:56.003 Set Features Save Field: Not Supported 00:15:56.003 Reservations: Not Supported 00:15:56.003 Timestamp: Not Supported 00:15:56.003 Copy: Supported 00:15:56.003 Volatile Write Cache: Present 00:15:56.003 Atomic Write Unit (Normal): 1 00:15:56.003 Atomic Write Unit (PFail): 1 00:15:56.003 Atomic Compare & Write Unit: 1 00:15:56.003 Fused Compare & Write: Supported 00:15:56.003 Scatter-Gather List 00:15:56.003 SGL Command Set: Supported (Dword aligned) 00:15:56.003 SGL Keyed: Not Supported 00:15:56.003 SGL Bit Bucket Descriptor: Not Supported 00:15:56.003 SGL Metadata Pointer: Not Supported 00:15:56.003 Oversized SGL: Not Supported 00:15:56.003 SGL Metadata Address: Not Supported 00:15:56.003 SGL Offset: Not Supported 00:15:56.003 Transport SGL Data Block: Not Supported 00:15:56.003 Replay Protected Memory Block: Not Supported 00:15:56.003 00:15:56.003 Firmware Slot Information 00:15:56.003 ========================= 00:15:56.003 Active slot: 1 00:15:56.003 Slot 1 Firmware Revision: 24.01.1 00:15:56.003 00:15:56.003 00:15:56.003 Commands Supported and Effects 00:15:56.003 ============================== 00:15:56.003 Admin Commands 00:15:56.003 -------------- 00:15:56.003 Get Log Page (02h): Supported 00:15:56.003 Identify (06h): Supported 00:15:56.003 Abort (08h): Supported 00:15:56.003 Set Features (09h): Supported 00:15:56.003 Get Features (0Ah): Supported 00:15:56.003 Asynchronous Event Request (0Ch): Supported 00:15:56.003 Keep Alive (18h): Supported 00:15:56.003 I/O Commands 00:15:56.003 ------------ 00:15:56.003 Flush (00h): Supported LBA-Change 00:15:56.003 Write (01h): Supported LBA-Change 00:15:56.003 Read (02h): Supported 00:15:56.003 Compare (05h): Supported 00:15:56.003 Write Zeroes (08h): Supported LBA-Change 00:15:56.003 Dataset Management (09h): Supported LBA-Change 00:15:56.003 Copy (19h): Supported LBA-Change 00:15:56.003 Unknown (79h): Supported LBA-Change 00:15:56.003 Unknown (7Ah): Supported 00:15:56.003 00:15:56.003 Error Log 00:15:56.003 ========= 00:15:56.003 00:15:56.003 Arbitration 00:15:56.003 =========== 00:15:56.003 Arbitration Burst: 1 00:15:56.003 00:15:56.003 Power Management 00:15:56.003 ================ 00:15:56.003 Number of Power States: 1 00:15:56.003 Current Power State: Power State #0 00:15:56.003 Power State #0: 00:15:56.003 Max Power: 0.00 W 00:15:56.003 Non-Operational State: Operational 00:15:56.003 Entry Latency: Not Reported 00:15:56.003 Exit Latency: Not Reported 00:15:56.003 Relative Read Throughput: 0 00:15:56.003 Relative Read Latency: 0 00:15:56.003 Relative Write Throughput: 0 00:15:56.003 Relative Write Latency: 0 00:15:56.003 Idle Power: Not Reported 00:15:56.003 Active Power: Not Reported 00:15:56.003 Non-Operational Permissive Mode: Not Supported 00:15:56.003 00:15:56.003 Health Information 00:15:56.003 ================== 00:15:56.003 Critical Warnings: 00:15:56.003 Available Spare Space: OK 00:15:56.003 Temperature: OK 00:15:56.003 Device Reliability: OK 00:15:56.003 Read Only: No 00:15:56.003 Volatile Memory Backup: OK 00:15:56.003 Current Temperature: 0 Kelvin[2024-11-28 01:10:10.363791] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:56.003 [2024-11-28 01:10:10.363823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:56.003 [2024-11-28 01:10:10.363863] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:15:56.003 [2024-11-28 01:10:10.363880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:56.003 [2024-11-28 01:10:10.363891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:56.003 [2024-11-28 01:10:10.363900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:56.003 [2024-11-28 01:10:10.363909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:56.003 [2024-11-28 01:10:10.366541] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:56.003 [2024-11-28 01:10:10.366565] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:15:56.003 [2024-11-28 01:10:10.367430] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:15:56.003 [2024-11-28 01:10:10.367443] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:15:56.003 [2024-11-28 01:10:10.368379] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:15:56.003 [2024-11-28 01:10:10.368402] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:15:56.003 [2024-11-28 01:10:10.368458] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:15:56.003 [2024-11-28 01:10:10.370423] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:56.003 (-273 Celsius) 00:15:56.003 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:56.003 Available Spare: 0% 00:15:56.003 Available Spare Threshold: 0% 00:15:56.003 Life Percentage Used: 0% 00:15:56.003 Data Units Read: 0 00:15:56.003 Data Units Written: 0 00:15:56.003 Host Read Commands: 0 00:15:56.003 Host Write Commands: 0 00:15:56.003 Controller Busy Time: 0 minutes 00:15:56.003 Power Cycles: 0 00:15:56.003 Power On Hours: 0 hours 00:15:56.003 Unsafe Shutdowns: 0 00:15:56.003 Unrecoverable Media Errors: 0 00:15:56.003 Lifetime Error Log Entries: 0 00:15:56.003 Warning Temperature Time: 0 minutes 00:15:56.003 Critical Temperature Time: 0 minutes 00:15:56.003 00:15:56.003 Number of Queues 00:15:56.003 ================ 00:15:56.003 Number of I/O Submission Queues: 127 00:15:56.003 Number of I/O Completion Queues: 127 00:15:56.003 00:15:56.003 Active Namespaces 00:15:56.003 ================= 00:15:56.003 Namespace ID:1 00:15:56.003 Error Recovery Timeout: Unlimited 00:15:56.003 Command Set Identifier: NVM (00h) 00:15:56.003 Deallocate: Supported 00:15:56.003 Deallocated/Unwritten Error: Not Supported 00:15:56.003 Deallocated Read Value: Unknown 00:15:56.003 Deallocate in Write Zeroes: Not Supported 00:15:56.003 Deallocated Guard Field: 0xFFFF 00:15:56.003 Flush: Supported 00:15:56.003 Reservation: Supported 00:15:56.003 Namespace Sharing Capabilities: Multiple Controllers 00:15:56.003 Size (in LBAs): 131072 (0GiB) 00:15:56.003 Capacity (in LBAs): 131072 (0GiB) 00:15:56.003 Utilization (in LBAs): 131072 (0GiB) 00:15:56.003 NGUID: EF5F1EC0D0DE40E7926CE0BFA9AD604B 00:15:56.003 UUID: ef5f1ec0-d0de-40e7-926c-e0bfa9ad604b 00:15:56.003 Thin Provisioning: Not Supported 00:15:56.003 Per-NS Atomic Units: Yes 00:15:56.003 Atomic Boundary Size (Normal): 0 00:15:56.003 Atomic Boundary Size (PFail): 0 00:15:56.003 Atomic Boundary Offset: 0 00:15:56.003 Maximum Single Source Range Length: 65535 00:15:56.003 Maximum Copy Length: 65535 00:15:56.003 Maximum Source Range Count: 1 00:15:56.003 NGUID/EUI64 Never Reused: No 00:15:56.003 Namespace Write Protected: No 00:15:56.003 Number of LBA Formats: 1 00:15:56.003 Current LBA Format: LBA Format #00 00:15:56.004 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:56.004 00:15:56.004 01:10:10 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:56.004 EAL: No free 2048 kB hugepages reported on node 1 00:16:01.266 Initializing NVMe Controllers 00:16:01.266 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:16:01.266 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:16:01.266 Initialization complete. Launching workers. 00:16:01.266 ======================================================== 00:16:01.266 Latency(us) 00:16:01.266 Device Information : IOPS MiB/s Average min max 00:16:01.266 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 37281.79 145.63 3432.65 1150.99 10487.42 00:16:01.266 ======================================================== 00:16:01.266 Total : 37281.79 145.63 3432.65 1150.99 10487.42 00:16:01.266 00:16:01.266 01:10:15 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:16:01.266 EAL: No free 2048 kB hugepages reported on node 1 00:16:06.527 Initializing NVMe Controllers 00:16:06.527 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:16:06.527 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:16:06.527 Initialization complete. Launching workers. 00:16:06.527 ======================================================== 00:16:06.527 Latency(us) 00:16:06.527 Device Information : IOPS MiB/s Average min max 00:16:06.527 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 16000.00 62.50 8008.23 6980.07 15979.54 00:16:06.527 ======================================================== 00:16:06.528 Total : 16000.00 62.50 8008.23 6980.07 15979.54 00:16:06.528 00:16:06.528 01:10:20 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:16:06.528 EAL: No free 2048 kB hugepages reported on node 1 00:16:11.792 Initializing NVMe Controllers 00:16:11.792 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:16:11.792 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:16:11.792 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:16:11.792 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:16:11.792 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:16:11.792 Initialization complete. Launching workers. 00:16:11.792 Starting thread on core 2 00:16:11.792 Starting thread on core 3 00:16:11.792 Starting thread on core 1 00:16:11.792 01:10:26 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:16:11.792 EAL: No free 2048 kB hugepages reported on node 1 00:16:15.076 Initializing NVMe Controllers 00:16:15.076 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:15.076 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:15.076 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:16:15.076 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:16:15.076 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:16:15.076 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:16:15.076 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:16:15.076 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:16:15.076 Initialization complete. Launching workers. 00:16:15.076 Starting thread on core 1 with urgent priority queue 00:16:15.076 Starting thread on core 2 with urgent priority queue 00:16:15.076 Starting thread on core 3 with urgent priority queue 00:16:15.076 Starting thread on core 0 with urgent priority queue 00:16:15.076 SPDK bdev Controller (SPDK1 ) core 0: 4798.67 IO/s 20.84 secs/100000 ios 00:16:15.076 SPDK bdev Controller (SPDK1 ) core 1: 5525.00 IO/s 18.10 secs/100000 ios 00:16:15.076 SPDK bdev Controller (SPDK1 ) core 2: 5776.33 IO/s 17.31 secs/100000 ios 00:16:15.076 SPDK bdev Controller (SPDK1 ) core 3: 5661.00 IO/s 17.66 secs/100000 ios 00:16:15.076 ======================================================== 00:16:15.076 00:16:15.076 01:10:29 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:16:15.076 EAL: No free 2048 kB hugepages reported on node 1 00:16:15.334 Initializing NVMe Controllers 00:16:15.334 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:15.334 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:15.334 Namespace ID: 1 size: 0GB 00:16:15.334 Initialization complete. 00:16:15.334 INFO: using host memory buffer for IO 00:16:15.334 Hello world! 00:16:15.334 01:10:29 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:16:15.592 EAL: No free 2048 kB hugepages reported on node 1 00:16:16.966 Initializing NVMe Controllers 00:16:16.966 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:16.966 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:16.966 Initialization complete. Launching workers. 00:16:16.966 submit (in ns) avg, min, max = 6929.2, 3444.4, 4022577.8 00:16:16.966 complete (in ns) avg, min, max = 26470.3, 2033.3, 4072998.9 00:16:16.966 00:16:16.966 Submit histogram 00:16:16.966 ================ 00:16:16.966 Range in us Cumulative Count 00:16:16.966 3.437 - 3.461: 0.1034% ( 14) 00:16:16.966 3.461 - 3.484: 0.4061% ( 41) 00:16:16.966 3.484 - 3.508: 1.6172% ( 164) 00:16:16.966 3.508 - 3.532: 4.7039% ( 418) 00:16:16.966 3.532 - 3.556: 10.8699% ( 835) 00:16:16.966 3.556 - 3.579: 19.1774% ( 1125) 00:16:16.966 3.579 - 3.603: 28.9322% ( 1321) 00:16:16.966 3.603 - 3.627: 38.0594% ( 1236) 00:16:16.966 3.627 - 3.650: 45.4733% ( 1004) 00:16:16.966 3.650 - 3.674: 50.0369% ( 618) 00:16:16.966 3.674 - 3.698: 53.7439% ( 502) 00:16:16.966 3.698 - 3.721: 57.6429% ( 528) 00:16:16.966 3.721 - 3.745: 61.0028% ( 455) 00:16:16.966 3.745 - 3.769: 64.5990% ( 487) 00:16:16.966 3.769 - 3.793: 68.5275% ( 532) 00:16:16.966 3.793 - 3.816: 73.0025% ( 606) 00:16:16.966 3.816 - 3.840: 77.3298% ( 586) 00:16:16.966 3.840 - 3.864: 81.2140% ( 526) 00:16:16.966 3.864 - 3.887: 83.5549% ( 317) 00:16:16.966 3.887 - 3.911: 85.3641% ( 245) 00:16:16.966 3.911 - 3.935: 86.8557% ( 202) 00:16:16.966 3.935 - 3.959: 87.9412% ( 147) 00:16:16.966 3.959 - 3.982: 88.8495% ( 123) 00:16:16.966 3.982 - 4.006: 90.0606% ( 164) 00:16:16.966 4.006 - 4.030: 90.9245% ( 117) 00:16:16.966 4.030 - 4.053: 91.9805% ( 143) 00:16:16.966 4.053 - 4.077: 92.6451% ( 90) 00:16:16.966 4.077 - 4.101: 93.2285% ( 79) 00:16:16.966 4.101 - 4.124: 93.6272% ( 54) 00:16:16.966 4.124 - 4.148: 93.9078% ( 38) 00:16:16.966 4.148 - 4.172: 94.1663% ( 35) 00:16:16.966 4.172 - 4.196: 94.4026% ( 32) 00:16:16.966 4.196 - 4.219: 94.5503% ( 20) 00:16:16.966 4.219 - 4.243: 94.6906% ( 19) 00:16:16.966 4.243 - 4.267: 94.8457% ( 21) 00:16:16.966 4.267 - 4.290: 95.0303% ( 25) 00:16:16.966 4.290 - 4.314: 95.1706% ( 19) 00:16:16.966 4.314 - 4.338: 95.2666% ( 13) 00:16:16.966 4.338 - 4.361: 95.3847% ( 16) 00:16:16.966 4.361 - 4.385: 95.4807% ( 13) 00:16:16.966 4.385 - 4.409: 95.6063% ( 17) 00:16:16.966 4.409 - 4.433: 95.7023% ( 13) 00:16:16.966 4.433 - 4.456: 95.8130% ( 15) 00:16:16.966 4.456 - 4.480: 95.9016% ( 12) 00:16:16.966 4.480 - 4.504: 95.9533% ( 7) 00:16:16.966 4.504 - 4.527: 96.0419% ( 12) 00:16:16.966 4.527 - 4.551: 96.0863% ( 6) 00:16:16.966 4.551 - 4.575: 96.1675% ( 11) 00:16:16.966 4.575 - 4.599: 96.2413% ( 10) 00:16:16.966 4.599 - 4.622: 96.3226% ( 11) 00:16:16.966 4.622 - 4.646: 96.3521% ( 4) 00:16:16.966 4.646 - 4.670: 96.4185% ( 9) 00:16:16.966 4.670 - 4.693: 96.4555% ( 5) 00:16:16.966 4.693 - 4.717: 96.5145% ( 8) 00:16:16.966 4.717 - 4.741: 96.5589% ( 6) 00:16:16.966 4.741 - 4.764: 96.6253% ( 9) 00:16:16.966 4.764 - 4.788: 96.6844% ( 8) 00:16:16.966 4.788 - 4.812: 96.7656% ( 11) 00:16:16.966 4.812 - 4.836: 96.8321% ( 9) 00:16:16.966 4.836 - 4.859: 96.9207% ( 12) 00:16:16.966 4.859 - 4.883: 96.9945% ( 10) 00:16:16.966 4.883 - 4.907: 97.0388% ( 6) 00:16:16.966 4.907 - 4.930: 97.1127% ( 10) 00:16:16.966 4.930 - 4.954: 97.1570% ( 6) 00:16:16.966 4.954 - 4.978: 97.2161% ( 8) 00:16:16.966 4.978 - 5.001: 97.2825% ( 9) 00:16:16.966 5.001 - 5.025: 97.3268% ( 6) 00:16:16.966 5.025 - 5.049: 97.3785% ( 7) 00:16:16.966 5.049 - 5.073: 97.4228% ( 6) 00:16:16.966 5.073 - 5.096: 97.4745% ( 7) 00:16:16.966 5.096 - 5.120: 97.5041% ( 4) 00:16:16.966 5.120 - 5.144: 97.5336% ( 4) 00:16:16.966 5.144 - 5.167: 97.5631% ( 4) 00:16:16.966 5.167 - 5.191: 97.5779% ( 2) 00:16:16.966 5.191 - 5.215: 97.6001% ( 3) 00:16:16.966 5.215 - 5.239: 97.6518% ( 7) 00:16:16.966 5.239 - 5.262: 97.6813% ( 4) 00:16:16.966 5.262 - 5.286: 97.7034% ( 3) 00:16:16.966 5.286 - 5.310: 97.7182% ( 2) 00:16:16.966 5.310 - 5.333: 97.7330% ( 2) 00:16:16.966 5.333 - 5.357: 97.7404% ( 1) 00:16:16.966 5.357 - 5.381: 97.7625% ( 3) 00:16:16.966 5.404 - 5.428: 97.7699% ( 1) 00:16:16.966 5.476 - 5.499: 97.7847% ( 2) 00:16:16.966 5.499 - 5.523: 97.7994% ( 2) 00:16:16.966 5.523 - 5.547: 97.8068% ( 1) 00:16:16.966 5.594 - 5.618: 97.8142% ( 1) 00:16:16.966 5.665 - 5.689: 97.8216% ( 1) 00:16:16.966 5.736 - 5.760: 97.8290% ( 1) 00:16:16.966 5.760 - 5.784: 97.8364% ( 1) 00:16:16.966 5.831 - 5.855: 97.8437% ( 1) 00:16:16.966 5.855 - 5.879: 97.8511% ( 1) 00:16:16.966 5.950 - 5.973: 97.8585% ( 1) 00:16:16.966 5.997 - 6.021: 97.8659% ( 1) 00:16:16.966 6.021 - 6.044: 97.8733% ( 1) 00:16:16.966 6.044 - 6.068: 97.8807% ( 1) 00:16:16.966 6.068 - 6.116: 97.8881% ( 1) 00:16:16.966 6.163 - 6.210: 97.8954% ( 1) 00:16:16.966 6.258 - 6.305: 97.9028% ( 1) 00:16:16.966 6.305 - 6.353: 97.9102% ( 1) 00:16:16.966 6.400 - 6.447: 97.9176% ( 1) 00:16:16.966 6.495 - 6.542: 97.9250% ( 1) 00:16:16.966 6.542 - 6.590: 97.9324% ( 1) 00:16:16.966 6.590 - 6.637: 97.9471% ( 2) 00:16:16.966 6.637 - 6.684: 97.9545% ( 1) 00:16:16.966 6.969 - 7.016: 97.9619% ( 1) 00:16:16.966 7.016 - 7.064: 97.9693% ( 1) 00:16:16.966 7.159 - 7.206: 97.9767% ( 1) 00:16:16.966 7.206 - 7.253: 97.9840% ( 1) 00:16:16.966 7.396 - 7.443: 97.9988% ( 2) 00:16:16.966 7.443 - 7.490: 98.0062% ( 1) 00:16:16.966 7.490 - 7.538: 98.0136% ( 1) 00:16:16.966 7.538 - 7.585: 98.0284% ( 2) 00:16:16.966 7.585 - 7.633: 98.0357% ( 1) 00:16:16.966 7.775 - 7.822: 98.0431% ( 1) 00:16:16.966 7.822 - 7.870: 98.0579% ( 2) 00:16:16.966 7.917 - 7.964: 98.0653% ( 1) 00:16:16.966 7.964 - 8.012: 98.0727% ( 1) 00:16:16.966 8.059 - 8.107: 98.0800% ( 1) 00:16:16.966 8.154 - 8.201: 98.0948% ( 2) 00:16:16.966 8.201 - 8.249: 98.1096% ( 2) 00:16:16.966 8.249 - 8.296: 98.1170% ( 1) 00:16:16.966 8.296 - 8.344: 98.1244% ( 1) 00:16:16.967 8.344 - 8.391: 98.1391% ( 2) 00:16:16.967 8.439 - 8.486: 98.1539% ( 2) 00:16:16.967 8.486 - 8.533: 98.1613% ( 1) 00:16:16.967 8.581 - 8.628: 98.1687% ( 1) 00:16:16.967 8.723 - 8.770: 98.1760% ( 1) 00:16:16.967 8.770 - 8.818: 98.1834% ( 1) 00:16:16.967 8.818 - 8.865: 98.1908% ( 1) 00:16:16.967 9.007 - 9.055: 98.1982% ( 1) 00:16:16.967 9.102 - 9.150: 98.2056% ( 1) 00:16:16.967 9.150 - 9.197: 98.2130% ( 1) 00:16:16.967 9.197 - 9.244: 98.2204% ( 1) 00:16:16.967 9.576 - 9.624: 98.2351% ( 2) 00:16:16.967 9.719 - 9.766: 98.2425% ( 1) 00:16:16.967 9.813 - 9.861: 98.2499% ( 1) 00:16:16.967 9.861 - 9.908: 98.2573% ( 1) 00:16:16.967 9.956 - 10.003: 98.2720% ( 2) 00:16:16.967 10.050 - 10.098: 98.2794% ( 1) 00:16:16.967 10.098 - 10.145: 98.2868% ( 1) 00:16:16.967 10.335 - 10.382: 98.2942% ( 1) 00:16:16.967 10.524 - 10.572: 98.3090% ( 2) 00:16:16.967 10.572 - 10.619: 98.3237% ( 2) 00:16:16.967 10.619 - 10.667: 98.3533% ( 4) 00:16:16.967 10.761 - 10.809: 98.3607% ( 1) 00:16:16.967 10.904 - 10.951: 98.3680% ( 1) 00:16:16.967 11.093 - 11.141: 98.3902% ( 3) 00:16:16.967 11.188 - 11.236: 98.3976% ( 1) 00:16:16.967 11.283 - 11.330: 98.4271% ( 4) 00:16:16.967 11.330 - 11.378: 98.4345% ( 1) 00:16:16.967 11.378 - 11.425: 98.4419% ( 1) 00:16:16.967 11.473 - 11.520: 98.4567% ( 2) 00:16:16.967 11.520 - 11.567: 98.4640% ( 1) 00:16:16.967 11.615 - 11.662: 98.4714% ( 1) 00:16:16.967 11.710 - 11.757: 98.4788% ( 1) 00:16:16.967 11.899 - 11.947: 98.4862% ( 1) 00:16:16.967 11.947 - 11.994: 98.4936% ( 1) 00:16:16.967 12.136 - 12.231: 98.5010% ( 1) 00:16:16.967 12.421 - 12.516: 98.5157% ( 2) 00:16:16.967 12.516 - 12.610: 98.5231% ( 1) 00:16:16.967 12.705 - 12.800: 98.5305% ( 1) 00:16:16.967 12.895 - 12.990: 98.5379% ( 1) 00:16:16.967 12.990 - 13.084: 98.5453% ( 1) 00:16:16.967 13.084 - 13.179: 98.5527% ( 1) 00:16:16.967 13.179 - 13.274: 98.5600% ( 1) 00:16:16.967 13.274 - 13.369: 98.5748% ( 2) 00:16:16.967 13.369 - 13.464: 98.5822% ( 1) 00:16:16.967 13.748 - 13.843: 98.5896% ( 1) 00:16:16.967 13.938 - 14.033: 98.5970% ( 1) 00:16:16.967 14.127 - 14.222: 98.6043% ( 1) 00:16:16.967 14.222 - 14.317: 98.6117% ( 1) 00:16:16.967 14.317 - 14.412: 98.6265% ( 2) 00:16:16.967 14.412 - 14.507: 98.6339% ( 1) 00:16:16.967 14.507 - 14.601: 98.6486% ( 2) 00:16:16.967 14.601 - 14.696: 98.6634% ( 2) 00:16:16.967 14.696 - 14.791: 98.6782% ( 2) 00:16:16.967 14.791 - 14.886: 98.6930% ( 2) 00:16:16.967 15.076 - 15.170: 98.7077% ( 2) 00:16:16.967 15.170 - 15.265: 98.7151% ( 1) 00:16:16.967 15.360 - 15.455: 98.7225% ( 1) 00:16:16.967 16.877 - 16.972: 98.7299% ( 1) 00:16:16.967 17.067 - 17.161: 98.7446% ( 2) 00:16:16.967 17.256 - 17.351: 98.7668% ( 3) 00:16:16.967 17.351 - 17.446: 98.8111% ( 6) 00:16:16.967 17.541 - 17.636: 98.8554% ( 6) 00:16:16.967 17.636 - 17.730: 98.9514% ( 13) 00:16:16.967 17.730 - 17.825: 99.0031% ( 7) 00:16:16.967 17.825 - 17.920: 99.0474% ( 6) 00:16:16.967 17.920 - 18.015: 99.1065% ( 8) 00:16:16.967 18.015 - 18.110: 99.1729% ( 9) 00:16:16.967 18.110 - 18.204: 99.2320% ( 8) 00:16:16.967 18.204 - 18.299: 99.3280% ( 13) 00:16:16.967 18.299 - 18.394: 99.4019% ( 10) 00:16:16.967 18.394 - 18.489: 99.4757% ( 10) 00:16:16.967 18.489 - 18.584: 99.5274% ( 7) 00:16:16.967 18.584 - 18.679: 99.5717% ( 6) 00:16:16.967 18.679 - 18.773: 99.5865% ( 2) 00:16:16.967 18.773 - 18.868: 99.6455% ( 8) 00:16:16.967 18.868 - 18.963: 99.6751% ( 4) 00:16:16.967 18.963 - 19.058: 99.6972% ( 3) 00:16:16.967 19.058 - 19.153: 99.7489% ( 7) 00:16:16.967 19.153 - 19.247: 99.7711% ( 3) 00:16:16.967 19.247 - 19.342: 99.7932% ( 3) 00:16:16.967 19.342 - 19.437: 99.8080% ( 2) 00:16:16.967 19.721 - 19.816: 99.8228% ( 2) 00:16:16.967 20.101 - 20.196: 99.8375% ( 2) 00:16:16.967 20.670 - 20.764: 99.8449% ( 1) 00:16:16.967 21.428 - 21.523: 99.8523% ( 1) 00:16:16.967 21.902 - 21.997: 99.8597% ( 1) 00:16:16.967 22.187 - 22.281: 99.8671% ( 1) 00:16:16.967 22.376 - 22.471: 99.8745% ( 1) 00:16:16.967 22.850 - 22.945: 99.8818% ( 1) 00:16:16.967 23.324 - 23.419: 99.8892% ( 1) 00:16:16.967 23.609 - 23.704: 99.8966% ( 1) 00:16:16.967 24.273 - 24.462: 99.9040% ( 1) 00:16:16.967 27.117 - 27.307: 99.9114% ( 1) 00:16:16.967 28.065 - 28.255: 99.9188% ( 1) 00:16:16.967 35.081 - 35.271: 99.9262% ( 1) 00:16:16.967 3980.705 - 4004.978: 99.9852% ( 8) 00:16:16.967 4004.978 - 4029.250: 100.0000% ( 2) 00:16:16.967 00:16:16.967 Complete histogram 00:16:16.967 ================== 00:16:16.967 Range in us Cumulative Count 00:16:16.967 2.027 - 2.039: 0.1920% ( 26) 00:16:16.967 2.039 - 2.050: 10.8034% ( 1437) 00:16:16.967 2.050 - 2.062: 17.5380% ( 912) 00:16:16.967 2.062 - 2.074: 21.1564% ( 490) 00:16:16.967 2.074 - 2.086: 47.8068% ( 3609) 00:16:16.967 2.086 - 2.098: 56.4983% ( 1177) 00:16:16.967 2.098 - 2.110: 58.5069% ( 272) 00:16:16.967 2.110 - 2.121: 62.5978% ( 554) 00:16:16.967 2.121 - 2.133: 63.6095% ( 137) 00:16:16.967 2.133 - 2.145: 67.4273% ( 517) 00:16:16.967 2.145 - 2.157: 75.8381% ( 1139) 00:16:16.967 2.157 - 2.169: 77.6916% ( 251) 00:16:16.967 2.169 - 2.181: 79.4417% ( 237) 00:16:16.967 2.181 - 2.193: 82.1444% ( 366) 00:16:16.967 2.193 - 2.204: 82.9936% ( 115) 00:16:16.967 2.204 - 2.216: 85.4527% ( 333) 00:16:16.967 2.216 - 2.228: 90.4224% ( 673) 00:16:16.967 2.228 - 2.240: 91.4710% ( 142) 00:16:16.967 2.240 - 2.252: 92.0543% ( 79) 00:16:16.967 2.252 - 2.264: 92.4310% ( 51) 00:16:16.967 2.264 - 2.276: 92.7263% ( 40) 00:16:16.967 2.276 - 2.287: 93.2137% ( 66) 00:16:16.967 2.287 - 2.299: 93.4352% ( 30) 00:16:16.967 2.299 - 2.311: 93.5682% ( 18) 00:16:16.967 2.311 - 2.323: 93.7011% ( 18) 00:16:16.967 2.323 - 2.335: 93.8340% ( 18) 00:16:16.967 2.335 - 2.347: 94.0038% ( 23) 00:16:16.967 2.347 - 2.359: 94.1737% ( 23) 00:16:16.967 2.359 - 2.370: 94.4617% ( 39) 00:16:16.967 2.370 - 2.382: 94.6758% ( 29) 00:16:16.967 2.382 - 2.394: 94.8826% ( 28) 00:16:16.967 2.394 - 2.406: 95.0450% ( 22) 00:16:16.967 2.406 - 2.418: 95.1853% ( 19) 00:16:16.967 2.418 - 2.430: 95.3404% ( 21) 00:16:16.967 2.430 - 2.441: 95.5398% ( 27) 00:16:16.967 2.441 - 2.453: 95.6875% ( 20) 00:16:16.967 2.453 - 2.465: 95.8573% ( 23) 00:16:16.967 2.465 - 2.477: 95.9903% ( 18) 00:16:16.967 2.477 - 2.489: 96.0863% ( 13) 00:16:16.967 2.489 - 2.501: 96.2635% ( 24) 00:16:16.967 2.501 - 2.513: 96.3816% ( 16) 00:16:16.967 2.513 - 2.524: 96.4555% ( 10) 00:16:16.967 2.524 - 2.536: 96.5810% ( 17) 00:16:16.967 2.536 - 2.548: 96.6696% ( 12) 00:16:16.967 2.548 - 2.560: 96.7582% ( 12) 00:16:16.967 2.560 - 2.572: 96.8395% ( 11) 00:16:16.967 2.572 - 2.584: 96.8912% ( 7) 00:16:16.967 2.584 - 2.596: 96.9502% ( 8) 00:16:16.967 2.596 - 2.607: 96.9945% ( 6) 00:16:16.967 2.607 - 2.619: 97.0536% ( 8) 00:16:16.967 2.619 - 2.631: 97.0758% ( 3) 00:16:16.967 2.631 - 2.643: 97.1348% ( 8) 00:16:16.967 2.643 - 2.655: 97.2087% ( 10) 00:16:16.967 2.667 - 2.679: 97.2456% ( 5) 00:16:16.967 2.679 - 2.690: 97.2825% ( 5) 00:16:16.967 2.690 - 2.702: 97.2899% ( 1) 00:16:16.967 2.702 - 2.714: 97.3268% ( 5) 00:16:16.967 2.714 - 2.726: 97.3564% ( 4) 00:16:16.967 2.726 - 2.738: 97.3785% ( 3) 00:16:16.967 2.738 - 2.750: 97.4450% ( 9) 00:16:16.967 2.750 - 2.761: 97.4745% ( 4) 00:16:16.967 2.761 - 2.773: 97.4893% ( 2) 00:16:16.967 2.773 - 2.785: 97.5114% ( 3) 00:16:16.967 2.785 - 2.797: 97.5336% ( 3) 00:16:16.967 2.797 - 2.809: 97.5558% ( 3) 00:16:16.967 2.809 - 2.821: 97.6001% ( 6) 00:16:16.967 2.821 - 2.833: 97.6296% ( 4) 00:16:16.967 2.833 - 2.844: 97.6739% ( 6) 00:16:16.967 2.844 - 2.856: 97.6961% ( 3) 00:16:16.967 2.856 - 2.868: 97.7108% ( 2) 00:16:16.967 2.868 - 2.880: 97.7182% ( 1) 00:16:16.967 2.880 - 2.892: 97.7551% ( 5) 00:16:16.967 2.892 - 2.904: 97.7699% ( 2) 00:16:16.967 2.904 - 2.916: 97.7773% ( 1) 00:16:16.967 2.916 - 2.927: 97.7994% ( 3) 00:16:16.967 2.927 - 2.939: 97.8142% ( 2) 00:16:16.967 2.939 - 2.951: 97.8364% ( 3) 00:16:16.967 2.951 - 2.963: 97.8585% ( 3) 00:16:16.967 2.963 - 2.975: 97.8807% ( 3) 00:16:16.967 2.975 - 2.987: 97.9028% ( 3) 00:16:16.967 2.987 - 2.999: 97.9102% ( 1) 00:16:16.967 2.999 - 3.010: 97.9545% ( 6) 00:16:16.967 3.010 - 3.022: 97.9693% ( 2) 00:16:16.967 3.022 - 3.034: 97.9840% ( 2) 00:16:16.967 3.058 - 3.081: 98.0062% ( 3) 00:16:16.967 3.081 - 3.105: 98.0284% ( 3) 00:16:16.967 3.105 - 3.129: 98.0431% ( 2) 00:16:16.967 3.129 - 3.153: 98.0653% ( 3) 00:16:16.968 3.176 - 3.200: 98.1022% ( 5) 00:16:16.968 3.200 - 3.224: 98.1391% ( 5) 00:16:16.968 3.224 - 3.247: 98.1465% ( 1) 00:16:16.968 3.247 - 3.271: 98.1613% ( 2) 00:16:16.968 3.271 - 3.295: 98.1908% ( 4) 00:16:16.968 3.295 - 3.319: 98.1982% ( 1) 00:16:16.968 3.319 - 3.342: 98.2277% ( 4) 00:16:16.968 3.342 - 3.366: 98.2351% ( 1) 00:16:16.968 3.366 - 3.390: 98.2573% ( 3) 00:16:16.968 3.390 - 3.413: 98.2720% ( 2) 00:16:16.968 3.413 - 3.437: 98.2794% ( 1) 00:16:16.968 3.437 - 3.461: 98.3016% ( 3) 00:16:16.968 3.461 - 3.484: 98.3163% ( 2) 00:16:16.968 3.484 - 3.508: 98.3237% ( 1) 00:16:16.968 3.508 - 3.532: 98.3385% ( 2) 00:16:16.968 3.532 - 3.556: 98.3459% ( 1) 00:16:16.968 3.556 - 3.579: 98.3680% ( 3) 00:16:16.968 3.579 - 3.603: 98.3754% ( 1) 00:16:16.968 3.650 - 3.674: 98.3828% ( 1) 00:16:16.968 3.674 - 3.698: 98.3902% ( 1) 00:16:16.968 3.698 - 3.721: 98.3976% ( 1) 00:16:16.968 3.721 - 3.745: 98.4050% ( 1) 00:16:16.968 3.745 - 3.769: 98.4197% ( 2) 00:16:16.968 3.887 - 3.911: 98.4419% ( 3) 00:16:16.968 3.911 - 3.935: 98.4493% ( 1) 00:16:16.968 4.006 - 4.030: 98.4567% ( 1) 00:16:16.968 4.124 - 4.148: 98.4640% ( 1) 00:16:16.968 4.219 - 4.243: 98.4714% ( 1) 00:16:16.968 4.338 - 4.361: 98.4788% ( 1) 00:16:16.968 4.504 - 4.527: 98.4862% ( 1) 00:16:16.968 5.333 - 5.357: 98.4936% ( 1) 00:16:16.968 5.452 - 5.476: 98.5010% ( 1) 00:16:16.968 5.476 - 5.499: 98.5083% ( 1) 00:16:16.968 5.665 - 5.689: 98.5157% ( 1) 00:16:16.968 5.689 - 5.713: 98.5231% ( 1) 00:16:16.968 5.760 - 5.784: 98.5305% ( 1) 00:16:16.968 5.831 - 5.855: 98.5379% ( 1) 00:16:16.968 6.353 - 6.400: 98.5453% ( 1) 00:16:16.968 6.542 - 6.590: 98.5527% ( 1) 00:16:16.968 6.590 - 6.637: 98.5600% ( 1) 00:16:16.968 6.637 - 6.684: 98.5674% ( 1) 00:16:16.968 6.732 - 6.779: 98.5748% ( 1) 00:16:16.968 6.874 - 6.921: 98.5822% ( 1) 00:16:16.968 6.969 - 7.016: 98.5896% ( 1) 00:16:16.968 7.064 - 7.111: 98.5970% ( 1) 00:16:16.968 7.443 - 7.490: 98.6043% ( 1) 00:16:16.968 7.538 - 7.585: 98.6191% ( 2) 00:16:16.968 7.585 - 7.633: 98.6265% ( 1) 00:16:16.968 7.822 - 7.870: 98.6339% ( 1) 00:16:16.968 8.107 - 8.154: 98.6413% ( 1) 00:16:16.968 8.296 - 8.344: 98.6486% ( 1) 00:16:16.968 8.533 - 8.581: 98.6560% ( 1) 00:16:16.968 8.913 - 8.960: 98.6634% ( 1) 00:16:16.968 9.766 - 9.813: 98.6708% ( 1) 00:16:16.968 9.861 - 9.908: 98.6782% ( 1) 00:16:16.968 10.524 - 10.572: 98.6856% ( 1) 00:16:16.968 10.572 - 10.619: 98.6930% ( 1) 00:16:16.968 10.761 - 10.809: 98.7003% ( 1) 00:16:16.968 10.999 - 11.046: 98.7077% ( 1) 00:16:16.968 11.093 - 11.141: 98.7151% ( 1) 00:16:16.968 12.705 - 12.800: 98.7225% ( 1) 00:16:16.968 15.455 - 15.550: 98.7373% ( 2) 00:16:16.968 15.550 - 15.644: 98.7594% ( 3) 00:16:16.968 15.644 - 15.739: 98.7742% ( 2) 00:16:16.968 15.739 - 15.834: 98.7890% ( 2) 00:16:16.968 15.834 - 15.929: 98.8037% ( 2) 00:16:16.968 15.929 - 16.024: 98.8406% ( 5) 00:16:16.968 16.024 - 16.119: 98.8702% ( 4) 00:16:16.968 16.119 - 16.213: 98.8923% ( 3) 00:16:16.968 16.213 - 16.308: 98.9219% ( 4) 00:16:16.968 16.308 - 16.403: 98.9366% ( 2) 00:16:16.968 16.403 - 16.498: 98.9957% ( 8) 00:16:16.968 16.498 - 16.593: 99.0769% ( 11) 00:16:16.968 16.593 - 16.687: 99.1139% ( 5) 00:16:16.968 16.687 - 16.782: 99.1803% ( 9) 00:16:16.968 16.782 - 16.877: 99.2173% ( 5) 00:16:16.968 16.877 - 16.972: 99.2320% ( 2) 00:16:16.968 16.972 - 17.067: 99.2542% ( 3) 00:16:16.968 17.067 - 17.161: 99.2689% ( 2) 00:16:16.968 17.161 - 17.256: 99.2763% ( 1) 00:16:16.968 17.256 - 17.351: 99.2837% ( 1) 00:16:16.968 17.351 - 17.446: 99.2985% ( 2) 00:16:16.968 17.446 - 17.541: 99.3132% ( 2) 00:16:16.968 17.541 - 17.636: 99.3206% ( 1) 00:16:16.968 18.110 - 18.204: 99.3280% ( 1) 00:16:16.968 18.299 - 18.394: 99.3354% ( 1) 00:16:16.968 18.773 - 18.868: 99.3428% ( 1) 00:16:16.968 21.333 - 21.428: 99.3502% ( 1) 00:16:16.968 23.040 - 23.135: 99.3576% ( 1) 00:16:16.968 23.704 - 23.799: 99.3723% ( 2) 00:16:16.968 23.799 - 23.893: 99.3797% ( 1) 00:16:16.968 39.253 - 39.443: 99.3871% ( 1) 00:16:16.968 819.200 - 825.268: 99.3945% ( 1) 00:16:16.968 2997.665 - 3009.801: 99.4019% ( 1) 00:16:16.968 3980.705 - 4004.978: 99.8745% ( 64) 00:16:16.968 4004.978 - 4029.250: 99.9852% ( 15) 00:16:16.968 4029.250 - 4053.523: 99.9926% ( 1) 00:16:16.968 4053.523 - 4077.796: 100.0000% ( 1) 00:16:16.968 00:16:16.968 01:10:31 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:16:16.968 01:10:31 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:16:16.968 01:10:31 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:16:16.968 01:10:31 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:16:16.968 01:10:31 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:16.968 [2024-11-28 01:10:31.494085] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:16:16.968 [ 00:16:16.968 { 00:16:16.968 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:16.968 "subtype": "Discovery", 00:16:16.968 "listen_addresses": [], 00:16:16.968 "allow_any_host": true, 00:16:16.968 "hosts": [] 00:16:16.968 }, 00:16:16.968 { 00:16:16.968 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:16.968 "subtype": "NVMe", 00:16:16.968 "listen_addresses": [ 00:16:16.968 { 00:16:16.968 "transport": "VFIOUSER", 00:16:16.968 "trtype": "VFIOUSER", 00:16:16.968 "adrfam": "IPv4", 00:16:16.968 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:16.968 "trsvcid": "0" 00:16:16.968 } 00:16:16.968 ], 00:16:16.968 "allow_any_host": true, 00:16:16.968 "hosts": [], 00:16:16.968 "serial_number": "SPDK1", 00:16:16.968 "model_number": "SPDK bdev Controller", 00:16:16.968 "max_namespaces": 32, 00:16:16.968 "min_cntlid": 1, 00:16:16.968 "max_cntlid": 65519, 00:16:16.968 "namespaces": [ 00:16:16.968 { 00:16:16.968 "nsid": 1, 00:16:16.968 "bdev_name": "Malloc1", 00:16:16.968 "name": "Malloc1", 00:16:16.968 "nguid": "EF5F1EC0D0DE40E7926CE0BFA9AD604B", 00:16:16.968 "uuid": "ef5f1ec0-d0de-40e7-926c-e0bfa9ad604b" 00:16:16.968 } 00:16:16.968 ] 00:16:16.968 }, 00:16:16.968 { 00:16:16.968 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:16.968 "subtype": "NVMe", 00:16:16.968 "listen_addresses": [ 00:16:16.968 { 00:16:16.968 "transport": "VFIOUSER", 00:16:16.968 "trtype": "VFIOUSER", 00:16:16.968 "adrfam": "IPv4", 00:16:16.968 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:16.968 "trsvcid": "0" 00:16:16.968 } 00:16:16.968 ], 00:16:16.968 "allow_any_host": true, 00:16:16.968 "hosts": [], 00:16:16.968 "serial_number": "SPDK2", 00:16:16.968 "model_number": "SPDK bdev Controller", 00:16:16.968 "max_namespaces": 32, 00:16:16.968 "min_cntlid": 1, 00:16:16.968 "max_cntlid": 65519, 00:16:16.968 "namespaces": [ 00:16:16.968 { 00:16:16.968 "nsid": 1, 00:16:16.968 "bdev_name": "Malloc2", 00:16:16.968 "name": "Malloc2", 00:16:16.968 "nguid": "C600549DF57B4530A04D98B19B171165", 00:16:16.968 "uuid": "c600549d-f57b-4530-a04d-98b19b171165" 00:16:16.968 } 00:16:16.968 ] 00:16:16.968 } 00:16:16.968 ] 00:16:16.968 01:10:31 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:16:16.968 01:10:31 -- target/nvmf_vfio_user.sh@34 -- # aerpid=2012048 00:16:16.968 01:10:31 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:16:16.968 01:10:31 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:16:16.968 01:10:31 -- common/autotest_common.sh@1254 -- # local i=0 00:16:16.968 01:10:31 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:16.968 01:10:31 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:16.968 01:10:31 -- common/autotest_common.sh@1265 -- # return 0 00:16:16.968 01:10:31 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:16:16.968 01:10:31 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:16:16.968 EAL: No free 2048 kB hugepages reported on node 1 00:16:17.226 Malloc3 00:16:17.226 01:10:31 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:16:17.483 01:10:32 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:17.483 Asynchronous Event Request test 00:16:17.483 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:17.483 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:17.483 Registering asynchronous event callbacks... 00:16:17.483 Starting namespace attribute notice tests for all controllers... 00:16:17.483 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:16:17.483 aer_cb - Changed Namespace 00:16:17.483 Cleaning up... 00:16:17.741 [ 00:16:17.741 { 00:16:17.741 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:17.741 "subtype": "Discovery", 00:16:17.741 "listen_addresses": [], 00:16:17.741 "allow_any_host": true, 00:16:17.741 "hosts": [] 00:16:17.741 }, 00:16:17.741 { 00:16:17.741 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:17.741 "subtype": "NVMe", 00:16:17.741 "listen_addresses": [ 00:16:17.741 { 00:16:17.741 "transport": "VFIOUSER", 00:16:17.741 "trtype": "VFIOUSER", 00:16:17.741 "adrfam": "IPv4", 00:16:17.741 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:17.741 "trsvcid": "0" 00:16:17.741 } 00:16:17.741 ], 00:16:17.741 "allow_any_host": true, 00:16:17.741 "hosts": [], 00:16:17.741 "serial_number": "SPDK1", 00:16:17.741 "model_number": "SPDK bdev Controller", 00:16:17.741 "max_namespaces": 32, 00:16:17.741 "min_cntlid": 1, 00:16:17.741 "max_cntlid": 65519, 00:16:17.741 "namespaces": [ 00:16:17.741 { 00:16:17.741 "nsid": 1, 00:16:17.741 "bdev_name": "Malloc1", 00:16:17.741 "name": "Malloc1", 00:16:17.741 "nguid": "EF5F1EC0D0DE40E7926CE0BFA9AD604B", 00:16:17.741 "uuid": "ef5f1ec0-d0de-40e7-926c-e0bfa9ad604b" 00:16:17.741 }, 00:16:17.741 { 00:16:17.741 "nsid": 2, 00:16:17.741 "bdev_name": "Malloc3", 00:16:17.741 "name": "Malloc3", 00:16:17.741 "nguid": "1318D9B9E20A4282BCFACFC76AFF3245", 00:16:17.741 "uuid": "1318d9b9-e20a-4282-bcfa-cfc76aff3245" 00:16:17.741 } 00:16:17.741 ] 00:16:17.741 }, 00:16:17.741 { 00:16:17.741 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:17.741 "subtype": "NVMe", 00:16:17.741 "listen_addresses": [ 00:16:17.741 { 00:16:17.741 "transport": "VFIOUSER", 00:16:17.741 "trtype": "VFIOUSER", 00:16:17.741 "adrfam": "IPv4", 00:16:17.741 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:17.741 "trsvcid": "0" 00:16:17.741 } 00:16:17.741 ], 00:16:17.741 "allow_any_host": true, 00:16:17.741 "hosts": [], 00:16:17.741 "serial_number": "SPDK2", 00:16:17.741 "model_number": "SPDK bdev Controller", 00:16:17.741 "max_namespaces": 32, 00:16:17.741 "min_cntlid": 1, 00:16:17.741 "max_cntlid": 65519, 00:16:17.741 "namespaces": [ 00:16:17.741 { 00:16:17.741 "nsid": 1, 00:16:17.741 "bdev_name": "Malloc2", 00:16:17.741 "name": "Malloc2", 00:16:17.741 "nguid": "C600549DF57B4530A04D98B19B171165", 00:16:17.741 "uuid": "c600549d-f57b-4530-a04d-98b19b171165" 00:16:17.741 } 00:16:17.741 ] 00:16:17.741 } 00:16:17.741 ] 00:16:17.741 01:10:32 -- target/nvmf_vfio_user.sh@44 -- # wait 2012048 00:16:17.741 01:10:32 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:17.741 01:10:32 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:16:17.741 01:10:32 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:16:17.741 01:10:32 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:16:17.741 [2024-11-28 01:10:32.312009] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:17.741 [2024-11-28 01:10:32.312051] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2012067 ] 00:16:17.741 EAL: No free 2048 kB hugepages reported on node 1 00:16:18.001 [2024-11-28 01:10:32.345756] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:16:18.001 [2024-11-28 01:10:32.354822] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:16:18.001 [2024-11-28 01:10:32.354866] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f5ba6cad000 00:16:18.001 [2024-11-28 01:10:32.355823] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:18.001 [2024-11-28 01:10:32.356830] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:18.001 [2024-11-28 01:10:32.357846] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:18.001 [2024-11-28 01:10:32.358854] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:18.001 [2024-11-28 01:10:32.359857] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:18.001 [2024-11-28 01:10:32.360854] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:18.001 [2024-11-28 01:10:32.361859] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:18.001 [2024-11-28 01:10:32.362863] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:18.001 [2024-11-28 01:10:32.363891] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:16:18.001 [2024-11-28 01:10:32.363912] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f5ba59a5000 00:16:18.001 [2024-11-28 01:10:32.365035] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:16:18.001 [2024-11-28 01:10:32.380188] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:16:18.001 [2024-11-28 01:10:32.380224] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:16:18.002 [2024-11-28 01:10:32.385341] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:16:18.002 [2024-11-28 01:10:32.385399] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:16:18.002 [2024-11-28 01:10:32.385492] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:16:18.002 [2024-11-28 01:10:32.385519] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:16:18.002 [2024-11-28 01:10:32.385554] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:16:18.002 [2024-11-28 01:10:32.386351] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:16:18.002 [2024-11-28 01:10:32.386372] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:16:18.002 [2024-11-28 01:10:32.386384] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:16:18.002 [2024-11-28 01:10:32.387357] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:16:18.002 [2024-11-28 01:10:32.387378] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:16:18.002 [2024-11-28 01:10:32.387392] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:16:18.002 [2024-11-28 01:10:32.388361] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:16:18.002 [2024-11-28 01:10:32.388388] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:16:18.002 [2024-11-28 01:10:32.389363] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:16:18.002 [2024-11-28 01:10:32.389383] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:16:18.002 [2024-11-28 01:10:32.389393] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:16:18.002 [2024-11-28 01:10:32.389404] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:16:18.002 [2024-11-28 01:10:32.389514] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:16:18.002 [2024-11-28 01:10:32.389522] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:16:18.002 [2024-11-28 01:10:32.389556] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:16:18.002 [2024-11-28 01:10:32.390368] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:16:18.002 [2024-11-28 01:10:32.391374] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:16:18.002 [2024-11-28 01:10:32.392380] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:16:18.002 [2024-11-28 01:10:32.393409] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:16:18.002 [2024-11-28 01:10:32.394387] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:16:18.002 [2024-11-28 01:10:32.394406] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:16:18.002 [2024-11-28 01:10:32.394415] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:16:18.002 [2024-11-28 01:10:32.394445] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:16:18.002 [2024-11-28 01:10:32.394458] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:16:18.002 [2024-11-28 01:10:32.394476] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:18.002 [2024-11-28 01:10:32.394485] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:18.002 [2024-11-28 01:10:32.394518] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:18.002 [2024-11-28 01:10:32.402557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:16:18.002 [2024-11-28 01:10:32.402580] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:16:18.002 [2024-11-28 01:10:32.402589] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:16:18.002 [2024-11-28 01:10:32.402597] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:16:18.002 [2024-11-28 01:10:32.402604] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:16:18.002 [2024-11-28 01:10:32.402613] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:16:18.002 [2024-11-28 01:10:32.402621] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:16:18.002 [2024-11-28 01:10:32.402629] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:16:18.002 [2024-11-28 01:10:32.402646] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:16:18.002 [2024-11-28 01:10:32.402662] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:16:18.002 [2024-11-28 01:10:32.410552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:16:18.002 [2024-11-28 01:10:32.410583] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:16:18.002 [2024-11-28 01:10:32.410598] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:16:18.002 [2024-11-28 01:10:32.410610] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:16:18.002 [2024-11-28 01:10:32.410623] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:16:18.002 [2024-11-28 01:10:32.410631] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:16:18.002 [2024-11-28 01:10:32.410647] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:16:18.002 [2024-11-28 01:10:32.410661] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:16:18.002 [2024-11-28 01:10:32.418552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:16:18.002 [2024-11-28 01:10:32.418572] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:16:18.002 [2024-11-28 01:10:32.418586] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:16:18.002 [2024-11-28 01:10:32.418598] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:16:18.002 [2024-11-28 01:10:32.418612] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:16:18.002 [2024-11-28 01:10:32.418626] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:16:18.002 [2024-11-28 01:10:32.426554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:16:18.002 [2024-11-28 01:10:32.426623] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:16:18.002 [2024-11-28 01:10:32.426638] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:16:18.002 [2024-11-28 01:10:32.426651] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:16:18.002 [2024-11-28 01:10:32.426659] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:16:18.002 [2024-11-28 01:10:32.426669] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:16:18.002 [2024-11-28 01:10:32.434553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:16:18.002 [2024-11-28 01:10:32.434586] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:16:18.002 [2024-11-28 01:10:32.434602] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:16:18.002 [2024-11-28 01:10:32.434618] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:16:18.002 [2024-11-28 01:10:32.434631] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:18.002 [2024-11-28 01:10:32.434640] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:18.002 [2024-11-28 01:10:32.434651] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:18.002 [2024-11-28 01:10:32.442539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:16:18.002 [2024-11-28 01:10:32.442579] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:16:18.002 [2024-11-28 01:10:32.442595] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:16:18.002 [2024-11-28 01:10:32.442608] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:18.002 [2024-11-28 01:10:32.442617] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:18.002 [2024-11-28 01:10:32.442626] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:18.002 [2024-11-28 01:10:32.450541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:16:18.003 [2024-11-28 01:10:32.450562] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:16:18.003 [2024-11-28 01:10:32.450574] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:16:18.003 [2024-11-28 01:10:32.450599] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:16:18.003 [2024-11-28 01:10:32.450610] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:16:18.003 [2024-11-28 01:10:32.450618] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:16:18.003 [2024-11-28 01:10:32.450627] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:16:18.003 [2024-11-28 01:10:32.450634] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:16:18.003 [2024-11-28 01:10:32.450642] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:16:18.003 [2024-11-28 01:10:32.450667] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:16:18.003 [2024-11-28 01:10:32.458536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:16:18.003 [2024-11-28 01:10:32.458563] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:16:18.003 [2024-11-28 01:10:32.466535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:16:18.003 [2024-11-28 01:10:32.466562] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:16:18.003 [2024-11-28 01:10:32.474553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:16:18.003 [2024-11-28 01:10:32.474578] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:16:18.003 [2024-11-28 01:10:32.482550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:16:18.003 [2024-11-28 01:10:32.482577] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:16:18.003 [2024-11-28 01:10:32.482587] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:16:18.003 [2024-11-28 01:10:32.482593] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:16:18.003 [2024-11-28 01:10:32.482599] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:16:18.003 [2024-11-28 01:10:32.482608] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:16:18.003 [2024-11-28 01:10:32.482619] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:16:18.003 [2024-11-28 01:10:32.482627] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:16:18.003 [2024-11-28 01:10:32.482636] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:16:18.003 [2024-11-28 01:10:32.482646] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:16:18.003 [2024-11-28 01:10:32.482654] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:18.003 [2024-11-28 01:10:32.482663] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:18.003 [2024-11-28 01:10:32.482675] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:16:18.003 [2024-11-28 01:10:32.482687] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:16:18.003 [2024-11-28 01:10:32.482696] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:16:18.003 [2024-11-28 01:10:32.490552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:16:18.003 [2024-11-28 01:10:32.490582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:16:18.003 [2024-11-28 01:10:32.490599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:16:18.003 [2024-11-28 01:10:32.490611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:16:18.003 ===================================================== 00:16:18.003 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:18.003 ===================================================== 00:16:18.003 Controller Capabilities/Features 00:16:18.003 ================================ 00:16:18.003 Vendor ID: 4e58 00:16:18.003 Subsystem Vendor ID: 4e58 00:16:18.003 Serial Number: SPDK2 00:16:18.003 Model Number: SPDK bdev Controller 00:16:18.003 Firmware Version: 24.01.1 00:16:18.003 Recommended Arb Burst: 6 00:16:18.003 IEEE OUI Identifier: 8d 6b 50 00:16:18.003 Multi-path I/O 00:16:18.003 May have multiple subsystem ports: Yes 00:16:18.003 May have multiple controllers: Yes 00:16:18.003 Associated with SR-IOV VF: No 00:16:18.003 Max Data Transfer Size: 131072 00:16:18.003 Max Number of Namespaces: 32 00:16:18.003 Max Number of I/O Queues: 127 00:16:18.003 NVMe Specification Version (VS): 1.3 00:16:18.003 NVMe Specification Version (Identify): 1.3 00:16:18.003 Maximum Queue Entries: 256 00:16:18.003 Contiguous Queues Required: Yes 00:16:18.003 Arbitration Mechanisms Supported 00:16:18.003 Weighted Round Robin: Not Supported 00:16:18.003 Vendor Specific: Not Supported 00:16:18.003 Reset Timeout: 15000 ms 00:16:18.003 Doorbell Stride: 4 bytes 00:16:18.003 NVM Subsystem Reset: Not Supported 00:16:18.003 Command Sets Supported 00:16:18.003 NVM Command Set: Supported 00:16:18.003 Boot Partition: Not Supported 00:16:18.003 Memory Page Size Minimum: 4096 bytes 00:16:18.003 Memory Page Size Maximum: 4096 bytes 00:16:18.003 Persistent Memory Region: Not Supported 00:16:18.003 Optional Asynchronous Events Supported 00:16:18.003 Namespace Attribute Notices: Supported 00:16:18.003 Firmware Activation Notices: Not Supported 00:16:18.003 ANA Change Notices: Not Supported 00:16:18.003 PLE Aggregate Log Change Notices: Not Supported 00:16:18.003 LBA Status Info Alert Notices: Not Supported 00:16:18.003 EGE Aggregate Log Change Notices: Not Supported 00:16:18.003 Normal NVM Subsystem Shutdown event: Not Supported 00:16:18.003 Zone Descriptor Change Notices: Not Supported 00:16:18.003 Discovery Log Change Notices: Not Supported 00:16:18.003 Controller Attributes 00:16:18.003 128-bit Host Identifier: Supported 00:16:18.003 Non-Operational Permissive Mode: Not Supported 00:16:18.003 NVM Sets: Not Supported 00:16:18.003 Read Recovery Levels: Not Supported 00:16:18.003 Endurance Groups: Not Supported 00:16:18.003 Predictable Latency Mode: Not Supported 00:16:18.003 Traffic Based Keep ALive: Not Supported 00:16:18.003 Namespace Granularity: Not Supported 00:16:18.003 SQ Associations: Not Supported 00:16:18.003 UUID List: Not Supported 00:16:18.003 Multi-Domain Subsystem: Not Supported 00:16:18.003 Fixed Capacity Management: Not Supported 00:16:18.003 Variable Capacity Management: Not Supported 00:16:18.003 Delete Endurance Group: Not Supported 00:16:18.003 Delete NVM Set: Not Supported 00:16:18.003 Extended LBA Formats Supported: Not Supported 00:16:18.003 Flexible Data Placement Supported: Not Supported 00:16:18.003 00:16:18.003 Controller Memory Buffer Support 00:16:18.003 ================================ 00:16:18.003 Supported: No 00:16:18.003 00:16:18.003 Persistent Memory Region Support 00:16:18.003 ================================ 00:16:18.003 Supported: No 00:16:18.003 00:16:18.003 Admin Command Set Attributes 00:16:18.003 ============================ 00:16:18.003 Security Send/Receive: Not Supported 00:16:18.003 Format NVM: Not Supported 00:16:18.003 Firmware Activate/Download: Not Supported 00:16:18.003 Namespace Management: Not Supported 00:16:18.003 Device Self-Test: Not Supported 00:16:18.003 Directives: Not Supported 00:16:18.003 NVMe-MI: Not Supported 00:16:18.003 Virtualization Management: Not Supported 00:16:18.003 Doorbell Buffer Config: Not Supported 00:16:18.003 Get LBA Status Capability: Not Supported 00:16:18.003 Command & Feature Lockdown Capability: Not Supported 00:16:18.003 Abort Command Limit: 4 00:16:18.003 Async Event Request Limit: 4 00:16:18.003 Number of Firmware Slots: N/A 00:16:18.003 Firmware Slot 1 Read-Only: N/A 00:16:18.003 Firmware Activation Without Reset: N/A 00:16:18.003 Multiple Update Detection Support: N/A 00:16:18.003 Firmware Update Granularity: No Information Provided 00:16:18.003 Per-Namespace SMART Log: No 00:16:18.003 Asymmetric Namespace Access Log Page: Not Supported 00:16:18.003 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:16:18.003 Command Effects Log Page: Supported 00:16:18.003 Get Log Page Extended Data: Supported 00:16:18.003 Telemetry Log Pages: Not Supported 00:16:18.003 Persistent Event Log Pages: Not Supported 00:16:18.003 Supported Log Pages Log Page: May Support 00:16:18.003 Commands Supported & Effects Log Page: Not Supported 00:16:18.003 Feature Identifiers & Effects Log Page:May Support 00:16:18.003 NVMe-MI Commands & Effects Log Page: May Support 00:16:18.003 Data Area 4 for Telemetry Log: Not Supported 00:16:18.003 Error Log Page Entries Supported: 128 00:16:18.003 Keep Alive: Supported 00:16:18.003 Keep Alive Granularity: 10000 ms 00:16:18.003 00:16:18.003 NVM Command Set Attributes 00:16:18.003 ========================== 00:16:18.003 Submission Queue Entry Size 00:16:18.003 Max: 64 00:16:18.003 Min: 64 00:16:18.004 Completion Queue Entry Size 00:16:18.004 Max: 16 00:16:18.004 Min: 16 00:16:18.004 Number of Namespaces: 32 00:16:18.004 Compare Command: Supported 00:16:18.004 Write Uncorrectable Command: Not Supported 00:16:18.004 Dataset Management Command: Supported 00:16:18.004 Write Zeroes Command: Supported 00:16:18.004 Set Features Save Field: Not Supported 00:16:18.004 Reservations: Not Supported 00:16:18.004 Timestamp: Not Supported 00:16:18.004 Copy: Supported 00:16:18.004 Volatile Write Cache: Present 00:16:18.004 Atomic Write Unit (Normal): 1 00:16:18.004 Atomic Write Unit (PFail): 1 00:16:18.004 Atomic Compare & Write Unit: 1 00:16:18.004 Fused Compare & Write: Supported 00:16:18.004 Scatter-Gather List 00:16:18.004 SGL Command Set: Supported (Dword aligned) 00:16:18.004 SGL Keyed: Not Supported 00:16:18.004 SGL Bit Bucket Descriptor: Not Supported 00:16:18.004 SGL Metadata Pointer: Not Supported 00:16:18.004 Oversized SGL: Not Supported 00:16:18.004 SGL Metadata Address: Not Supported 00:16:18.004 SGL Offset: Not Supported 00:16:18.004 Transport SGL Data Block: Not Supported 00:16:18.004 Replay Protected Memory Block: Not Supported 00:16:18.004 00:16:18.004 Firmware Slot Information 00:16:18.004 ========================= 00:16:18.004 Active slot: 1 00:16:18.004 Slot 1 Firmware Revision: 24.01.1 00:16:18.004 00:16:18.004 00:16:18.004 Commands Supported and Effects 00:16:18.004 ============================== 00:16:18.004 Admin Commands 00:16:18.004 -------------- 00:16:18.004 Get Log Page (02h): Supported 00:16:18.004 Identify (06h): Supported 00:16:18.004 Abort (08h): Supported 00:16:18.004 Set Features (09h): Supported 00:16:18.004 Get Features (0Ah): Supported 00:16:18.004 Asynchronous Event Request (0Ch): Supported 00:16:18.004 Keep Alive (18h): Supported 00:16:18.004 I/O Commands 00:16:18.004 ------------ 00:16:18.004 Flush (00h): Supported LBA-Change 00:16:18.004 Write (01h): Supported LBA-Change 00:16:18.004 Read (02h): Supported 00:16:18.004 Compare (05h): Supported 00:16:18.004 Write Zeroes (08h): Supported LBA-Change 00:16:18.004 Dataset Management (09h): Supported LBA-Change 00:16:18.004 Copy (19h): Supported LBA-Change 00:16:18.004 Unknown (79h): Supported LBA-Change 00:16:18.004 Unknown (7Ah): Supported 00:16:18.004 00:16:18.004 Error Log 00:16:18.004 ========= 00:16:18.004 00:16:18.004 Arbitration 00:16:18.004 =========== 00:16:18.004 Arbitration Burst: 1 00:16:18.004 00:16:18.004 Power Management 00:16:18.004 ================ 00:16:18.004 Number of Power States: 1 00:16:18.004 Current Power State: Power State #0 00:16:18.004 Power State #0: 00:16:18.004 Max Power: 0.00 W 00:16:18.004 Non-Operational State: Operational 00:16:18.004 Entry Latency: Not Reported 00:16:18.004 Exit Latency: Not Reported 00:16:18.004 Relative Read Throughput: 0 00:16:18.004 Relative Read Latency: 0 00:16:18.004 Relative Write Throughput: 0 00:16:18.004 Relative Write Latency: 0 00:16:18.004 Idle Power: Not Reported 00:16:18.004 Active Power: Not Reported 00:16:18.004 Non-Operational Permissive Mode: Not Supported 00:16:18.004 00:16:18.004 Health Information 00:16:18.004 ================== 00:16:18.004 Critical Warnings: 00:16:18.004 Available Spare Space: OK 00:16:18.004 Temperature: OK 00:16:18.004 Device Reliability: OK 00:16:18.004 Read Only: No 00:16:18.004 Volatile Memory Backup: OK 00:16:18.004 Current Temperature: 0 Kelvin[2024-11-28 01:10:32.490737] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:16:18.004 [2024-11-28 01:10:32.498553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:16:18.004 [2024-11-28 01:10:32.498598] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:16:18.004 [2024-11-28 01:10:32.498615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:18.004 [2024-11-28 01:10:32.498627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:18.004 [2024-11-28 01:10:32.498638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:18.004 [2024-11-28 01:10:32.498663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:18.004 [2024-11-28 01:10:32.498750] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:16:18.004 [2024-11-28 01:10:32.498772] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:16:18.004 [2024-11-28 01:10:32.499792] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:16:18.004 [2024-11-28 01:10:32.499808] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:16:18.004 [2024-11-28 01:10:32.500766] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:16:18.004 [2024-11-28 01:10:32.500791] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:16:18.004 [2024-11-28 01:10:32.500860] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:16:18.004 [2024-11-28 01:10:32.502052] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:16:18.004 (-273 Celsius) 00:16:18.004 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:16:18.004 Available Spare: 0% 00:16:18.004 Available Spare Threshold: 0% 00:16:18.004 Life Percentage Used: 0% 00:16:18.004 Data Units Read: 0 00:16:18.004 Data Units Written: 0 00:16:18.004 Host Read Commands: 0 00:16:18.004 Host Write Commands: 0 00:16:18.004 Controller Busy Time: 0 minutes 00:16:18.004 Power Cycles: 0 00:16:18.004 Power On Hours: 0 hours 00:16:18.004 Unsafe Shutdowns: 0 00:16:18.004 Unrecoverable Media Errors: 0 00:16:18.004 Lifetime Error Log Entries: 0 00:16:18.004 Warning Temperature Time: 0 minutes 00:16:18.004 Critical Temperature Time: 0 minutes 00:16:18.004 00:16:18.004 Number of Queues 00:16:18.004 ================ 00:16:18.004 Number of I/O Submission Queues: 127 00:16:18.004 Number of I/O Completion Queues: 127 00:16:18.004 00:16:18.004 Active Namespaces 00:16:18.004 ================= 00:16:18.004 Namespace ID:1 00:16:18.004 Error Recovery Timeout: Unlimited 00:16:18.004 Command Set Identifier: NVM (00h) 00:16:18.004 Deallocate: Supported 00:16:18.004 Deallocated/Unwritten Error: Not Supported 00:16:18.004 Deallocated Read Value: Unknown 00:16:18.004 Deallocate in Write Zeroes: Not Supported 00:16:18.004 Deallocated Guard Field: 0xFFFF 00:16:18.004 Flush: Supported 00:16:18.004 Reservation: Supported 00:16:18.004 Namespace Sharing Capabilities: Multiple Controllers 00:16:18.004 Size (in LBAs): 131072 (0GiB) 00:16:18.004 Capacity (in LBAs): 131072 (0GiB) 00:16:18.004 Utilization (in LBAs): 131072 (0GiB) 00:16:18.004 NGUID: C600549DF57B4530A04D98B19B171165 00:16:18.004 UUID: c600549d-f57b-4530-a04d-98b19b171165 00:16:18.004 Thin Provisioning: Not Supported 00:16:18.004 Per-NS Atomic Units: Yes 00:16:18.004 Atomic Boundary Size (Normal): 0 00:16:18.004 Atomic Boundary Size (PFail): 0 00:16:18.004 Atomic Boundary Offset: 0 00:16:18.004 Maximum Single Source Range Length: 65535 00:16:18.004 Maximum Copy Length: 65535 00:16:18.004 Maximum Source Range Count: 1 00:16:18.004 NGUID/EUI64 Never Reused: No 00:16:18.004 Namespace Write Protected: No 00:16:18.004 Number of LBA Formats: 1 00:16:18.004 Current LBA Format: LBA Format #00 00:16:18.004 LBA Format #00: Data Size: 512 Metadata Size: 0 00:16:18.004 00:16:18.004 01:10:32 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:16:18.004 EAL: No free 2048 kB hugepages reported on node 1 00:16:24.561 Initializing NVMe Controllers 00:16:24.561 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:24.561 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:16:24.561 Initialization complete. Launching workers. 00:16:24.561 ======================================================== 00:16:24.561 Latency(us) 00:16:24.561 Device Information : IOPS MiB/s Average min max 00:16:24.561 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 37738.35 147.42 3391.36 1135.53 7362.79 00:16:24.561 ======================================================== 00:16:24.561 Total : 37738.35 147.42 3391.36 1135.53 7362.79 00:16:24.561 00:16:24.561 01:10:37 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:16:24.561 EAL: No free 2048 kB hugepages reported on node 1 00:16:28.745 Initializing NVMe Controllers 00:16:28.745 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:28.745 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:16:28.745 Initialization complete. Launching workers. 00:16:28.745 ======================================================== 00:16:28.745 Latency(us) 00:16:28.745 Device Information : IOPS MiB/s Average min max 00:16:28.745 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 35703.83 139.47 3584.39 1158.33 7667.25 00:16:28.745 ======================================================== 00:16:28.745 Total : 35703.83 139.47 3584.39 1158.33 7667.25 00:16:28.745 00:16:28.745 01:10:43 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:16:28.745 EAL: No free 2048 kB hugepages reported on node 1 00:16:34.012 Initializing NVMe Controllers 00:16:34.012 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:34.012 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:34.012 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:16:34.012 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:16:34.012 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:16:34.012 Initialization complete. Launching workers. 00:16:34.012 Starting thread on core 2 00:16:34.012 Starting thread on core 3 00:16:34.012 Starting thread on core 1 00:16:34.012 01:10:48 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:16:34.012 EAL: No free 2048 kB hugepages reported on node 1 00:16:37.389 Initializing NVMe Controllers 00:16:37.389 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:37.389 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:37.389 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:16:37.389 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:16:37.389 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:16:37.389 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:16:37.389 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:16:37.389 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:16:37.389 Initialization complete. Launching workers. 00:16:37.389 Starting thread on core 1 with urgent priority queue 00:16:37.389 Starting thread on core 2 with urgent priority queue 00:16:37.389 Starting thread on core 3 with urgent priority queue 00:16:37.389 Starting thread on core 0 with urgent priority queue 00:16:37.389 SPDK bdev Controller (SPDK2 ) core 0: 5521.67 IO/s 18.11 secs/100000 ios 00:16:37.389 SPDK bdev Controller (SPDK2 ) core 1: 6014.33 IO/s 16.63 secs/100000 ios 00:16:37.389 SPDK bdev Controller (SPDK2 ) core 2: 6032.33 IO/s 16.58 secs/100000 ios 00:16:37.389 SPDK bdev Controller (SPDK2 ) core 3: 5943.00 IO/s 16.83 secs/100000 ios 00:16:37.389 ======================================================== 00:16:37.389 00:16:37.389 01:10:51 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:37.389 EAL: No free 2048 kB hugepages reported on node 1 00:16:37.647 Initializing NVMe Controllers 00:16:37.647 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:37.647 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:37.647 Namespace ID: 1 size: 0GB 00:16:37.647 Initialization complete. 00:16:37.647 INFO: using host memory buffer for IO 00:16:37.647 Hello world! 00:16:37.647 01:10:52 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:37.647 EAL: No free 2048 kB hugepages reported on node 1 00:16:39.021 Initializing NVMe Controllers 00:16:39.021 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:39.021 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:39.021 Initialization complete. Launching workers. 00:16:39.021 submit (in ns) avg, min, max = 8004.7, 3436.7, 4015637.8 00:16:39.021 complete (in ns) avg, min, max = 25295.9, 2012.2, 4015724.4 00:16:39.021 00:16:39.021 Submit histogram 00:16:39.021 ================ 00:16:39.021 Range in us Cumulative Count 00:16:39.021 3.413 - 3.437: 0.0074% ( 1) 00:16:39.021 3.437 - 3.461: 0.5864% ( 78) 00:16:39.021 3.461 - 3.484: 1.6997% ( 150) 00:16:39.021 3.484 - 3.508: 4.7725% ( 414) 00:16:39.021 3.508 - 3.532: 9.5524% ( 644) 00:16:39.021 3.532 - 3.556: 18.3701% ( 1188) 00:16:39.021 3.556 - 3.579: 27.5588% ( 1238) 00:16:39.021 3.579 - 3.603: 36.4061% ( 1192) 00:16:39.021 3.603 - 3.627: 43.5538% ( 963) 00:16:39.021 3.627 - 3.650: 51.6218% ( 1087) 00:16:39.021 3.650 - 3.674: 57.5893% ( 804) 00:16:39.021 3.674 - 3.698: 62.3098% ( 636) 00:16:39.021 3.698 - 3.721: 65.9170% ( 486) 00:16:39.021 3.721 - 3.745: 69.2867% ( 454) 00:16:39.021 3.745 - 3.769: 72.9162% ( 489) 00:16:39.021 3.769 - 3.793: 76.4269% ( 473) 00:16:39.021 3.793 - 3.816: 79.7892% ( 453) 00:16:39.021 3.816 - 3.840: 83.0030% ( 433) 00:16:39.021 3.840 - 3.864: 85.8383% ( 382) 00:16:39.021 3.864 - 3.887: 87.9537% ( 285) 00:16:39.021 3.887 - 3.911: 89.8167% ( 251) 00:16:39.021 3.911 - 3.935: 91.3976% ( 213) 00:16:39.021 3.935 - 3.959: 92.6074% ( 163) 00:16:39.021 3.959 - 3.982: 93.5352% ( 125) 00:16:39.021 3.982 - 4.006: 94.5372% ( 135) 00:16:39.021 4.006 - 4.030: 95.2498% ( 96) 00:16:39.021 4.030 - 4.053: 95.6951% ( 60) 00:16:39.021 4.053 - 4.077: 96.1256% ( 58) 00:16:39.021 4.077 - 4.101: 96.4819% ( 48) 00:16:39.021 4.101 - 4.124: 96.6080% ( 17) 00:16:39.021 4.124 - 4.148: 96.7491% ( 19) 00:16:39.021 4.148 - 4.172: 96.8678% ( 16) 00:16:39.021 4.172 - 4.196: 96.9643% ( 13) 00:16:39.021 4.196 - 4.219: 97.0756% ( 15) 00:16:39.021 4.219 - 4.243: 97.2389% ( 22) 00:16:39.021 4.243 - 4.267: 97.3131% ( 10) 00:16:39.021 4.267 - 4.290: 97.3948% ( 11) 00:16:39.021 4.290 - 4.314: 97.4393% ( 6) 00:16:39.021 4.314 - 4.338: 97.4764% ( 5) 00:16:39.021 4.338 - 4.361: 97.5135% ( 5) 00:16:39.021 4.361 - 4.385: 97.5581% ( 6) 00:16:39.021 4.385 - 4.409: 97.5729% ( 2) 00:16:39.021 4.433 - 4.456: 97.5878% ( 2) 00:16:39.021 4.456 - 4.480: 97.6026% ( 2) 00:16:39.021 4.504 - 4.527: 97.6249% ( 3) 00:16:39.021 4.527 - 4.551: 97.6323% ( 1) 00:16:39.021 4.551 - 4.575: 97.6546% ( 3) 00:16:39.021 4.575 - 4.599: 97.6694% ( 2) 00:16:39.021 4.599 - 4.622: 97.6768% ( 1) 00:16:39.021 4.622 - 4.646: 97.6843% ( 1) 00:16:39.021 4.646 - 4.670: 97.7139% ( 4) 00:16:39.021 4.670 - 4.693: 97.7511% ( 5) 00:16:39.021 4.693 - 4.717: 97.7733% ( 3) 00:16:39.021 4.717 - 4.741: 97.8550% ( 11) 00:16:39.021 4.741 - 4.764: 97.8847% ( 4) 00:16:39.021 4.764 - 4.788: 97.9440% ( 8) 00:16:39.021 4.788 - 4.812: 98.0108% ( 9) 00:16:39.021 4.812 - 4.836: 98.0554% ( 6) 00:16:39.021 4.836 - 4.859: 98.0851% ( 4) 00:16:39.021 4.859 - 4.883: 98.1147% ( 4) 00:16:39.021 4.883 - 4.907: 98.1296% ( 2) 00:16:39.021 4.907 - 4.930: 98.1815% ( 7) 00:16:39.021 4.930 - 4.954: 98.2038% ( 3) 00:16:39.021 4.954 - 4.978: 98.2335% ( 4) 00:16:39.021 4.978 - 5.001: 98.2632% ( 4) 00:16:39.021 5.001 - 5.025: 98.2706% ( 1) 00:16:39.021 5.025 - 5.049: 98.2929% ( 3) 00:16:39.021 5.049 - 5.073: 98.3374% ( 6) 00:16:39.021 5.073 - 5.096: 98.3448% ( 1) 00:16:39.021 5.120 - 5.144: 98.3671% ( 3) 00:16:39.021 5.144 - 5.167: 98.3819% ( 2) 00:16:39.021 5.191 - 5.215: 98.3894% ( 1) 00:16:39.021 5.215 - 5.239: 98.3968% ( 1) 00:16:39.021 5.239 - 5.262: 98.4042% ( 1) 00:16:39.022 5.262 - 5.286: 98.4116% ( 1) 00:16:39.022 5.381 - 5.404: 98.4265% ( 2) 00:16:39.022 5.404 - 5.428: 98.4339% ( 1) 00:16:39.022 5.428 - 5.452: 98.4413% ( 1) 00:16:39.022 5.618 - 5.641: 98.4487% ( 1) 00:16:39.022 5.641 - 5.665: 98.4636% ( 2) 00:16:39.022 5.665 - 5.689: 98.4710% ( 1) 00:16:39.022 5.760 - 5.784: 98.4784% ( 1) 00:16:39.022 5.831 - 5.855: 98.4859% ( 1) 00:16:39.022 5.879 - 5.902: 98.4933% ( 1) 00:16:39.022 6.210 - 6.258: 98.5007% ( 1) 00:16:39.022 6.353 - 6.400: 98.5081% ( 1) 00:16:39.022 6.637 - 6.684: 98.5155% ( 1) 00:16:39.022 6.874 - 6.921: 98.5230% ( 1) 00:16:39.022 6.969 - 7.016: 98.5304% ( 1) 00:16:39.022 7.064 - 7.111: 98.5378% ( 1) 00:16:39.022 7.111 - 7.159: 98.5452% ( 1) 00:16:39.022 7.253 - 7.301: 98.5527% ( 1) 00:16:39.022 7.348 - 7.396: 98.5601% ( 1) 00:16:39.022 7.490 - 7.538: 98.5675% ( 1) 00:16:39.022 7.585 - 7.633: 98.5749% ( 1) 00:16:39.022 7.727 - 7.775: 98.5898% ( 2) 00:16:39.022 7.870 - 7.917: 98.5972% ( 1) 00:16:39.022 8.012 - 8.059: 98.6120% ( 2) 00:16:39.022 8.059 - 8.107: 98.6195% ( 1) 00:16:39.022 8.107 - 8.154: 98.6343% ( 2) 00:16:39.022 8.154 - 8.201: 98.6492% ( 2) 00:16:39.022 8.486 - 8.533: 98.6566% ( 1) 00:16:39.022 8.533 - 8.581: 98.6640% ( 1) 00:16:39.022 8.581 - 8.628: 98.6714% ( 1) 00:16:39.022 8.628 - 8.676: 98.6788% ( 1) 00:16:39.022 8.676 - 8.723: 98.7011% ( 3) 00:16:39.022 8.723 - 8.770: 98.7085% ( 1) 00:16:39.022 8.770 - 8.818: 98.7160% ( 1) 00:16:39.022 8.818 - 8.865: 98.7382% ( 3) 00:16:39.022 8.865 - 8.913: 98.7531% ( 2) 00:16:39.022 8.913 - 8.960: 98.7679% ( 2) 00:16:39.022 9.007 - 9.055: 98.7753% ( 1) 00:16:39.022 9.055 - 9.102: 98.7828% ( 1) 00:16:39.022 9.244 - 9.292: 98.7902% ( 1) 00:16:39.022 9.292 - 9.339: 98.8050% ( 2) 00:16:39.022 9.339 - 9.387: 98.8124% ( 1) 00:16:39.022 9.434 - 9.481: 98.8199% ( 1) 00:16:39.022 9.481 - 9.529: 98.8273% ( 1) 00:16:39.022 9.529 - 9.576: 98.8347% ( 1) 00:16:39.022 9.813 - 9.861: 98.8421% ( 1) 00:16:39.022 9.908 - 9.956: 98.8496% ( 1) 00:16:39.022 9.956 - 10.003: 98.8644% ( 2) 00:16:39.022 10.287 - 10.335: 98.8792% ( 2) 00:16:39.022 10.335 - 10.382: 98.8867% ( 1) 00:16:39.022 10.382 - 10.430: 98.8941% ( 1) 00:16:39.022 10.761 - 10.809: 98.9164% ( 3) 00:16:39.022 11.046 - 11.093: 98.9238% ( 1) 00:16:39.022 11.236 - 11.283: 98.9312% ( 1) 00:16:39.022 11.425 - 11.473: 98.9386% ( 1) 00:16:39.022 11.520 - 11.567: 98.9535% ( 2) 00:16:39.022 11.567 - 11.615: 98.9609% ( 1) 00:16:39.022 11.804 - 11.852: 98.9683% ( 1) 00:16:39.022 11.852 - 11.899: 98.9757% ( 1) 00:16:39.022 11.899 - 11.947: 98.9832% ( 1) 00:16:39.022 12.136 - 12.231: 98.9906% ( 1) 00:16:39.022 12.231 - 12.326: 98.9980% ( 1) 00:16:39.022 12.516 - 12.610: 99.0054% ( 1) 00:16:39.022 12.610 - 12.705: 99.0128% ( 1) 00:16:39.022 12.800 - 12.895: 99.0203% ( 1) 00:16:39.022 12.895 - 12.990: 99.0277% ( 1) 00:16:39.022 12.990 - 13.084: 99.0351% ( 1) 00:16:39.022 13.179 - 13.274: 99.0500% ( 2) 00:16:39.022 13.464 - 13.559: 99.0648% ( 2) 00:16:39.022 13.559 - 13.653: 99.0722% ( 1) 00:16:39.022 13.653 - 13.748: 99.0796% ( 1) 00:16:39.022 13.748 - 13.843: 99.0945% ( 2) 00:16:39.022 13.843 - 13.938: 99.1093% ( 2) 00:16:39.022 13.938 - 14.033: 99.1168% ( 1) 00:16:39.022 14.127 - 14.222: 99.1316% ( 2) 00:16:39.022 14.222 - 14.317: 99.1390% ( 1) 00:16:39.022 14.412 - 14.507: 99.1464% ( 1) 00:16:39.022 14.601 - 14.696: 99.1539% ( 1) 00:16:39.022 16.877 - 16.972: 99.1613% ( 1) 00:16:39.022 17.067 - 17.161: 99.1687% ( 1) 00:16:39.022 17.161 - 17.256: 99.1984% ( 4) 00:16:39.022 17.256 - 17.351: 99.2281% ( 4) 00:16:39.022 17.351 - 17.446: 99.2504% ( 3) 00:16:39.022 17.446 - 17.541: 99.2652% ( 2) 00:16:39.022 17.541 - 17.636: 99.2949% ( 4) 00:16:39.022 17.636 - 17.730: 99.3394% ( 6) 00:16:39.022 17.730 - 17.825: 99.3840% ( 6) 00:16:39.022 17.825 - 17.920: 99.4136% ( 4) 00:16:39.022 17.920 - 18.015: 99.4656% ( 7) 00:16:39.022 18.015 - 18.110: 99.5176% ( 7) 00:16:39.022 18.110 - 18.204: 99.5324% ( 2) 00:16:39.022 18.204 - 18.299: 99.5844% ( 7) 00:16:39.022 18.299 - 18.394: 99.6289% ( 6) 00:16:39.022 18.394 - 18.489: 99.6660% ( 5) 00:16:39.022 18.489 - 18.584: 99.6808% ( 2) 00:16:39.022 18.584 - 18.679: 99.7105% ( 4) 00:16:39.022 18.679 - 18.773: 99.7180% ( 1) 00:16:39.022 18.773 - 18.868: 99.7551% ( 5) 00:16:39.022 18.868 - 18.963: 99.7699% ( 2) 00:16:39.022 18.963 - 19.058: 99.7848% ( 2) 00:16:39.022 19.058 - 19.153: 99.7996% ( 2) 00:16:39.022 19.153 - 19.247: 99.8144% ( 2) 00:16:39.022 19.437 - 19.532: 99.8219% ( 1) 00:16:39.022 19.627 - 19.721: 99.8293% ( 1) 00:16:39.022 19.816 - 19.911: 99.8367% ( 1) 00:16:39.022 19.911 - 20.006: 99.8441% ( 1) 00:16:39.022 20.101 - 20.196: 99.8516% ( 1) 00:16:39.022 21.333 - 21.428: 99.8590% ( 1) 00:16:39.022 22.850 - 22.945: 99.8664% ( 1) 00:16:39.022 25.031 - 25.221: 99.8738% ( 1) 00:16:39.022 27.496 - 27.686: 99.8812% ( 1) 00:16:39.022 32.616 - 32.806: 99.8887% ( 1) 00:16:39.022 33.564 - 33.754: 99.8961% ( 1) 00:16:39.022 3980.705 - 4004.978: 99.9703% ( 10) 00:16:39.022 4004.978 - 4029.250: 100.0000% ( 4) 00:16:39.022 00:16:39.022 Complete histogram 00:16:39.022 ================== 00:16:39.022 Range in us Cumulative Count 00:16:39.022 2.003 - 2.015: 0.0816% ( 11) 00:16:39.022 2.015 - 2.027: 7.2590% ( 967) 00:16:39.022 2.027 - 2.039: 16.7001% ( 1272) 00:16:39.022 2.039 - 2.050: 18.9119% ( 298) 00:16:39.022 2.050 - 2.062: 43.6503% ( 3333) 00:16:39.022 2.062 - 2.074: 61.0258% ( 2341) 00:16:39.022 2.074 - 2.086: 63.0743% ( 276) 00:16:39.022 2.086 - 2.098: 67.1120% ( 544) 00:16:39.022 2.098 - 2.110: 68.9305% ( 245) 00:16:39.022 2.110 - 2.121: 72.4115% ( 469) 00:16:39.022 2.121 - 2.133: 83.7675% ( 1530) 00:16:39.022 2.133 - 2.145: 87.4638% ( 498) 00:16:39.022 2.145 - 2.157: 88.5994% ( 153) 00:16:39.022 2.157 - 2.169: 89.9206% ( 178) 00:16:39.022 2.169 - 2.181: 90.6628% ( 100) 00:16:39.022 2.181 - 2.193: 92.1769% ( 204) 00:16:39.022 2.193 - 2.204: 94.4407% ( 305) 00:16:39.022 2.204 - 2.216: 95.0345% ( 80) 00:16:39.022 2.216 - 2.228: 95.3462% ( 42) 00:16:39.022 2.228 - 2.240: 95.6209% ( 37) 00:16:39.022 2.240 - 2.252: 95.7767% ( 21) 00:16:39.022 2.252 - 2.264: 95.9994% ( 30) 00:16:39.022 2.264 - 2.276: 96.1627% ( 22) 00:16:39.022 2.276 - 2.287: 96.2221% ( 8) 00:16:39.022 2.287 - 2.299: 96.3260% ( 14) 00:16:39.022 2.299 - 2.311: 96.5264% ( 27) 00:16:39.022 2.311 - 2.323: 96.7565% ( 31) 00:16:39.022 2.323 - 2.335: 97.0608% ( 41) 00:16:39.022 2.335 - 2.347: 97.3577% ( 40) 00:16:39.022 2.347 - 2.359: 97.6323% ( 37) 00:16:39.022 2.359 - 2.370: 97.8847% ( 34) 00:16:39.022 2.370 - 2.382: 98.0257% ( 19) 00:16:39.022 2.382 - 2.394: 98.1741% ( 20) 00:16:39.022 2.394 - 2.406: 98.2929% ( 16) 00:16:39.022 2.406 - 2.418: 98.3597% ( 9) 00:16:39.022 2.418 - 2.430: 98.4042% ( 6) 00:16:39.022 2.430 - 2.441: 98.4636% ( 8) 00:16:39.022 2.441 - 2.453: 98.4933% ( 4) 00:16:39.022 2.465 - 2.477: 98.5081% ( 2) 00:16:39.022 2.477 - 2.489: 98.5155% ( 1) 00:16:39.022 2.501 - 2.513: 98.5230% ( 1) 00:16:39.022 2.513 - 2.524: 98.5378% ( 2) 00:16:39.022 2.548 - 2.560: 98.5527% ( 2) 00:16:39.022 2.584 - 2.596: 98.5601% ( 1) 00:16:39.022 2.643 - 2.655: 98.5675% ( 1) 00:16:39.022 2.773 - 2.785: 98.5749% ( 1) 00:16:39.022 2.785 - 2.797: 98.5823% ( 1) 00:16:39.022 2.809 - 2.821: 98.5972% ( 2) 00:16:39.022 2.916 - 2.927: 98.6046% ( 1) 00:16:39.022 3.010 - 3.022: 98.6120% ( 1) 00:16:39.022 3.224 - 3.247: 98.6195% ( 1) 00:16:39.022 3.271 - 3.295: 98.6269% ( 1) 00:16:39.022 3.295 - 3.319: 98.6343% ( 1) 00:16:39.022 3.390 - 3.413: 98.6492% ( 2) 00:16:39.022 3.413 - 3.437: 98.6566% ( 1) 00:16:39.022 3.437 - 3.461: 98.6640% ( 1) 00:16:39.022 3.484 - 3.508: 98.6714% ( 1) 00:16:39.022 3.508 - 3.532: 98.6863% ( 2) 00:16:39.022 3.532 - 3.556: 98.6937% ( 1) 00:16:39.022 3.556 - 3.579: 98.7085% ( 2) 00:16:39.022 3.579 - 3.603: 98.7160% ( 1) 00:16:39.022 3.603 - 3.627: 98.7308% ( 2) 00:16:39.022 3.840 - 3.864: 98.7382% ( 1) 00:16:39.022 3.911 - 3.935: 98.7456% ( 1) 00:16:39.022 3.982 - 4.006: 98.7531% ( 1) 00:16:39.022 5.381 - 5.404: 98.7605% ( 1) 00:16:39.022 5.476 - 5.499: 98.7679% ( 1) 00:16:39.022 6.353 - 6.400: 98.7753% ( 1) 00:16:39.022 6.400 - 6.447: 98.7902% ( 2) 00:16:39.023 6.447 - 6.495: 98.7976% ( 1) 00:16:39.023 6.542 - 6.590: 98.8050% ( 1) 00:16:39.023 7.016 - 7.064: 98.8199% ( 2) 00:16:39.023 7.064 - 7.111: 98.8273% ( 1) 00:16:39.023 7.111 - 7.159: 98.8347% ( 1) 00:16:39.023 7.253 - 7.301: 98.8496% ( 2) 00:16:39.023 7.490 - 7.538: 98.8570% ( 1) 00:16:39.023 7.822 - 7.870: 98.8644% ( 1) 00:16:39.023 8.818 - 8.865: 98.8718% ( 1) 00:16:39.023 10.335 - 10.382: 98.8792% ( 1) 00:16:39.023 10.477 - 10.524: 98.8867% ( 1) 00:16:39.023 15.360 - 15.455: 98.9089% ( 3) 00:16:39.023 15.455 - 15.550: 98.9238% ( 2) 00:16:39.023 15.644 - 15.739: 98.9386% ( 2) 00:16:39.023 15.739 - 15.834: 98.9535% ( 2) 00:16:39.023 15.834 - 15.929: 98.9609% ( 1) 00:16:39.023 15.929 - 16.024: 98.9832% ( 3) 00:16:39.023 16.024 - 16.119: 98.9906% ( 1) 00:16:39.023 16.119 - 16.213: 99.0128% ( 3) 00:16:39.023 16.213 - 16.308: 99.0277% ( 2) 00:16:39.023 16.308 - 16.403: 99.0574% ( 4) 00:16:39.023 16.403 - 16.498: 99.1019% ( 6) 00:16:39.023 16.498 - 16.593: 99.1464% ( 6) 00:16:39.023 16.593 - 16.687: 99.1910% ( 6) 00:16:39.023 16.687 - 16.782: 99.2281% ( 5) 00:16:39.023 16.782 - 16.877: 99.2504% ( 3) 00:16:39.023 16.877 - 16.972: 99.2652% ( 2) 00:16:39.023 16.972 - 17.067: 99.2726% ( 1) 00:16:39.023 17.067 - 17.161: 99.2800% ( 1) 00:16:39.023 17.161 - 17.256: 99.3023% ( 3) 00:16:39.023 17.256 - 17.351: 99.3097% ( 1) 00:16:39.023 17.351 - 17.446: 99.3172% ( 1) 00:16:39.023 17.730 - 17.825: 99.3320% ( 2) 00:16:39.023 17.825 - 17.920: 99.3394% ( 1) 00:16:39.023 17.920 - 18.015: 99.3543% ( 2) 00:16:39.023 18.110 - 18.204: 99.3617% ( 1) 00:16:39.023 18.204 - 18.299: 99.3840% ( 3) 00:16:39.023 18.299 - 18.394: 99.3914% ( 1) 00:16:39.023 18.489 - 18.584: 99.3988% ( 1) 00:16:39.023 18.773 - 18.868: 99.4062% ( 1) 00:16:39.023 21.428 - 21.523: 99.4136% ( 1) 00:16:39.023 1007.313 - 1013.381: 99.4211% ( 1) 00:16:39.023 2900.575 - 2912.711: 99.4285% ( 1) 00:16:39.023 3446.708 - 3470.981: 99.4359% ( 1) 00:16:39.023 3980.705 - 4004.978: 99.8441% ( 55) 00:16:39.023 4004.978 - 4029.250: 100.0000% ( 21) 00:16:39.023 00:16:39.023 01:10:53 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:16:39.023 01:10:53 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:16:39.023 01:10:53 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:16:39.023 01:10:53 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:16:39.023 01:10:53 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:39.281 [ 00:16:39.281 { 00:16:39.281 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:39.281 "subtype": "Discovery", 00:16:39.281 "listen_addresses": [], 00:16:39.281 "allow_any_host": true, 00:16:39.281 "hosts": [] 00:16:39.281 }, 00:16:39.281 { 00:16:39.281 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:39.281 "subtype": "NVMe", 00:16:39.281 "listen_addresses": [ 00:16:39.281 { 00:16:39.281 "transport": "VFIOUSER", 00:16:39.281 "trtype": "VFIOUSER", 00:16:39.281 "adrfam": "IPv4", 00:16:39.281 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:39.281 "trsvcid": "0" 00:16:39.281 } 00:16:39.281 ], 00:16:39.281 "allow_any_host": true, 00:16:39.281 "hosts": [], 00:16:39.281 "serial_number": "SPDK1", 00:16:39.281 "model_number": "SPDK bdev Controller", 00:16:39.281 "max_namespaces": 32, 00:16:39.281 "min_cntlid": 1, 00:16:39.281 "max_cntlid": 65519, 00:16:39.281 "namespaces": [ 00:16:39.281 { 00:16:39.281 "nsid": 1, 00:16:39.281 "bdev_name": "Malloc1", 00:16:39.281 "name": "Malloc1", 00:16:39.281 "nguid": "EF5F1EC0D0DE40E7926CE0BFA9AD604B", 00:16:39.281 "uuid": "ef5f1ec0-d0de-40e7-926c-e0bfa9ad604b" 00:16:39.281 }, 00:16:39.281 { 00:16:39.281 "nsid": 2, 00:16:39.281 "bdev_name": "Malloc3", 00:16:39.281 "name": "Malloc3", 00:16:39.281 "nguid": "1318D9B9E20A4282BCFACFC76AFF3245", 00:16:39.281 "uuid": "1318d9b9-e20a-4282-bcfa-cfc76aff3245" 00:16:39.281 } 00:16:39.281 ] 00:16:39.281 }, 00:16:39.281 { 00:16:39.281 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:39.281 "subtype": "NVMe", 00:16:39.281 "listen_addresses": [ 00:16:39.281 { 00:16:39.281 "transport": "VFIOUSER", 00:16:39.281 "trtype": "VFIOUSER", 00:16:39.281 "adrfam": "IPv4", 00:16:39.281 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:39.281 "trsvcid": "0" 00:16:39.281 } 00:16:39.281 ], 00:16:39.281 "allow_any_host": true, 00:16:39.281 "hosts": [], 00:16:39.281 "serial_number": "SPDK2", 00:16:39.281 "model_number": "SPDK bdev Controller", 00:16:39.281 "max_namespaces": 32, 00:16:39.281 "min_cntlid": 1, 00:16:39.281 "max_cntlid": 65519, 00:16:39.281 "namespaces": [ 00:16:39.281 { 00:16:39.281 "nsid": 1, 00:16:39.281 "bdev_name": "Malloc2", 00:16:39.281 "name": "Malloc2", 00:16:39.281 "nguid": "C600549DF57B4530A04D98B19B171165", 00:16:39.281 "uuid": "c600549d-f57b-4530-a04d-98b19b171165" 00:16:39.281 } 00:16:39.281 ] 00:16:39.281 } 00:16:39.281 ] 00:16:39.281 01:10:53 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:16:39.281 01:10:53 -- target/nvmf_vfio_user.sh@34 -- # aerpid=2014667 00:16:39.281 01:10:53 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:16:39.281 01:10:53 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:16:39.281 01:10:53 -- common/autotest_common.sh@1254 -- # local i=0 00:16:39.281 01:10:53 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:39.281 01:10:53 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:39.281 01:10:53 -- common/autotest_common.sh@1265 -- # return 0 00:16:39.281 01:10:53 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:16:39.281 01:10:53 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:16:39.281 EAL: No free 2048 kB hugepages reported on node 1 00:16:39.539 Malloc4 00:16:39.539 01:10:54 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:16:39.796 01:10:54 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:39.796 Asynchronous Event Request test 00:16:39.796 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:39.796 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:39.796 Registering asynchronous event callbacks... 00:16:39.796 Starting namespace attribute notice tests for all controllers... 00:16:39.796 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:16:39.796 aer_cb - Changed Namespace 00:16:39.796 Cleaning up... 00:16:40.054 [ 00:16:40.054 { 00:16:40.054 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:40.054 "subtype": "Discovery", 00:16:40.054 "listen_addresses": [], 00:16:40.054 "allow_any_host": true, 00:16:40.054 "hosts": [] 00:16:40.054 }, 00:16:40.054 { 00:16:40.054 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:40.054 "subtype": "NVMe", 00:16:40.054 "listen_addresses": [ 00:16:40.054 { 00:16:40.054 "transport": "VFIOUSER", 00:16:40.054 "trtype": "VFIOUSER", 00:16:40.054 "adrfam": "IPv4", 00:16:40.054 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:40.054 "trsvcid": "0" 00:16:40.054 } 00:16:40.054 ], 00:16:40.054 "allow_any_host": true, 00:16:40.054 "hosts": [], 00:16:40.054 "serial_number": "SPDK1", 00:16:40.054 "model_number": "SPDK bdev Controller", 00:16:40.054 "max_namespaces": 32, 00:16:40.054 "min_cntlid": 1, 00:16:40.054 "max_cntlid": 65519, 00:16:40.054 "namespaces": [ 00:16:40.054 { 00:16:40.054 "nsid": 1, 00:16:40.054 "bdev_name": "Malloc1", 00:16:40.054 "name": "Malloc1", 00:16:40.054 "nguid": "EF5F1EC0D0DE40E7926CE0BFA9AD604B", 00:16:40.054 "uuid": "ef5f1ec0-d0de-40e7-926c-e0bfa9ad604b" 00:16:40.054 }, 00:16:40.054 { 00:16:40.054 "nsid": 2, 00:16:40.054 "bdev_name": "Malloc3", 00:16:40.054 "name": "Malloc3", 00:16:40.054 "nguid": "1318D9B9E20A4282BCFACFC76AFF3245", 00:16:40.054 "uuid": "1318d9b9-e20a-4282-bcfa-cfc76aff3245" 00:16:40.054 } 00:16:40.054 ] 00:16:40.054 }, 00:16:40.054 { 00:16:40.054 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:40.054 "subtype": "NVMe", 00:16:40.054 "listen_addresses": [ 00:16:40.054 { 00:16:40.054 "transport": "VFIOUSER", 00:16:40.054 "trtype": "VFIOUSER", 00:16:40.054 "adrfam": "IPv4", 00:16:40.054 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:40.054 "trsvcid": "0" 00:16:40.054 } 00:16:40.054 ], 00:16:40.054 "allow_any_host": true, 00:16:40.054 "hosts": [], 00:16:40.054 "serial_number": "SPDK2", 00:16:40.054 "model_number": "SPDK bdev Controller", 00:16:40.054 "max_namespaces": 32, 00:16:40.054 "min_cntlid": 1, 00:16:40.054 "max_cntlid": 65519, 00:16:40.054 "namespaces": [ 00:16:40.054 { 00:16:40.054 "nsid": 1, 00:16:40.054 "bdev_name": "Malloc2", 00:16:40.054 "name": "Malloc2", 00:16:40.054 "nguid": "C600549DF57B4530A04D98B19B171165", 00:16:40.054 "uuid": "c600549d-f57b-4530-a04d-98b19b171165" 00:16:40.054 }, 00:16:40.054 { 00:16:40.054 "nsid": 2, 00:16:40.054 "bdev_name": "Malloc4", 00:16:40.054 "name": "Malloc4", 00:16:40.054 "nguid": "63483D4A58D44A48BD8AF98F126304C1", 00:16:40.054 "uuid": "63483d4a-58d4-4a48-bd8a-f98f126304c1" 00:16:40.054 } 00:16:40.054 ] 00:16:40.054 } 00:16:40.054 ] 00:16:40.054 01:10:54 -- target/nvmf_vfio_user.sh@44 -- # wait 2014667 00:16:40.054 01:10:54 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:16:40.054 01:10:54 -- target/nvmf_vfio_user.sh@95 -- # killprocess 2008891 00:16:40.054 01:10:54 -- common/autotest_common.sh@936 -- # '[' -z 2008891 ']' 00:16:40.054 01:10:54 -- common/autotest_common.sh@940 -- # kill -0 2008891 00:16:40.054 01:10:54 -- common/autotest_common.sh@941 -- # uname 00:16:40.054 01:10:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:40.054 01:10:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2008891 00:16:40.054 01:10:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:40.054 01:10:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:40.054 01:10:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2008891' 00:16:40.054 killing process with pid 2008891 00:16:40.054 01:10:54 -- common/autotest_common.sh@955 -- # kill 2008891 00:16:40.055 [2024-11-28 01:10:54.578417] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:16:40.055 01:10:54 -- common/autotest_common.sh@960 -- # wait 2008891 00:16:40.313 01:10:54 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:40.313 01:10:54 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:40.313 01:10:54 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:16:40.313 01:10:54 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:16:40.313 01:10:54 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:16:40.313 01:10:54 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=2014812 00:16:40.313 01:10:54 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:16:40.313 01:10:54 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 2014812' 00:16:40.313 Process pid: 2014812 00:16:40.313 01:10:54 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:40.313 01:10:54 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 2014812 00:16:40.313 01:10:54 -- common/autotest_common.sh@829 -- # '[' -z 2014812 ']' 00:16:40.313 01:10:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:40.313 01:10:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:40.313 01:10:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:40.313 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:40.313 01:10:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:40.313 01:10:54 -- common/autotest_common.sh@10 -- # set +x 00:16:40.581 [2024-11-28 01:10:54.924001] thread.c:2929:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:16:40.581 [2024-11-28 01:10:54.924994] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:40.581 [2024-11-28 01:10:54.925054] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:40.581 EAL: No free 2048 kB hugepages reported on node 1 00:16:40.581 [2024-11-28 01:10:54.984242] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:40.581 [2024-11-28 01:10:55.070632] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:40.581 [2024-11-28 01:10:55.070831] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:40.581 [2024-11-28 01:10:55.070849] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:40.581 [2024-11-28 01:10:55.070861] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:40.581 [2024-11-28 01:10:55.070913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:40.581 [2024-11-28 01:10:55.070937] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:40.581 [2024-11-28 01:10:55.070998] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:40.581 [2024-11-28 01:10:55.071001] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:40.581 [2024-11-28 01:10:55.168837] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:16:40.581 [2024-11-28 01:10:55.169121] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:16:40.581 [2024-11-28 01:10:55.169372] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:16:40.581 [2024-11-28 01:10:55.170088] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:16:40.581 [2024-11-28 01:10:55.170200] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:16:41.518 01:10:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:41.518 01:10:55 -- common/autotest_common.sh@862 -- # return 0 00:16:41.518 01:10:55 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:16:42.450 01:10:56 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:16:42.708 01:10:57 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:16:42.708 01:10:57 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:16:42.708 01:10:57 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:42.708 01:10:57 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:16:42.708 01:10:57 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:16:42.966 Malloc1 00:16:42.966 01:10:57 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:16:43.223 01:10:57 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:16:43.481 01:10:58 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:16:43.738 01:10:58 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:43.738 01:10:58 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:16:43.738 01:10:58 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:16:43.996 Malloc2 00:16:44.254 01:10:58 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:16:44.512 01:10:58 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:16:44.770 01:10:59 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:16:45.027 01:10:59 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:16:45.027 01:10:59 -- target/nvmf_vfio_user.sh@95 -- # killprocess 2014812 00:16:45.027 01:10:59 -- common/autotest_common.sh@936 -- # '[' -z 2014812 ']' 00:16:45.027 01:10:59 -- common/autotest_common.sh@940 -- # kill -0 2014812 00:16:45.027 01:10:59 -- common/autotest_common.sh@941 -- # uname 00:16:45.027 01:10:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:45.027 01:10:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2014812 00:16:45.027 01:10:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:45.027 01:10:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:45.027 01:10:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2014812' 00:16:45.028 killing process with pid 2014812 00:16:45.028 01:10:59 -- common/autotest_common.sh@955 -- # kill 2014812 00:16:45.028 01:10:59 -- common/autotest_common.sh@960 -- # wait 2014812 00:16:45.285 01:10:59 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:45.285 01:10:59 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:45.285 00:16:45.285 real 0m54.053s 00:16:45.285 user 3m33.786s 00:16:45.285 sys 0m4.392s 00:16:45.285 01:10:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:45.285 01:10:59 -- common/autotest_common.sh@10 -- # set +x 00:16:45.285 ************************************ 00:16:45.285 END TEST nvmf_vfio_user 00:16:45.285 ************************************ 00:16:45.285 01:10:59 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:45.285 01:10:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:45.285 01:10:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:45.285 01:10:59 -- common/autotest_common.sh@10 -- # set +x 00:16:45.285 ************************************ 00:16:45.285 START TEST nvmf_vfio_user_nvme_compliance 00:16:45.285 ************************************ 00:16:45.285 01:10:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:45.285 * Looking for test storage... 00:16:45.285 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:16:45.285 01:10:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:45.285 01:10:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:45.285 01:10:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:45.544 01:10:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:45.544 01:10:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:45.544 01:10:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:45.544 01:10:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:45.544 01:10:59 -- scripts/common.sh@335 -- # IFS=.-: 00:16:45.544 01:10:59 -- scripts/common.sh@335 -- # read -ra ver1 00:16:45.544 01:10:59 -- scripts/common.sh@336 -- # IFS=.-: 00:16:45.544 01:10:59 -- scripts/common.sh@336 -- # read -ra ver2 00:16:45.544 01:10:59 -- scripts/common.sh@337 -- # local 'op=<' 00:16:45.544 01:10:59 -- scripts/common.sh@339 -- # ver1_l=2 00:16:45.544 01:10:59 -- scripts/common.sh@340 -- # ver2_l=1 00:16:45.544 01:10:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:45.544 01:10:59 -- scripts/common.sh@343 -- # case "$op" in 00:16:45.544 01:10:59 -- scripts/common.sh@344 -- # : 1 00:16:45.544 01:10:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:45.544 01:10:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:45.544 01:10:59 -- scripts/common.sh@364 -- # decimal 1 00:16:45.544 01:10:59 -- scripts/common.sh@352 -- # local d=1 00:16:45.544 01:10:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:45.544 01:10:59 -- scripts/common.sh@354 -- # echo 1 00:16:45.544 01:10:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:45.544 01:10:59 -- scripts/common.sh@365 -- # decimal 2 00:16:45.544 01:10:59 -- scripts/common.sh@352 -- # local d=2 00:16:45.544 01:10:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:45.544 01:10:59 -- scripts/common.sh@354 -- # echo 2 00:16:45.544 01:10:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:45.544 01:10:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:45.544 01:10:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:45.544 01:10:59 -- scripts/common.sh@367 -- # return 0 00:16:45.544 01:10:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:45.544 01:10:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:45.544 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:45.544 --rc genhtml_branch_coverage=1 00:16:45.544 --rc genhtml_function_coverage=1 00:16:45.544 --rc genhtml_legend=1 00:16:45.544 --rc geninfo_all_blocks=1 00:16:45.544 --rc geninfo_unexecuted_blocks=1 00:16:45.544 00:16:45.544 ' 00:16:45.544 01:10:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:45.544 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:45.544 --rc genhtml_branch_coverage=1 00:16:45.544 --rc genhtml_function_coverage=1 00:16:45.544 --rc genhtml_legend=1 00:16:45.544 --rc geninfo_all_blocks=1 00:16:45.544 --rc geninfo_unexecuted_blocks=1 00:16:45.544 00:16:45.544 ' 00:16:45.544 01:10:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:45.544 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:45.544 --rc genhtml_branch_coverage=1 00:16:45.544 --rc genhtml_function_coverage=1 00:16:45.544 --rc genhtml_legend=1 00:16:45.544 --rc geninfo_all_blocks=1 00:16:45.544 --rc geninfo_unexecuted_blocks=1 00:16:45.544 00:16:45.544 ' 00:16:45.544 01:10:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:45.544 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:45.544 --rc genhtml_branch_coverage=1 00:16:45.544 --rc genhtml_function_coverage=1 00:16:45.544 --rc genhtml_legend=1 00:16:45.544 --rc geninfo_all_blocks=1 00:16:45.544 --rc geninfo_unexecuted_blocks=1 00:16:45.544 00:16:45.544 ' 00:16:45.544 01:10:59 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:45.544 01:10:59 -- nvmf/common.sh@7 -- # uname -s 00:16:45.544 01:10:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:45.544 01:10:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:45.544 01:10:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:45.544 01:10:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:45.544 01:10:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:45.544 01:10:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:45.544 01:10:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:45.544 01:10:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:45.544 01:10:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:45.544 01:10:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:45.544 01:10:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:45.544 01:10:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:45.544 01:10:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:45.544 01:10:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:45.544 01:10:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:45.544 01:10:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:45.544 01:10:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:45.544 01:10:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:45.544 01:10:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:45.544 01:10:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:45.544 01:10:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:45.544 01:10:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:45.545 01:10:59 -- paths/export.sh@5 -- # export PATH 00:16:45.545 01:10:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:45.545 01:10:59 -- nvmf/common.sh@46 -- # : 0 00:16:45.545 01:10:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:45.545 01:10:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:45.545 01:10:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:45.545 01:10:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:45.545 01:10:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:45.545 01:10:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:45.545 01:10:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:45.545 01:10:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:45.545 01:10:59 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:45.545 01:10:59 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:45.545 01:10:59 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:16:45.545 01:10:59 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:16:45.545 01:10:59 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:16:45.545 01:10:59 -- compliance/compliance.sh@20 -- # nvmfpid=2015561 00:16:45.545 01:10:59 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:45.545 01:10:59 -- compliance/compliance.sh@21 -- # echo 'Process pid: 2015561' 00:16:45.545 Process pid: 2015561 00:16:45.545 01:10:59 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:45.545 01:10:59 -- compliance/compliance.sh@24 -- # waitforlisten 2015561 00:16:45.545 01:10:59 -- common/autotest_common.sh@829 -- # '[' -z 2015561 ']' 00:16:45.545 01:10:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:45.545 01:10:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:45.545 01:10:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:45.545 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:45.545 01:10:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:45.545 01:10:59 -- common/autotest_common.sh@10 -- # set +x 00:16:45.545 [2024-11-28 01:10:59.975897] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:45.545 [2024-11-28 01:10:59.975978] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:45.545 EAL: No free 2048 kB hugepages reported on node 1 00:16:45.545 [2024-11-28 01:11:00.036655] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:45.545 [2024-11-28 01:11:00.126629] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:45.545 [2024-11-28 01:11:00.126801] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:45.545 [2024-11-28 01:11:00.126829] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:45.545 [2024-11-28 01:11:00.126843] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:45.545 [2024-11-28 01:11:00.126899] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:45.545 [2024-11-28 01:11:00.126954] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:45.545 [2024-11-28 01:11:00.126957] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:46.477 01:11:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:46.477 01:11:00 -- common/autotest_common.sh@862 -- # return 0 00:16:46.478 01:11:00 -- compliance/compliance.sh@26 -- # sleep 1 00:16:47.409 01:11:01 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:47.409 01:11:01 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:16:47.409 01:11:01 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:47.409 01:11:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:47.409 01:11:01 -- common/autotest_common.sh@10 -- # set +x 00:16:47.409 01:11:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:47.409 01:11:01 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:16:47.409 01:11:01 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:47.409 01:11:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:47.409 01:11:01 -- common/autotest_common.sh@10 -- # set +x 00:16:47.667 malloc0 00:16:47.667 01:11:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:47.667 01:11:02 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:16:47.667 01:11:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:47.667 01:11:02 -- common/autotest_common.sh@10 -- # set +x 00:16:47.667 01:11:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:47.667 01:11:02 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:47.667 01:11:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:47.667 01:11:02 -- common/autotest_common.sh@10 -- # set +x 00:16:47.667 01:11:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:47.667 01:11:02 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:47.667 01:11:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:47.667 01:11:02 -- common/autotest_common.sh@10 -- # set +x 00:16:47.667 01:11:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:47.667 01:11:02 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:16:47.667 EAL: No free 2048 kB hugepages reported on node 1 00:16:47.667 00:16:47.667 00:16:47.667 CUnit - A unit testing framework for C - Version 2.1-3 00:16:47.667 http://cunit.sourceforge.net/ 00:16:47.667 00:16:47.667 00:16:47.667 Suite: nvme_compliance 00:16:47.667 Test: admin_identify_ctrlr_verify_dptr ...[2024-11-28 01:11:02.194317] vfio_user.c: 789:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:16:47.667 [2024-11-28 01:11:02.194374] vfio_user.c:5484:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:16:47.667 [2024-11-28 01:11:02.194403] vfio_user.c:5576:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:16:47.667 passed 00:16:47.927 Test: admin_identify_ctrlr_verify_fused ...passed 00:16:47.927 Test: admin_identify_ns ...[2024-11-28 01:11:02.434546] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:16:47.927 [2024-11-28 01:11:02.442551] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:16:47.927 passed 00:16:48.184 Test: admin_get_features_mandatory_features ...passed 00:16:48.184 Test: admin_get_features_optional_features ...passed 00:16:48.442 Test: admin_set_features_number_of_queues ...passed 00:16:48.442 Test: admin_get_log_page_mandatory_logs ...passed 00:16:48.699 Test: admin_get_log_page_with_lpo ...[2024-11-28 01:11:03.061545] ctrlr.c:2546:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:16:48.699 passed 00:16:48.699 Test: fabric_property_get ...passed 00:16:48.699 Test: admin_delete_io_sq_use_admin_qid ...[2024-11-28 01:11:03.248187] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:16:48.699 passed 00:16:48.956 Test: admin_delete_io_sq_delete_sq_twice ...[2024-11-28 01:11:03.419537] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:48.956 [2024-11-28 01:11:03.435542] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:48.956 passed 00:16:48.956 Test: admin_delete_io_cq_use_admin_qid ...[2024-11-28 01:11:03.526660] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:16:49.214 passed 00:16:49.214 Test: admin_delete_io_cq_delete_cq_first ...[2024-11-28 01:11:03.685554] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:49.214 [2024-11-28 01:11:03.709536] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:49.214 passed 00:16:49.214 Test: admin_create_io_cq_verify_iv_pc ...[2024-11-28 01:11:03.797241] vfio_user.c:2150:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:16:49.214 [2024-11-28 01:11:03.797296] vfio_user.c:2144:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:16:49.471 passed 00:16:49.471 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-11-28 01:11:03.977549] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:16:49.471 [2024-11-28 01:11:03.985553] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:16:49.471 [2024-11-28 01:11:03.993541] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:16:49.471 [2024-11-28 01:11:04.001554] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:16:49.471 passed 00:16:49.729 Test: admin_create_io_sq_verify_pc ...[2024-11-28 01:11:04.138566] vfio_user.c:2044:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:16:49.729 passed 00:16:51.100 Test: admin_create_io_qp_max_qps ...[2024-11-28 01:11:05.334544] nvme_ctrlr.c:5318:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:16:51.357 passed 00:16:51.357 Test: admin_create_io_sq_shared_cq ...[2024-11-28 01:11:05.938542] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:51.614 passed 00:16:51.614 00:16:51.614 Run Summary: Type Total Ran Passed Failed Inactive 00:16:51.614 suites 1 1 n/a 0 0 00:16:51.614 tests 18 18 18 0 0 00:16:51.614 asserts 360 360 360 0 n/a 00:16:51.614 00:16:51.614 Elapsed time = 1.568 seconds 00:16:51.614 01:11:06 -- compliance/compliance.sh@42 -- # killprocess 2015561 00:16:51.614 01:11:06 -- common/autotest_common.sh@936 -- # '[' -z 2015561 ']' 00:16:51.615 01:11:06 -- common/autotest_common.sh@940 -- # kill -0 2015561 00:16:51.615 01:11:06 -- common/autotest_common.sh@941 -- # uname 00:16:51.615 01:11:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:51.615 01:11:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2015561 00:16:51.615 01:11:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:51.615 01:11:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:51.615 01:11:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2015561' 00:16:51.615 killing process with pid 2015561 00:16:51.615 01:11:06 -- common/autotest_common.sh@955 -- # kill 2015561 00:16:51.615 01:11:06 -- common/autotest_common.sh@960 -- # wait 2015561 00:16:51.873 01:11:06 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:16:51.873 01:11:06 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:16:51.873 00:16:51.873 real 0m6.546s 00:16:51.873 user 0m18.629s 00:16:51.873 sys 0m0.611s 00:16:51.873 01:11:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:51.873 01:11:06 -- common/autotest_common.sh@10 -- # set +x 00:16:51.873 ************************************ 00:16:51.873 END TEST nvmf_vfio_user_nvme_compliance 00:16:51.873 ************************************ 00:16:51.873 01:11:06 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:51.873 01:11:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:51.873 01:11:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:51.873 01:11:06 -- common/autotest_common.sh@10 -- # set +x 00:16:51.873 ************************************ 00:16:51.873 START TEST nvmf_vfio_user_fuzz 00:16:51.873 ************************************ 00:16:51.873 01:11:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:51.873 * Looking for test storage... 00:16:51.873 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:51.873 01:11:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:51.873 01:11:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:51.873 01:11:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:52.132 01:11:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:52.132 01:11:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:52.132 01:11:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:52.132 01:11:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:52.132 01:11:06 -- scripts/common.sh@335 -- # IFS=.-: 00:16:52.132 01:11:06 -- scripts/common.sh@335 -- # read -ra ver1 00:16:52.132 01:11:06 -- scripts/common.sh@336 -- # IFS=.-: 00:16:52.132 01:11:06 -- scripts/common.sh@336 -- # read -ra ver2 00:16:52.132 01:11:06 -- scripts/common.sh@337 -- # local 'op=<' 00:16:52.132 01:11:06 -- scripts/common.sh@339 -- # ver1_l=2 00:16:52.132 01:11:06 -- scripts/common.sh@340 -- # ver2_l=1 00:16:52.132 01:11:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:52.132 01:11:06 -- scripts/common.sh@343 -- # case "$op" in 00:16:52.132 01:11:06 -- scripts/common.sh@344 -- # : 1 00:16:52.132 01:11:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:52.132 01:11:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:52.132 01:11:06 -- scripts/common.sh@364 -- # decimal 1 00:16:52.132 01:11:06 -- scripts/common.sh@352 -- # local d=1 00:16:52.132 01:11:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:52.132 01:11:06 -- scripts/common.sh@354 -- # echo 1 00:16:52.132 01:11:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:52.132 01:11:06 -- scripts/common.sh@365 -- # decimal 2 00:16:52.132 01:11:06 -- scripts/common.sh@352 -- # local d=2 00:16:52.132 01:11:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:52.132 01:11:06 -- scripts/common.sh@354 -- # echo 2 00:16:52.132 01:11:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:52.132 01:11:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:52.132 01:11:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:52.132 01:11:06 -- scripts/common.sh@367 -- # return 0 00:16:52.132 01:11:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:52.132 01:11:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:52.132 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:52.132 --rc genhtml_branch_coverage=1 00:16:52.132 --rc genhtml_function_coverage=1 00:16:52.132 --rc genhtml_legend=1 00:16:52.132 --rc geninfo_all_blocks=1 00:16:52.132 --rc geninfo_unexecuted_blocks=1 00:16:52.132 00:16:52.132 ' 00:16:52.132 01:11:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:52.132 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:52.132 --rc genhtml_branch_coverage=1 00:16:52.132 --rc genhtml_function_coverage=1 00:16:52.132 --rc genhtml_legend=1 00:16:52.132 --rc geninfo_all_blocks=1 00:16:52.132 --rc geninfo_unexecuted_blocks=1 00:16:52.132 00:16:52.132 ' 00:16:52.132 01:11:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:52.132 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:52.132 --rc genhtml_branch_coverage=1 00:16:52.132 --rc genhtml_function_coverage=1 00:16:52.132 --rc genhtml_legend=1 00:16:52.132 --rc geninfo_all_blocks=1 00:16:52.132 --rc geninfo_unexecuted_blocks=1 00:16:52.132 00:16:52.132 ' 00:16:52.132 01:11:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:52.132 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:52.132 --rc genhtml_branch_coverage=1 00:16:52.132 --rc genhtml_function_coverage=1 00:16:52.132 --rc genhtml_legend=1 00:16:52.132 --rc geninfo_all_blocks=1 00:16:52.132 --rc geninfo_unexecuted_blocks=1 00:16:52.132 00:16:52.132 ' 00:16:52.132 01:11:06 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:52.132 01:11:06 -- nvmf/common.sh@7 -- # uname -s 00:16:52.132 01:11:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:52.132 01:11:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:52.132 01:11:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:52.132 01:11:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:52.132 01:11:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:52.132 01:11:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:52.132 01:11:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:52.132 01:11:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:52.132 01:11:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:52.132 01:11:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:52.132 01:11:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:52.132 01:11:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:52.132 01:11:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:52.132 01:11:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:52.132 01:11:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:52.132 01:11:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:52.132 01:11:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:52.132 01:11:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:52.132 01:11:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:52.132 01:11:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:52.132 01:11:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:52.132 01:11:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:52.132 01:11:06 -- paths/export.sh@5 -- # export PATH 00:16:52.133 01:11:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:52.133 01:11:06 -- nvmf/common.sh@46 -- # : 0 00:16:52.133 01:11:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:52.133 01:11:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:52.133 01:11:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:52.133 01:11:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:52.133 01:11:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:52.133 01:11:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:52.133 01:11:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:52.133 01:11:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:52.133 01:11:06 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:16:52.133 01:11:06 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:16:52.133 01:11:06 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:52.133 01:11:06 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:16:52.133 01:11:06 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:16:52.133 01:11:06 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:16:52.133 01:11:06 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:16:52.133 01:11:06 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=2016433 00:16:52.133 01:11:06 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:52.133 01:11:06 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 2016433' 00:16:52.133 Process pid: 2016433 00:16:52.133 01:11:06 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:52.133 01:11:06 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 2016433 00:16:52.133 01:11:06 -- common/autotest_common.sh@829 -- # '[' -z 2016433 ']' 00:16:52.133 01:11:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:52.133 01:11:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:52.133 01:11:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:52.133 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:52.133 01:11:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:52.133 01:11:06 -- common/autotest_common.sh@10 -- # set +x 00:16:53.066 01:11:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:53.066 01:11:07 -- common/autotest_common.sh@862 -- # return 0 00:16:53.067 01:11:07 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:16:54.000 01:11:08 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:54.000 01:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:54.000 01:11:08 -- common/autotest_common.sh@10 -- # set +x 00:16:54.000 01:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:54.000 01:11:08 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:16:54.000 01:11:08 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:54.000 01:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:54.000 01:11:08 -- common/autotest_common.sh@10 -- # set +x 00:16:54.000 malloc0 00:16:54.000 01:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:54.000 01:11:08 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:16:54.000 01:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:54.000 01:11:08 -- common/autotest_common.sh@10 -- # set +x 00:16:54.259 01:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:54.259 01:11:08 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:54.259 01:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:54.259 01:11:08 -- common/autotest_common.sh@10 -- # set +x 00:16:54.259 01:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:54.259 01:11:08 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:54.259 01:11:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:54.259 01:11:08 -- common/autotest_common.sh@10 -- # set +x 00:16:54.259 01:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:54.259 01:11:08 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:16:54.259 01:11:08 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/vfio_user_fuzz -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:17:26.323 Fuzzing completed. Shutting down the fuzz application 00:17:26.323 00:17:26.323 Dumping successful admin opcodes: 00:17:26.323 8, 9, 10, 24, 00:17:26.323 Dumping successful io opcodes: 00:17:26.323 0, 00:17:26.323 NS: 0x200003a1ef00 I/O qp, Total commands completed: 581195, total successful commands: 2232, random_seed: 1569879808 00:17:26.323 NS: 0x200003a1ef00 admin qp, Total commands completed: 144285, total successful commands: 1173, random_seed: 3235265664 00:17:26.323 01:11:39 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:17:26.323 01:11:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:26.323 01:11:39 -- common/autotest_common.sh@10 -- # set +x 00:17:26.323 01:11:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:26.323 01:11:39 -- target/vfio_user_fuzz.sh@46 -- # killprocess 2016433 00:17:26.323 01:11:39 -- common/autotest_common.sh@936 -- # '[' -z 2016433 ']' 00:17:26.323 01:11:39 -- common/autotest_common.sh@940 -- # kill -0 2016433 00:17:26.323 01:11:39 -- common/autotest_common.sh@941 -- # uname 00:17:26.323 01:11:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:26.323 01:11:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2016433 00:17:26.323 01:11:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:26.323 01:11:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:26.323 01:11:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2016433' 00:17:26.323 killing process with pid 2016433 00:17:26.323 01:11:39 -- common/autotest_common.sh@955 -- # kill 2016433 00:17:26.323 01:11:39 -- common/autotest_common.sh@960 -- # wait 2016433 00:17:26.323 01:11:39 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:17:26.323 01:11:39 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:17:26.323 00:17:26.323 real 0m33.067s 00:17:26.323 user 0m33.911s 00:17:26.323 sys 0m26.319s 00:17:26.323 01:11:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:26.323 01:11:39 -- common/autotest_common.sh@10 -- # set +x 00:17:26.323 ************************************ 00:17:26.323 END TEST nvmf_vfio_user_fuzz 00:17:26.323 ************************************ 00:17:26.323 01:11:39 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:17:26.323 01:11:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:26.324 01:11:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:26.324 01:11:39 -- common/autotest_common.sh@10 -- # set +x 00:17:26.324 ************************************ 00:17:26.324 START TEST nvmf_host_management 00:17:26.324 ************************************ 00:17:26.324 01:11:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:17:26.324 * Looking for test storage... 00:17:26.324 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:26.324 01:11:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:26.324 01:11:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:26.324 01:11:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:26.324 01:11:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:26.324 01:11:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:26.324 01:11:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:26.324 01:11:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:26.324 01:11:39 -- scripts/common.sh@335 -- # IFS=.-: 00:17:26.324 01:11:39 -- scripts/common.sh@335 -- # read -ra ver1 00:17:26.324 01:11:39 -- scripts/common.sh@336 -- # IFS=.-: 00:17:26.324 01:11:39 -- scripts/common.sh@336 -- # read -ra ver2 00:17:26.324 01:11:39 -- scripts/common.sh@337 -- # local 'op=<' 00:17:26.324 01:11:39 -- scripts/common.sh@339 -- # ver1_l=2 00:17:26.324 01:11:39 -- scripts/common.sh@340 -- # ver2_l=1 00:17:26.324 01:11:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:26.324 01:11:39 -- scripts/common.sh@343 -- # case "$op" in 00:17:26.324 01:11:39 -- scripts/common.sh@344 -- # : 1 00:17:26.324 01:11:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:26.324 01:11:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:26.324 01:11:39 -- scripts/common.sh@364 -- # decimal 1 00:17:26.324 01:11:39 -- scripts/common.sh@352 -- # local d=1 00:17:26.324 01:11:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:26.324 01:11:39 -- scripts/common.sh@354 -- # echo 1 00:17:26.324 01:11:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:26.324 01:11:39 -- scripts/common.sh@365 -- # decimal 2 00:17:26.324 01:11:39 -- scripts/common.sh@352 -- # local d=2 00:17:26.324 01:11:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:26.324 01:11:39 -- scripts/common.sh@354 -- # echo 2 00:17:26.324 01:11:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:26.324 01:11:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:26.324 01:11:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:26.324 01:11:39 -- scripts/common.sh@367 -- # return 0 00:17:26.324 01:11:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:26.324 01:11:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:26.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:26.324 --rc genhtml_branch_coverage=1 00:17:26.324 --rc genhtml_function_coverage=1 00:17:26.324 --rc genhtml_legend=1 00:17:26.324 --rc geninfo_all_blocks=1 00:17:26.324 --rc geninfo_unexecuted_blocks=1 00:17:26.324 00:17:26.324 ' 00:17:26.324 01:11:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:26.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:26.324 --rc genhtml_branch_coverage=1 00:17:26.324 --rc genhtml_function_coverage=1 00:17:26.324 --rc genhtml_legend=1 00:17:26.324 --rc geninfo_all_blocks=1 00:17:26.324 --rc geninfo_unexecuted_blocks=1 00:17:26.324 00:17:26.324 ' 00:17:26.324 01:11:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:26.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:26.324 --rc genhtml_branch_coverage=1 00:17:26.324 --rc genhtml_function_coverage=1 00:17:26.324 --rc genhtml_legend=1 00:17:26.324 --rc geninfo_all_blocks=1 00:17:26.324 --rc geninfo_unexecuted_blocks=1 00:17:26.324 00:17:26.324 ' 00:17:26.324 01:11:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:26.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:26.324 --rc genhtml_branch_coverage=1 00:17:26.324 --rc genhtml_function_coverage=1 00:17:26.324 --rc genhtml_legend=1 00:17:26.324 --rc geninfo_all_blocks=1 00:17:26.324 --rc geninfo_unexecuted_blocks=1 00:17:26.324 00:17:26.324 ' 00:17:26.324 01:11:39 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:26.324 01:11:39 -- nvmf/common.sh@7 -- # uname -s 00:17:26.324 01:11:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:26.324 01:11:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:26.324 01:11:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:26.324 01:11:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:26.324 01:11:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:26.324 01:11:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:26.324 01:11:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:26.324 01:11:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:26.324 01:11:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:26.324 01:11:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:26.324 01:11:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:26.324 01:11:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:26.324 01:11:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:26.324 01:11:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:26.324 01:11:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:26.324 01:11:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:26.324 01:11:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:26.324 01:11:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:26.324 01:11:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:26.324 01:11:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:26.324 01:11:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:26.324 01:11:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:26.324 01:11:39 -- paths/export.sh@5 -- # export PATH 00:17:26.324 01:11:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:26.324 01:11:39 -- nvmf/common.sh@46 -- # : 0 00:17:26.324 01:11:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:26.324 01:11:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:26.324 01:11:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:26.324 01:11:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:26.324 01:11:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:26.324 01:11:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:26.324 01:11:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:26.325 01:11:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:26.325 01:11:39 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:26.325 01:11:39 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:26.325 01:11:39 -- target/host_management.sh@104 -- # nvmftestinit 00:17:26.325 01:11:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:26.325 01:11:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:26.325 01:11:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:26.325 01:11:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:26.325 01:11:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:26.325 01:11:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:26.325 01:11:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:26.325 01:11:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:26.325 01:11:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:26.325 01:11:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:26.325 01:11:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:26.325 01:11:39 -- common/autotest_common.sh@10 -- # set +x 00:17:27.261 01:11:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:27.261 01:11:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:27.261 01:11:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:27.261 01:11:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:27.261 01:11:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:27.261 01:11:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:27.261 01:11:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:27.261 01:11:41 -- nvmf/common.sh@294 -- # net_devs=() 00:17:27.261 01:11:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:27.261 01:11:41 -- nvmf/common.sh@295 -- # e810=() 00:17:27.261 01:11:41 -- nvmf/common.sh@295 -- # local -ga e810 00:17:27.261 01:11:41 -- nvmf/common.sh@296 -- # x722=() 00:17:27.261 01:11:41 -- nvmf/common.sh@296 -- # local -ga x722 00:17:27.261 01:11:41 -- nvmf/common.sh@297 -- # mlx=() 00:17:27.261 01:11:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:27.261 01:11:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:27.261 01:11:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:27.261 01:11:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:27.261 01:11:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:27.261 01:11:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:27.261 01:11:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:27.261 01:11:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:27.261 01:11:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:27.261 01:11:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:27.261 01:11:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:27.261 01:11:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:27.261 01:11:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:27.261 01:11:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:27.261 01:11:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:27.261 01:11:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:27.261 01:11:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:27.261 01:11:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:27.261 01:11:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:27.261 01:11:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:27.261 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:27.261 01:11:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:27.261 01:11:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:27.261 01:11:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:27.261 01:11:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:27.261 01:11:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:27.261 01:11:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:27.261 01:11:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:27.261 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:27.261 01:11:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:27.261 01:11:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:27.261 01:11:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:27.261 01:11:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:27.261 01:11:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:27.261 01:11:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:27.261 01:11:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:27.261 01:11:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:27.261 01:11:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:27.261 01:11:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:27.261 01:11:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:27.261 01:11:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:27.261 01:11:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:27.261 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:27.261 01:11:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:27.261 01:11:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:27.261 01:11:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:27.261 01:11:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:27.261 01:11:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:27.261 01:11:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:27.261 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:27.261 01:11:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:27.261 01:11:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:27.261 01:11:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:27.261 01:11:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:27.261 01:11:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:27.261 01:11:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:27.261 01:11:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:27.261 01:11:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:27.261 01:11:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:27.261 01:11:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:27.261 01:11:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:27.261 01:11:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:27.261 01:11:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:27.261 01:11:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:27.261 01:11:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:27.261 01:11:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:27.261 01:11:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:27.261 01:11:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:27.261 01:11:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:27.261 01:11:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:27.261 01:11:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:27.262 01:11:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:27.262 01:11:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:27.262 01:11:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:27.262 01:11:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:27.262 01:11:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:27.262 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:27.262 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.320 ms 00:17:27.262 00:17:27.262 --- 10.0.0.2 ping statistics --- 00:17:27.262 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:27.262 rtt min/avg/max/mdev = 0.320/0.320/0.320/0.000 ms 00:17:27.262 01:11:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:27.262 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:27.262 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:17:27.262 00:17:27.262 --- 10.0.0.1 ping statistics --- 00:17:27.262 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:27.262 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:17:27.262 01:11:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:27.262 01:11:41 -- nvmf/common.sh@410 -- # return 0 00:17:27.262 01:11:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:27.262 01:11:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:27.262 01:11:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:27.262 01:11:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:27.262 01:11:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:27.262 01:11:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:27.262 01:11:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:27.262 01:11:41 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:17:27.262 01:11:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:27.262 01:11:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:27.262 01:11:41 -- common/autotest_common.sh@10 -- # set +x 00:17:27.262 ************************************ 00:17:27.262 START TEST nvmf_host_management 00:17:27.262 ************************************ 00:17:27.262 01:11:41 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:17:27.262 01:11:41 -- target/host_management.sh@69 -- # starttarget 00:17:27.262 01:11:41 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:17:27.262 01:11:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:27.262 01:11:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:27.262 01:11:41 -- common/autotest_common.sh@10 -- # set +x 00:17:27.262 01:11:41 -- nvmf/common.sh@469 -- # nvmfpid=2022030 00:17:27.262 01:11:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:17:27.262 01:11:41 -- nvmf/common.sh@470 -- # waitforlisten 2022030 00:17:27.262 01:11:41 -- common/autotest_common.sh@829 -- # '[' -z 2022030 ']' 00:17:27.262 01:11:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:27.262 01:11:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:27.262 01:11:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:27.262 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:27.262 01:11:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:27.262 01:11:41 -- common/autotest_common.sh@10 -- # set +x 00:17:27.262 [2024-11-28 01:11:41.734778] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:27.262 [2024-11-28 01:11:41.734873] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:27.262 EAL: No free 2048 kB hugepages reported on node 1 00:17:27.262 [2024-11-28 01:11:41.799417] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:27.521 [2024-11-28 01:11:41.885977] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:27.521 [2024-11-28 01:11:41.886141] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:27.521 [2024-11-28 01:11:41.886162] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:27.521 [2024-11-28 01:11:41.886175] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:27.521 [2024-11-28 01:11:41.886226] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:27.521 [2024-11-28 01:11:41.886287] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:27.521 [2024-11-28 01:11:41.886332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:27.521 [2024-11-28 01:11:41.886335] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:28.455 01:11:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:28.455 01:11:42 -- common/autotest_common.sh@862 -- # return 0 00:17:28.455 01:11:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:28.455 01:11:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:28.455 01:11:42 -- common/autotest_common.sh@10 -- # set +x 00:17:28.455 01:11:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:28.455 01:11:42 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:28.455 01:11:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:28.455 01:11:42 -- common/autotest_common.sh@10 -- # set +x 00:17:28.455 [2024-11-28 01:11:42.733284] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:28.455 01:11:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:28.455 01:11:42 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:17:28.455 01:11:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:28.455 01:11:42 -- common/autotest_common.sh@10 -- # set +x 00:17:28.455 01:11:42 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:28.455 01:11:42 -- target/host_management.sh@23 -- # cat 00:17:28.455 01:11:42 -- target/host_management.sh@30 -- # rpc_cmd 00:17:28.455 01:11:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:28.455 01:11:42 -- common/autotest_common.sh@10 -- # set +x 00:17:28.455 Malloc0 00:17:28.455 [2024-11-28 01:11:42.794551] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:28.455 01:11:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:28.455 01:11:42 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:17:28.455 01:11:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:28.455 01:11:42 -- common/autotest_common.sh@10 -- # set +x 00:17:28.455 01:11:42 -- target/host_management.sh@73 -- # perfpid=2022206 00:17:28.455 01:11:42 -- target/host_management.sh@74 -- # waitforlisten 2022206 /var/tmp/bdevperf.sock 00:17:28.455 01:11:42 -- common/autotest_common.sh@829 -- # '[' -z 2022206 ']' 00:17:28.455 01:11:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:28.455 01:11:42 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:17:28.455 01:11:42 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:17:28.455 01:11:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:28.455 01:11:42 -- nvmf/common.sh@520 -- # config=() 00:17:28.455 01:11:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:28.455 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:28.455 01:11:42 -- nvmf/common.sh@520 -- # local subsystem config 00:17:28.455 01:11:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:28.455 01:11:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:28.455 01:11:42 -- common/autotest_common.sh@10 -- # set +x 00:17:28.455 01:11:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:28.455 { 00:17:28.455 "params": { 00:17:28.455 "name": "Nvme$subsystem", 00:17:28.455 "trtype": "$TEST_TRANSPORT", 00:17:28.455 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:28.455 "adrfam": "ipv4", 00:17:28.455 "trsvcid": "$NVMF_PORT", 00:17:28.455 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:28.455 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:28.455 "hdgst": ${hdgst:-false}, 00:17:28.455 "ddgst": ${ddgst:-false} 00:17:28.455 }, 00:17:28.455 "method": "bdev_nvme_attach_controller" 00:17:28.455 } 00:17:28.455 EOF 00:17:28.455 )") 00:17:28.455 01:11:42 -- nvmf/common.sh@542 -- # cat 00:17:28.455 01:11:42 -- nvmf/common.sh@544 -- # jq . 00:17:28.455 01:11:42 -- nvmf/common.sh@545 -- # IFS=, 00:17:28.455 01:11:42 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:28.455 "params": { 00:17:28.455 "name": "Nvme0", 00:17:28.455 "trtype": "tcp", 00:17:28.455 "traddr": "10.0.0.2", 00:17:28.455 "adrfam": "ipv4", 00:17:28.455 "trsvcid": "4420", 00:17:28.455 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:28.456 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:28.456 "hdgst": false, 00:17:28.456 "ddgst": false 00:17:28.456 }, 00:17:28.456 "method": "bdev_nvme_attach_controller" 00:17:28.456 }' 00:17:28.456 [2024-11-28 01:11:42.871048] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:28.456 [2024-11-28 01:11:42.871138] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2022206 ] 00:17:28.456 EAL: No free 2048 kB hugepages reported on node 1 00:17:28.456 [2024-11-28 01:11:42.932692] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:28.456 [2024-11-28 01:11:43.018414] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:29.021 Running I/O for 10 seconds... 00:17:29.280 01:11:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:29.280 01:11:43 -- common/autotest_common.sh@862 -- # return 0 00:17:29.280 01:11:43 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:17:29.280 01:11:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:29.280 01:11:43 -- common/autotest_common.sh@10 -- # set +x 00:17:29.280 01:11:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:29.280 01:11:43 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:29.280 01:11:43 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:17:29.280 01:11:43 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:17:29.280 01:11:43 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:17:29.280 01:11:43 -- target/host_management.sh@52 -- # local ret=1 00:17:29.280 01:11:43 -- target/host_management.sh@53 -- # local i 00:17:29.280 01:11:43 -- target/host_management.sh@54 -- # (( i = 10 )) 00:17:29.280 01:11:43 -- target/host_management.sh@54 -- # (( i != 0 )) 00:17:29.280 01:11:43 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:17:29.280 01:11:43 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:17:29.280 01:11:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:29.280 01:11:43 -- common/autotest_common.sh@10 -- # set +x 00:17:29.280 01:11:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:29.280 01:11:43 -- target/host_management.sh@55 -- # read_io_count=1572 00:17:29.280 01:11:43 -- target/host_management.sh@58 -- # '[' 1572 -ge 100 ']' 00:17:29.280 01:11:43 -- target/host_management.sh@59 -- # ret=0 00:17:29.280 01:11:43 -- target/host_management.sh@60 -- # break 00:17:29.280 01:11:43 -- target/host_management.sh@64 -- # return 0 00:17:29.280 01:11:43 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:29.280 01:11:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:29.280 01:11:43 -- common/autotest_common.sh@10 -- # set +x 00:17:29.540 [2024-11-28 01:11:43.887145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.540 [2024-11-28 01:11:43.887249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.540 [2024-11-28 01:11:43.887266] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.540 [2024-11-28 01:11:43.887278] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.540 [2024-11-28 01:11:43.887289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.540 [2024-11-28 01:11:43.887301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.540 [2024-11-28 01:11:43.887322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.540 [2024-11-28 01:11:43.887334] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.540 [2024-11-28 01:11:43.887346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.540 [2024-11-28 01:11:43.887357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.540 [2024-11-28 01:11:43.887368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.540 [2024-11-28 01:11:43.887380] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.540 [2024-11-28 01:11:43.887392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.540 [2024-11-28 01:11:43.887404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.540 [2024-11-28 01:11:43.887415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.540 [2024-11-28 01:11:43.887427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.540 [2024-11-28 01:11:43.887438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.540 [2024-11-28 01:11:43.887449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.540 [2024-11-28 01:11:43.887460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.540 [2024-11-28 01:11:43.887472] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.540 [2024-11-28 01:11:43.887483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.541 [2024-11-28 01:11:43.887494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.541 [2024-11-28 01:11:43.887539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.541 [2024-11-28 01:11:43.887554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1104f40 is same with the state(5) to be set 00:17:29.541 [2024-11-28 01:11:43.887673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:82048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.887714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.887742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:88320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.887758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.887776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:88448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.887792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.887818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:88576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.887849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.887871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:88704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.887886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.887902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:88832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.887917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.887932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:88960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.887945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.887960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:89088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.887974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.887990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:89216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.888004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.888019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:89344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.888033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.888050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:89472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.888064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.888079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:89600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.888095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.888110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:89728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.888126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.888143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:89856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.888159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.888175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:89984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.888190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.888207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:82304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.888222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.888239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:82560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.888259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.888276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:90112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.888292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.888309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:90240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.888324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.888341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:90368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.888356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.888372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:90496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.888388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.888404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:90624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.888419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.888435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:82816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.888450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.888467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:82944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.888483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.888499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:83072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.888544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.888565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:83200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.888581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.888599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:83584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.888614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.888631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:83840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.541 [2024-11-28 01:11:43.888647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.541 [2024-11-28 01:11:43.888664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:84096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.888680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.888702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:90752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.888718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.888735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:90880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.888751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.888768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:91008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.888784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.888802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:91136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.888833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.888851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:91264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.888866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.888883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:91392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.888899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.888915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:91520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.888931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.888949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:91648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.888964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.888980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:84224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.888996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:91776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:91904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:92032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:92160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:92288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:92416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:92544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:92672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:92800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:92928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:93056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:93184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:84480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:84608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:93312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:85120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:85248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:85760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:85888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:86272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:86400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.542 [2024-11-28 01:11:43.889715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:86528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.542 [2024-11-28 01:11:43.889730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.543 [2024-11-28 01:11:43.889747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:87168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.543 [2024-11-28 01:11:43.889762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.543 [2024-11-28 01:11:43.889779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:87296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.543 [2024-11-28 01:11:43.889794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.543 [2024-11-28 01:11:43.889811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:87424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.543 [2024-11-28 01:11:43.889828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.543 [2024-11-28 01:11:43.889845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:88192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:29.543 [2024-11-28 01:11:43.889877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:29.543 [2024-11-28 01:11:43.889963] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x5f2f30 was disconnected and freed. reset controller. 00:17:29.543 01:11:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:29.543 01:11:43 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:29.543 01:11:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:29.543 01:11:43 -- common/autotest_common.sh@10 -- # set +x 00:17:29.543 [2024-11-28 01:11:43.891111] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:17:29.543 task offset: 82048 on job bdev=Nvme0n1 fails 00:17:29.543 00:17:29.543 Latency(us) 00:17:29.543 [2024-11-28T00:11:44.146Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:29.543 [2024-11-28T00:11:44.146Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:29.543 [2024-11-28T00:11:44.146Z] Job: Nvme0n1 ended in about 0.54 seconds with error 00:17:29.543 Verification LBA range: start 0x0 length 0x400 00:17:29.543 Nvme0n1 : 0.54 3130.48 195.66 118.55 0.00 19411.64 4636.07 26214.40 00:17:29.543 [2024-11-28T00:11:44.146Z] =================================================================================================================== 00:17:29.543 [2024-11-28T00:11:44.146Z] Total : 3130.48 195.66 118.55 0.00 19411.64 4636.07 26214.40 00:17:29.543 [2024-11-28 01:11:43.893069] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:17:29.543 [2024-11-28 01:11:43.893101] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5f5870 (9): Bad file descriptor 00:17:29.543 01:11:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:29.543 01:11:43 -- target/host_management.sh@87 -- # sleep 1 00:17:29.543 [2024-11-28 01:11:43.900326] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:30.477 01:11:44 -- target/host_management.sh@91 -- # kill -9 2022206 00:17:30.477 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (2022206) - No such process 00:17:30.477 01:11:44 -- target/host_management.sh@91 -- # true 00:17:30.477 01:11:44 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:17:30.477 01:11:44 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:17:30.477 01:11:44 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:17:30.477 01:11:44 -- nvmf/common.sh@520 -- # config=() 00:17:30.477 01:11:44 -- nvmf/common.sh@520 -- # local subsystem config 00:17:30.477 01:11:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:30.477 01:11:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:30.477 { 00:17:30.477 "params": { 00:17:30.477 "name": "Nvme$subsystem", 00:17:30.477 "trtype": "$TEST_TRANSPORT", 00:17:30.477 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:30.477 "adrfam": "ipv4", 00:17:30.477 "trsvcid": "$NVMF_PORT", 00:17:30.477 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:30.477 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:30.477 "hdgst": ${hdgst:-false}, 00:17:30.477 "ddgst": ${ddgst:-false} 00:17:30.477 }, 00:17:30.477 "method": "bdev_nvme_attach_controller" 00:17:30.477 } 00:17:30.477 EOF 00:17:30.477 )") 00:17:30.477 01:11:44 -- nvmf/common.sh@542 -- # cat 00:17:30.477 01:11:44 -- nvmf/common.sh@544 -- # jq . 00:17:30.477 01:11:44 -- nvmf/common.sh@545 -- # IFS=, 00:17:30.477 01:11:44 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:30.477 "params": { 00:17:30.477 "name": "Nvme0", 00:17:30.477 "trtype": "tcp", 00:17:30.477 "traddr": "10.0.0.2", 00:17:30.477 "adrfam": "ipv4", 00:17:30.477 "trsvcid": "4420", 00:17:30.477 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:30.477 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:30.477 "hdgst": false, 00:17:30.477 "ddgst": false 00:17:30.477 }, 00:17:30.477 "method": "bdev_nvme_attach_controller" 00:17:30.477 }' 00:17:30.477 [2024-11-28 01:11:44.942159] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:30.477 [2024-11-28 01:11:44.942256] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2022493 ] 00:17:30.477 EAL: No free 2048 kB hugepages reported on node 1 00:17:30.477 [2024-11-28 01:11:45.002677] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:30.735 [2024-11-28 01:11:45.092005] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:30.735 Running I/O for 1 seconds... 00:17:32.108 00:17:32.108 Latency(us) 00:17:32.108 [2024-11-28T00:11:46.711Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:32.108 [2024-11-28T00:11:46.711Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:32.108 Verification LBA range: start 0x0 length 0x400 00:17:32.108 Nvme0n1 : 1.01 3931.86 245.74 0.00 0.00 16028.22 788.86 23398.78 00:17:32.108 [2024-11-28T00:11:46.711Z] =================================================================================================================== 00:17:32.108 [2024-11-28T00:11:46.711Z] Total : 3931.86 245.74 0.00 0.00 16028.22 788.86 23398.78 00:17:32.108 01:11:46 -- target/host_management.sh@101 -- # stoptarget 00:17:32.108 01:11:46 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:17:32.108 01:11:46 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:32.108 01:11:46 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:32.108 01:11:46 -- target/host_management.sh@40 -- # nvmftestfini 00:17:32.108 01:11:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:32.108 01:11:46 -- nvmf/common.sh@116 -- # sync 00:17:32.108 01:11:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:32.108 01:11:46 -- nvmf/common.sh@119 -- # set +e 00:17:32.108 01:11:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:32.108 01:11:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:32.108 rmmod nvme_tcp 00:17:32.108 rmmod nvme_fabrics 00:17:32.108 rmmod nvme_keyring 00:17:32.108 01:11:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:32.108 01:11:46 -- nvmf/common.sh@123 -- # set -e 00:17:32.108 01:11:46 -- nvmf/common.sh@124 -- # return 0 00:17:32.108 01:11:46 -- nvmf/common.sh@477 -- # '[' -n 2022030 ']' 00:17:32.108 01:11:46 -- nvmf/common.sh@478 -- # killprocess 2022030 00:17:32.108 01:11:46 -- common/autotest_common.sh@936 -- # '[' -z 2022030 ']' 00:17:32.108 01:11:46 -- common/autotest_common.sh@940 -- # kill -0 2022030 00:17:32.108 01:11:46 -- common/autotest_common.sh@941 -- # uname 00:17:32.108 01:11:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:32.108 01:11:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2022030 00:17:32.108 01:11:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:32.108 01:11:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:32.108 01:11:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2022030' 00:17:32.108 killing process with pid 2022030 00:17:32.108 01:11:46 -- common/autotest_common.sh@955 -- # kill 2022030 00:17:32.108 01:11:46 -- common/autotest_common.sh@960 -- # wait 2022030 00:17:32.367 [2024-11-28 01:11:46.821685] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:17:32.367 01:11:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:32.367 01:11:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:32.367 01:11:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:32.367 01:11:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:32.367 01:11:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:32.367 01:11:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:32.367 01:11:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:32.367 01:11:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:34.329 01:11:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:34.329 00:17:34.329 real 0m7.204s 00:17:34.329 user 0m21.532s 00:17:34.329 sys 0m1.599s 00:17:34.329 01:11:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:34.329 01:11:48 -- common/autotest_common.sh@10 -- # set +x 00:17:34.329 ************************************ 00:17:34.329 END TEST nvmf_host_management 00:17:34.329 ************************************ 00:17:34.329 01:11:48 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:17:34.329 00:17:34.329 real 0m9.476s 00:17:34.329 user 0m22.379s 00:17:34.329 sys 0m3.017s 00:17:34.329 01:11:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:34.329 01:11:48 -- common/autotest_common.sh@10 -- # set +x 00:17:34.329 ************************************ 00:17:34.329 END TEST nvmf_host_management 00:17:34.329 ************************************ 00:17:34.589 01:11:48 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:34.589 01:11:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:34.589 01:11:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:34.589 01:11:48 -- common/autotest_common.sh@10 -- # set +x 00:17:34.589 ************************************ 00:17:34.589 START TEST nvmf_lvol 00:17:34.589 ************************************ 00:17:34.589 01:11:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:34.589 * Looking for test storage... 00:17:34.589 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:34.589 01:11:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:34.589 01:11:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:34.589 01:11:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:34.589 01:11:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:34.589 01:11:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:34.589 01:11:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:34.589 01:11:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:34.589 01:11:49 -- scripts/common.sh@335 -- # IFS=.-: 00:17:34.589 01:11:49 -- scripts/common.sh@335 -- # read -ra ver1 00:17:34.589 01:11:49 -- scripts/common.sh@336 -- # IFS=.-: 00:17:34.589 01:11:49 -- scripts/common.sh@336 -- # read -ra ver2 00:17:34.589 01:11:49 -- scripts/common.sh@337 -- # local 'op=<' 00:17:34.589 01:11:49 -- scripts/common.sh@339 -- # ver1_l=2 00:17:34.589 01:11:49 -- scripts/common.sh@340 -- # ver2_l=1 00:17:34.589 01:11:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:34.589 01:11:49 -- scripts/common.sh@343 -- # case "$op" in 00:17:34.589 01:11:49 -- scripts/common.sh@344 -- # : 1 00:17:34.589 01:11:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:34.589 01:11:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:34.589 01:11:49 -- scripts/common.sh@364 -- # decimal 1 00:17:34.589 01:11:49 -- scripts/common.sh@352 -- # local d=1 00:17:34.589 01:11:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:34.589 01:11:49 -- scripts/common.sh@354 -- # echo 1 00:17:34.589 01:11:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:34.589 01:11:49 -- scripts/common.sh@365 -- # decimal 2 00:17:34.589 01:11:49 -- scripts/common.sh@352 -- # local d=2 00:17:34.589 01:11:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:34.589 01:11:49 -- scripts/common.sh@354 -- # echo 2 00:17:34.589 01:11:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:34.589 01:11:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:34.589 01:11:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:34.589 01:11:49 -- scripts/common.sh@367 -- # return 0 00:17:34.589 01:11:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:34.589 01:11:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:34.589 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:34.589 --rc genhtml_branch_coverage=1 00:17:34.589 --rc genhtml_function_coverage=1 00:17:34.589 --rc genhtml_legend=1 00:17:34.589 --rc geninfo_all_blocks=1 00:17:34.589 --rc geninfo_unexecuted_blocks=1 00:17:34.589 00:17:34.589 ' 00:17:34.589 01:11:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:34.589 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:34.589 --rc genhtml_branch_coverage=1 00:17:34.589 --rc genhtml_function_coverage=1 00:17:34.589 --rc genhtml_legend=1 00:17:34.589 --rc geninfo_all_blocks=1 00:17:34.589 --rc geninfo_unexecuted_blocks=1 00:17:34.589 00:17:34.589 ' 00:17:34.589 01:11:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:34.589 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:34.589 --rc genhtml_branch_coverage=1 00:17:34.589 --rc genhtml_function_coverage=1 00:17:34.589 --rc genhtml_legend=1 00:17:34.589 --rc geninfo_all_blocks=1 00:17:34.589 --rc geninfo_unexecuted_blocks=1 00:17:34.589 00:17:34.589 ' 00:17:34.589 01:11:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:34.589 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:34.589 --rc genhtml_branch_coverage=1 00:17:34.589 --rc genhtml_function_coverage=1 00:17:34.589 --rc genhtml_legend=1 00:17:34.589 --rc geninfo_all_blocks=1 00:17:34.589 --rc geninfo_unexecuted_blocks=1 00:17:34.589 00:17:34.589 ' 00:17:34.589 01:11:49 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:34.589 01:11:49 -- nvmf/common.sh@7 -- # uname -s 00:17:34.589 01:11:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:34.589 01:11:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:34.589 01:11:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:34.589 01:11:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:34.589 01:11:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:34.589 01:11:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:34.589 01:11:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:34.589 01:11:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:34.589 01:11:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:34.589 01:11:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:34.589 01:11:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:34.589 01:11:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:34.590 01:11:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:34.590 01:11:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:34.590 01:11:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:34.590 01:11:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:34.590 01:11:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:34.590 01:11:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:34.590 01:11:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:34.590 01:11:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:34.590 01:11:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:34.590 01:11:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:34.590 01:11:49 -- paths/export.sh@5 -- # export PATH 00:17:34.590 01:11:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:34.590 01:11:49 -- nvmf/common.sh@46 -- # : 0 00:17:34.590 01:11:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:34.590 01:11:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:34.590 01:11:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:34.590 01:11:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:34.590 01:11:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:34.590 01:11:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:34.590 01:11:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:34.590 01:11:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:34.590 01:11:49 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:34.590 01:11:49 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:34.590 01:11:49 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:17:34.590 01:11:49 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:17:34.590 01:11:49 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:34.590 01:11:49 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:17:34.590 01:11:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:34.590 01:11:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:34.590 01:11:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:34.590 01:11:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:34.590 01:11:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:34.590 01:11:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:34.590 01:11:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:34.590 01:11:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:34.590 01:11:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:34.590 01:11:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:34.590 01:11:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:34.590 01:11:49 -- common/autotest_common.sh@10 -- # set +x 00:17:37.122 01:11:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:37.122 01:11:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:37.122 01:11:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:37.122 01:11:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:37.122 01:11:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:37.122 01:11:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:37.122 01:11:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:37.122 01:11:51 -- nvmf/common.sh@294 -- # net_devs=() 00:17:37.122 01:11:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:37.122 01:11:51 -- nvmf/common.sh@295 -- # e810=() 00:17:37.122 01:11:51 -- nvmf/common.sh@295 -- # local -ga e810 00:17:37.122 01:11:51 -- nvmf/common.sh@296 -- # x722=() 00:17:37.122 01:11:51 -- nvmf/common.sh@296 -- # local -ga x722 00:17:37.122 01:11:51 -- nvmf/common.sh@297 -- # mlx=() 00:17:37.122 01:11:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:37.122 01:11:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:37.122 01:11:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:37.122 01:11:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:37.122 01:11:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:37.122 01:11:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:37.122 01:11:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:37.122 01:11:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:37.122 01:11:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:37.122 01:11:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:37.122 01:11:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:37.122 01:11:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:37.122 01:11:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:37.122 01:11:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:37.122 01:11:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:37.122 01:11:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:37.122 01:11:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:37.122 01:11:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:37.122 01:11:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:37.122 01:11:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:37.122 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:37.122 01:11:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:37.122 01:11:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:37.122 01:11:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:37.122 01:11:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:37.122 01:11:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:37.122 01:11:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:37.122 01:11:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:37.122 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:37.122 01:11:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:37.122 01:11:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:37.122 01:11:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:37.122 01:11:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:37.122 01:11:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:37.122 01:11:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:37.122 01:11:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:37.122 01:11:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:37.122 01:11:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:37.122 01:11:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:37.122 01:11:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:37.122 01:11:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:37.122 01:11:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:37.122 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:37.122 01:11:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:37.122 01:11:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:37.122 01:11:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:37.122 01:11:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:37.122 01:11:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:37.122 01:11:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:37.122 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:37.122 01:11:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:37.122 01:11:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:37.122 01:11:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:37.122 01:11:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:37.122 01:11:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:37.122 01:11:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:37.122 01:11:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:37.122 01:11:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:37.122 01:11:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:37.122 01:11:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:37.122 01:11:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:37.122 01:11:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:37.122 01:11:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:37.122 01:11:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:37.122 01:11:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:37.122 01:11:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:37.122 01:11:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:37.122 01:11:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:37.122 01:11:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:37.122 01:11:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:37.122 01:11:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:37.122 01:11:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:37.122 01:11:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:37.122 01:11:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:37.122 01:11:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:37.122 01:11:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:37.122 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:37.122 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.351 ms 00:17:37.122 00:17:37.122 --- 10.0.0.2 ping statistics --- 00:17:37.122 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:37.122 rtt min/avg/max/mdev = 0.351/0.351/0.351/0.000 ms 00:17:37.122 01:11:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:37.122 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:37.122 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.067 ms 00:17:37.122 00:17:37.122 --- 10.0.0.1 ping statistics --- 00:17:37.122 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:37.122 rtt min/avg/max/mdev = 0.067/0.067/0.067/0.000 ms 00:17:37.122 01:11:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:37.122 01:11:51 -- nvmf/common.sh@410 -- # return 0 00:17:37.122 01:11:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:37.122 01:11:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:37.122 01:11:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:37.122 01:11:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:37.122 01:11:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:37.122 01:11:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:37.122 01:11:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:37.122 01:11:51 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:17:37.122 01:11:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:37.123 01:11:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:37.123 01:11:51 -- common/autotest_common.sh@10 -- # set +x 00:17:37.123 01:11:51 -- nvmf/common.sh@469 -- # nvmfpid=2024613 00:17:37.123 01:11:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:17:37.123 01:11:51 -- nvmf/common.sh@470 -- # waitforlisten 2024613 00:17:37.123 01:11:51 -- common/autotest_common.sh@829 -- # '[' -z 2024613 ']' 00:17:37.123 01:11:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:37.123 01:11:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:37.123 01:11:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:37.123 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:37.123 01:11:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:37.123 01:11:51 -- common/autotest_common.sh@10 -- # set +x 00:17:37.123 [2024-11-28 01:11:51.323322] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:37.123 [2024-11-28 01:11:51.323406] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:37.123 EAL: No free 2048 kB hugepages reported on node 1 00:17:37.123 [2024-11-28 01:11:51.395756] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:37.123 [2024-11-28 01:11:51.484981] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:37.123 [2024-11-28 01:11:51.485163] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:37.123 [2024-11-28 01:11:51.485183] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:37.123 [2024-11-28 01:11:51.485198] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:37.123 [2024-11-28 01:11:51.485281] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:37.123 [2024-11-28 01:11:51.485336] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:37.123 [2024-11-28 01:11:51.485339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:37.731 01:11:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:37.731 01:11:52 -- common/autotest_common.sh@862 -- # return 0 00:17:37.731 01:11:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:37.731 01:11:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:37.731 01:11:52 -- common/autotest_common.sh@10 -- # set +x 00:17:37.731 01:11:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:37.731 01:11:52 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:37.988 [2024-11-28 01:11:52.550823] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:37.988 01:11:52 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:38.553 01:11:52 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:17:38.553 01:11:52 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:38.553 01:11:53 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:17:38.553 01:11:53 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:17:38.812 01:11:53 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:17:39.070 01:11:53 -- target/nvmf_lvol.sh@29 -- # lvs=8c346bff-374d-4a64-9a5d-d2b15c86bc33 00:17:39.070 01:11:53 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 8c346bff-374d-4a64-9a5d-d2b15c86bc33 lvol 20 00:17:39.327 01:11:53 -- target/nvmf_lvol.sh@32 -- # lvol=7384a116-45e0-4e40-b190-cfc43f5ddd51 00:17:39.327 01:11:53 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:39.585 01:11:54 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 7384a116-45e0-4e40-b190-cfc43f5ddd51 00:17:39.844 01:11:54 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:40.102 [2024-11-28 01:11:54.657288] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:40.102 01:11:54 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:40.359 01:11:54 -- target/nvmf_lvol.sh@42 -- # perf_pid=2025178 00:17:40.359 01:11:54 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:17:40.359 01:11:54 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:17:40.617 EAL: No free 2048 kB hugepages reported on node 1 00:17:41.560 01:11:55 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 7384a116-45e0-4e40-b190-cfc43f5ddd51 MY_SNAPSHOT 00:17:41.818 01:11:56 -- target/nvmf_lvol.sh@47 -- # snapshot=6139ac47-f711-4173-bf45-8f1b88952fa8 00:17:41.818 01:11:56 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 7384a116-45e0-4e40-b190-cfc43f5ddd51 30 00:17:42.076 01:11:56 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 6139ac47-f711-4173-bf45-8f1b88952fa8 MY_CLONE 00:17:42.334 01:11:56 -- target/nvmf_lvol.sh@49 -- # clone=8dfb4669-b1ed-48b4-bba0-c3c4c136ea03 00:17:42.334 01:11:56 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 8dfb4669-b1ed-48b4-bba0-c3c4c136ea03 00:17:42.901 01:11:57 -- target/nvmf_lvol.sh@53 -- # wait 2025178 00:17:51.011 Initializing NVMe Controllers 00:17:51.011 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:17:51.011 Controller IO queue size 128, less than required. 00:17:51.011 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:51.011 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:17:51.011 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:17:51.011 Initialization complete. Launching workers. 00:17:51.011 ======================================================== 00:17:51.011 Latency(us) 00:17:51.011 Device Information : IOPS MiB/s Average min max 00:17:51.011 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10234.90 39.98 12506.88 1761.04 59156.70 00:17:51.011 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10859.30 42.42 11791.79 1996.24 51715.62 00:17:51.011 ======================================================== 00:17:51.011 Total : 21094.20 82.40 12138.75 1761.04 59156.70 00:17:51.011 00:17:51.011 01:12:05 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:51.011 01:12:05 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 7384a116-45e0-4e40-b190-cfc43f5ddd51 00:17:51.269 01:12:05 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 8c346bff-374d-4a64-9a5d-d2b15c86bc33 00:17:51.527 01:12:06 -- target/nvmf_lvol.sh@60 -- # rm -f 00:17:51.527 01:12:06 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:17:51.527 01:12:06 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:17:51.527 01:12:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:51.527 01:12:06 -- nvmf/common.sh@116 -- # sync 00:17:51.527 01:12:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:51.527 01:12:06 -- nvmf/common.sh@119 -- # set +e 00:17:51.527 01:12:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:51.527 01:12:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:51.527 rmmod nvme_tcp 00:17:51.527 rmmod nvme_fabrics 00:17:51.527 rmmod nvme_keyring 00:17:51.527 01:12:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:51.527 01:12:06 -- nvmf/common.sh@123 -- # set -e 00:17:51.527 01:12:06 -- nvmf/common.sh@124 -- # return 0 00:17:51.527 01:12:06 -- nvmf/common.sh@477 -- # '[' -n 2024613 ']' 00:17:51.527 01:12:06 -- nvmf/common.sh@478 -- # killprocess 2024613 00:17:51.527 01:12:06 -- common/autotest_common.sh@936 -- # '[' -z 2024613 ']' 00:17:51.527 01:12:06 -- common/autotest_common.sh@940 -- # kill -0 2024613 00:17:51.527 01:12:06 -- common/autotest_common.sh@941 -- # uname 00:17:51.527 01:12:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:51.527 01:12:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2024613 00:17:51.785 01:12:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:51.786 01:12:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:51.786 01:12:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2024613' 00:17:51.786 killing process with pid 2024613 00:17:51.786 01:12:06 -- common/autotest_common.sh@955 -- # kill 2024613 00:17:51.786 01:12:06 -- common/autotest_common.sh@960 -- # wait 2024613 00:17:52.045 01:12:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:52.045 01:12:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:52.045 01:12:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:52.045 01:12:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:52.045 01:12:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:52.045 01:12:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:52.045 01:12:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:52.045 01:12:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:53.948 01:12:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:53.948 00:17:53.948 real 0m19.547s 00:17:53.948 user 1m5.950s 00:17:53.948 sys 0m5.672s 00:17:53.948 01:12:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:53.948 01:12:08 -- common/autotest_common.sh@10 -- # set +x 00:17:53.948 ************************************ 00:17:53.948 END TEST nvmf_lvol 00:17:53.948 ************************************ 00:17:53.948 01:12:08 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:53.948 01:12:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:53.948 01:12:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:53.948 01:12:08 -- common/autotest_common.sh@10 -- # set +x 00:17:53.948 ************************************ 00:17:53.948 START TEST nvmf_lvs_grow 00:17:53.948 ************************************ 00:17:53.948 01:12:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:54.208 * Looking for test storage... 00:17:54.208 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:54.208 01:12:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:54.208 01:12:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:54.208 01:12:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:54.208 01:12:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:54.208 01:12:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:54.208 01:12:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:54.208 01:12:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:54.208 01:12:08 -- scripts/common.sh@335 -- # IFS=.-: 00:17:54.208 01:12:08 -- scripts/common.sh@335 -- # read -ra ver1 00:17:54.208 01:12:08 -- scripts/common.sh@336 -- # IFS=.-: 00:17:54.208 01:12:08 -- scripts/common.sh@336 -- # read -ra ver2 00:17:54.208 01:12:08 -- scripts/common.sh@337 -- # local 'op=<' 00:17:54.208 01:12:08 -- scripts/common.sh@339 -- # ver1_l=2 00:17:54.208 01:12:08 -- scripts/common.sh@340 -- # ver2_l=1 00:17:54.208 01:12:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:54.208 01:12:08 -- scripts/common.sh@343 -- # case "$op" in 00:17:54.208 01:12:08 -- scripts/common.sh@344 -- # : 1 00:17:54.208 01:12:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:54.208 01:12:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:54.208 01:12:08 -- scripts/common.sh@364 -- # decimal 1 00:17:54.208 01:12:08 -- scripts/common.sh@352 -- # local d=1 00:17:54.208 01:12:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:54.208 01:12:08 -- scripts/common.sh@354 -- # echo 1 00:17:54.208 01:12:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:54.208 01:12:08 -- scripts/common.sh@365 -- # decimal 2 00:17:54.208 01:12:08 -- scripts/common.sh@352 -- # local d=2 00:17:54.208 01:12:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:54.208 01:12:08 -- scripts/common.sh@354 -- # echo 2 00:17:54.208 01:12:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:54.208 01:12:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:54.208 01:12:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:54.208 01:12:08 -- scripts/common.sh@367 -- # return 0 00:17:54.208 01:12:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:54.208 01:12:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:54.208 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:54.208 --rc genhtml_branch_coverage=1 00:17:54.208 --rc genhtml_function_coverage=1 00:17:54.208 --rc genhtml_legend=1 00:17:54.208 --rc geninfo_all_blocks=1 00:17:54.208 --rc geninfo_unexecuted_blocks=1 00:17:54.208 00:17:54.208 ' 00:17:54.208 01:12:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:54.208 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:54.208 --rc genhtml_branch_coverage=1 00:17:54.208 --rc genhtml_function_coverage=1 00:17:54.208 --rc genhtml_legend=1 00:17:54.208 --rc geninfo_all_blocks=1 00:17:54.208 --rc geninfo_unexecuted_blocks=1 00:17:54.208 00:17:54.208 ' 00:17:54.208 01:12:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:54.208 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:54.208 --rc genhtml_branch_coverage=1 00:17:54.208 --rc genhtml_function_coverage=1 00:17:54.208 --rc genhtml_legend=1 00:17:54.208 --rc geninfo_all_blocks=1 00:17:54.208 --rc geninfo_unexecuted_blocks=1 00:17:54.208 00:17:54.208 ' 00:17:54.208 01:12:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:54.208 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:54.208 --rc genhtml_branch_coverage=1 00:17:54.208 --rc genhtml_function_coverage=1 00:17:54.208 --rc genhtml_legend=1 00:17:54.208 --rc geninfo_all_blocks=1 00:17:54.208 --rc geninfo_unexecuted_blocks=1 00:17:54.208 00:17:54.208 ' 00:17:54.208 01:12:08 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:54.208 01:12:08 -- nvmf/common.sh@7 -- # uname -s 00:17:54.208 01:12:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:54.208 01:12:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:54.208 01:12:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:54.208 01:12:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:54.208 01:12:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:54.208 01:12:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:54.208 01:12:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:54.208 01:12:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:54.208 01:12:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:54.208 01:12:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:54.208 01:12:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:54.208 01:12:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:54.208 01:12:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:54.208 01:12:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:54.208 01:12:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:54.208 01:12:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:54.208 01:12:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:54.208 01:12:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:54.208 01:12:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:54.208 01:12:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:54.208 01:12:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:54.208 01:12:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:54.208 01:12:08 -- paths/export.sh@5 -- # export PATH 00:17:54.208 01:12:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:54.208 01:12:08 -- nvmf/common.sh@46 -- # : 0 00:17:54.208 01:12:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:54.208 01:12:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:54.208 01:12:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:54.208 01:12:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:54.208 01:12:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:54.208 01:12:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:54.208 01:12:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:54.208 01:12:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:54.208 01:12:08 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:54.208 01:12:08 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:54.208 01:12:08 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:54.208 01:12:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:54.208 01:12:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:54.208 01:12:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:54.208 01:12:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:54.208 01:12:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:54.208 01:12:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:54.208 01:12:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:54.208 01:12:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:54.208 01:12:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:54.208 01:12:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:54.208 01:12:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:54.208 01:12:08 -- common/autotest_common.sh@10 -- # set +x 00:17:56.109 01:12:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:56.109 01:12:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:56.109 01:12:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:56.109 01:12:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:56.109 01:12:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:56.109 01:12:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:56.109 01:12:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:56.109 01:12:10 -- nvmf/common.sh@294 -- # net_devs=() 00:17:56.109 01:12:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:56.109 01:12:10 -- nvmf/common.sh@295 -- # e810=() 00:17:56.109 01:12:10 -- nvmf/common.sh@295 -- # local -ga e810 00:17:56.109 01:12:10 -- nvmf/common.sh@296 -- # x722=() 00:17:56.109 01:12:10 -- nvmf/common.sh@296 -- # local -ga x722 00:17:56.109 01:12:10 -- nvmf/common.sh@297 -- # mlx=() 00:17:56.109 01:12:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:56.109 01:12:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:56.109 01:12:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:56.109 01:12:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:56.109 01:12:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:56.109 01:12:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:56.109 01:12:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:56.109 01:12:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:56.109 01:12:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:56.109 01:12:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:56.109 01:12:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:56.109 01:12:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:56.109 01:12:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:56.109 01:12:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:56.109 01:12:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:56.109 01:12:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:56.109 01:12:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:56.109 01:12:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:56.109 01:12:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:56.109 01:12:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:56.109 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:56.109 01:12:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:56.109 01:12:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:56.109 01:12:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:56.109 01:12:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:56.109 01:12:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:56.109 01:12:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:56.109 01:12:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:56.109 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:56.109 01:12:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:56.110 01:12:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:56.110 01:12:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:56.110 01:12:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:56.110 01:12:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:56.110 01:12:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:56.110 01:12:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:56.110 01:12:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:56.110 01:12:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:56.110 01:12:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:56.110 01:12:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:56.110 01:12:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:56.110 01:12:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:56.110 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:56.110 01:12:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:56.110 01:12:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:56.110 01:12:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:56.110 01:12:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:56.110 01:12:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:56.110 01:12:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:56.110 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:56.110 01:12:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:56.110 01:12:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:56.110 01:12:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:56.110 01:12:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:56.110 01:12:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:56.110 01:12:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:56.110 01:12:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:56.110 01:12:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:56.110 01:12:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:56.110 01:12:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:56.110 01:12:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:56.110 01:12:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:56.110 01:12:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:56.110 01:12:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:56.110 01:12:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:56.110 01:12:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:56.110 01:12:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:56.110 01:12:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:56.110 01:12:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:56.110 01:12:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:56.110 01:12:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:56.368 01:12:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:56.368 01:12:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:56.368 01:12:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:56.368 01:12:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:56.368 01:12:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:56.368 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:56.368 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.258 ms 00:17:56.368 00:17:56.368 --- 10.0.0.2 ping statistics --- 00:17:56.368 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:56.368 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:17:56.368 01:12:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:56.368 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:56.368 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.166 ms 00:17:56.368 00:17:56.368 --- 10.0.0.1 ping statistics --- 00:17:56.368 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:56.368 rtt min/avg/max/mdev = 0.166/0.166/0.166/0.000 ms 00:17:56.368 01:12:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:56.368 01:12:10 -- nvmf/common.sh@410 -- # return 0 00:17:56.368 01:12:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:56.368 01:12:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:56.368 01:12:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:56.368 01:12:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:56.368 01:12:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:56.368 01:12:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:56.368 01:12:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:56.368 01:12:10 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:17:56.368 01:12:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:56.368 01:12:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:56.368 01:12:10 -- common/autotest_common.sh@10 -- # set +x 00:17:56.368 01:12:10 -- nvmf/common.sh@469 -- # nvmfpid=2029108 00:17:56.368 01:12:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:56.368 01:12:10 -- nvmf/common.sh@470 -- # waitforlisten 2029108 00:17:56.368 01:12:10 -- common/autotest_common.sh@829 -- # '[' -z 2029108 ']' 00:17:56.369 01:12:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:56.369 01:12:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:56.369 01:12:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:56.369 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:56.369 01:12:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:56.369 01:12:10 -- common/autotest_common.sh@10 -- # set +x 00:17:56.369 [2024-11-28 01:12:10.836885] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:56.369 [2024-11-28 01:12:10.836984] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:56.369 EAL: No free 2048 kB hugepages reported on node 1 00:17:56.369 [2024-11-28 01:12:10.905726] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:56.626 [2024-11-28 01:12:10.993580] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:56.626 [2024-11-28 01:12:10.993760] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:56.626 [2024-11-28 01:12:10.993779] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:56.626 [2024-11-28 01:12:10.993793] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:56.626 [2024-11-28 01:12:10.993831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:57.190 01:12:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:57.191 01:12:11 -- common/autotest_common.sh@862 -- # return 0 00:17:57.191 01:12:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:57.191 01:12:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:57.191 01:12:11 -- common/autotest_common.sh@10 -- # set +x 00:17:57.448 01:12:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:57.448 01:12:11 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:57.448 [2024-11-28 01:12:12.035073] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:57.706 01:12:12 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:17:57.706 01:12:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:57.706 01:12:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:57.706 01:12:12 -- common/autotest_common.sh@10 -- # set +x 00:17:57.706 ************************************ 00:17:57.706 START TEST lvs_grow_clean 00:17:57.706 ************************************ 00:17:57.706 01:12:12 -- common/autotest_common.sh@1114 -- # lvs_grow 00:17:57.706 01:12:12 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:57.706 01:12:12 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:57.706 01:12:12 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:57.706 01:12:12 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:57.706 01:12:12 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:57.706 01:12:12 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:57.706 01:12:12 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:57.706 01:12:12 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:57.706 01:12:12 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:57.964 01:12:12 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:57.964 01:12:12 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:58.222 01:12:12 -- target/nvmf_lvs_grow.sh@28 -- # lvs=45492068-1b07-4215-a45a-1cf469a8f1ee 00:17:58.222 01:12:12 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 45492068-1b07-4215-a45a-1cf469a8f1ee 00:17:58.222 01:12:12 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:58.480 01:12:12 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:58.481 01:12:12 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:58.481 01:12:12 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 45492068-1b07-4215-a45a-1cf469a8f1ee lvol 150 00:17:58.738 01:12:13 -- target/nvmf_lvs_grow.sh@33 -- # lvol=976d52c7-5a83-4d51-9ed4-22f028b4cbf4 00:17:58.738 01:12:13 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:58.738 01:12:13 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:58.738 [2024-11-28 01:12:13.333877] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:58.738 [2024-11-28 01:12:13.333968] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:58.739 true 00:17:58.996 01:12:13 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 45492068-1b07-4215-a45a-1cf469a8f1ee 00:17:58.996 01:12:13 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:59.253 01:12:13 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:59.253 01:12:13 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:59.511 01:12:13 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 976d52c7-5a83-4d51-9ed4-22f028b4cbf4 00:17:59.769 01:12:14 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:59.770 [2024-11-28 01:12:14.353098] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:59.770 01:12:14 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:00.028 01:12:14 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2029568 00:18:00.028 01:12:14 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:18:00.028 01:12:14 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:00.028 01:12:14 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2029568 /var/tmp/bdevperf.sock 00:18:00.028 01:12:14 -- common/autotest_common.sh@829 -- # '[' -z 2029568 ']' 00:18:00.028 01:12:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:00.028 01:12:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:00.028 01:12:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:00.028 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:00.028 01:12:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:00.028 01:12:14 -- common/autotest_common.sh@10 -- # set +x 00:18:00.286 [2024-11-28 01:12:14.659571] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:00.286 [2024-11-28 01:12:14.659638] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2029568 ] 00:18:00.286 EAL: No free 2048 kB hugepages reported on node 1 00:18:00.286 [2024-11-28 01:12:14.721743] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:00.286 [2024-11-28 01:12:14.811128] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:01.219 01:12:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:01.219 01:12:15 -- common/autotest_common.sh@862 -- # return 0 00:18:01.219 01:12:15 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:18:01.477 Nvme0n1 00:18:01.477 01:12:16 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:18:01.735 [ 00:18:01.735 { 00:18:01.735 "name": "Nvme0n1", 00:18:01.735 "aliases": [ 00:18:01.735 "976d52c7-5a83-4d51-9ed4-22f028b4cbf4" 00:18:01.735 ], 00:18:01.735 "product_name": "NVMe disk", 00:18:01.735 "block_size": 4096, 00:18:01.735 "num_blocks": 38912, 00:18:01.735 "uuid": "976d52c7-5a83-4d51-9ed4-22f028b4cbf4", 00:18:01.735 "assigned_rate_limits": { 00:18:01.735 "rw_ios_per_sec": 0, 00:18:01.735 "rw_mbytes_per_sec": 0, 00:18:01.735 "r_mbytes_per_sec": 0, 00:18:01.735 "w_mbytes_per_sec": 0 00:18:01.735 }, 00:18:01.735 "claimed": false, 00:18:01.735 "zoned": false, 00:18:01.735 "supported_io_types": { 00:18:01.735 "read": true, 00:18:01.735 "write": true, 00:18:01.735 "unmap": true, 00:18:01.735 "write_zeroes": true, 00:18:01.735 "flush": true, 00:18:01.735 "reset": true, 00:18:01.735 "compare": true, 00:18:01.735 "compare_and_write": true, 00:18:01.735 "abort": true, 00:18:01.735 "nvme_admin": true, 00:18:01.735 "nvme_io": true 00:18:01.735 }, 00:18:01.735 "driver_specific": { 00:18:01.735 "nvme": [ 00:18:01.735 { 00:18:01.735 "trid": { 00:18:01.735 "trtype": "TCP", 00:18:01.735 "adrfam": "IPv4", 00:18:01.735 "traddr": "10.0.0.2", 00:18:01.735 "trsvcid": "4420", 00:18:01.735 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:18:01.735 }, 00:18:01.736 "ctrlr_data": { 00:18:01.736 "cntlid": 1, 00:18:01.736 "vendor_id": "0x8086", 00:18:01.736 "model_number": "SPDK bdev Controller", 00:18:01.736 "serial_number": "SPDK0", 00:18:01.736 "firmware_revision": "24.01.1", 00:18:01.736 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:18:01.736 "oacs": { 00:18:01.736 "security": 0, 00:18:01.736 "format": 0, 00:18:01.736 "firmware": 0, 00:18:01.736 "ns_manage": 0 00:18:01.736 }, 00:18:01.736 "multi_ctrlr": true, 00:18:01.736 "ana_reporting": false 00:18:01.736 }, 00:18:01.736 "vs": { 00:18:01.736 "nvme_version": "1.3" 00:18:01.736 }, 00:18:01.736 "ns_data": { 00:18:01.736 "id": 1, 00:18:01.736 "can_share": true 00:18:01.736 } 00:18:01.736 } 00:18:01.736 ], 00:18:01.736 "mp_policy": "active_passive" 00:18:01.736 } 00:18:01.736 } 00:18:01.736 ] 00:18:01.994 01:12:16 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2029837 00:18:01.994 01:12:16 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:18:01.994 01:12:16 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:01.994 Running I/O for 10 seconds... 00:18:02.929 Latency(us) 00:18:02.929 [2024-11-28T00:12:17.532Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:02.929 [2024-11-28T00:12:17.532Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:02.929 Nvme0n1 : 1.00 14735.00 57.56 0.00 0.00 0.00 0.00 0.00 00:18:02.929 [2024-11-28T00:12:17.532Z] =================================================================================================================== 00:18:02.929 [2024-11-28T00:12:17.532Z] Total : 14735.00 57.56 0.00 0.00 0.00 0.00 0.00 00:18:02.929 00:18:03.865 01:12:18 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 45492068-1b07-4215-a45a-1cf469a8f1ee 00:18:04.124 [2024-11-28T00:12:18.727Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:04.124 Nvme0n1 : 2.00 14928.50 58.31 0.00 0.00 0.00 0.00 0.00 00:18:04.124 [2024-11-28T00:12:18.727Z] =================================================================================================================== 00:18:04.124 [2024-11-28T00:12:18.727Z] Total : 14928.50 58.31 0.00 0.00 0.00 0.00 0.00 00:18:04.124 00:18:04.124 true 00:18:04.124 01:12:18 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 45492068-1b07-4215-a45a-1cf469a8f1ee 00:18:04.124 01:12:18 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:18:04.383 01:12:18 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:18:04.383 01:12:18 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:18:04.383 01:12:18 -- target/nvmf_lvs_grow.sh@65 -- # wait 2029837 00:18:04.950 [2024-11-28T00:12:19.554Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:04.951 Nvme0n1 : 3.00 15193.33 59.35 0.00 0.00 0.00 0.00 0.00 00:18:04.951 [2024-11-28T00:12:19.554Z] =================================================================================================================== 00:18:04.951 [2024-11-28T00:12:19.554Z] Total : 15193.33 59.35 0.00 0.00 0.00 0.00 0.00 00:18:04.951 00:18:05.887 [2024-11-28T00:12:20.490Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:05.887 Nvme0n1 : 4.00 15226.00 59.48 0.00 0.00 0.00 0.00 0.00 00:18:05.887 [2024-11-28T00:12:20.490Z] =================================================================================================================== 00:18:05.887 [2024-11-28T00:12:20.490Z] Total : 15226.00 59.48 0.00 0.00 0.00 0.00 0.00 00:18:05.887 00:18:07.263 [2024-11-28T00:12:21.866Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:07.263 Nvme0n1 : 5.00 15384.40 60.10 0.00 0.00 0.00 0.00 0.00 00:18:07.263 [2024-11-28T00:12:21.866Z] =================================================================================================================== 00:18:07.263 [2024-11-28T00:12:21.866Z] Total : 15384.40 60.10 0.00 0.00 0.00 0.00 0.00 00:18:07.263 00:18:08.198 [2024-11-28T00:12:22.801Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:08.198 Nvme0n1 : 6.00 15415.67 60.22 0.00 0.00 0.00 0.00 0.00 00:18:08.198 [2024-11-28T00:12:22.801Z] =================================================================================================================== 00:18:08.198 [2024-11-28T00:12:22.801Z] Total : 15415.67 60.22 0.00 0.00 0.00 0.00 0.00 00:18:08.198 00:18:09.135 [2024-11-28T00:12:23.738Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:09.135 Nvme0n1 : 7.00 15405.14 60.18 0.00 0.00 0.00 0.00 0.00 00:18:09.135 [2024-11-28T00:12:23.738Z] =================================================================================================================== 00:18:09.135 [2024-11-28T00:12:23.738Z] Total : 15405.14 60.18 0.00 0.00 0.00 0.00 0.00 00:18:09.135 00:18:10.125 [2024-11-28T00:12:24.728Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:10.125 Nvme0n1 : 8.00 15405.88 60.18 0.00 0.00 0.00 0.00 0.00 00:18:10.125 [2024-11-28T00:12:24.728Z] =================================================================================================================== 00:18:10.125 [2024-11-28T00:12:24.728Z] Total : 15405.88 60.18 0.00 0.00 0.00 0.00 0.00 00:18:10.125 00:18:11.093 [2024-11-28T00:12:25.696Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:11.093 Nvme0n1 : 9.00 15307.67 59.80 0.00 0.00 0.00 0.00 0.00 00:18:11.093 [2024-11-28T00:12:25.696Z] =================================================================================================================== 00:18:11.093 [2024-11-28T00:12:25.696Z] Total : 15307.67 59.80 0.00 0.00 0.00 0.00 0.00 00:18:11.093 00:18:12.029 [2024-11-28T00:12:26.633Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:12.030 Nvme0n1 : 10.00 15231.30 59.50 0.00 0.00 0.00 0.00 0.00 00:18:12.030 [2024-11-28T00:12:26.633Z] =================================================================================================================== 00:18:12.030 [2024-11-28T00:12:26.633Z] Total : 15231.30 59.50 0.00 0.00 0.00 0.00 0.00 00:18:12.030 00:18:12.030 00:18:12.030 Latency(us) 00:18:12.030 [2024-11-28T00:12:26.633Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:12.030 [2024-11-28T00:12:26.633Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:12.030 Nvme0n1 : 10.01 15228.72 59.49 0.00 0.00 8397.41 2936.98 17185.00 00:18:12.030 [2024-11-28T00:12:26.633Z] =================================================================================================================== 00:18:12.030 [2024-11-28T00:12:26.633Z] Total : 15228.72 59.49 0.00 0.00 8397.41 2936.98 17185.00 00:18:12.030 0 00:18:12.030 01:12:26 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2029568 00:18:12.030 01:12:26 -- common/autotest_common.sh@936 -- # '[' -z 2029568 ']' 00:18:12.030 01:12:26 -- common/autotest_common.sh@940 -- # kill -0 2029568 00:18:12.030 01:12:26 -- common/autotest_common.sh@941 -- # uname 00:18:12.030 01:12:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:12.030 01:12:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2029568 00:18:12.030 01:12:26 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:12.030 01:12:26 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:12.030 01:12:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2029568' 00:18:12.030 killing process with pid 2029568 00:18:12.030 01:12:26 -- common/autotest_common.sh@955 -- # kill 2029568 00:18:12.030 Received shutdown signal, test time was about 10.000000 seconds 00:18:12.030 00:18:12.030 Latency(us) 00:18:12.030 [2024-11-28T00:12:26.633Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:12.030 [2024-11-28T00:12:26.633Z] =================================================================================================================== 00:18:12.030 [2024-11-28T00:12:26.633Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:12.030 01:12:26 -- common/autotest_common.sh@960 -- # wait 2029568 00:18:12.288 01:12:26 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:12.546 01:12:27 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 45492068-1b07-4215-a45a-1cf469a8f1ee 00:18:12.546 01:12:27 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:12.804 01:12:27 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:12.804 01:12:27 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:18:12.804 01:12:27 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:13.062 [2024-11-28 01:12:27.575263] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:13.062 01:12:27 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 45492068-1b07-4215-a45a-1cf469a8f1ee 00:18:13.062 01:12:27 -- common/autotest_common.sh@650 -- # local es=0 00:18:13.062 01:12:27 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 45492068-1b07-4215-a45a-1cf469a8f1ee 00:18:13.062 01:12:27 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:13.062 01:12:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:13.062 01:12:27 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:13.062 01:12:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:13.062 01:12:27 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:13.062 01:12:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:13.062 01:12:27 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:13.062 01:12:27 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:18:13.062 01:12:27 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 45492068-1b07-4215-a45a-1cf469a8f1ee 00:18:13.321 request: 00:18:13.321 { 00:18:13.321 "uuid": "45492068-1b07-4215-a45a-1cf469a8f1ee", 00:18:13.321 "method": "bdev_lvol_get_lvstores", 00:18:13.321 "req_id": 1 00:18:13.321 } 00:18:13.321 Got JSON-RPC error response 00:18:13.321 response: 00:18:13.321 { 00:18:13.321 "code": -19, 00:18:13.321 "message": "No such device" 00:18:13.321 } 00:18:13.321 01:12:27 -- common/autotest_common.sh@653 -- # es=1 00:18:13.321 01:12:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:13.321 01:12:27 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:13.321 01:12:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:13.321 01:12:27 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:13.579 aio_bdev 00:18:13.579 01:12:28 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 976d52c7-5a83-4d51-9ed4-22f028b4cbf4 00:18:13.579 01:12:28 -- common/autotest_common.sh@897 -- # local bdev_name=976d52c7-5a83-4d51-9ed4-22f028b4cbf4 00:18:13.579 01:12:28 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:13.579 01:12:28 -- common/autotest_common.sh@899 -- # local i 00:18:13.579 01:12:28 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:13.579 01:12:28 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:13.579 01:12:28 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:13.837 01:12:28 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 976d52c7-5a83-4d51-9ed4-22f028b4cbf4 -t 2000 00:18:14.095 [ 00:18:14.095 { 00:18:14.095 "name": "976d52c7-5a83-4d51-9ed4-22f028b4cbf4", 00:18:14.095 "aliases": [ 00:18:14.095 "lvs/lvol" 00:18:14.095 ], 00:18:14.095 "product_name": "Logical Volume", 00:18:14.095 "block_size": 4096, 00:18:14.095 "num_blocks": 38912, 00:18:14.095 "uuid": "976d52c7-5a83-4d51-9ed4-22f028b4cbf4", 00:18:14.095 "assigned_rate_limits": { 00:18:14.095 "rw_ios_per_sec": 0, 00:18:14.095 "rw_mbytes_per_sec": 0, 00:18:14.095 "r_mbytes_per_sec": 0, 00:18:14.095 "w_mbytes_per_sec": 0 00:18:14.095 }, 00:18:14.095 "claimed": false, 00:18:14.095 "zoned": false, 00:18:14.095 "supported_io_types": { 00:18:14.095 "read": true, 00:18:14.095 "write": true, 00:18:14.095 "unmap": true, 00:18:14.095 "write_zeroes": true, 00:18:14.095 "flush": false, 00:18:14.095 "reset": true, 00:18:14.095 "compare": false, 00:18:14.095 "compare_and_write": false, 00:18:14.095 "abort": false, 00:18:14.095 "nvme_admin": false, 00:18:14.095 "nvme_io": false 00:18:14.095 }, 00:18:14.095 "driver_specific": { 00:18:14.095 "lvol": { 00:18:14.095 "lvol_store_uuid": "45492068-1b07-4215-a45a-1cf469a8f1ee", 00:18:14.095 "base_bdev": "aio_bdev", 00:18:14.096 "thin_provision": false, 00:18:14.096 "snapshot": false, 00:18:14.096 "clone": false, 00:18:14.096 "esnap_clone": false 00:18:14.096 } 00:18:14.096 } 00:18:14.096 } 00:18:14.096 ] 00:18:14.096 01:12:28 -- common/autotest_common.sh@905 -- # return 0 00:18:14.096 01:12:28 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 45492068-1b07-4215-a45a-1cf469a8f1ee 00:18:14.096 01:12:28 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:14.354 01:12:28 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:14.354 01:12:28 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 45492068-1b07-4215-a45a-1cf469a8f1ee 00:18:14.354 01:12:28 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:14.611 01:12:29 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:14.611 01:12:29 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 976d52c7-5a83-4d51-9ed4-22f028b4cbf4 00:18:14.868 01:12:29 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 45492068-1b07-4215-a45a-1cf469a8f1ee 00:18:15.125 01:12:29 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:15.382 01:12:29 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:15.382 00:18:15.382 real 0m17.900s 00:18:15.382 user 0m16.903s 00:18:15.382 sys 0m2.192s 00:18:15.382 01:12:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:15.382 01:12:29 -- common/autotest_common.sh@10 -- # set +x 00:18:15.382 ************************************ 00:18:15.382 END TEST lvs_grow_clean 00:18:15.382 ************************************ 00:18:15.382 01:12:29 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:18:15.382 01:12:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:15.382 01:12:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:15.382 01:12:29 -- common/autotest_common.sh@10 -- # set +x 00:18:15.639 ************************************ 00:18:15.639 START TEST lvs_grow_dirty 00:18:15.639 ************************************ 00:18:15.639 01:12:29 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:18:15.639 01:12:29 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:18:15.639 01:12:29 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:18:15.639 01:12:29 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:18:15.639 01:12:29 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:18:15.639 01:12:29 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:18:15.639 01:12:29 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:18:15.639 01:12:29 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:15.639 01:12:29 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:15.639 01:12:29 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:15.896 01:12:30 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:18:15.896 01:12:30 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:18:16.153 01:12:30 -- target/nvmf_lvs_grow.sh@28 -- # lvs=9b6ac1ae-bb36-404e-aa11-72399db9b28a 00:18:16.153 01:12:30 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9b6ac1ae-bb36-404e-aa11-72399db9b28a 00:18:16.153 01:12:30 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:18:16.410 01:12:30 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:18:16.410 01:12:30 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:18:16.410 01:12:30 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 9b6ac1ae-bb36-404e-aa11-72399db9b28a lvol 150 00:18:16.667 01:12:31 -- target/nvmf_lvs_grow.sh@33 -- # lvol=ea3eca6a-3d17-4a89-a466-07dfe6a309b0 00:18:16.667 01:12:31 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:16.667 01:12:31 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:18:16.667 [2024-11-28 01:12:31.268818] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:18:16.667 [2024-11-28 01:12:31.268939] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:18:16.925 true 00:18:16.925 01:12:31 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9b6ac1ae-bb36-404e-aa11-72399db9b28a 00:18:16.925 01:12:31 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:18:17.183 01:12:31 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:18:17.183 01:12:31 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:18:17.440 01:12:31 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 ea3eca6a-3d17-4a89-a466-07dfe6a309b0 00:18:17.440 01:12:32 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:18:17.698 01:12:32 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:18.265 01:12:32 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2031805 00:18:18.265 01:12:32 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:18:18.265 01:12:32 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:18.265 01:12:32 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2031805 /var/tmp/bdevperf.sock 00:18:18.265 01:12:32 -- common/autotest_common.sh@829 -- # '[' -z 2031805 ']' 00:18:18.265 01:12:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:18.265 01:12:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:18.265 01:12:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:18.265 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:18.265 01:12:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:18.265 01:12:32 -- common/autotest_common.sh@10 -- # set +x 00:18:18.265 [2024-11-28 01:12:32.627425] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:18.265 [2024-11-28 01:12:32.627494] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2031805 ] 00:18:18.265 EAL: No free 2048 kB hugepages reported on node 1 00:18:18.265 [2024-11-28 01:12:32.686177] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:18.265 [2024-11-28 01:12:32.768132] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:19.199 01:12:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:19.199 01:12:33 -- common/autotest_common.sh@862 -- # return 0 00:18:19.199 01:12:33 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:18:19.456 Nvme0n1 00:18:19.456 01:12:34 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:18:19.714 [ 00:18:19.714 { 00:18:19.714 "name": "Nvme0n1", 00:18:19.714 "aliases": [ 00:18:19.714 "ea3eca6a-3d17-4a89-a466-07dfe6a309b0" 00:18:19.714 ], 00:18:19.714 "product_name": "NVMe disk", 00:18:19.714 "block_size": 4096, 00:18:19.714 "num_blocks": 38912, 00:18:19.714 "uuid": "ea3eca6a-3d17-4a89-a466-07dfe6a309b0", 00:18:19.714 "assigned_rate_limits": { 00:18:19.714 "rw_ios_per_sec": 0, 00:18:19.714 "rw_mbytes_per_sec": 0, 00:18:19.714 "r_mbytes_per_sec": 0, 00:18:19.714 "w_mbytes_per_sec": 0 00:18:19.714 }, 00:18:19.714 "claimed": false, 00:18:19.714 "zoned": false, 00:18:19.714 "supported_io_types": { 00:18:19.714 "read": true, 00:18:19.714 "write": true, 00:18:19.714 "unmap": true, 00:18:19.714 "write_zeroes": true, 00:18:19.714 "flush": true, 00:18:19.714 "reset": true, 00:18:19.714 "compare": true, 00:18:19.714 "compare_and_write": true, 00:18:19.714 "abort": true, 00:18:19.715 "nvme_admin": true, 00:18:19.715 "nvme_io": true 00:18:19.715 }, 00:18:19.715 "driver_specific": { 00:18:19.715 "nvme": [ 00:18:19.715 { 00:18:19.715 "trid": { 00:18:19.715 "trtype": "TCP", 00:18:19.715 "adrfam": "IPv4", 00:18:19.715 "traddr": "10.0.0.2", 00:18:19.715 "trsvcid": "4420", 00:18:19.715 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:18:19.715 }, 00:18:19.715 "ctrlr_data": { 00:18:19.715 "cntlid": 1, 00:18:19.715 "vendor_id": "0x8086", 00:18:19.715 "model_number": "SPDK bdev Controller", 00:18:19.715 "serial_number": "SPDK0", 00:18:19.715 "firmware_revision": "24.01.1", 00:18:19.715 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:18:19.715 "oacs": { 00:18:19.715 "security": 0, 00:18:19.715 "format": 0, 00:18:19.715 "firmware": 0, 00:18:19.715 "ns_manage": 0 00:18:19.715 }, 00:18:19.715 "multi_ctrlr": true, 00:18:19.715 "ana_reporting": false 00:18:19.715 }, 00:18:19.715 "vs": { 00:18:19.715 "nvme_version": "1.3" 00:18:19.715 }, 00:18:19.715 "ns_data": { 00:18:19.715 "id": 1, 00:18:19.715 "can_share": true 00:18:19.715 } 00:18:19.715 } 00:18:19.715 ], 00:18:19.715 "mp_policy": "active_passive" 00:18:19.715 } 00:18:19.715 } 00:18:19.715 ] 00:18:19.973 01:12:34 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2032080 00:18:19.973 01:12:34 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:19.973 01:12:34 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:18:19.973 Running I/O for 10 seconds... 00:18:20.908 Latency(us) 00:18:20.908 [2024-11-28T00:12:35.511Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:20.908 [2024-11-28T00:12:35.511Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:20.908 Nvme0n1 : 1.00 14263.00 55.71 0.00 0.00 0.00 0.00 0.00 00:18:20.908 [2024-11-28T00:12:35.511Z] =================================================================================================================== 00:18:20.908 [2024-11-28T00:12:35.511Z] Total : 14263.00 55.71 0.00 0.00 0.00 0.00 0.00 00:18:20.908 00:18:21.843 01:12:36 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 9b6ac1ae-bb36-404e-aa11-72399db9b28a 00:18:21.843 [2024-11-28T00:12:36.446Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:21.843 Nvme0n1 : 2.00 14358.00 56.09 0.00 0.00 0.00 0.00 0.00 00:18:21.843 [2024-11-28T00:12:36.446Z] =================================================================================================================== 00:18:21.843 [2024-11-28T00:12:36.446Z] Total : 14358.00 56.09 0.00 0.00 0.00 0.00 0.00 00:18:21.843 00:18:22.102 true 00:18:22.102 01:12:36 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9b6ac1ae-bb36-404e-aa11-72399db9b28a 00:18:22.102 01:12:36 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:18:22.361 01:12:36 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:18:22.361 01:12:36 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:18:22.361 01:12:36 -- target/nvmf_lvs_grow.sh@65 -- # wait 2032080 00:18:22.929 [2024-11-28T00:12:37.532Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:22.929 Nvme0n1 : 3.00 14461.67 56.49 0.00 0.00 0.00 0.00 0.00 00:18:22.929 [2024-11-28T00:12:37.532Z] =================================================================================================================== 00:18:22.929 [2024-11-28T00:12:37.532Z] Total : 14461.67 56.49 0.00 0.00 0.00 0.00 0.00 00:18:22.929 00:18:23.864 [2024-11-28T00:12:38.467Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:23.864 Nvme0n1 : 4.00 14545.00 56.82 0.00 0.00 0.00 0.00 0.00 00:18:23.864 [2024-11-28T00:12:38.467Z] =================================================================================================================== 00:18:23.864 [2024-11-28T00:12:38.467Z] Total : 14545.00 56.82 0.00 0.00 0.00 0.00 0.00 00:18:23.864 00:18:25.241 [2024-11-28T00:12:39.844Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:25.241 Nvme0n1 : 5.00 14597.20 57.02 0.00 0.00 0.00 0.00 0.00 00:18:25.241 [2024-11-28T00:12:39.844Z] =================================================================================================================== 00:18:25.241 [2024-11-28T00:12:39.844Z] Total : 14597.20 57.02 0.00 0.00 0.00 0.00 0.00 00:18:25.241 00:18:26.177 [2024-11-28T00:12:40.780Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:26.177 Nvme0n1 : 6.00 14627.67 57.14 0.00 0.00 0.00 0.00 0.00 00:18:26.177 [2024-11-28T00:12:40.780Z] =================================================================================================================== 00:18:26.177 [2024-11-28T00:12:40.780Z] Total : 14627.67 57.14 0.00 0.00 0.00 0.00 0.00 00:18:26.177 00:18:27.113 [2024-11-28T00:12:41.716Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:27.113 Nvme0n1 : 7.00 14672.43 57.31 0.00 0.00 0.00 0.00 0.00 00:18:27.113 [2024-11-28T00:12:41.716Z] =================================================================================================================== 00:18:27.113 [2024-11-28T00:12:41.716Z] Total : 14672.43 57.31 0.00 0.00 0.00 0.00 0.00 00:18:27.113 00:18:28.047 [2024-11-28T00:12:42.650Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:28.047 Nvme0n1 : 8.00 14707.12 57.45 0.00 0.00 0.00 0.00 0.00 00:18:28.047 [2024-11-28T00:12:42.650Z] =================================================================================================================== 00:18:28.047 [2024-11-28T00:12:42.650Z] Total : 14707.12 57.45 0.00 0.00 0.00 0.00 0.00 00:18:28.047 00:18:28.982 [2024-11-28T00:12:43.585Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:28.982 Nvme0n1 : 9.00 14748.78 57.61 0.00 0.00 0.00 0.00 0.00 00:18:28.982 [2024-11-28T00:12:43.585Z] =================================================================================================================== 00:18:28.982 [2024-11-28T00:12:43.585Z] Total : 14748.78 57.61 0.00 0.00 0.00 0.00 0.00 00:18:28.982 00:18:29.918 [2024-11-28T00:12:44.521Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:29.918 Nvme0n1 : 10.00 14771.40 57.70 0.00 0.00 0.00 0.00 0.00 00:18:29.918 [2024-11-28T00:12:44.521Z] =================================================================================================================== 00:18:29.918 [2024-11-28T00:12:44.521Z] Total : 14771.40 57.70 0.00 0.00 0.00 0.00 0.00 00:18:29.918 00:18:29.918 00:18:29.918 Latency(us) 00:18:29.918 [2024-11-28T00:12:44.521Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:29.918 [2024-11-28T00:12:44.521Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:29.918 Nvme0n1 : 10.01 14768.53 57.69 0.00 0.00 8661.30 2208.81 16408.27 00:18:29.918 [2024-11-28T00:12:44.521Z] =================================================================================================================== 00:18:29.918 [2024-11-28T00:12:44.521Z] Total : 14768.53 57.69 0.00 0.00 8661.30 2208.81 16408.27 00:18:29.918 0 00:18:29.918 01:12:44 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2031805 00:18:29.918 01:12:44 -- common/autotest_common.sh@936 -- # '[' -z 2031805 ']' 00:18:29.918 01:12:44 -- common/autotest_common.sh@940 -- # kill -0 2031805 00:18:29.918 01:12:44 -- common/autotest_common.sh@941 -- # uname 00:18:29.918 01:12:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:29.918 01:12:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2031805 00:18:29.918 01:12:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:29.918 01:12:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:29.918 01:12:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2031805' 00:18:29.918 killing process with pid 2031805 00:18:29.918 01:12:44 -- common/autotest_common.sh@955 -- # kill 2031805 00:18:29.918 Received shutdown signal, test time was about 10.000000 seconds 00:18:29.918 00:18:29.918 Latency(us) 00:18:29.918 [2024-11-28T00:12:44.521Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:29.918 [2024-11-28T00:12:44.521Z] =================================================================================================================== 00:18:29.918 [2024-11-28T00:12:44.521Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:29.918 01:12:44 -- common/autotest_common.sh@960 -- # wait 2031805 00:18:30.177 01:12:44 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:30.742 01:12:45 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9b6ac1ae-bb36-404e-aa11-72399db9b28a 00:18:30.742 01:12:45 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:30.742 01:12:45 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:30.742 01:12:45 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:18:30.742 01:12:45 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 2029108 00:18:30.742 01:12:45 -- target/nvmf_lvs_grow.sh@74 -- # wait 2029108 00:18:30.742 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 2029108 Killed "${NVMF_APP[@]}" "$@" 00:18:30.742 01:12:45 -- target/nvmf_lvs_grow.sh@74 -- # true 00:18:30.743 01:12:45 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:18:30.743 01:12:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:30.743 01:12:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:30.743 01:12:45 -- common/autotest_common.sh@10 -- # set +x 00:18:30.743 01:12:45 -- nvmf/common.sh@469 -- # nvmfpid=2033324 00:18:30.743 01:12:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:30.743 01:12:45 -- nvmf/common.sh@470 -- # waitforlisten 2033324 00:18:30.743 01:12:45 -- common/autotest_common.sh@829 -- # '[' -z 2033324 ']' 00:18:30.743 01:12:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:30.743 01:12:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:30.743 01:12:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:30.743 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:30.743 01:12:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:30.743 01:12:45 -- common/autotest_common.sh@10 -- # set +x 00:18:31.000 [2024-11-28 01:12:45.374252] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:31.000 [2024-11-28 01:12:45.374327] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:31.000 EAL: No free 2048 kB hugepages reported on node 1 00:18:31.000 [2024-11-28 01:12:45.440644] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:31.000 [2024-11-28 01:12:45.528540] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:31.000 [2024-11-28 01:12:45.528711] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:31.000 [2024-11-28 01:12:45.528728] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:31.000 [2024-11-28 01:12:45.528740] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:31.000 [2024-11-28 01:12:45.528767] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:31.934 01:12:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:31.934 01:12:46 -- common/autotest_common.sh@862 -- # return 0 00:18:31.934 01:12:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:31.934 01:12:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:31.934 01:12:46 -- common/autotest_common.sh@10 -- # set +x 00:18:31.934 01:12:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:31.934 01:12:46 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:32.192 [2024-11-28 01:12:46.601792] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:18:32.192 [2024-11-28 01:12:46.601954] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:18:32.192 [2024-11-28 01:12:46.602002] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:18:32.192 01:12:46 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:18:32.192 01:12:46 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev ea3eca6a-3d17-4a89-a466-07dfe6a309b0 00:18:32.192 01:12:46 -- common/autotest_common.sh@897 -- # local bdev_name=ea3eca6a-3d17-4a89-a466-07dfe6a309b0 00:18:32.192 01:12:46 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:32.192 01:12:46 -- common/autotest_common.sh@899 -- # local i 00:18:32.192 01:12:46 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:32.192 01:12:46 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:32.192 01:12:46 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:32.449 01:12:46 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b ea3eca6a-3d17-4a89-a466-07dfe6a309b0 -t 2000 00:18:32.707 [ 00:18:32.707 { 00:18:32.707 "name": "ea3eca6a-3d17-4a89-a466-07dfe6a309b0", 00:18:32.707 "aliases": [ 00:18:32.707 "lvs/lvol" 00:18:32.707 ], 00:18:32.707 "product_name": "Logical Volume", 00:18:32.707 "block_size": 4096, 00:18:32.707 "num_blocks": 38912, 00:18:32.707 "uuid": "ea3eca6a-3d17-4a89-a466-07dfe6a309b0", 00:18:32.707 "assigned_rate_limits": { 00:18:32.707 "rw_ios_per_sec": 0, 00:18:32.707 "rw_mbytes_per_sec": 0, 00:18:32.707 "r_mbytes_per_sec": 0, 00:18:32.707 "w_mbytes_per_sec": 0 00:18:32.707 }, 00:18:32.707 "claimed": false, 00:18:32.707 "zoned": false, 00:18:32.707 "supported_io_types": { 00:18:32.707 "read": true, 00:18:32.707 "write": true, 00:18:32.707 "unmap": true, 00:18:32.707 "write_zeroes": true, 00:18:32.707 "flush": false, 00:18:32.707 "reset": true, 00:18:32.707 "compare": false, 00:18:32.707 "compare_and_write": false, 00:18:32.707 "abort": false, 00:18:32.707 "nvme_admin": false, 00:18:32.707 "nvme_io": false 00:18:32.707 }, 00:18:32.707 "driver_specific": { 00:18:32.707 "lvol": { 00:18:32.707 "lvol_store_uuid": "9b6ac1ae-bb36-404e-aa11-72399db9b28a", 00:18:32.707 "base_bdev": "aio_bdev", 00:18:32.707 "thin_provision": false, 00:18:32.707 "snapshot": false, 00:18:32.707 "clone": false, 00:18:32.707 "esnap_clone": false 00:18:32.707 } 00:18:32.707 } 00:18:32.707 } 00:18:32.707 ] 00:18:32.707 01:12:47 -- common/autotest_common.sh@905 -- # return 0 00:18:32.707 01:12:47 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9b6ac1ae-bb36-404e-aa11-72399db9b28a 00:18:32.707 01:12:47 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:18:32.964 01:12:47 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:18:32.964 01:12:47 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9b6ac1ae-bb36-404e-aa11-72399db9b28a 00:18:32.964 01:12:47 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:18:33.220 01:12:47 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:18:33.220 01:12:47 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:33.478 [2024-11-28 01:12:47.899120] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:33.478 01:12:47 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9b6ac1ae-bb36-404e-aa11-72399db9b28a 00:18:33.478 01:12:47 -- common/autotest_common.sh@650 -- # local es=0 00:18:33.478 01:12:47 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9b6ac1ae-bb36-404e-aa11-72399db9b28a 00:18:33.478 01:12:47 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:33.478 01:12:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:33.478 01:12:47 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:33.478 01:12:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:33.478 01:12:47 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:33.478 01:12:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:33.478 01:12:47 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:33.478 01:12:47 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:18:33.478 01:12:47 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9b6ac1ae-bb36-404e-aa11-72399db9b28a 00:18:33.736 request: 00:18:33.736 { 00:18:33.736 "uuid": "9b6ac1ae-bb36-404e-aa11-72399db9b28a", 00:18:33.736 "method": "bdev_lvol_get_lvstores", 00:18:33.736 "req_id": 1 00:18:33.736 } 00:18:33.736 Got JSON-RPC error response 00:18:33.736 response: 00:18:33.736 { 00:18:33.736 "code": -19, 00:18:33.736 "message": "No such device" 00:18:33.736 } 00:18:33.736 01:12:48 -- common/autotest_common.sh@653 -- # es=1 00:18:33.736 01:12:48 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:33.736 01:12:48 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:33.736 01:12:48 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:33.736 01:12:48 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:33.994 aio_bdev 00:18:33.994 01:12:48 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev ea3eca6a-3d17-4a89-a466-07dfe6a309b0 00:18:33.994 01:12:48 -- common/autotest_common.sh@897 -- # local bdev_name=ea3eca6a-3d17-4a89-a466-07dfe6a309b0 00:18:33.994 01:12:48 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:33.994 01:12:48 -- common/autotest_common.sh@899 -- # local i 00:18:33.994 01:12:48 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:33.994 01:12:48 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:33.994 01:12:48 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:34.252 01:12:48 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b ea3eca6a-3d17-4a89-a466-07dfe6a309b0 -t 2000 00:18:34.509 [ 00:18:34.509 { 00:18:34.509 "name": "ea3eca6a-3d17-4a89-a466-07dfe6a309b0", 00:18:34.509 "aliases": [ 00:18:34.509 "lvs/lvol" 00:18:34.509 ], 00:18:34.509 "product_name": "Logical Volume", 00:18:34.509 "block_size": 4096, 00:18:34.509 "num_blocks": 38912, 00:18:34.509 "uuid": "ea3eca6a-3d17-4a89-a466-07dfe6a309b0", 00:18:34.509 "assigned_rate_limits": { 00:18:34.509 "rw_ios_per_sec": 0, 00:18:34.509 "rw_mbytes_per_sec": 0, 00:18:34.509 "r_mbytes_per_sec": 0, 00:18:34.509 "w_mbytes_per_sec": 0 00:18:34.509 }, 00:18:34.509 "claimed": false, 00:18:34.509 "zoned": false, 00:18:34.509 "supported_io_types": { 00:18:34.509 "read": true, 00:18:34.509 "write": true, 00:18:34.509 "unmap": true, 00:18:34.509 "write_zeroes": true, 00:18:34.509 "flush": false, 00:18:34.509 "reset": true, 00:18:34.509 "compare": false, 00:18:34.509 "compare_and_write": false, 00:18:34.509 "abort": false, 00:18:34.509 "nvme_admin": false, 00:18:34.509 "nvme_io": false 00:18:34.509 }, 00:18:34.509 "driver_specific": { 00:18:34.509 "lvol": { 00:18:34.509 "lvol_store_uuid": "9b6ac1ae-bb36-404e-aa11-72399db9b28a", 00:18:34.509 "base_bdev": "aio_bdev", 00:18:34.509 "thin_provision": false, 00:18:34.509 "snapshot": false, 00:18:34.509 "clone": false, 00:18:34.509 "esnap_clone": false 00:18:34.509 } 00:18:34.509 } 00:18:34.509 } 00:18:34.509 ] 00:18:34.510 01:12:48 -- common/autotest_common.sh@905 -- # return 0 00:18:34.510 01:12:48 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9b6ac1ae-bb36-404e-aa11-72399db9b28a 00:18:34.510 01:12:48 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:34.767 01:12:49 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:34.767 01:12:49 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 9b6ac1ae-bb36-404e-aa11-72399db9b28a 00:18:34.767 01:12:49 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:35.025 01:12:49 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:35.025 01:12:49 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete ea3eca6a-3d17-4a89-a466-07dfe6a309b0 00:18:35.283 01:12:49 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 9b6ac1ae-bb36-404e-aa11-72399db9b28a 00:18:35.541 01:12:49 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:35.799 01:12:50 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:35.800 00:18:35.800 real 0m20.294s 00:18:35.800 user 0m50.999s 00:18:35.800 sys 0m4.663s 00:18:35.800 01:12:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:35.800 01:12:50 -- common/autotest_common.sh@10 -- # set +x 00:18:35.800 ************************************ 00:18:35.800 END TEST lvs_grow_dirty 00:18:35.800 ************************************ 00:18:35.800 01:12:50 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:18:35.800 01:12:50 -- common/autotest_common.sh@806 -- # type=--id 00:18:35.800 01:12:50 -- common/autotest_common.sh@807 -- # id=0 00:18:35.800 01:12:50 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:35.800 01:12:50 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:35.800 01:12:50 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:35.800 01:12:50 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:35.800 01:12:50 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:35.800 01:12:50 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:35.800 nvmf_trace.0 00:18:35.800 01:12:50 -- common/autotest_common.sh@821 -- # return 0 00:18:35.800 01:12:50 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:18:35.800 01:12:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:35.800 01:12:50 -- nvmf/common.sh@116 -- # sync 00:18:35.800 01:12:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:35.800 01:12:50 -- nvmf/common.sh@119 -- # set +e 00:18:35.800 01:12:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:35.800 01:12:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:35.800 rmmod nvme_tcp 00:18:35.800 rmmod nvme_fabrics 00:18:35.800 rmmod nvme_keyring 00:18:35.800 01:12:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:35.800 01:12:50 -- nvmf/common.sh@123 -- # set -e 00:18:35.800 01:12:50 -- nvmf/common.sh@124 -- # return 0 00:18:35.800 01:12:50 -- nvmf/common.sh@477 -- # '[' -n 2033324 ']' 00:18:35.800 01:12:50 -- nvmf/common.sh@478 -- # killprocess 2033324 00:18:35.800 01:12:50 -- common/autotest_common.sh@936 -- # '[' -z 2033324 ']' 00:18:35.800 01:12:50 -- common/autotest_common.sh@940 -- # kill -0 2033324 00:18:35.800 01:12:50 -- common/autotest_common.sh@941 -- # uname 00:18:35.800 01:12:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:35.800 01:12:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2033324 00:18:36.058 01:12:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:36.058 01:12:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:36.058 01:12:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2033324' 00:18:36.058 killing process with pid 2033324 00:18:36.058 01:12:50 -- common/autotest_common.sh@955 -- # kill 2033324 00:18:36.058 01:12:50 -- common/autotest_common.sh@960 -- # wait 2033324 00:18:36.316 01:12:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:36.317 01:12:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:36.317 01:12:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:36.317 01:12:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:36.317 01:12:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:36.317 01:12:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:36.317 01:12:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:36.317 01:12:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:38.219 01:12:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:38.219 00:18:38.219 real 0m44.199s 00:18:38.219 user 1m14.507s 00:18:38.219 sys 0m8.774s 00:18:38.219 01:12:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:38.219 01:12:52 -- common/autotest_common.sh@10 -- # set +x 00:18:38.219 ************************************ 00:18:38.219 END TEST nvmf_lvs_grow 00:18:38.219 ************************************ 00:18:38.219 01:12:52 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:38.219 01:12:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:38.219 01:12:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:38.219 01:12:52 -- common/autotest_common.sh@10 -- # set +x 00:18:38.219 ************************************ 00:18:38.219 START TEST nvmf_bdev_io_wait 00:18:38.219 ************************************ 00:18:38.219 01:12:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:38.219 * Looking for test storage... 00:18:38.219 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:38.219 01:12:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:38.220 01:12:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:38.220 01:12:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:38.479 01:12:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:38.479 01:12:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:38.479 01:12:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:38.479 01:12:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:38.479 01:12:52 -- scripts/common.sh@335 -- # IFS=.-: 00:18:38.479 01:12:52 -- scripts/common.sh@335 -- # read -ra ver1 00:18:38.479 01:12:52 -- scripts/common.sh@336 -- # IFS=.-: 00:18:38.479 01:12:52 -- scripts/common.sh@336 -- # read -ra ver2 00:18:38.479 01:12:52 -- scripts/common.sh@337 -- # local 'op=<' 00:18:38.479 01:12:52 -- scripts/common.sh@339 -- # ver1_l=2 00:18:38.479 01:12:52 -- scripts/common.sh@340 -- # ver2_l=1 00:18:38.479 01:12:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:38.479 01:12:52 -- scripts/common.sh@343 -- # case "$op" in 00:18:38.479 01:12:52 -- scripts/common.sh@344 -- # : 1 00:18:38.479 01:12:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:38.479 01:12:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:38.479 01:12:52 -- scripts/common.sh@364 -- # decimal 1 00:18:38.479 01:12:52 -- scripts/common.sh@352 -- # local d=1 00:18:38.479 01:12:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:38.479 01:12:52 -- scripts/common.sh@354 -- # echo 1 00:18:38.479 01:12:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:38.479 01:12:52 -- scripts/common.sh@365 -- # decimal 2 00:18:38.479 01:12:52 -- scripts/common.sh@352 -- # local d=2 00:18:38.479 01:12:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:38.479 01:12:52 -- scripts/common.sh@354 -- # echo 2 00:18:38.479 01:12:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:38.479 01:12:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:38.479 01:12:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:38.479 01:12:52 -- scripts/common.sh@367 -- # return 0 00:18:38.479 01:12:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:38.479 01:12:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:38.479 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:38.479 --rc genhtml_branch_coverage=1 00:18:38.479 --rc genhtml_function_coverage=1 00:18:38.479 --rc genhtml_legend=1 00:18:38.479 --rc geninfo_all_blocks=1 00:18:38.479 --rc geninfo_unexecuted_blocks=1 00:18:38.479 00:18:38.479 ' 00:18:38.479 01:12:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:38.479 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:38.479 --rc genhtml_branch_coverage=1 00:18:38.479 --rc genhtml_function_coverage=1 00:18:38.479 --rc genhtml_legend=1 00:18:38.479 --rc geninfo_all_blocks=1 00:18:38.479 --rc geninfo_unexecuted_blocks=1 00:18:38.479 00:18:38.479 ' 00:18:38.479 01:12:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:38.479 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:38.479 --rc genhtml_branch_coverage=1 00:18:38.479 --rc genhtml_function_coverage=1 00:18:38.479 --rc genhtml_legend=1 00:18:38.479 --rc geninfo_all_blocks=1 00:18:38.479 --rc geninfo_unexecuted_blocks=1 00:18:38.479 00:18:38.479 ' 00:18:38.479 01:12:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:38.479 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:38.479 --rc genhtml_branch_coverage=1 00:18:38.479 --rc genhtml_function_coverage=1 00:18:38.479 --rc genhtml_legend=1 00:18:38.479 --rc geninfo_all_blocks=1 00:18:38.479 --rc geninfo_unexecuted_blocks=1 00:18:38.479 00:18:38.479 ' 00:18:38.479 01:12:52 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:38.479 01:12:52 -- nvmf/common.sh@7 -- # uname -s 00:18:38.479 01:12:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:38.479 01:12:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:38.479 01:12:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:38.479 01:12:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:38.479 01:12:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:38.479 01:12:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:38.479 01:12:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:38.479 01:12:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:38.479 01:12:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:38.479 01:12:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:38.479 01:12:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:38.479 01:12:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:38.479 01:12:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:38.479 01:12:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:38.479 01:12:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:38.479 01:12:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:38.479 01:12:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:38.479 01:12:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:38.479 01:12:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:38.479 01:12:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:38.479 01:12:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:38.479 01:12:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:38.479 01:12:52 -- paths/export.sh@5 -- # export PATH 00:18:38.479 01:12:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:38.479 01:12:52 -- nvmf/common.sh@46 -- # : 0 00:18:38.479 01:12:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:38.479 01:12:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:38.479 01:12:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:38.479 01:12:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:38.479 01:12:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:38.479 01:12:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:38.479 01:12:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:38.479 01:12:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:38.479 01:12:52 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:38.479 01:12:52 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:38.479 01:12:52 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:18:38.479 01:12:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:38.479 01:12:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:38.479 01:12:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:38.479 01:12:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:38.479 01:12:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:38.479 01:12:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:38.479 01:12:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:38.479 01:12:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:38.479 01:12:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:38.479 01:12:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:38.479 01:12:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:38.479 01:12:52 -- common/autotest_common.sh@10 -- # set +x 00:18:40.381 01:12:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:40.381 01:12:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:40.381 01:12:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:40.381 01:12:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:40.381 01:12:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:40.381 01:12:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:40.381 01:12:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:40.381 01:12:54 -- nvmf/common.sh@294 -- # net_devs=() 00:18:40.381 01:12:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:40.381 01:12:54 -- nvmf/common.sh@295 -- # e810=() 00:18:40.381 01:12:54 -- nvmf/common.sh@295 -- # local -ga e810 00:18:40.381 01:12:54 -- nvmf/common.sh@296 -- # x722=() 00:18:40.381 01:12:54 -- nvmf/common.sh@296 -- # local -ga x722 00:18:40.381 01:12:54 -- nvmf/common.sh@297 -- # mlx=() 00:18:40.381 01:12:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:40.381 01:12:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:40.381 01:12:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:40.381 01:12:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:40.381 01:12:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:40.381 01:12:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:40.381 01:12:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:40.381 01:12:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:40.381 01:12:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:40.381 01:12:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:40.381 01:12:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:40.381 01:12:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:40.381 01:12:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:40.381 01:12:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:40.381 01:12:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:40.381 01:12:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:40.381 01:12:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:40.381 01:12:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:40.381 01:12:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:40.381 01:12:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:40.381 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:40.381 01:12:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:40.381 01:12:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:40.381 01:12:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:40.381 01:12:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:40.381 01:12:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:40.381 01:12:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:40.381 01:12:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:40.381 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:40.381 01:12:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:40.381 01:12:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:40.381 01:12:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:40.381 01:12:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:40.381 01:12:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:40.381 01:12:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:40.381 01:12:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:40.381 01:12:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:40.381 01:12:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:40.381 01:12:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:40.381 01:12:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:40.381 01:12:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:40.381 01:12:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:40.381 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:40.381 01:12:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:40.381 01:12:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:40.381 01:12:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:40.381 01:12:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:40.381 01:12:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:40.381 01:12:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:40.381 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:40.381 01:12:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:40.381 01:12:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:40.381 01:12:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:40.381 01:12:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:40.381 01:12:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:40.381 01:12:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:40.381 01:12:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:40.381 01:12:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:40.381 01:12:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:40.381 01:12:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:40.381 01:12:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:40.381 01:12:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:40.381 01:12:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:40.381 01:12:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:40.381 01:12:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:40.381 01:12:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:40.381 01:12:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:40.381 01:12:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:40.381 01:12:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:40.645 01:12:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:40.645 01:12:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:40.645 01:12:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:40.645 01:12:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:40.645 01:12:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:40.645 01:12:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:40.645 01:12:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:40.645 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:40.645 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.213 ms 00:18:40.645 00:18:40.645 --- 10.0.0.2 ping statistics --- 00:18:40.645 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:40.645 rtt min/avg/max/mdev = 0.213/0.213/0.213/0.000 ms 00:18:40.645 01:12:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:40.645 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:40.645 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.147 ms 00:18:40.645 00:18:40.645 --- 10.0.0.1 ping statistics --- 00:18:40.645 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:40.645 rtt min/avg/max/mdev = 0.147/0.147/0.147/0.000 ms 00:18:40.645 01:12:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:40.645 01:12:55 -- nvmf/common.sh@410 -- # return 0 00:18:40.645 01:12:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:40.645 01:12:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:40.645 01:12:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:40.645 01:12:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:40.645 01:12:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:40.645 01:12:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:40.645 01:12:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:40.645 01:12:55 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:18:40.645 01:12:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:40.645 01:12:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:40.645 01:12:55 -- common/autotest_common.sh@10 -- # set +x 00:18:40.645 01:12:55 -- nvmf/common.sh@469 -- # nvmfpid=2036007 00:18:40.645 01:12:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:18:40.645 01:12:55 -- nvmf/common.sh@470 -- # waitforlisten 2036007 00:18:40.645 01:12:55 -- common/autotest_common.sh@829 -- # '[' -z 2036007 ']' 00:18:40.645 01:12:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:40.645 01:12:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:40.645 01:12:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:40.645 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:40.645 01:12:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:40.645 01:12:55 -- common/autotest_common.sh@10 -- # set +x 00:18:40.645 [2024-11-28 01:12:55.141230] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:40.645 [2024-11-28 01:12:55.141327] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:40.645 EAL: No free 2048 kB hugepages reported on node 1 00:18:40.645 [2024-11-28 01:12:55.211303] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:40.948 [2024-11-28 01:12:55.303185] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:40.948 [2024-11-28 01:12:55.303365] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:40.948 [2024-11-28 01:12:55.303392] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:40.948 [2024-11-28 01:12:55.303408] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:40.948 [2024-11-28 01:12:55.303491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:40.948 [2024-11-28 01:12:55.303572] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:40.948 [2024-11-28 01:12:55.303614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:40.948 [2024-11-28 01:12:55.303617] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:40.948 01:12:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:40.948 01:12:55 -- common/autotest_common.sh@862 -- # return 0 00:18:40.948 01:12:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:40.948 01:12:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:40.948 01:12:55 -- common/autotest_common.sh@10 -- # set +x 00:18:40.948 01:12:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:40.948 01:12:55 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:18:40.948 01:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:40.948 01:12:55 -- common/autotest_common.sh@10 -- # set +x 00:18:40.948 01:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:40.948 01:12:55 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:18:40.948 01:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:40.948 01:12:55 -- common/autotest_common.sh@10 -- # set +x 00:18:40.948 01:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:40.948 01:12:55 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:40.948 01:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:40.948 01:12:55 -- common/autotest_common.sh@10 -- # set +x 00:18:40.948 [2024-11-28 01:12:55.460942] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:40.948 01:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:40.948 01:12:55 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:40.948 01:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:40.948 01:12:55 -- common/autotest_common.sh@10 -- # set +x 00:18:40.948 Malloc0 00:18:40.948 01:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:40.948 01:12:55 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:40.948 01:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:40.948 01:12:55 -- common/autotest_common.sh@10 -- # set +x 00:18:40.948 01:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:40.948 01:12:55 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:40.948 01:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:40.948 01:12:55 -- common/autotest_common.sh@10 -- # set +x 00:18:40.948 01:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:40.948 01:12:55 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:40.948 01:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:40.948 01:12:55 -- common/autotest_common.sh@10 -- # set +x 00:18:40.948 [2024-11-28 01:12:55.522292] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:40.948 01:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:40.948 01:12:55 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=2036032 00:18:40.948 01:12:55 -- target/bdev_io_wait.sh@30 -- # READ_PID=2036033 00:18:40.948 01:12:55 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:18:40.948 01:12:55 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:18:40.948 01:12:55 -- nvmf/common.sh@520 -- # config=() 00:18:40.948 01:12:55 -- nvmf/common.sh@520 -- # local subsystem config 00:18:40.948 01:12:55 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=2036036 00:18:40.948 01:12:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:40.948 01:12:55 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:18:40.948 01:12:55 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:18:40.948 01:12:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:40.948 { 00:18:40.948 "params": { 00:18:40.948 "name": "Nvme$subsystem", 00:18:40.948 "trtype": "$TEST_TRANSPORT", 00:18:40.948 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:40.948 "adrfam": "ipv4", 00:18:40.948 "trsvcid": "$NVMF_PORT", 00:18:40.948 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:40.948 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:40.948 "hdgst": ${hdgst:-false}, 00:18:40.948 "ddgst": ${ddgst:-false} 00:18:40.948 }, 00:18:40.948 "method": "bdev_nvme_attach_controller" 00:18:40.948 } 00:18:40.948 EOF 00:18:40.948 )") 00:18:40.948 01:12:55 -- nvmf/common.sh@520 -- # config=() 00:18:40.948 01:12:55 -- nvmf/common.sh@520 -- # local subsystem config 00:18:40.948 01:12:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:40.948 01:12:55 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=2036038 00:18:40.948 01:12:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:40.948 { 00:18:40.948 "params": { 00:18:40.948 "name": "Nvme$subsystem", 00:18:40.948 "trtype": "$TEST_TRANSPORT", 00:18:40.948 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:40.948 "adrfam": "ipv4", 00:18:40.948 "trsvcid": "$NVMF_PORT", 00:18:40.948 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:40.948 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:40.948 "hdgst": ${hdgst:-false}, 00:18:40.948 "ddgst": ${ddgst:-false} 00:18:40.948 }, 00:18:40.948 "method": "bdev_nvme_attach_controller" 00:18:40.948 } 00:18:40.948 EOF 00:18:40.948 )") 00:18:40.948 01:12:55 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:18:40.948 01:12:55 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:18:40.948 01:12:55 -- target/bdev_io_wait.sh@35 -- # sync 00:18:40.948 01:12:55 -- nvmf/common.sh@520 -- # config=() 00:18:40.948 01:12:55 -- nvmf/common.sh@520 -- # local subsystem config 00:18:40.948 01:12:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:40.948 01:12:55 -- nvmf/common.sh@542 -- # cat 00:18:40.948 01:12:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:40.948 { 00:18:40.948 "params": { 00:18:40.948 "name": "Nvme$subsystem", 00:18:40.948 "trtype": "$TEST_TRANSPORT", 00:18:40.948 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:40.948 "adrfam": "ipv4", 00:18:40.948 "trsvcid": "$NVMF_PORT", 00:18:40.948 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:40.948 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:40.948 "hdgst": ${hdgst:-false}, 00:18:40.948 "ddgst": ${ddgst:-false} 00:18:40.948 }, 00:18:40.948 "method": "bdev_nvme_attach_controller" 00:18:40.948 } 00:18:40.948 EOF 00:18:40.948 )") 00:18:40.948 01:12:55 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:18:40.948 01:12:55 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:18:40.948 01:12:55 -- nvmf/common.sh@520 -- # config=() 00:18:40.948 01:12:55 -- nvmf/common.sh@542 -- # cat 00:18:40.948 01:12:55 -- nvmf/common.sh@520 -- # local subsystem config 00:18:41.229 01:12:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:41.229 01:12:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:41.229 { 00:18:41.229 "params": { 00:18:41.229 "name": "Nvme$subsystem", 00:18:41.229 "trtype": "$TEST_TRANSPORT", 00:18:41.229 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:41.229 "adrfam": "ipv4", 00:18:41.229 "trsvcid": "$NVMF_PORT", 00:18:41.229 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:41.229 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:41.229 "hdgst": ${hdgst:-false}, 00:18:41.229 "ddgst": ${ddgst:-false} 00:18:41.229 }, 00:18:41.229 "method": "bdev_nvme_attach_controller" 00:18:41.229 } 00:18:41.229 EOF 00:18:41.229 )") 00:18:41.229 01:12:55 -- nvmf/common.sh@542 -- # cat 00:18:41.229 01:12:55 -- target/bdev_io_wait.sh@37 -- # wait 2036032 00:18:41.229 01:12:55 -- nvmf/common.sh@542 -- # cat 00:18:41.229 01:12:55 -- nvmf/common.sh@544 -- # jq . 00:18:41.229 01:12:55 -- nvmf/common.sh@544 -- # jq . 00:18:41.229 01:12:55 -- nvmf/common.sh@545 -- # IFS=, 00:18:41.229 01:12:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:41.229 "params": { 00:18:41.229 "name": "Nvme1", 00:18:41.229 "trtype": "tcp", 00:18:41.229 "traddr": "10.0.0.2", 00:18:41.229 "adrfam": "ipv4", 00:18:41.229 "trsvcid": "4420", 00:18:41.229 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:41.229 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:41.229 "hdgst": false, 00:18:41.229 "ddgst": false 00:18:41.229 }, 00:18:41.229 "method": "bdev_nvme_attach_controller" 00:18:41.229 }' 00:18:41.229 01:12:55 -- nvmf/common.sh@544 -- # jq . 00:18:41.229 01:12:55 -- nvmf/common.sh@545 -- # IFS=, 00:18:41.229 01:12:55 -- nvmf/common.sh@544 -- # jq . 00:18:41.229 01:12:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:41.229 "params": { 00:18:41.229 "name": "Nvme1", 00:18:41.229 "trtype": "tcp", 00:18:41.229 "traddr": "10.0.0.2", 00:18:41.229 "adrfam": "ipv4", 00:18:41.229 "trsvcid": "4420", 00:18:41.229 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:41.229 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:41.229 "hdgst": false, 00:18:41.229 "ddgst": false 00:18:41.229 }, 00:18:41.229 "method": "bdev_nvme_attach_controller" 00:18:41.229 }' 00:18:41.229 01:12:55 -- nvmf/common.sh@545 -- # IFS=, 00:18:41.229 01:12:55 -- nvmf/common.sh@545 -- # IFS=, 00:18:41.229 01:12:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:41.229 "params": { 00:18:41.229 "name": "Nvme1", 00:18:41.229 "trtype": "tcp", 00:18:41.229 "traddr": "10.0.0.2", 00:18:41.229 "adrfam": "ipv4", 00:18:41.229 "trsvcid": "4420", 00:18:41.229 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:41.229 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:41.229 "hdgst": false, 00:18:41.229 "ddgst": false 00:18:41.229 }, 00:18:41.229 "method": "bdev_nvme_attach_controller" 00:18:41.229 }' 00:18:41.229 01:12:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:41.229 "params": { 00:18:41.229 "name": "Nvme1", 00:18:41.229 "trtype": "tcp", 00:18:41.229 "traddr": "10.0.0.2", 00:18:41.229 "adrfam": "ipv4", 00:18:41.229 "trsvcid": "4420", 00:18:41.229 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:41.229 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:41.229 "hdgst": false, 00:18:41.229 "ddgst": false 00:18:41.229 }, 00:18:41.229 "method": "bdev_nvme_attach_controller" 00:18:41.229 }' 00:18:41.229 [2024-11-28 01:12:55.567824] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:41.229 [2024-11-28 01:12:55.567824] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:41.229 [2024-11-28 01:12:55.567824] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:41.229 [2024-11-28 01:12:55.567825] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:41.229 [2024-11-28 01:12:55.567914] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-28 01:12:55.567915] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-28 01:12:55.567915] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:18:41.229 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:18:41.229 [2024-11-28 01:12:55.567917] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:18:41.229 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:18:41.229 EAL: No free 2048 kB hugepages reported on node 1 00:18:41.229 EAL: No free 2048 kB hugepages reported on node 1 00:18:41.229 [2024-11-28 01:12:55.734570] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:41.229 EAL: No free 2048 kB hugepages reported on node 1 00:18:41.229 [2024-11-28 01:12:55.806263] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:41.488 [2024-11-28 01:12:55.831579] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:41.488 EAL: No free 2048 kB hugepages reported on node 1 00:18:41.488 [2024-11-28 01:12:55.906379] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:18:41.488 [2024-11-28 01:12:55.935506] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:41.488 [2024-11-28 01:12:56.007516] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:18:41.488 [2024-11-28 01:12:56.046887] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:41.746 [2024-11-28 01:12:56.126238] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:18:41.746 Running I/O for 1 seconds... 00:18:41.746 Running I/O for 1 seconds... 00:18:41.746 Running I/O for 1 seconds... 00:18:41.746 Running I/O for 1 seconds... 00:18:43.119 00:18:43.119 Latency(us) 00:18:43.119 [2024-11-28T00:12:57.722Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:43.119 [2024-11-28T00:12:57.722Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:18:43.119 Nvme1n1 : 1.02 6714.11 26.23 0.00 0.00 18851.45 8058.50 31263.10 00:18:43.119 [2024-11-28T00:12:57.722Z] =================================================================================================================== 00:18:43.119 [2024-11-28T00:12:57.722Z] Total : 6714.11 26.23 0.00 0.00 18851.45 8058.50 31263.10 00:18:43.119 00:18:43.119 Latency(us) 00:18:43.119 [2024-11-28T00:12:57.722Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:43.119 [2024-11-28T00:12:57.722Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:18:43.120 Nvme1n1 : 1.00 148533.58 580.21 0.00 0.00 858.50 403.53 1165.08 00:18:43.120 [2024-11-28T00:12:57.723Z] =================================================================================================================== 00:18:43.120 [2024-11-28T00:12:57.723Z] Total : 148533.58 580.21 0.00 0.00 858.50 403.53 1165.08 00:18:43.120 00:18:43.120 Latency(us) 00:18:43.120 [2024-11-28T00:12:57.723Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:43.120 [2024-11-28T00:12:57.723Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:18:43.120 Nvme1n1 : 1.01 6588.94 25.74 0.00 0.00 19362.23 6262.33 43108.12 00:18:43.120 [2024-11-28T00:12:57.723Z] =================================================================================================================== 00:18:43.120 [2024-11-28T00:12:57.723Z] Total : 6588.94 25.74 0.00 0.00 19362.23 6262.33 43108.12 00:18:43.120 00:18:43.120 Latency(us) 00:18:43.120 [2024-11-28T00:12:57.723Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:43.120 [2024-11-28T00:12:57.723Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:18:43.120 Nvme1n1 : 1.01 8924.11 34.86 0.00 0.00 14284.35 8301.23 27379.48 00:18:43.120 [2024-11-28T00:12:57.723Z] =================================================================================================================== 00:18:43.120 [2024-11-28T00:12:57.723Z] Total : 8924.11 34.86 0.00 0.00 14284.35 8301.23 27379.48 00:18:43.120 01:12:57 -- target/bdev_io_wait.sh@38 -- # wait 2036033 00:18:43.120 01:12:57 -- target/bdev_io_wait.sh@39 -- # wait 2036036 00:18:43.120 01:12:57 -- target/bdev_io_wait.sh@40 -- # wait 2036038 00:18:43.120 01:12:57 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:43.120 01:12:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:43.120 01:12:57 -- common/autotest_common.sh@10 -- # set +x 00:18:43.120 01:12:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:43.120 01:12:57 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:18:43.120 01:12:57 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:18:43.120 01:12:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:43.120 01:12:57 -- nvmf/common.sh@116 -- # sync 00:18:43.120 01:12:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:43.120 01:12:57 -- nvmf/common.sh@119 -- # set +e 00:18:43.120 01:12:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:43.120 01:12:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:43.120 rmmod nvme_tcp 00:18:43.120 rmmod nvme_fabrics 00:18:43.120 rmmod nvme_keyring 00:18:43.378 01:12:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:43.378 01:12:57 -- nvmf/common.sh@123 -- # set -e 00:18:43.378 01:12:57 -- nvmf/common.sh@124 -- # return 0 00:18:43.378 01:12:57 -- nvmf/common.sh@477 -- # '[' -n 2036007 ']' 00:18:43.378 01:12:57 -- nvmf/common.sh@478 -- # killprocess 2036007 00:18:43.378 01:12:57 -- common/autotest_common.sh@936 -- # '[' -z 2036007 ']' 00:18:43.378 01:12:57 -- common/autotest_common.sh@940 -- # kill -0 2036007 00:18:43.378 01:12:57 -- common/autotest_common.sh@941 -- # uname 00:18:43.378 01:12:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:43.378 01:12:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2036007 00:18:43.378 01:12:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:43.378 01:12:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:43.378 01:12:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2036007' 00:18:43.378 killing process with pid 2036007 00:18:43.378 01:12:57 -- common/autotest_common.sh@955 -- # kill 2036007 00:18:43.378 01:12:57 -- common/autotest_common.sh@960 -- # wait 2036007 00:18:43.637 01:12:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:43.637 01:12:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:43.637 01:12:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:43.637 01:12:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:43.637 01:12:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:43.637 01:12:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:43.637 01:12:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:43.637 01:12:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:45.539 01:13:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:45.539 00:18:45.539 real 0m7.311s 00:18:45.539 user 0m16.552s 00:18:45.539 sys 0m3.464s 00:18:45.539 01:13:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:45.539 01:13:00 -- common/autotest_common.sh@10 -- # set +x 00:18:45.539 ************************************ 00:18:45.539 END TEST nvmf_bdev_io_wait 00:18:45.540 ************************************ 00:18:45.540 01:13:00 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:45.540 01:13:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:45.540 01:13:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:45.540 01:13:00 -- common/autotest_common.sh@10 -- # set +x 00:18:45.540 ************************************ 00:18:45.540 START TEST nvmf_queue_depth 00:18:45.540 ************************************ 00:18:45.540 01:13:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:45.540 * Looking for test storage... 00:18:45.540 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:45.540 01:13:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:45.540 01:13:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:45.540 01:13:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:45.797 01:13:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:45.797 01:13:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:45.797 01:13:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:45.797 01:13:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:45.797 01:13:00 -- scripts/common.sh@335 -- # IFS=.-: 00:18:45.797 01:13:00 -- scripts/common.sh@335 -- # read -ra ver1 00:18:45.797 01:13:00 -- scripts/common.sh@336 -- # IFS=.-: 00:18:45.797 01:13:00 -- scripts/common.sh@336 -- # read -ra ver2 00:18:45.797 01:13:00 -- scripts/common.sh@337 -- # local 'op=<' 00:18:45.797 01:13:00 -- scripts/common.sh@339 -- # ver1_l=2 00:18:45.797 01:13:00 -- scripts/common.sh@340 -- # ver2_l=1 00:18:45.798 01:13:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:45.798 01:13:00 -- scripts/common.sh@343 -- # case "$op" in 00:18:45.798 01:13:00 -- scripts/common.sh@344 -- # : 1 00:18:45.798 01:13:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:45.798 01:13:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:45.798 01:13:00 -- scripts/common.sh@364 -- # decimal 1 00:18:45.798 01:13:00 -- scripts/common.sh@352 -- # local d=1 00:18:45.798 01:13:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:45.798 01:13:00 -- scripts/common.sh@354 -- # echo 1 00:18:45.798 01:13:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:45.798 01:13:00 -- scripts/common.sh@365 -- # decimal 2 00:18:45.798 01:13:00 -- scripts/common.sh@352 -- # local d=2 00:18:45.798 01:13:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:45.798 01:13:00 -- scripts/common.sh@354 -- # echo 2 00:18:45.798 01:13:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:45.798 01:13:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:45.798 01:13:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:45.798 01:13:00 -- scripts/common.sh@367 -- # return 0 00:18:45.798 01:13:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:45.798 01:13:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:45.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:45.798 --rc genhtml_branch_coverage=1 00:18:45.798 --rc genhtml_function_coverage=1 00:18:45.798 --rc genhtml_legend=1 00:18:45.798 --rc geninfo_all_blocks=1 00:18:45.798 --rc geninfo_unexecuted_blocks=1 00:18:45.798 00:18:45.798 ' 00:18:45.798 01:13:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:45.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:45.798 --rc genhtml_branch_coverage=1 00:18:45.798 --rc genhtml_function_coverage=1 00:18:45.798 --rc genhtml_legend=1 00:18:45.798 --rc geninfo_all_blocks=1 00:18:45.798 --rc geninfo_unexecuted_blocks=1 00:18:45.798 00:18:45.798 ' 00:18:45.798 01:13:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:45.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:45.798 --rc genhtml_branch_coverage=1 00:18:45.798 --rc genhtml_function_coverage=1 00:18:45.798 --rc genhtml_legend=1 00:18:45.798 --rc geninfo_all_blocks=1 00:18:45.798 --rc geninfo_unexecuted_blocks=1 00:18:45.798 00:18:45.798 ' 00:18:45.798 01:13:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:45.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:45.798 --rc genhtml_branch_coverage=1 00:18:45.798 --rc genhtml_function_coverage=1 00:18:45.798 --rc genhtml_legend=1 00:18:45.798 --rc geninfo_all_blocks=1 00:18:45.798 --rc geninfo_unexecuted_blocks=1 00:18:45.798 00:18:45.798 ' 00:18:45.798 01:13:00 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:45.798 01:13:00 -- nvmf/common.sh@7 -- # uname -s 00:18:45.798 01:13:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:45.798 01:13:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:45.798 01:13:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:45.798 01:13:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:45.798 01:13:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:45.798 01:13:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:45.798 01:13:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:45.798 01:13:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:45.798 01:13:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:45.798 01:13:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:45.798 01:13:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:45.798 01:13:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:45.798 01:13:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:45.798 01:13:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:45.798 01:13:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:45.798 01:13:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:45.798 01:13:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:45.798 01:13:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:45.798 01:13:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:45.798 01:13:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.798 01:13:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.798 01:13:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.798 01:13:00 -- paths/export.sh@5 -- # export PATH 00:18:45.798 01:13:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.798 01:13:00 -- nvmf/common.sh@46 -- # : 0 00:18:45.798 01:13:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:45.798 01:13:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:45.798 01:13:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:45.798 01:13:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:45.798 01:13:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:45.798 01:13:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:45.798 01:13:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:45.798 01:13:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:45.798 01:13:00 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:18:45.798 01:13:00 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:18:45.798 01:13:00 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:45.798 01:13:00 -- target/queue_depth.sh@19 -- # nvmftestinit 00:18:45.798 01:13:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:45.798 01:13:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:45.798 01:13:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:45.798 01:13:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:45.798 01:13:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:45.798 01:13:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:45.798 01:13:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:45.798 01:13:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:45.798 01:13:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:45.798 01:13:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:45.798 01:13:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:45.798 01:13:00 -- common/autotest_common.sh@10 -- # set +x 00:18:47.702 01:13:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:47.703 01:13:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:47.703 01:13:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:47.703 01:13:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:47.703 01:13:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:47.703 01:13:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:47.703 01:13:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:47.703 01:13:02 -- nvmf/common.sh@294 -- # net_devs=() 00:18:47.703 01:13:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:47.703 01:13:02 -- nvmf/common.sh@295 -- # e810=() 00:18:47.703 01:13:02 -- nvmf/common.sh@295 -- # local -ga e810 00:18:47.703 01:13:02 -- nvmf/common.sh@296 -- # x722=() 00:18:47.703 01:13:02 -- nvmf/common.sh@296 -- # local -ga x722 00:18:47.703 01:13:02 -- nvmf/common.sh@297 -- # mlx=() 00:18:47.703 01:13:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:47.703 01:13:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:47.703 01:13:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:47.703 01:13:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:47.703 01:13:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:47.703 01:13:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:47.703 01:13:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:47.703 01:13:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:47.703 01:13:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:47.703 01:13:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:47.703 01:13:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:47.703 01:13:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:47.703 01:13:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:47.703 01:13:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:47.703 01:13:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:47.703 01:13:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:47.703 01:13:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:47.703 01:13:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:47.703 01:13:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:47.703 01:13:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:47.703 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:47.703 01:13:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:47.703 01:13:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:47.703 01:13:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:47.703 01:13:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:47.703 01:13:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:47.703 01:13:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:47.703 01:13:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:47.703 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:47.703 01:13:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:47.703 01:13:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:47.703 01:13:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:47.703 01:13:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:47.703 01:13:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:47.703 01:13:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:47.703 01:13:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:47.703 01:13:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:47.703 01:13:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:47.703 01:13:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:47.703 01:13:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:47.703 01:13:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:47.703 01:13:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:47.703 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:47.703 01:13:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:47.703 01:13:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:47.703 01:13:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:47.703 01:13:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:47.703 01:13:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:47.703 01:13:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:47.703 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:47.703 01:13:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:47.703 01:13:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:47.703 01:13:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:47.703 01:13:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:47.703 01:13:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:47.703 01:13:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:47.703 01:13:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:47.703 01:13:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:47.703 01:13:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:47.703 01:13:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:47.703 01:13:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:47.703 01:13:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:47.703 01:13:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:47.703 01:13:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:47.703 01:13:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:47.703 01:13:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:47.703 01:13:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:47.703 01:13:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:47.703 01:13:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:47.703 01:13:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:47.703 01:13:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:47.703 01:13:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:47.703 01:13:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:47.703 01:13:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:47.703 01:13:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:47.703 01:13:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:47.703 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:47.703 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.271 ms 00:18:47.703 00:18:47.703 --- 10.0.0.2 ping statistics --- 00:18:47.703 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:47.703 rtt min/avg/max/mdev = 0.271/0.271/0.271/0.000 ms 00:18:47.703 01:13:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:47.703 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:47.703 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.156 ms 00:18:47.703 00:18:47.703 --- 10.0.0.1 ping statistics --- 00:18:47.703 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:47.703 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:18:47.703 01:13:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:47.703 01:13:02 -- nvmf/common.sh@410 -- # return 0 00:18:47.703 01:13:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:47.703 01:13:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:47.703 01:13:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:47.703 01:13:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:47.703 01:13:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:47.703 01:13:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:47.703 01:13:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:47.703 01:13:02 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:18:47.703 01:13:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:47.703 01:13:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:47.703 01:13:02 -- common/autotest_common.sh@10 -- # set +x 00:18:47.703 01:13:02 -- nvmf/common.sh@469 -- # nvmfpid=2038285 00:18:47.703 01:13:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:47.703 01:13:02 -- nvmf/common.sh@470 -- # waitforlisten 2038285 00:18:47.703 01:13:02 -- common/autotest_common.sh@829 -- # '[' -z 2038285 ']' 00:18:47.703 01:13:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:47.703 01:13:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:47.703 01:13:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:47.703 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:47.703 01:13:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:47.703 01:13:02 -- common/autotest_common.sh@10 -- # set +x 00:18:47.963 [2024-11-28 01:13:02.322147] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:47.963 [2024-11-28 01:13:02.322214] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:47.963 EAL: No free 2048 kB hugepages reported on node 1 00:18:47.963 [2024-11-28 01:13:02.389023] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:47.963 [2024-11-28 01:13:02.484538] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:47.963 [2024-11-28 01:13:02.484714] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:47.963 [2024-11-28 01:13:02.484731] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:47.963 [2024-11-28 01:13:02.484743] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:47.963 [2024-11-28 01:13:02.484773] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:48.897 01:13:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:48.897 01:13:03 -- common/autotest_common.sh@862 -- # return 0 00:18:48.897 01:13:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:48.897 01:13:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:48.897 01:13:03 -- common/autotest_common.sh@10 -- # set +x 00:18:48.897 01:13:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:48.897 01:13:03 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:48.897 01:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.897 01:13:03 -- common/autotest_common.sh@10 -- # set +x 00:18:48.897 [2024-11-28 01:13:03.390034] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:48.897 01:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.897 01:13:03 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:48.897 01:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.897 01:13:03 -- common/autotest_common.sh@10 -- # set +x 00:18:48.897 Malloc0 00:18:48.897 01:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.897 01:13:03 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:48.897 01:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.897 01:13:03 -- common/autotest_common.sh@10 -- # set +x 00:18:48.897 01:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.897 01:13:03 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:48.897 01:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.897 01:13:03 -- common/autotest_common.sh@10 -- # set +x 00:18:48.897 01:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.897 01:13:03 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:48.897 01:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.897 01:13:03 -- common/autotest_common.sh@10 -- # set +x 00:18:48.897 [2024-11-28 01:13:03.451692] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:48.897 01:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.897 01:13:03 -- target/queue_depth.sh@30 -- # bdevperf_pid=2038443 00:18:48.897 01:13:03 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:48.897 01:13:03 -- target/queue_depth.sh@33 -- # waitforlisten 2038443 /var/tmp/bdevperf.sock 00:18:48.897 01:13:03 -- common/autotest_common.sh@829 -- # '[' -z 2038443 ']' 00:18:48.897 01:13:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:48.897 01:13:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:48.897 01:13:03 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:18:48.897 01:13:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:48.897 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:48.897 01:13:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:48.897 01:13:03 -- common/autotest_common.sh@10 -- # set +x 00:18:48.897 [2024-11-28 01:13:03.497165] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:48.897 [2024-11-28 01:13:03.497260] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2038443 ] 00:18:49.155 EAL: No free 2048 kB hugepages reported on node 1 00:18:49.155 [2024-11-28 01:13:03.556033] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:49.156 [2024-11-28 01:13:03.639880] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:50.088 01:13:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:50.088 01:13:04 -- common/autotest_common.sh@862 -- # return 0 00:18:50.088 01:13:04 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:50.088 01:13:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:50.088 01:13:04 -- common/autotest_common.sh@10 -- # set +x 00:18:50.347 NVMe0n1 00:18:50.347 01:13:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:50.347 01:13:04 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:50.347 Running I/O for 10 seconds... 00:19:02.543 00:19:02.543 Latency(us) 00:19:02.543 [2024-11-28T00:13:17.146Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:02.543 [2024-11-28T00:13:17.146Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:19:02.543 Verification LBA range: start 0x0 length 0x4000 00:19:02.543 NVMe0n1 : 10.07 12381.10 48.36 0.00 0.00 82382.79 13495.56 59807.67 00:19:02.543 [2024-11-28T00:13:17.146Z] =================================================================================================================== 00:19:02.543 [2024-11-28T00:13:17.146Z] Total : 12381.10 48.36 0.00 0.00 82382.79 13495.56 59807.67 00:19:02.543 0 00:19:02.543 01:13:14 -- target/queue_depth.sh@39 -- # killprocess 2038443 00:19:02.543 01:13:14 -- common/autotest_common.sh@936 -- # '[' -z 2038443 ']' 00:19:02.543 01:13:14 -- common/autotest_common.sh@940 -- # kill -0 2038443 00:19:02.543 01:13:14 -- common/autotest_common.sh@941 -- # uname 00:19:02.543 01:13:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:02.543 01:13:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2038443 00:19:02.543 01:13:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:02.543 01:13:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:02.543 01:13:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2038443' 00:19:02.543 killing process with pid 2038443 00:19:02.543 01:13:15 -- common/autotest_common.sh@955 -- # kill 2038443 00:19:02.543 Received shutdown signal, test time was about 10.000000 seconds 00:19:02.543 00:19:02.543 Latency(us) 00:19:02.543 [2024-11-28T00:13:17.146Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:02.543 [2024-11-28T00:13:17.146Z] =================================================================================================================== 00:19:02.543 [2024-11-28T00:13:17.146Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:19:02.543 01:13:15 -- common/autotest_common.sh@960 -- # wait 2038443 00:19:02.543 01:13:15 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:19:02.543 01:13:15 -- target/queue_depth.sh@43 -- # nvmftestfini 00:19:02.543 01:13:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:02.543 01:13:15 -- nvmf/common.sh@116 -- # sync 00:19:02.543 01:13:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:02.543 01:13:15 -- nvmf/common.sh@119 -- # set +e 00:19:02.543 01:13:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:02.543 01:13:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:02.543 rmmod nvme_tcp 00:19:02.543 rmmod nvme_fabrics 00:19:02.543 rmmod nvme_keyring 00:19:02.543 01:13:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:02.543 01:13:15 -- nvmf/common.sh@123 -- # set -e 00:19:02.543 01:13:15 -- nvmf/common.sh@124 -- # return 0 00:19:02.543 01:13:15 -- nvmf/common.sh@477 -- # '[' -n 2038285 ']' 00:19:02.543 01:13:15 -- nvmf/common.sh@478 -- # killprocess 2038285 00:19:02.543 01:13:15 -- common/autotest_common.sh@936 -- # '[' -z 2038285 ']' 00:19:02.543 01:13:15 -- common/autotest_common.sh@940 -- # kill -0 2038285 00:19:02.543 01:13:15 -- common/autotest_common.sh@941 -- # uname 00:19:02.543 01:13:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:02.543 01:13:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2038285 00:19:02.543 01:13:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:02.543 01:13:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:02.543 01:13:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2038285' 00:19:02.543 killing process with pid 2038285 00:19:02.543 01:13:15 -- common/autotest_common.sh@955 -- # kill 2038285 00:19:02.543 01:13:15 -- common/autotest_common.sh@960 -- # wait 2038285 00:19:02.543 01:13:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:02.543 01:13:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:02.543 01:13:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:02.543 01:13:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:02.543 01:13:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:02.543 01:13:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:02.544 01:13:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:02.544 01:13:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:03.111 01:13:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:03.111 00:19:03.111 real 0m17.578s 00:19:03.111 user 0m25.489s 00:19:03.111 sys 0m3.068s 00:19:03.111 01:13:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:03.111 01:13:17 -- common/autotest_common.sh@10 -- # set +x 00:19:03.111 ************************************ 00:19:03.111 END TEST nvmf_queue_depth 00:19:03.111 ************************************ 00:19:03.111 01:13:17 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:19:03.111 01:13:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:03.111 01:13:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:03.111 01:13:17 -- common/autotest_common.sh@10 -- # set +x 00:19:03.111 ************************************ 00:19:03.111 START TEST nvmf_multipath 00:19:03.111 ************************************ 00:19:03.111 01:13:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:19:03.370 * Looking for test storage... 00:19:03.370 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:03.370 01:13:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:03.370 01:13:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:03.370 01:13:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:03.370 01:13:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:03.370 01:13:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:03.370 01:13:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:03.370 01:13:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:03.370 01:13:17 -- scripts/common.sh@335 -- # IFS=.-: 00:19:03.370 01:13:17 -- scripts/common.sh@335 -- # read -ra ver1 00:19:03.370 01:13:17 -- scripts/common.sh@336 -- # IFS=.-: 00:19:03.370 01:13:17 -- scripts/common.sh@336 -- # read -ra ver2 00:19:03.370 01:13:17 -- scripts/common.sh@337 -- # local 'op=<' 00:19:03.370 01:13:17 -- scripts/common.sh@339 -- # ver1_l=2 00:19:03.370 01:13:17 -- scripts/common.sh@340 -- # ver2_l=1 00:19:03.370 01:13:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:03.370 01:13:17 -- scripts/common.sh@343 -- # case "$op" in 00:19:03.370 01:13:17 -- scripts/common.sh@344 -- # : 1 00:19:03.370 01:13:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:03.370 01:13:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:03.370 01:13:17 -- scripts/common.sh@364 -- # decimal 1 00:19:03.370 01:13:17 -- scripts/common.sh@352 -- # local d=1 00:19:03.370 01:13:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:03.370 01:13:17 -- scripts/common.sh@354 -- # echo 1 00:19:03.370 01:13:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:03.370 01:13:17 -- scripts/common.sh@365 -- # decimal 2 00:19:03.370 01:13:17 -- scripts/common.sh@352 -- # local d=2 00:19:03.370 01:13:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:03.370 01:13:17 -- scripts/common.sh@354 -- # echo 2 00:19:03.370 01:13:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:03.370 01:13:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:03.370 01:13:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:03.370 01:13:17 -- scripts/common.sh@367 -- # return 0 00:19:03.370 01:13:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:03.370 01:13:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:03.370 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:03.370 --rc genhtml_branch_coverage=1 00:19:03.370 --rc genhtml_function_coverage=1 00:19:03.370 --rc genhtml_legend=1 00:19:03.370 --rc geninfo_all_blocks=1 00:19:03.370 --rc geninfo_unexecuted_blocks=1 00:19:03.370 00:19:03.370 ' 00:19:03.370 01:13:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:03.370 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:03.370 --rc genhtml_branch_coverage=1 00:19:03.370 --rc genhtml_function_coverage=1 00:19:03.370 --rc genhtml_legend=1 00:19:03.370 --rc geninfo_all_blocks=1 00:19:03.370 --rc geninfo_unexecuted_blocks=1 00:19:03.370 00:19:03.370 ' 00:19:03.370 01:13:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:03.370 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:03.370 --rc genhtml_branch_coverage=1 00:19:03.370 --rc genhtml_function_coverage=1 00:19:03.370 --rc genhtml_legend=1 00:19:03.370 --rc geninfo_all_blocks=1 00:19:03.370 --rc geninfo_unexecuted_blocks=1 00:19:03.370 00:19:03.370 ' 00:19:03.370 01:13:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:03.370 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:03.370 --rc genhtml_branch_coverage=1 00:19:03.370 --rc genhtml_function_coverage=1 00:19:03.370 --rc genhtml_legend=1 00:19:03.370 --rc geninfo_all_blocks=1 00:19:03.370 --rc geninfo_unexecuted_blocks=1 00:19:03.370 00:19:03.370 ' 00:19:03.370 01:13:17 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:03.370 01:13:17 -- nvmf/common.sh@7 -- # uname -s 00:19:03.370 01:13:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:03.370 01:13:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:03.370 01:13:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:03.370 01:13:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:03.370 01:13:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:03.370 01:13:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:03.370 01:13:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:03.370 01:13:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:03.370 01:13:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:03.370 01:13:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:03.370 01:13:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:03.370 01:13:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:03.370 01:13:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:03.370 01:13:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:03.370 01:13:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:03.370 01:13:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:03.370 01:13:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:03.370 01:13:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:03.370 01:13:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:03.370 01:13:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:03.371 01:13:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:03.371 01:13:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:03.371 01:13:17 -- paths/export.sh@5 -- # export PATH 00:19:03.371 01:13:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:03.371 01:13:17 -- nvmf/common.sh@46 -- # : 0 00:19:03.371 01:13:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:03.371 01:13:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:03.371 01:13:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:03.371 01:13:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:03.371 01:13:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:03.371 01:13:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:03.371 01:13:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:03.371 01:13:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:03.371 01:13:17 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:03.371 01:13:17 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:03.371 01:13:17 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:19:03.371 01:13:17 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:03.371 01:13:17 -- target/multipath.sh@43 -- # nvmftestinit 00:19:03.371 01:13:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:03.371 01:13:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:03.371 01:13:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:03.371 01:13:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:03.371 01:13:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:03.371 01:13:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:03.371 01:13:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:03.371 01:13:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:03.371 01:13:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:03.371 01:13:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:03.371 01:13:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:03.371 01:13:17 -- common/autotest_common.sh@10 -- # set +x 00:19:05.274 01:13:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:05.274 01:13:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:05.274 01:13:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:05.274 01:13:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:05.274 01:13:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:05.274 01:13:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:05.274 01:13:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:05.274 01:13:19 -- nvmf/common.sh@294 -- # net_devs=() 00:19:05.274 01:13:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:05.274 01:13:19 -- nvmf/common.sh@295 -- # e810=() 00:19:05.274 01:13:19 -- nvmf/common.sh@295 -- # local -ga e810 00:19:05.274 01:13:19 -- nvmf/common.sh@296 -- # x722=() 00:19:05.274 01:13:19 -- nvmf/common.sh@296 -- # local -ga x722 00:19:05.274 01:13:19 -- nvmf/common.sh@297 -- # mlx=() 00:19:05.274 01:13:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:05.274 01:13:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:05.274 01:13:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:05.274 01:13:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:05.274 01:13:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:05.274 01:13:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:05.274 01:13:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:05.274 01:13:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:05.274 01:13:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:05.274 01:13:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:05.274 01:13:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:05.274 01:13:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:05.274 01:13:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:05.274 01:13:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:05.274 01:13:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:05.274 01:13:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:05.274 01:13:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:05.274 01:13:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:05.274 01:13:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:05.274 01:13:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:05.274 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:05.274 01:13:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:05.274 01:13:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:05.274 01:13:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:05.274 01:13:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:05.275 01:13:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:05.275 01:13:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:05.275 01:13:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:05.275 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:05.275 01:13:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:05.275 01:13:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:05.275 01:13:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:05.275 01:13:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:05.275 01:13:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:05.275 01:13:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:05.275 01:13:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:05.275 01:13:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:05.275 01:13:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:05.275 01:13:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:05.275 01:13:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:05.275 01:13:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:05.275 01:13:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:05.275 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:05.275 01:13:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:05.275 01:13:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:05.275 01:13:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:05.275 01:13:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:05.275 01:13:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:05.275 01:13:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:05.275 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:05.275 01:13:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:05.275 01:13:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:05.275 01:13:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:05.275 01:13:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:05.275 01:13:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:05.275 01:13:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:05.275 01:13:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:05.275 01:13:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:05.275 01:13:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:05.534 01:13:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:05.534 01:13:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:05.534 01:13:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:05.534 01:13:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:05.534 01:13:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:05.534 01:13:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:05.534 01:13:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:05.534 01:13:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:05.534 01:13:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:05.534 01:13:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:05.534 01:13:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:05.534 01:13:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:05.534 01:13:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:05.534 01:13:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:05.534 01:13:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:05.534 01:13:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:05.534 01:13:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:05.534 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:05.534 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.269 ms 00:19:05.534 00:19:05.534 --- 10.0.0.2 ping statistics --- 00:19:05.534 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:05.534 rtt min/avg/max/mdev = 0.269/0.269/0.269/0.000 ms 00:19:05.534 01:13:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:05.534 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:05.534 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.086 ms 00:19:05.534 00:19:05.534 --- 10.0.0.1 ping statistics --- 00:19:05.534 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:05.534 rtt min/avg/max/mdev = 0.086/0.086/0.086/0.000 ms 00:19:05.534 01:13:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:05.534 01:13:20 -- nvmf/common.sh@410 -- # return 0 00:19:05.534 01:13:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:05.534 01:13:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:05.534 01:13:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:05.534 01:13:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:05.534 01:13:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:05.534 01:13:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:05.534 01:13:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:05.534 01:13:20 -- target/multipath.sh@45 -- # '[' -z ']' 00:19:05.534 01:13:20 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:19:05.534 only one NIC for nvmf test 00:19:05.534 01:13:20 -- target/multipath.sh@47 -- # nvmftestfini 00:19:05.534 01:13:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:05.534 01:13:20 -- nvmf/common.sh@116 -- # sync 00:19:05.534 01:13:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:05.534 01:13:20 -- nvmf/common.sh@119 -- # set +e 00:19:05.534 01:13:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:05.534 01:13:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:05.534 rmmod nvme_tcp 00:19:05.534 rmmod nvme_fabrics 00:19:05.534 rmmod nvme_keyring 00:19:05.534 01:13:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:05.534 01:13:20 -- nvmf/common.sh@123 -- # set -e 00:19:05.534 01:13:20 -- nvmf/common.sh@124 -- # return 0 00:19:05.534 01:13:20 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:19:05.534 01:13:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:05.534 01:13:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:05.534 01:13:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:05.534 01:13:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:05.534 01:13:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:05.534 01:13:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:05.534 01:13:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:05.534 01:13:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:08.069 01:13:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:08.069 01:13:22 -- target/multipath.sh@48 -- # exit 0 00:19:08.069 01:13:22 -- target/multipath.sh@1 -- # nvmftestfini 00:19:08.069 01:13:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:08.069 01:13:22 -- nvmf/common.sh@116 -- # sync 00:19:08.069 01:13:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:08.069 01:13:22 -- nvmf/common.sh@119 -- # set +e 00:19:08.069 01:13:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:08.069 01:13:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:08.069 01:13:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:08.069 01:13:22 -- nvmf/common.sh@123 -- # set -e 00:19:08.069 01:13:22 -- nvmf/common.sh@124 -- # return 0 00:19:08.069 01:13:22 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:19:08.069 01:13:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:08.070 01:13:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:08.070 01:13:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:08.070 01:13:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:08.070 01:13:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:08.070 01:13:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:08.070 01:13:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:08.070 01:13:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:08.070 01:13:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:08.070 00:19:08.070 real 0m4.468s 00:19:08.070 user 0m0.913s 00:19:08.070 sys 0m1.546s 00:19:08.070 01:13:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:08.070 01:13:22 -- common/autotest_common.sh@10 -- # set +x 00:19:08.070 ************************************ 00:19:08.070 END TEST nvmf_multipath 00:19:08.070 ************************************ 00:19:08.070 01:13:22 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:19:08.070 01:13:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:08.070 01:13:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:08.070 01:13:22 -- common/autotest_common.sh@10 -- # set +x 00:19:08.070 ************************************ 00:19:08.070 START TEST nvmf_zcopy 00:19:08.070 ************************************ 00:19:08.070 01:13:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:19:08.070 * Looking for test storage... 00:19:08.070 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:08.070 01:13:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:08.070 01:13:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:08.070 01:13:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:08.070 01:13:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:08.070 01:13:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:08.070 01:13:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:08.070 01:13:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:08.070 01:13:22 -- scripts/common.sh@335 -- # IFS=.-: 00:19:08.070 01:13:22 -- scripts/common.sh@335 -- # read -ra ver1 00:19:08.070 01:13:22 -- scripts/common.sh@336 -- # IFS=.-: 00:19:08.070 01:13:22 -- scripts/common.sh@336 -- # read -ra ver2 00:19:08.070 01:13:22 -- scripts/common.sh@337 -- # local 'op=<' 00:19:08.070 01:13:22 -- scripts/common.sh@339 -- # ver1_l=2 00:19:08.070 01:13:22 -- scripts/common.sh@340 -- # ver2_l=1 00:19:08.070 01:13:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:08.070 01:13:22 -- scripts/common.sh@343 -- # case "$op" in 00:19:08.070 01:13:22 -- scripts/common.sh@344 -- # : 1 00:19:08.070 01:13:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:08.070 01:13:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:08.070 01:13:22 -- scripts/common.sh@364 -- # decimal 1 00:19:08.070 01:13:22 -- scripts/common.sh@352 -- # local d=1 00:19:08.070 01:13:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:08.070 01:13:22 -- scripts/common.sh@354 -- # echo 1 00:19:08.070 01:13:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:08.070 01:13:22 -- scripts/common.sh@365 -- # decimal 2 00:19:08.070 01:13:22 -- scripts/common.sh@352 -- # local d=2 00:19:08.070 01:13:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:08.070 01:13:22 -- scripts/common.sh@354 -- # echo 2 00:19:08.070 01:13:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:08.070 01:13:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:08.070 01:13:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:08.070 01:13:22 -- scripts/common.sh@367 -- # return 0 00:19:08.070 01:13:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:08.070 01:13:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:08.070 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:08.070 --rc genhtml_branch_coverage=1 00:19:08.070 --rc genhtml_function_coverage=1 00:19:08.070 --rc genhtml_legend=1 00:19:08.070 --rc geninfo_all_blocks=1 00:19:08.070 --rc geninfo_unexecuted_blocks=1 00:19:08.070 00:19:08.070 ' 00:19:08.070 01:13:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:08.070 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:08.070 --rc genhtml_branch_coverage=1 00:19:08.070 --rc genhtml_function_coverage=1 00:19:08.070 --rc genhtml_legend=1 00:19:08.070 --rc geninfo_all_blocks=1 00:19:08.070 --rc geninfo_unexecuted_blocks=1 00:19:08.070 00:19:08.070 ' 00:19:08.070 01:13:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:08.070 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:08.070 --rc genhtml_branch_coverage=1 00:19:08.070 --rc genhtml_function_coverage=1 00:19:08.070 --rc genhtml_legend=1 00:19:08.070 --rc geninfo_all_blocks=1 00:19:08.070 --rc geninfo_unexecuted_blocks=1 00:19:08.070 00:19:08.070 ' 00:19:08.070 01:13:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:08.070 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:08.070 --rc genhtml_branch_coverage=1 00:19:08.070 --rc genhtml_function_coverage=1 00:19:08.070 --rc genhtml_legend=1 00:19:08.070 --rc geninfo_all_blocks=1 00:19:08.070 --rc geninfo_unexecuted_blocks=1 00:19:08.070 00:19:08.070 ' 00:19:08.070 01:13:22 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:08.070 01:13:22 -- nvmf/common.sh@7 -- # uname -s 00:19:08.070 01:13:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:08.070 01:13:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:08.070 01:13:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:08.070 01:13:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:08.070 01:13:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:08.070 01:13:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:08.070 01:13:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:08.070 01:13:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:08.070 01:13:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:08.070 01:13:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:08.070 01:13:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:08.070 01:13:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:08.070 01:13:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:08.070 01:13:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:08.070 01:13:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:08.070 01:13:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:08.070 01:13:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:08.070 01:13:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:08.070 01:13:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:08.070 01:13:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:08.071 01:13:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:08.071 01:13:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:08.071 01:13:22 -- paths/export.sh@5 -- # export PATH 00:19:08.071 01:13:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:08.071 01:13:22 -- nvmf/common.sh@46 -- # : 0 00:19:08.071 01:13:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:08.071 01:13:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:08.071 01:13:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:08.071 01:13:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:08.071 01:13:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:08.071 01:13:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:08.071 01:13:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:08.071 01:13:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:08.071 01:13:22 -- target/zcopy.sh@12 -- # nvmftestinit 00:19:08.071 01:13:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:08.071 01:13:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:08.071 01:13:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:08.071 01:13:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:08.071 01:13:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:08.071 01:13:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:08.071 01:13:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:08.071 01:13:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:08.071 01:13:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:08.071 01:13:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:08.071 01:13:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:08.071 01:13:22 -- common/autotest_common.sh@10 -- # set +x 00:19:09.975 01:13:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:09.975 01:13:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:09.975 01:13:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:09.975 01:13:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:09.975 01:13:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:09.975 01:13:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:09.975 01:13:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:09.975 01:13:24 -- nvmf/common.sh@294 -- # net_devs=() 00:19:09.975 01:13:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:09.975 01:13:24 -- nvmf/common.sh@295 -- # e810=() 00:19:09.975 01:13:24 -- nvmf/common.sh@295 -- # local -ga e810 00:19:09.975 01:13:24 -- nvmf/common.sh@296 -- # x722=() 00:19:09.975 01:13:24 -- nvmf/common.sh@296 -- # local -ga x722 00:19:09.975 01:13:24 -- nvmf/common.sh@297 -- # mlx=() 00:19:09.975 01:13:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:09.975 01:13:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:09.975 01:13:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:09.975 01:13:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:09.975 01:13:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:09.975 01:13:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:09.975 01:13:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:09.975 01:13:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:09.975 01:13:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:09.975 01:13:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:09.975 01:13:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:09.975 01:13:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:09.975 01:13:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:09.975 01:13:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:09.975 01:13:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:09.976 01:13:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:09.976 01:13:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:09.976 01:13:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:09.976 01:13:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:09.976 01:13:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:09.976 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:09.976 01:13:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:09.976 01:13:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:09.976 01:13:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:09.976 01:13:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:09.976 01:13:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:09.976 01:13:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:09.976 01:13:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:09.976 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:09.976 01:13:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:09.976 01:13:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:09.976 01:13:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:09.976 01:13:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:09.976 01:13:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:09.976 01:13:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:09.976 01:13:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:09.976 01:13:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:09.976 01:13:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:09.976 01:13:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:09.976 01:13:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:09.976 01:13:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:09.976 01:13:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:09.976 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:09.976 01:13:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:09.976 01:13:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:09.976 01:13:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:09.976 01:13:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:09.976 01:13:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:09.976 01:13:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:09.976 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:09.976 01:13:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:09.976 01:13:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:09.976 01:13:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:09.976 01:13:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:09.976 01:13:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:09.976 01:13:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:09.976 01:13:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:09.976 01:13:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:09.976 01:13:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:09.976 01:13:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:09.976 01:13:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:09.976 01:13:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:09.976 01:13:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:09.976 01:13:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:09.976 01:13:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:09.976 01:13:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:09.976 01:13:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:09.976 01:13:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:09.976 01:13:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:10.235 01:13:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:10.235 01:13:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:10.235 01:13:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:10.235 01:13:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:10.235 01:13:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:10.235 01:13:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:10.235 01:13:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:10.235 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:10.235 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.382 ms 00:19:10.235 00:19:10.235 --- 10.0.0.2 ping statistics --- 00:19:10.235 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:10.235 rtt min/avg/max/mdev = 0.382/0.382/0.382/0.000 ms 00:19:10.235 01:13:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:10.235 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:10.235 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.153 ms 00:19:10.235 00:19:10.235 --- 10.0.0.1 ping statistics --- 00:19:10.235 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:10.235 rtt min/avg/max/mdev = 0.153/0.153/0.153/0.000 ms 00:19:10.235 01:13:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:10.235 01:13:24 -- nvmf/common.sh@410 -- # return 0 00:19:10.235 01:13:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:10.235 01:13:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:10.235 01:13:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:10.235 01:13:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:10.235 01:13:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:10.235 01:13:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:10.235 01:13:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:10.235 01:13:24 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:19:10.235 01:13:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:10.235 01:13:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:10.235 01:13:24 -- common/autotest_common.sh@10 -- # set +x 00:19:10.235 01:13:24 -- nvmf/common.sh@469 -- # nvmfpid=2043838 00:19:10.235 01:13:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:19:10.235 01:13:24 -- nvmf/common.sh@470 -- # waitforlisten 2043838 00:19:10.235 01:13:24 -- common/autotest_common.sh@829 -- # '[' -z 2043838 ']' 00:19:10.235 01:13:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:10.235 01:13:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:10.235 01:13:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:10.235 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:10.235 01:13:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:10.235 01:13:24 -- common/autotest_common.sh@10 -- # set +x 00:19:10.235 [2024-11-28 01:13:24.749081] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:10.235 [2024-11-28 01:13:24.749162] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:10.235 EAL: No free 2048 kB hugepages reported on node 1 00:19:10.235 [2024-11-28 01:13:24.816906] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:10.492 [2024-11-28 01:13:24.903475] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:10.492 [2024-11-28 01:13:24.903687] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:10.492 [2024-11-28 01:13:24.903707] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:10.492 [2024-11-28 01:13:24.903719] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:10.492 [2024-11-28 01:13:24.903746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:11.422 01:13:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:11.422 01:13:25 -- common/autotest_common.sh@862 -- # return 0 00:19:11.422 01:13:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:11.422 01:13:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:11.422 01:13:25 -- common/autotest_common.sh@10 -- # set +x 00:19:11.422 01:13:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:11.422 01:13:25 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:19:11.422 01:13:25 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:19:11.422 01:13:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:11.422 01:13:25 -- common/autotest_common.sh@10 -- # set +x 00:19:11.422 [2024-11-28 01:13:25.740182] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:11.422 01:13:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:11.422 01:13:25 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:19:11.422 01:13:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:11.422 01:13:25 -- common/autotest_common.sh@10 -- # set +x 00:19:11.422 01:13:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:11.422 01:13:25 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:11.422 01:13:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:11.422 01:13:25 -- common/autotest_common.sh@10 -- # set +x 00:19:11.422 [2024-11-28 01:13:25.756375] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:11.422 01:13:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:11.422 01:13:25 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:19:11.423 01:13:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:11.423 01:13:25 -- common/autotest_common.sh@10 -- # set +x 00:19:11.423 01:13:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:11.423 01:13:25 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:19:11.423 01:13:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:11.423 01:13:25 -- common/autotest_common.sh@10 -- # set +x 00:19:11.423 malloc0 00:19:11.423 01:13:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:11.423 01:13:25 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:11.423 01:13:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:11.423 01:13:25 -- common/autotest_common.sh@10 -- # set +x 00:19:11.423 01:13:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:11.423 01:13:25 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:19:11.423 01:13:25 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:19:11.423 01:13:25 -- nvmf/common.sh@520 -- # config=() 00:19:11.423 01:13:25 -- nvmf/common.sh@520 -- # local subsystem config 00:19:11.423 01:13:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:11.423 01:13:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:11.423 { 00:19:11.423 "params": { 00:19:11.423 "name": "Nvme$subsystem", 00:19:11.423 "trtype": "$TEST_TRANSPORT", 00:19:11.423 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:11.423 "adrfam": "ipv4", 00:19:11.423 "trsvcid": "$NVMF_PORT", 00:19:11.423 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:11.423 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:11.423 "hdgst": ${hdgst:-false}, 00:19:11.423 "ddgst": ${ddgst:-false} 00:19:11.423 }, 00:19:11.423 "method": "bdev_nvme_attach_controller" 00:19:11.423 } 00:19:11.423 EOF 00:19:11.423 )") 00:19:11.423 01:13:25 -- nvmf/common.sh@542 -- # cat 00:19:11.423 01:13:25 -- nvmf/common.sh@544 -- # jq . 00:19:11.423 01:13:25 -- nvmf/common.sh@545 -- # IFS=, 00:19:11.423 01:13:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:11.423 "params": { 00:19:11.423 "name": "Nvme1", 00:19:11.423 "trtype": "tcp", 00:19:11.423 "traddr": "10.0.0.2", 00:19:11.423 "adrfam": "ipv4", 00:19:11.423 "trsvcid": "4420", 00:19:11.423 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:11.423 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:11.423 "hdgst": false, 00:19:11.423 "ddgst": false 00:19:11.423 }, 00:19:11.423 "method": "bdev_nvme_attach_controller" 00:19:11.423 }' 00:19:11.423 [2024-11-28 01:13:25.838576] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:11.423 [2024-11-28 01:13:25.838667] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2043996 ] 00:19:11.423 EAL: No free 2048 kB hugepages reported on node 1 00:19:11.423 [2024-11-28 01:13:25.910317] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:11.423 [2024-11-28 01:13:26.003807] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:11.989 Running I/O for 10 seconds... 00:19:21.955 00:19:21.955 Latency(us) 00:19:21.955 [2024-11-28T00:13:36.558Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:21.955 [2024-11-28T00:13:36.558Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:19:21.955 Verification LBA range: start 0x0 length 0x1000 00:19:21.955 Nvme1n1 : 10.01 7768.53 60.69 0.00 0.00 16439.01 1225.77 24272.59 00:19:21.955 [2024-11-28T00:13:36.558Z] =================================================================================================================== 00:19:21.955 [2024-11-28T00:13:36.558Z] Total : 7768.53 60.69 0.00 0.00 16439.01 1225.77 24272.59 00:19:22.214 01:13:36 -- target/zcopy.sh@39 -- # perfpid=2045226 00:19:22.214 01:13:36 -- target/zcopy.sh@41 -- # xtrace_disable 00:19:22.214 01:13:36 -- common/autotest_common.sh@10 -- # set +x 00:19:22.214 01:13:36 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:19:22.214 01:13:36 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:19:22.214 01:13:36 -- nvmf/common.sh@520 -- # config=() 00:19:22.214 01:13:36 -- nvmf/common.sh@520 -- # local subsystem config 00:19:22.214 01:13:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:22.214 01:13:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:22.214 { 00:19:22.214 "params": { 00:19:22.214 "name": "Nvme$subsystem", 00:19:22.214 "trtype": "$TEST_TRANSPORT", 00:19:22.214 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:22.214 "adrfam": "ipv4", 00:19:22.214 "trsvcid": "$NVMF_PORT", 00:19:22.214 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:22.214 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:22.214 "hdgst": ${hdgst:-false}, 00:19:22.214 "ddgst": ${ddgst:-false} 00:19:22.214 }, 00:19:22.214 "method": "bdev_nvme_attach_controller" 00:19:22.214 } 00:19:22.214 EOF 00:19:22.214 )") 00:19:22.214 01:13:36 -- nvmf/common.sh@542 -- # cat 00:19:22.214 [2024-11-28 01:13:36.610149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.610194] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 01:13:36 -- nvmf/common.sh@544 -- # jq . 00:19:22.214 01:13:36 -- nvmf/common.sh@545 -- # IFS=, 00:19:22.214 01:13:36 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:22.214 "params": { 00:19:22.214 "name": "Nvme1", 00:19:22.214 "trtype": "tcp", 00:19:22.214 "traddr": "10.0.0.2", 00:19:22.214 "adrfam": "ipv4", 00:19:22.214 "trsvcid": "4420", 00:19:22.214 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:22.214 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:22.214 "hdgst": false, 00:19:22.214 "ddgst": false 00:19:22.214 }, 00:19:22.214 "method": "bdev_nvme_attach_controller" 00:19:22.214 }' 00:19:22.214 [2024-11-28 01:13:36.618112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.618140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.626134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.626159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.634149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.634171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.642167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.642188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.648056] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:22.214 [2024-11-28 01:13:36.648115] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2045226 ] 00:19:22.214 [2024-11-28 01:13:36.650187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.650207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.658223] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.658256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.666233] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.666255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.674256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.674277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 EAL: No free 2048 kB hugepages reported on node 1 00:19:22.214 [2024-11-28 01:13:36.682294] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.682327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.690319] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.690345] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.698342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.698367] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.706364] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.706389] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.712507] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:22.214 [2024-11-28 01:13:36.714387] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.714411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.722449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.722488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.730445] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.730478] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.738455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.738480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.746478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.746503] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.754501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.754538] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.762537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.762577] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.770595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.770631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.778592] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.778615] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.786612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.786635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.794627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.794648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.802649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.802671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.214 [2024-11-28 01:13:36.805776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:22.214 [2024-11-28 01:13:36.810671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.214 [2024-11-28 01:13:36.810692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.473 [2024-11-28 01:13:36.818697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.473 [2024-11-28 01:13:36.818720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.473 [2024-11-28 01:13:36.826769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.473 [2024-11-28 01:13:36.826832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.473 [2024-11-28 01:13:36.834765] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.473 [2024-11-28 01:13:36.834815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.473 [2024-11-28 01:13:36.842790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.473 [2024-11-28 01:13:36.842841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.473 [2024-11-28 01:13:36.850825] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.473 [2024-11-28 01:13:36.850876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.473 [2024-11-28 01:13:36.858853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.473 [2024-11-28 01:13:36.858894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.473 [2024-11-28 01:13:36.866878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.473 [2024-11-28 01:13:36.866917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.473 [2024-11-28 01:13:36.874862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.473 [2024-11-28 01:13:36.874901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.473 [2024-11-28 01:13:36.882937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.473 [2024-11-28 01:13:36.882977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.473 [2024-11-28 01:13:36.890966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.473 [2024-11-28 01:13:36.891006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.473 [2024-11-28 01:13:36.898944] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.473 [2024-11-28 01:13:36.898972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.473 [2024-11-28 01:13:36.906976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.473 [2024-11-28 01:13:36.906998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.473 [2024-11-28 01:13:36.914984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.473 [2024-11-28 01:13:36.915009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.473 [2024-11-28 01:13:36.923019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.473 [2024-11-28 01:13:36.923049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.473 [2024-11-28 01:13:36.931056] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.473 [2024-11-28 01:13:36.931085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.473 [2024-11-28 01:13:36.939062] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.473 [2024-11-28 01:13:36.939090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.473 [2024-11-28 01:13:36.947082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.473 [2024-11-28 01:13:36.947110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.473 [2024-11-28 01:13:36.955109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.473 [2024-11-28 01:13:36.955137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.474 [2024-11-28 01:13:36.963129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.474 [2024-11-28 01:13:36.963157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.474 [2024-11-28 01:13:36.971149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.474 [2024-11-28 01:13:36.971175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.474 [2024-11-28 01:13:36.979178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.474 [2024-11-28 01:13:36.979216] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.474 [2024-11-28 01:13:36.987196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.474 [2024-11-28 01:13:36.987224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.474 Running I/O for 5 seconds... 00:19:22.474 [2024-11-28 01:13:36.995219] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.474 [2024-11-28 01:13:36.995244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.474 [2024-11-28 01:13:37.009661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.474 [2024-11-28 01:13:37.009694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.474 [2024-11-28 01:13:37.020765] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.474 [2024-11-28 01:13:37.020796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.474 [2024-11-28 01:13:37.032083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.474 [2024-11-28 01:13:37.032115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.474 [2024-11-28 01:13:37.043441] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.474 [2024-11-28 01:13:37.043472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.474 [2024-11-28 01:13:37.054687] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.474 [2024-11-28 01:13:37.054716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.474 [2024-11-28 01:13:37.067786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.474 [2024-11-28 01:13:37.067814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.732 [2024-11-28 01:13:37.077598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.732 [2024-11-28 01:13:37.077626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.732 [2024-11-28 01:13:37.089638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.732 [2024-11-28 01:13:37.089668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.732 [2024-11-28 01:13:37.100781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.732 [2024-11-28 01:13:37.100828] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.732 [2024-11-28 01:13:37.113624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.732 [2024-11-28 01:13:37.113654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.732 [2024-11-28 01:13:37.123762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.732 [2024-11-28 01:13:37.123790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.733 [2024-11-28 01:13:37.134579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.733 [2024-11-28 01:13:37.134608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.733 [2024-11-28 01:13:37.146001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.733 [2024-11-28 01:13:37.146034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.733 [2024-11-28 01:13:37.156730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.733 [2024-11-28 01:13:37.156760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.733 [2024-11-28 01:13:37.167400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.733 [2024-11-28 01:13:37.167431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.733 [2024-11-28 01:13:37.178609] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.733 [2024-11-28 01:13:37.178638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.733 [2024-11-28 01:13:37.191453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.733 [2024-11-28 01:13:37.191484] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.733 [2024-11-28 01:13:37.201555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.733 [2024-11-28 01:13:37.201600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.733 [2024-11-28 01:13:37.212463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.733 [2024-11-28 01:13:37.212494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.733 [2024-11-28 01:13:37.225165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.733 [2024-11-28 01:13:37.225197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.733 [2024-11-28 01:13:37.235123] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.733 [2024-11-28 01:13:37.235153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.733 [2024-11-28 01:13:37.246973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.733 [2024-11-28 01:13:37.247005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.733 [2024-11-28 01:13:37.258075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.733 [2024-11-28 01:13:37.258107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.733 [2024-11-28 01:13:37.269447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.733 [2024-11-28 01:13:37.269478] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.733 [2024-11-28 01:13:37.280326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.733 [2024-11-28 01:13:37.280357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.733 [2024-11-28 01:13:37.292970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.733 [2024-11-28 01:13:37.293002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.733 [2024-11-28 01:13:37.302889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.733 [2024-11-28 01:13:37.302920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.733 [2024-11-28 01:13:37.314236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.733 [2024-11-28 01:13:37.314268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.733 [2024-11-28 01:13:37.325859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.733 [2024-11-28 01:13:37.325890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.337220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.337252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.350255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.350287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.360354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.360385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.370926] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.370958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.381731] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.381759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.394338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.394370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.404154] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.404184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.415121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.415151] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.428008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.428040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.438013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.438045] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.449099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.449130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.461631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.461659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.471293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.471324] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.482277] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.482308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.493356] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.493388] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.506227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.506258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.516674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.516703] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.527676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.527704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.540056] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.540087] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.549805] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.549847] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.560986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.561018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.573827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.573856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:22.992 [2024-11-28 01:13:37.584030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:22.992 [2024-11-28 01:13:37.584061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.251 [2024-11-28 01:13:37.595937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.251 [2024-11-28 01:13:37.595976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.251 [2024-11-28 01:13:37.607780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.251 [2024-11-28 01:13:37.607809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.251 [2024-11-28 01:13:37.619067] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.251 [2024-11-28 01:13:37.619099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.251 [2024-11-28 01:13:37.631930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.251 [2024-11-28 01:13:37.631962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.251 [2024-11-28 01:13:37.642188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.251 [2024-11-28 01:13:37.642219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.251 [2024-11-28 01:13:37.653310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.251 [2024-11-28 01:13:37.653341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.251 [2024-11-28 01:13:37.666302] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.251 [2024-11-28 01:13:37.666332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.251 [2024-11-28 01:13:37.676287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.251 [2024-11-28 01:13:37.676318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.251 [2024-11-28 01:13:37.687671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.251 [2024-11-28 01:13:37.687701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.251 [2024-11-28 01:13:37.698738] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.251 [2024-11-28 01:13:37.698767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.251 [2024-11-28 01:13:37.709938] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.251 [2024-11-28 01:13:37.709969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.251 [2024-11-28 01:13:37.721271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.251 [2024-11-28 01:13:37.721301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.251 [2024-11-28 01:13:37.732213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.251 [2024-11-28 01:13:37.732244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.251 [2024-11-28 01:13:37.743480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.251 [2024-11-28 01:13:37.743510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.251 [2024-11-28 01:13:37.754968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.251 [2024-11-28 01:13:37.754999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.251 [2024-11-28 01:13:37.765637] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.251 [2024-11-28 01:13:37.765665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.251 [2024-11-28 01:13:37.777034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.251 [2024-11-28 01:13:37.777065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.251 [2024-11-28 01:13:37.788270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.251 [2024-11-28 01:13:37.788301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.251 [2024-11-28 01:13:37.799341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.251 [2024-11-28 01:13:37.799372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.251 [2024-11-28 01:13:37.812358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.252 [2024-11-28 01:13:37.812389] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.252 [2024-11-28 01:13:37.823286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.252 [2024-11-28 01:13:37.823324] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.252 [2024-11-28 01:13:37.834378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.252 [2024-11-28 01:13:37.834408] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.252 [2024-11-28 01:13:37.845090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.252 [2024-11-28 01:13:37.845121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.510 [2024-11-28 01:13:37.857142] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.510 [2024-11-28 01:13:37.857174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:37.868375] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:37.868406] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:37.881520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:37.881562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:37.892463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:37.892494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:37.903409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:37.903439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:37.916554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:37.916598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:37.926994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:37.927027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:37.938360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:37.938391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:37.949309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:37.949340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:37.960112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:37.960143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:37.970971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:37.971003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:37.983824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:37.983852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:37.994270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:37.994301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:38.005638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:38.005667] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:38.016779] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:38.016807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:38.027891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:38.027922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:38.039693] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:38.039729] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:38.053149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:38.053180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:38.063439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:38.063470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:38.073978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:38.074009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:38.084984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:38.085015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:38.095728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:38.095755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.511 [2024-11-28 01:13:38.108645] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.511 [2024-11-28 01:13:38.108680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.118841] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.118873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.129933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.129967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.142913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.142944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.152886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.152918] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.163866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.163897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.175400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.175431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.186662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.186690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.197716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.197744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.208783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.208827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.219291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.219322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.230278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.230309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.241355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.241385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.252920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.252958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.264318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.264348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.275478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.275508] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.286469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.286500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.297404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.297435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.310101] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.310133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.319907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.319938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.331625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.331653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.342233] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.342264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.353226] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.353256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:23.770 [2024-11-28 01:13:38.364280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:23.770 [2024-11-28 01:13:38.364310] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.375723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.375752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.386924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.386955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.398278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.398308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.409174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.409205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.420359] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.420390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.432856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.432887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.443354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.443384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.454957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.454988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.466077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.466116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.477028] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.477059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.490202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.490233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.500932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.500964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.511855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.511886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.524358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.524389] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.534255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.534286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.545501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.545541] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.558668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.558696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.568920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.568951] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.579534] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.579579] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.590260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.590291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.601130] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.601162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.612051] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.612083] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.029 [2024-11-28 01:13:38.622738] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.029 [2024-11-28 01:13:38.622766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.633747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.633782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.644536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.644588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.655583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.655612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.668189] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.668221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.677773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.677814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.689290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.689319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.700282] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.700313] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.711553] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.711598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.722663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.722700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.735208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.735239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.745342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.745372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.756722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.756751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.767970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.768001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.779356] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.779387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.790717] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.790745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.801891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.801922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.814991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.815023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.825143] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.825174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.836229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.836260] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.847444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.847474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.858335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.858366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.288 [2024-11-28 01:13:38.871236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.288 [2024-11-28 01:13:38.871267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.289 [2024-11-28 01:13:38.881479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.289 [2024-11-28 01:13:38.881509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.547 [2024-11-28 01:13:38.892533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.547 [2024-11-28 01:13:38.892580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.547 [2024-11-28 01:13:38.905518] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.547 [2024-11-28 01:13:38.905574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.547 [2024-11-28 01:13:38.915325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.547 [2024-11-28 01:13:38.915356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.547 [2024-11-28 01:13:38.926832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.547 [2024-11-28 01:13:38.926863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.547 [2024-11-28 01:13:38.937802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.547 [2024-11-28 01:13:38.937830] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.547 [2024-11-28 01:13:38.949002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.547 [2024-11-28 01:13:38.949033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.547 [2024-11-28 01:13:38.960172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.547 [2024-11-28 01:13:38.960202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.547 [2024-11-28 01:13:38.971026] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.547 [2024-11-28 01:13:38.971058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.547 [2024-11-28 01:13:38.984019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.547 [2024-11-28 01:13:38.984050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.547 [2024-11-28 01:13:38.994160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.547 [2024-11-28 01:13:38.994190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.547 [2024-11-28 01:13:39.005023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.547 [2024-11-28 01:13:39.005053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.548 [2024-11-28 01:13:39.018229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.548 [2024-11-28 01:13:39.018260] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.548 [2024-11-28 01:13:39.028625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.548 [2024-11-28 01:13:39.028653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.548 [2024-11-28 01:13:39.039940] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.548 [2024-11-28 01:13:39.039971] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.548 [2024-11-28 01:13:39.052790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.548 [2024-11-28 01:13:39.052818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.548 [2024-11-28 01:13:39.063476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.548 [2024-11-28 01:13:39.063509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.548 [2024-11-28 01:13:39.075025] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.548 [2024-11-28 01:13:39.075056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.548 [2024-11-28 01:13:39.086092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.548 [2024-11-28 01:13:39.086123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.548 [2024-11-28 01:13:39.097315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.548 [2024-11-28 01:13:39.097346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.548 [2024-11-28 01:13:39.108053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.548 [2024-11-28 01:13:39.108091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.548 [2024-11-28 01:13:39.119231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.548 [2024-11-28 01:13:39.119262] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.548 [2024-11-28 01:13:39.132355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.548 [2024-11-28 01:13:39.132385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.548 [2024-11-28 01:13:39.143128] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.548 [2024-11-28 01:13:39.143159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.806 [2024-11-28 01:13:39.154721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.806 [2024-11-28 01:13:39.154751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.806 [2024-11-28 01:13:39.167799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.806 [2024-11-28 01:13:39.167854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.806 [2024-11-28 01:13:39.178455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.806 [2024-11-28 01:13:39.178487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.806 [2024-11-28 01:13:39.189860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.806 [2024-11-28 01:13:39.189905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.806 [2024-11-28 01:13:39.201488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.806 [2024-11-28 01:13:39.201520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.806 [2024-11-28 01:13:39.213000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.806 [2024-11-28 01:13:39.213031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.806 [2024-11-28 01:13:39.224039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.806 [2024-11-28 01:13:39.224071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.806 [2024-11-28 01:13:39.234985] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.806 [2024-11-28 01:13:39.235016] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.806 [2024-11-28 01:13:39.245924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.806 [2024-11-28 01:13:39.245956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.806 [2024-11-28 01:13:39.257405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.806 [2024-11-28 01:13:39.257437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.806 [2024-11-28 01:13:39.268369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.806 [2024-11-28 01:13:39.268400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.806 [2024-11-28 01:13:39.281459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.806 [2024-11-28 01:13:39.281490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.806 [2024-11-28 01:13:39.291795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.806 [2024-11-28 01:13:39.291823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.806 [2024-11-28 01:13:39.303105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.806 [2024-11-28 01:13:39.303136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.806 [2024-11-28 01:13:39.316243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.806 [2024-11-28 01:13:39.316274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.806 [2024-11-28 01:13:39.326642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.806 [2024-11-28 01:13:39.326670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.806 [2024-11-28 01:13:39.337192] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.806 [2024-11-28 01:13:39.337223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.806 [2024-11-28 01:13:39.348118] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.807 [2024-11-28 01:13:39.348149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.807 [2024-11-28 01:13:39.361101] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.807 [2024-11-28 01:13:39.361133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.807 [2024-11-28 01:13:39.371417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.807 [2024-11-28 01:13:39.371448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.807 [2024-11-28 01:13:39.382403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.807 [2024-11-28 01:13:39.382434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.807 [2024-11-28 01:13:39.393656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.807 [2024-11-28 01:13:39.393685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:24.807 [2024-11-28 01:13:39.404656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:24.807 [2024-11-28 01:13:39.404684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.415944] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.415977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.426897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.426929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.439695] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.439724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.450026] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.450057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.461029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.461060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.473916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.473947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.484430] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.484461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.495839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.495883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.507022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.507054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.519652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.519680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.529788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.529844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.540717] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.540747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.553653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.553681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.564189] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.564219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.575064] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.575095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.586148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.586178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.597394] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.597425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.608265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.608295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.619300] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.619331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.631655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.631684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.640781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.640826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.066 [2024-11-28 01:13:39.654245] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.066 [2024-11-28 01:13:39.654276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.067 [2024-11-28 01:13:39.664538] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.067 [2024-11-28 01:13:39.664582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.326 [2024-11-28 01:13:39.675882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.326 [2024-11-28 01:13:39.675914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.326 [2024-11-28 01:13:39.688423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.326 [2024-11-28 01:13:39.688453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.326 [2024-11-28 01:13:39.698156] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.326 [2024-11-28 01:13:39.698187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.326 [2024-11-28 01:13:39.709241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.326 [2024-11-28 01:13:39.709273] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.326 [2024-11-28 01:13:39.719709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.326 [2024-11-28 01:13:39.719736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.326 [2024-11-28 01:13:39.730390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.326 [2024-11-28 01:13:39.730420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.326 [2024-11-28 01:13:39.741878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.326 [2024-11-28 01:13:39.741918] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.326 [2024-11-28 01:13:39.752437] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.326 [2024-11-28 01:13:39.752468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.326 [2024-11-28 01:13:39.763543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.326 [2024-11-28 01:13:39.763589] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.326 [2024-11-28 01:13:39.774655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.326 [2024-11-28 01:13:39.774683] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.326 [2024-11-28 01:13:39.786005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.326 [2024-11-28 01:13:39.786036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.326 [2024-11-28 01:13:39.799417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.326 [2024-11-28 01:13:39.799448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.326 [2024-11-28 01:13:39.810110] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.326 [2024-11-28 01:13:39.810141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.326 [2024-11-28 01:13:39.821416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.326 [2024-11-28 01:13:39.821447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.327 [2024-11-28 01:13:39.834671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.327 [2024-11-28 01:13:39.834699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.327 [2024-11-28 01:13:39.845432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.327 [2024-11-28 01:13:39.845463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.327 [2024-11-28 01:13:39.856378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.327 [2024-11-28 01:13:39.856409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.327 [2024-11-28 01:13:39.869496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.327 [2024-11-28 01:13:39.869534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.327 [2024-11-28 01:13:39.880285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.327 [2024-11-28 01:13:39.880315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.327 [2024-11-28 01:13:39.891119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.327 [2024-11-28 01:13:39.891150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.327 [2024-11-28 01:13:39.902436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.327 [2024-11-28 01:13:39.902467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.327 [2024-11-28 01:13:39.913735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.327 [2024-11-28 01:13:39.913764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.327 [2024-11-28 01:13:39.925100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.327 [2024-11-28 01:13:39.925132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:39.936319] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:39.936350] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:39.949472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:39.949504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:39.959694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:39.959730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:39.970722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:39.970750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:39.984058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:39.984088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:39.994594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:39.994622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:40.005482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:40.005511] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:40.018389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:40.018422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:40.029040] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:40.029073] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:40.040011] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:40.040043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:40.052936] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:40.052969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:40.062720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:40.062749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:40.074131] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:40.074162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:40.087048] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:40.087079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:40.097117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:40.097148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:40.108438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:40.108470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:40.119380] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:40.119411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:40.132177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:40.132209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:40.142206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:40.142236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:40.153090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:40.153121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:40.165756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:40.165784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:40.175685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:40.175724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.586 [2024-11-28 01:13:40.186688] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.586 [2024-11-28 01:13:40.186718] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.845 [2024-11-28 01:13:40.200053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.845 [2024-11-28 01:13:40.200085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.845 [2024-11-28 01:13:40.210205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.845 [2024-11-28 01:13:40.210236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.845 [2024-11-28 01:13:40.221203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.845 [2024-11-28 01:13:40.221234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.845 [2024-11-28 01:13:40.234016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.845 [2024-11-28 01:13:40.234048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.845 [2024-11-28 01:13:40.244186] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.845 [2024-11-28 01:13:40.244218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.845 [2024-11-28 01:13:40.255307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.845 [2024-11-28 01:13:40.255339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.845 [2024-11-28 01:13:40.267989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.845 [2024-11-28 01:13:40.268021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.845 [2024-11-28 01:13:40.278261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.845 [2024-11-28 01:13:40.278292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.845 [2024-11-28 01:13:40.289602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.845 [2024-11-28 01:13:40.289630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.845 [2024-11-28 01:13:40.300856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.845 [2024-11-28 01:13:40.300886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.845 [2024-11-28 01:13:40.311848] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.845 [2024-11-28 01:13:40.311879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.845 [2024-11-28 01:13:40.325146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.845 [2024-11-28 01:13:40.325178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.845 [2024-11-28 01:13:40.335497] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.845 [2024-11-28 01:13:40.335539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.845 [2024-11-28 01:13:40.346305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.845 [2024-11-28 01:13:40.346336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.845 [2024-11-28 01:13:40.359212] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.845 [2024-11-28 01:13:40.359243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.845 [2024-11-28 01:13:40.368636] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.845 [2024-11-28 01:13:40.368664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.845 [2024-11-28 01:13:40.380310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.845 [2024-11-28 01:13:40.380341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.845 [2024-11-28 01:13:40.390776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.845 [2024-11-28 01:13:40.390828] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.845 [2024-11-28 01:13:40.402053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.846 [2024-11-28 01:13:40.402085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.846 [2024-11-28 01:13:40.414975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.846 [2024-11-28 01:13:40.415006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.846 [2024-11-28 01:13:40.425073] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.846 [2024-11-28 01:13:40.425104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.846 [2024-11-28 01:13:40.435743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:25.846 [2024-11-28 01:13:40.435771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.104 [2024-11-28 01:13:40.448835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.104 [2024-11-28 01:13:40.448867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.104 [2024-11-28 01:13:40.458857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.104 [2024-11-28 01:13:40.458889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.104 [2024-11-28 01:13:40.470472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.104 [2024-11-28 01:13:40.470503] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.104 [2024-11-28 01:13:40.481180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.104 [2024-11-28 01:13:40.481212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.104 [2024-11-28 01:13:40.492513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.104 [2024-11-28 01:13:40.492567] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.104 [2024-11-28 01:13:40.505178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.104 [2024-11-28 01:13:40.505209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.104 [2024-11-28 01:13:40.514912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.104 [2024-11-28 01:13:40.514944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.104 [2024-11-28 01:13:40.525443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.104 [2024-11-28 01:13:40.525475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.104 [2024-11-28 01:13:40.536295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.104 [2024-11-28 01:13:40.536325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.104 [2024-11-28 01:13:40.547153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.104 [2024-11-28 01:13:40.547184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.104 [2024-11-28 01:13:40.559862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.104 [2024-11-28 01:13:40.559893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.104 [2024-11-28 01:13:40.571465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.104 [2024-11-28 01:13:40.571497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.104 [2024-11-28 01:13:40.580190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.104 [2024-11-28 01:13:40.580222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.104 [2024-11-28 01:13:40.593754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.104 [2024-11-28 01:13:40.593783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.104 [2024-11-28 01:13:40.604551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.104 [2024-11-28 01:13:40.604596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.104 [2024-11-28 01:13:40.615626] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.104 [2024-11-28 01:13:40.615654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.105 [2024-11-28 01:13:40.626756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.105 [2024-11-28 01:13:40.626784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.105 [2024-11-28 01:13:40.637696] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.105 [2024-11-28 01:13:40.637725] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.105 [2024-11-28 01:13:40.650888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.105 [2024-11-28 01:13:40.650921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.105 [2024-11-28 01:13:40.661323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.105 [2024-11-28 01:13:40.661355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.105 [2024-11-28 01:13:40.672398] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.105 [2024-11-28 01:13:40.672428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.105 [2024-11-28 01:13:40.683214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.105 [2024-11-28 01:13:40.683244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.105 [2024-11-28 01:13:40.694377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.105 [2024-11-28 01:13:40.694409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.363 [2024-11-28 01:13:40.707547] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.707593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.718170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.718202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.728881] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.728913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.740296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.740328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.751281] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.751312] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.764222] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.764253] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.774046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.774077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.784945] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.784977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.797748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.797777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.807772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.807800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.818817] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.818848] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.832498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.832539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.842349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.842380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.853286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.853316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.866452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.866484] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.876642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.876670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.888383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.888414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.899756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.899784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.912618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.912645] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.923109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.923140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.933932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.933963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.946839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.946871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.364 [2024-11-28 01:13:40.956246] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.364 [2024-11-28 01:13:40.956277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:40.968208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:40.968240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:40.981551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:40.981596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:40.991918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:40.991949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:41.002615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:41.002643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:41.015704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:41.015733] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:41.026124] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:41.026155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:41.037111] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:41.037142] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:41.049949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:41.049980] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:41.059907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:41.059938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:41.070667] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:41.070695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:41.081386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:41.081416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:41.092458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:41.092489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:41.105186] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:41.105217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:41.115044] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:41.115076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:41.125904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:41.125935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:41.136664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:41.136692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:41.147567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:41.147610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:41.160362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:41.160392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:41.169771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:41.169799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:41.181385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:41.181415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:41.194175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:41.194207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:41.204197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:41.204228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.623 [2024-11-28 01:13:41.215017] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.623 [2024-11-28 01:13:41.215047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.228028] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.228061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.237608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.237645] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.248646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.248674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.259425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.259455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.270622] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.270650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.281005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.281035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.291515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.291553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.302354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.302385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.314910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.314942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.324689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.324717] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.336357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.336388] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.347042] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.347073] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.357767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.357795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.370649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.370678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.380684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.380712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.391321] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.391351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.402058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.402089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.413080] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.413111] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.424898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.424929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.433907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.433938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.446148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.446188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.457119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.457149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.468015] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.468047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:26.882 [2024-11-28 01:13:41.479418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:26.882 [2024-11-28 01:13:41.479449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.141 [2024-11-28 01:13:41.490681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.141 [2024-11-28 01:13:41.490709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.141 [2024-11-28 01:13:41.503845] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.141 [2024-11-28 01:13:41.503877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.141 [2024-11-28 01:13:41.513983] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.141 [2024-11-28 01:13:41.514015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.141 [2024-11-28 01:13:41.526338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.141 [2024-11-28 01:13:41.526369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.141 [2024-11-28 01:13:41.537214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.141 [2024-11-28 01:13:41.537245] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.141 [2024-11-28 01:13:41.550592] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.141 [2024-11-28 01:13:41.550623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.141 [2024-11-28 01:13:41.561132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.141 [2024-11-28 01:13:41.561163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.141 [2024-11-28 01:13:41.571840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.141 [2024-11-28 01:13:41.571870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.141 [2024-11-28 01:13:41.582675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.141 [2024-11-28 01:13:41.582704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.141 [2024-11-28 01:13:41.593703] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.141 [2024-11-28 01:13:41.593731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.141 [2024-11-28 01:13:41.606640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.141 [2024-11-28 01:13:41.606669] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.141 [2024-11-28 01:13:41.616748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.141 [2024-11-28 01:13:41.616777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.141 [2024-11-28 01:13:41.627992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.141 [2024-11-28 01:13:41.628024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.141 [2024-11-28 01:13:41.638896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.141 [2024-11-28 01:13:41.638927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.141 [2024-11-28 01:13:41.650097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.141 [2024-11-28 01:13:41.650127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.141 [2024-11-28 01:13:41.663396] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.141 [2024-11-28 01:13:41.663438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.141 [2024-11-28 01:13:41.673762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.142 [2024-11-28 01:13:41.673790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.142 [2024-11-28 01:13:41.684520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.142 [2024-11-28 01:13:41.684574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.142 [2024-11-28 01:13:41.698289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.142 [2024-11-28 01:13:41.698320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.142 [2024-11-28 01:13:41.708424] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.142 [2024-11-28 01:13:41.708454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.142 [2024-11-28 01:13:41.719590] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.142 [2024-11-28 01:13:41.719618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.142 [2024-11-28 01:13:41.732362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.142 [2024-11-28 01:13:41.732394] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.142 [2024-11-28 01:13:41.742511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.142 [2024-11-28 01:13:41.742554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.400 [2024-11-28 01:13:41.754244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.400 [2024-11-28 01:13:41.754277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.400 [2024-11-28 01:13:41.765293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.400 [2024-11-28 01:13:41.765324] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.400 [2024-11-28 01:13:41.776446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.400 [2024-11-28 01:13:41.776476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.400 [2024-11-28 01:13:41.787310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.400 [2024-11-28 01:13:41.787342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.400 [2024-11-28 01:13:41.799499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.400 [2024-11-28 01:13:41.799542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.400 [2024-11-28 01:13:41.808706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.400 [2024-11-28 01:13:41.808735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.400 [2024-11-28 01:13:41.821011] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.400 [2024-11-28 01:13:41.821043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.400 [2024-11-28 01:13:41.834249] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.400 [2024-11-28 01:13:41.834281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.400 [2024-11-28 01:13:41.844489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.400 [2024-11-28 01:13:41.844521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.400 [2024-11-28 01:13:41.855659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.400 [2024-11-28 01:13:41.855687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.400 [2024-11-28 01:13:41.868427] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.400 [2024-11-28 01:13:41.868458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.400 [2024-11-28 01:13:41.878937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.400 [2024-11-28 01:13:41.878977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.401 [2024-11-28 01:13:41.890100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.401 [2024-11-28 01:13:41.890130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.401 [2024-11-28 01:13:41.901190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.401 [2024-11-28 01:13:41.901221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.401 [2024-11-28 01:13:41.912297] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.401 [2024-11-28 01:13:41.912329] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.401 [2024-11-28 01:13:41.925023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.401 [2024-11-28 01:13:41.925054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.401 [2024-11-28 01:13:41.935100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.401 [2024-11-28 01:13:41.935131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.401 [2024-11-28 01:13:41.946795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.401 [2024-11-28 01:13:41.946844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.401 [2024-11-28 01:13:41.957618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.401 [2024-11-28 01:13:41.957647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.401 [2024-11-28 01:13:41.968355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.401 [2024-11-28 01:13:41.968386] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.401 [2024-11-28 01:13:41.979417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.401 [2024-11-28 01:13:41.979448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.401 [2024-11-28 01:13:41.990431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.401 [2024-11-28 01:13:41.990463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.660 [2024-11-28 01:13:42.003730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.660 [2024-11-28 01:13:42.003759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.660 [2024-11-28 01:13:42.011790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.660 [2024-11-28 01:13:42.011837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.660 00:19:27.660 Latency(us) 00:19:27.660 [2024-11-28T00:13:42.263Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:27.660 [2024-11-28T00:13:42.263Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:19:27.660 Nvme1n1 : 5.01 11543.93 90.19 0.00 0.00 11074.16 4903.06 23301.69 00:19:27.660 [2024-11-28T00:13:42.263Z] =================================================================================================================== 00:19:27.660 [2024-11-28T00:13:42.263Z] Total : 11543.93 90.19 0.00 0.00 11074.16 4903.06 23301.69 00:19:27.660 [2024-11-28 01:13:42.018864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.660 [2024-11-28 01:13:42.018894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.660 [2024-11-28 01:13:42.026892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.660 [2024-11-28 01:13:42.026922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.660 [2024-11-28 01:13:42.034942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.660 [2024-11-28 01:13:42.034986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.660 [2024-11-28 01:13:42.042983] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.660 [2024-11-28 01:13:42.043034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.660 [2024-11-28 01:13:42.050996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.660 [2024-11-28 01:13:42.051057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.660 [2024-11-28 01:13:42.059016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.660 [2024-11-28 01:13:42.059079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.660 [2024-11-28 01:13:42.071091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.660 [2024-11-28 01:13:42.071152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.660 [2024-11-28 01:13:42.079072] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.660 [2024-11-28 01:13:42.079121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.660 [2024-11-28 01:13:42.087105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.661 [2024-11-28 01:13:42.087156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.661 [2024-11-28 01:13:42.095129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.661 [2024-11-28 01:13:42.095179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.661 [2024-11-28 01:13:42.103143] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.661 [2024-11-28 01:13:42.103192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.661 [2024-11-28 01:13:42.111171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.661 [2024-11-28 01:13:42.111219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.661 [2024-11-28 01:13:42.119193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.661 [2024-11-28 01:13:42.119241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.661 [2024-11-28 01:13:42.127215] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.661 [2024-11-28 01:13:42.127261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.661 [2024-11-28 01:13:42.135237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.661 [2024-11-28 01:13:42.135283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.661 [2024-11-28 01:13:42.143260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.661 [2024-11-28 01:13:42.143308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.661 [2024-11-28 01:13:42.151237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.661 [2024-11-28 01:13:42.151266] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.661 [2024-11-28 01:13:42.159258] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.661 [2024-11-28 01:13:42.159286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.661 [2024-11-28 01:13:42.167328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.661 [2024-11-28 01:13:42.167376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.661 [2024-11-28 01:13:42.175350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.661 [2024-11-28 01:13:42.175398] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.661 [2024-11-28 01:13:42.183363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.661 [2024-11-28 01:13:42.183411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.661 [2024-11-28 01:13:42.191347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.661 [2024-11-28 01:13:42.191374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.661 [2024-11-28 01:13:42.199382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.661 [2024-11-28 01:13:42.199417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.661 [2024-11-28 01:13:42.207443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.661 [2024-11-28 01:13:42.207494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.661 [2024-11-28 01:13:42.215457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.661 [2024-11-28 01:13:42.215505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.661 [2024-11-28 01:13:42.223433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.661 [2024-11-28 01:13:42.223458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.661 [2024-11-28 01:13:42.231452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.661 [2024-11-28 01:13:42.231477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.661 [2024-11-28 01:13:42.239476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:27.661 [2024-11-28 01:13:42.239501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:27.661 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (2045226) - No such process 00:19:27.661 01:13:42 -- target/zcopy.sh@49 -- # wait 2045226 00:19:27.661 01:13:42 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:19:27.661 01:13:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:27.661 01:13:42 -- common/autotest_common.sh@10 -- # set +x 00:19:27.661 01:13:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:27.661 01:13:42 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:19:27.661 01:13:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:27.661 01:13:42 -- common/autotest_common.sh@10 -- # set +x 00:19:27.661 delay0 00:19:27.661 01:13:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:27.661 01:13:42 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:19:27.661 01:13:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:27.661 01:13:42 -- common/autotest_common.sh@10 -- # set +x 00:19:27.952 01:13:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:27.952 01:13:42 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:19:27.952 EAL: No free 2048 kB hugepages reported on node 1 00:19:27.952 [2024-11-28 01:13:42.361943] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:19:34.537 Initializing NVMe Controllers 00:19:34.537 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:19:34.537 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:34.537 Initialization complete. Launching workers. 00:19:34.537 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 83 00:19:34.537 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 370, failed to submit 33 00:19:34.537 success 211, unsuccess 159, failed 0 00:19:34.537 01:13:48 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:19:34.537 01:13:48 -- target/zcopy.sh@60 -- # nvmftestfini 00:19:34.537 01:13:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:34.537 01:13:48 -- nvmf/common.sh@116 -- # sync 00:19:34.537 01:13:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:34.537 01:13:48 -- nvmf/common.sh@119 -- # set +e 00:19:34.537 01:13:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:34.537 01:13:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:34.537 rmmod nvme_tcp 00:19:34.537 rmmod nvme_fabrics 00:19:34.537 rmmod nvme_keyring 00:19:34.537 01:13:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:34.537 01:13:48 -- nvmf/common.sh@123 -- # set -e 00:19:34.537 01:13:48 -- nvmf/common.sh@124 -- # return 0 00:19:34.537 01:13:48 -- nvmf/common.sh@477 -- # '[' -n 2043838 ']' 00:19:34.537 01:13:48 -- nvmf/common.sh@478 -- # killprocess 2043838 00:19:34.537 01:13:48 -- common/autotest_common.sh@936 -- # '[' -z 2043838 ']' 00:19:34.537 01:13:48 -- common/autotest_common.sh@940 -- # kill -0 2043838 00:19:34.537 01:13:48 -- common/autotest_common.sh@941 -- # uname 00:19:34.537 01:13:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:34.537 01:13:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2043838 00:19:34.537 01:13:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:34.537 01:13:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:34.537 01:13:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2043838' 00:19:34.537 killing process with pid 2043838 00:19:34.537 01:13:48 -- common/autotest_common.sh@955 -- # kill 2043838 00:19:34.537 01:13:48 -- common/autotest_common.sh@960 -- # wait 2043838 00:19:34.537 01:13:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:34.537 01:13:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:34.537 01:13:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:34.537 01:13:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:34.537 01:13:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:34.537 01:13:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:34.537 01:13:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:34.537 01:13:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:36.441 01:13:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:36.441 00:19:36.441 real 0m28.638s 00:19:36.441 user 0m41.874s 00:19:36.441 sys 0m8.264s 00:19:36.441 01:13:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:36.441 01:13:50 -- common/autotest_common.sh@10 -- # set +x 00:19:36.441 ************************************ 00:19:36.441 END TEST nvmf_zcopy 00:19:36.441 ************************************ 00:19:36.441 01:13:50 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:36.441 01:13:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:36.441 01:13:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:36.441 01:13:50 -- common/autotest_common.sh@10 -- # set +x 00:19:36.441 ************************************ 00:19:36.441 START TEST nvmf_nmic 00:19:36.441 ************************************ 00:19:36.441 01:13:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:36.441 * Looking for test storage... 00:19:36.441 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:36.441 01:13:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:36.441 01:13:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:36.441 01:13:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:36.441 01:13:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:36.441 01:13:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:36.441 01:13:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:36.441 01:13:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:36.441 01:13:50 -- scripts/common.sh@335 -- # IFS=.-: 00:19:36.441 01:13:50 -- scripts/common.sh@335 -- # read -ra ver1 00:19:36.441 01:13:50 -- scripts/common.sh@336 -- # IFS=.-: 00:19:36.441 01:13:50 -- scripts/common.sh@336 -- # read -ra ver2 00:19:36.441 01:13:50 -- scripts/common.sh@337 -- # local 'op=<' 00:19:36.441 01:13:50 -- scripts/common.sh@339 -- # ver1_l=2 00:19:36.441 01:13:50 -- scripts/common.sh@340 -- # ver2_l=1 00:19:36.441 01:13:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:36.441 01:13:50 -- scripts/common.sh@343 -- # case "$op" in 00:19:36.441 01:13:50 -- scripts/common.sh@344 -- # : 1 00:19:36.441 01:13:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:36.441 01:13:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:36.441 01:13:50 -- scripts/common.sh@364 -- # decimal 1 00:19:36.441 01:13:50 -- scripts/common.sh@352 -- # local d=1 00:19:36.441 01:13:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:36.441 01:13:50 -- scripts/common.sh@354 -- # echo 1 00:19:36.441 01:13:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:36.441 01:13:50 -- scripts/common.sh@365 -- # decimal 2 00:19:36.441 01:13:50 -- scripts/common.sh@352 -- # local d=2 00:19:36.441 01:13:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:36.441 01:13:50 -- scripts/common.sh@354 -- # echo 2 00:19:36.441 01:13:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:36.441 01:13:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:36.441 01:13:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:36.441 01:13:50 -- scripts/common.sh@367 -- # return 0 00:19:36.441 01:13:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:36.441 01:13:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:36.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:36.441 --rc genhtml_branch_coverage=1 00:19:36.441 --rc genhtml_function_coverage=1 00:19:36.441 --rc genhtml_legend=1 00:19:36.441 --rc geninfo_all_blocks=1 00:19:36.441 --rc geninfo_unexecuted_blocks=1 00:19:36.441 00:19:36.441 ' 00:19:36.441 01:13:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:36.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:36.441 --rc genhtml_branch_coverage=1 00:19:36.441 --rc genhtml_function_coverage=1 00:19:36.441 --rc genhtml_legend=1 00:19:36.441 --rc geninfo_all_blocks=1 00:19:36.441 --rc geninfo_unexecuted_blocks=1 00:19:36.441 00:19:36.441 ' 00:19:36.441 01:13:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:36.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:36.441 --rc genhtml_branch_coverage=1 00:19:36.441 --rc genhtml_function_coverage=1 00:19:36.441 --rc genhtml_legend=1 00:19:36.441 --rc geninfo_all_blocks=1 00:19:36.441 --rc geninfo_unexecuted_blocks=1 00:19:36.441 00:19:36.441 ' 00:19:36.441 01:13:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:36.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:36.441 --rc genhtml_branch_coverage=1 00:19:36.441 --rc genhtml_function_coverage=1 00:19:36.441 --rc genhtml_legend=1 00:19:36.441 --rc geninfo_all_blocks=1 00:19:36.441 --rc geninfo_unexecuted_blocks=1 00:19:36.441 00:19:36.441 ' 00:19:36.441 01:13:50 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:36.441 01:13:50 -- nvmf/common.sh@7 -- # uname -s 00:19:36.441 01:13:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:36.441 01:13:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:36.441 01:13:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:36.441 01:13:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:36.441 01:13:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:36.441 01:13:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:36.441 01:13:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:36.441 01:13:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:36.441 01:13:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:36.441 01:13:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:36.441 01:13:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:36.441 01:13:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:36.441 01:13:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:36.441 01:13:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:36.441 01:13:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:36.441 01:13:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:36.441 01:13:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:36.442 01:13:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:36.442 01:13:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:36.442 01:13:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:36.442 01:13:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:36.442 01:13:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:36.442 01:13:51 -- paths/export.sh@5 -- # export PATH 00:19:36.442 01:13:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:36.442 01:13:51 -- nvmf/common.sh@46 -- # : 0 00:19:36.442 01:13:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:36.442 01:13:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:36.442 01:13:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:36.442 01:13:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:36.442 01:13:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:36.442 01:13:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:36.442 01:13:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:36.442 01:13:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:36.442 01:13:51 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:36.442 01:13:51 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:36.442 01:13:51 -- target/nmic.sh@14 -- # nvmftestinit 00:19:36.442 01:13:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:36.442 01:13:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:36.442 01:13:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:36.442 01:13:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:36.442 01:13:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:36.442 01:13:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:36.442 01:13:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:36.442 01:13:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:36.442 01:13:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:36.442 01:13:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:36.442 01:13:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:36.442 01:13:51 -- common/autotest_common.sh@10 -- # set +x 00:19:38.973 01:13:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:38.974 01:13:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:38.974 01:13:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:38.974 01:13:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:38.974 01:13:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:38.974 01:13:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:38.974 01:13:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:38.974 01:13:53 -- nvmf/common.sh@294 -- # net_devs=() 00:19:38.974 01:13:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:38.974 01:13:53 -- nvmf/common.sh@295 -- # e810=() 00:19:38.974 01:13:53 -- nvmf/common.sh@295 -- # local -ga e810 00:19:38.974 01:13:53 -- nvmf/common.sh@296 -- # x722=() 00:19:38.974 01:13:53 -- nvmf/common.sh@296 -- # local -ga x722 00:19:38.974 01:13:53 -- nvmf/common.sh@297 -- # mlx=() 00:19:38.974 01:13:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:38.974 01:13:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:38.974 01:13:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:38.974 01:13:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:38.974 01:13:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:38.974 01:13:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:38.974 01:13:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:38.974 01:13:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:38.974 01:13:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:38.974 01:13:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:38.974 01:13:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:38.974 01:13:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:38.974 01:13:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:38.974 01:13:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:38.974 01:13:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:38.974 01:13:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:38.974 01:13:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:38.974 01:13:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:38.974 01:13:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:38.974 01:13:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:38.974 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:38.974 01:13:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:38.974 01:13:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:38.974 01:13:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:38.974 01:13:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:38.974 01:13:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:38.974 01:13:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:38.974 01:13:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:38.974 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:38.974 01:13:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:38.974 01:13:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:38.974 01:13:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:38.974 01:13:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:38.974 01:13:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:38.974 01:13:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:38.974 01:13:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:38.974 01:13:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:38.974 01:13:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:38.974 01:13:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:38.974 01:13:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:38.974 01:13:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:38.974 01:13:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:38.974 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:38.974 01:13:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:38.974 01:13:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:38.974 01:13:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:38.974 01:13:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:38.974 01:13:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:38.974 01:13:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:38.974 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:38.974 01:13:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:38.974 01:13:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:38.974 01:13:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:38.974 01:13:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:38.974 01:13:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:38.974 01:13:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:38.974 01:13:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:38.974 01:13:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:38.974 01:13:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:38.974 01:13:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:38.974 01:13:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:38.974 01:13:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:38.974 01:13:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:38.974 01:13:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:38.974 01:13:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:38.974 01:13:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:38.974 01:13:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:38.974 01:13:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:38.974 01:13:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:38.974 01:13:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:38.974 01:13:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:38.974 01:13:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:38.974 01:13:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:38.974 01:13:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:38.974 01:13:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:38.974 01:13:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:38.974 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:38.974 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.309 ms 00:19:38.974 00:19:38.974 --- 10.0.0.2 ping statistics --- 00:19:38.974 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:38.974 rtt min/avg/max/mdev = 0.309/0.309/0.309/0.000 ms 00:19:38.974 01:13:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:38.974 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:38.974 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.158 ms 00:19:38.974 00:19:38.974 --- 10.0.0.1 ping statistics --- 00:19:38.974 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:38.974 rtt min/avg/max/mdev = 0.158/0.158/0.158/0.000 ms 00:19:38.974 01:13:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:38.974 01:13:53 -- nvmf/common.sh@410 -- # return 0 00:19:38.974 01:13:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:38.974 01:13:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:38.974 01:13:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:38.974 01:13:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:38.974 01:13:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:38.974 01:13:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:38.974 01:13:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:38.974 01:13:53 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:19:38.974 01:13:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:38.974 01:13:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:38.974 01:13:53 -- common/autotest_common.sh@10 -- # set +x 00:19:38.974 01:13:53 -- nvmf/common.sh@469 -- # nvmfpid=2048665 00:19:38.974 01:13:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:38.974 01:13:53 -- nvmf/common.sh@470 -- # waitforlisten 2048665 00:19:38.974 01:13:53 -- common/autotest_common.sh@829 -- # '[' -z 2048665 ']' 00:19:38.974 01:13:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:38.974 01:13:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:38.974 01:13:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:38.974 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:38.974 01:13:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:38.974 01:13:53 -- common/autotest_common.sh@10 -- # set +x 00:19:38.974 [2024-11-28 01:13:53.346070] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:38.974 [2024-11-28 01:13:53.346147] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:38.974 EAL: No free 2048 kB hugepages reported on node 1 00:19:38.974 [2024-11-28 01:13:53.413632] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:38.974 [2024-11-28 01:13:53.499412] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:38.974 [2024-11-28 01:13:53.499566] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:38.974 [2024-11-28 01:13:53.499584] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:38.974 [2024-11-28 01:13:53.499597] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:38.974 [2024-11-28 01:13:53.499645] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:38.974 [2024-11-28 01:13:53.499704] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:38.974 [2024-11-28 01:13:53.499770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:38.974 [2024-11-28 01:13:53.499772] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:39.908 01:13:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:39.908 01:13:54 -- common/autotest_common.sh@862 -- # return 0 00:19:39.908 01:13:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:39.908 01:13:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:39.908 01:13:54 -- common/autotest_common.sh@10 -- # set +x 00:19:39.908 01:13:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:39.908 01:13:54 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:39.908 01:13:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:39.908 01:13:54 -- common/autotest_common.sh@10 -- # set +x 00:19:39.908 [2024-11-28 01:13:54.394318] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:39.908 01:13:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:39.908 01:13:54 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:39.908 01:13:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:39.908 01:13:54 -- common/autotest_common.sh@10 -- # set +x 00:19:39.908 Malloc0 00:19:39.908 01:13:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:39.908 01:13:54 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:39.908 01:13:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:39.908 01:13:54 -- common/autotest_common.sh@10 -- # set +x 00:19:39.908 01:13:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:39.908 01:13:54 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:39.908 01:13:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:39.908 01:13:54 -- common/autotest_common.sh@10 -- # set +x 00:19:39.908 01:13:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:39.908 01:13:54 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:39.908 01:13:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:39.908 01:13:54 -- common/autotest_common.sh@10 -- # set +x 00:19:39.908 [2024-11-28 01:13:54.448183] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:39.908 01:13:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:39.908 01:13:54 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:19:39.908 test case1: single bdev can't be used in multiple subsystems 00:19:39.908 01:13:54 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:39.908 01:13:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:39.908 01:13:54 -- common/autotest_common.sh@10 -- # set +x 00:19:39.908 01:13:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:39.908 01:13:54 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:39.908 01:13:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:39.908 01:13:54 -- common/autotest_common.sh@10 -- # set +x 00:19:39.908 01:13:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:39.908 01:13:54 -- target/nmic.sh@28 -- # nmic_status=0 00:19:39.908 01:13:54 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:19:39.908 01:13:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:39.908 01:13:54 -- common/autotest_common.sh@10 -- # set +x 00:19:39.908 [2024-11-28 01:13:54.472026] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:19:39.908 [2024-11-28 01:13:54.472057] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:19:39.908 [2024-11-28 01:13:54.472071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:39.908 request: 00:19:39.908 { 00:19:39.908 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:19:39.908 "namespace": { 00:19:39.908 "bdev_name": "Malloc0" 00:19:39.908 }, 00:19:39.908 "method": "nvmf_subsystem_add_ns", 00:19:39.908 "req_id": 1 00:19:39.908 } 00:19:39.908 Got JSON-RPC error response 00:19:39.908 response: 00:19:39.908 { 00:19:39.908 "code": -32602, 00:19:39.908 "message": "Invalid parameters" 00:19:39.908 } 00:19:39.908 01:13:54 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:19:39.908 01:13:54 -- target/nmic.sh@29 -- # nmic_status=1 00:19:39.908 01:13:54 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:19:39.908 01:13:54 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:19:39.908 Adding namespace failed - expected result. 00:19:39.908 01:13:54 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:19:39.908 test case2: host connect to nvmf target in multiple paths 00:19:39.908 01:13:54 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:19:39.908 01:13:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:39.908 01:13:54 -- common/autotest_common.sh@10 -- # set +x 00:19:39.908 [2024-11-28 01:13:54.480155] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:19:39.908 01:13:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:39.908 01:13:54 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:40.849 01:13:55 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:19:41.108 01:13:55 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:19:41.108 01:13:55 -- common/autotest_common.sh@1187 -- # local i=0 00:19:41.108 01:13:55 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:41.108 01:13:55 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:41.108 01:13:55 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:43.637 01:13:57 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:43.637 01:13:57 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:43.637 01:13:57 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:43.637 01:13:57 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:43.637 01:13:57 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:43.637 01:13:57 -- common/autotest_common.sh@1197 -- # return 0 00:19:43.637 01:13:57 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:43.637 [global] 00:19:43.637 thread=1 00:19:43.637 invalidate=1 00:19:43.637 rw=write 00:19:43.637 time_based=1 00:19:43.637 runtime=1 00:19:43.637 ioengine=libaio 00:19:43.637 direct=1 00:19:43.637 bs=4096 00:19:43.637 iodepth=1 00:19:43.637 norandommap=0 00:19:43.637 numjobs=1 00:19:43.637 00:19:43.637 verify_dump=1 00:19:43.637 verify_backlog=512 00:19:43.637 verify_state_save=0 00:19:43.637 do_verify=1 00:19:43.637 verify=crc32c-intel 00:19:43.637 [job0] 00:19:43.637 filename=/dev/nvme0n1 00:19:43.637 Could not set queue depth (nvme0n1) 00:19:43.637 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:43.637 fio-3.35 00:19:43.637 Starting 1 thread 00:19:44.572 00:19:44.572 job0: (groupid=0, jobs=1): err= 0: pid=2049324: Thu Nov 28 01:13:59 2024 00:19:44.572 read: IOPS=21, BW=87.0KiB/s (89.0kB/s)(88.0KiB/1012msec) 00:19:44.572 slat (nsec): min=7015, max=34434, avg=23151.23, stdev=10566.50 00:19:44.572 clat (usec): min=40882, max=42049, avg=41440.01, stdev=505.35 00:19:44.572 lat (usec): min=40916, max=42063, avg=41463.16, stdev=508.67 00:19:44.572 clat percentiles (usec): 00:19:44.572 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:44.572 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41681], 00:19:44.572 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:44.572 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:44.572 | 99.99th=[42206] 00:19:44.572 write: IOPS=505, BW=2024KiB/s (2072kB/s)(2048KiB/1012msec); 0 zone resets 00:19:44.572 slat (nsec): min=6916, max=37805, avg=8578.13, stdev=2857.24 00:19:44.572 clat (usec): min=161, max=371, avg=183.01, stdev=14.71 00:19:44.572 lat (usec): min=168, max=409, avg=191.59, stdev=15.75 00:19:44.572 clat percentiles (usec): 00:19:44.572 | 1.00th=[ 163], 5.00th=[ 165], 10.00th=[ 167], 20.00th=[ 174], 00:19:44.572 | 30.00th=[ 178], 40.00th=[ 180], 50.00th=[ 184], 60.00th=[ 186], 00:19:44.572 | 70.00th=[ 188], 80.00th=[ 190], 90.00th=[ 198], 95.00th=[ 204], 00:19:44.572 | 99.00th=[ 215], 99.50th=[ 231], 99.90th=[ 371], 99.95th=[ 371], 00:19:44.572 | 99.99th=[ 371] 00:19:44.572 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:19:44.572 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:44.572 lat (usec) : 250=95.51%, 500=0.37% 00:19:44.572 lat (msec) : 50=4.12% 00:19:44.572 cpu : usr=0.40%, sys=0.49%, ctx=534, majf=0, minf=1 00:19:44.572 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:44.572 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:44.572 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:44.572 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:44.572 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:44.572 00:19:44.572 Run status group 0 (all jobs): 00:19:44.572 READ: bw=87.0KiB/s (89.0kB/s), 87.0KiB/s-87.0KiB/s (89.0kB/s-89.0kB/s), io=88.0KiB (90.1kB), run=1012-1012msec 00:19:44.572 WRITE: bw=2024KiB/s (2072kB/s), 2024KiB/s-2024KiB/s (2072kB/s-2072kB/s), io=2048KiB (2097kB), run=1012-1012msec 00:19:44.572 00:19:44.572 Disk stats (read/write): 00:19:44.572 nvme0n1: ios=69/512, merge=0/0, ticks=902/86, in_queue=988, util=95.79% 00:19:44.572 01:13:59 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:44.830 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:19:44.830 01:13:59 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:44.830 01:13:59 -- common/autotest_common.sh@1208 -- # local i=0 00:19:44.830 01:13:59 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:44.830 01:13:59 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:44.830 01:13:59 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:44.830 01:13:59 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:44.830 01:13:59 -- common/autotest_common.sh@1220 -- # return 0 00:19:44.830 01:13:59 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:19:44.830 01:13:59 -- target/nmic.sh@53 -- # nvmftestfini 00:19:44.830 01:13:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:44.830 01:13:59 -- nvmf/common.sh@116 -- # sync 00:19:44.830 01:13:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:44.830 01:13:59 -- nvmf/common.sh@119 -- # set +e 00:19:44.830 01:13:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:44.830 01:13:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:44.830 rmmod nvme_tcp 00:19:44.830 rmmod nvme_fabrics 00:19:44.830 rmmod nvme_keyring 00:19:44.830 01:13:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:44.830 01:13:59 -- nvmf/common.sh@123 -- # set -e 00:19:44.830 01:13:59 -- nvmf/common.sh@124 -- # return 0 00:19:44.830 01:13:59 -- nvmf/common.sh@477 -- # '[' -n 2048665 ']' 00:19:44.830 01:13:59 -- nvmf/common.sh@478 -- # killprocess 2048665 00:19:44.831 01:13:59 -- common/autotest_common.sh@936 -- # '[' -z 2048665 ']' 00:19:44.831 01:13:59 -- common/autotest_common.sh@940 -- # kill -0 2048665 00:19:44.831 01:13:59 -- common/autotest_common.sh@941 -- # uname 00:19:44.831 01:13:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:44.831 01:13:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2048665 00:19:44.831 01:13:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:44.831 01:13:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:44.831 01:13:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2048665' 00:19:44.831 killing process with pid 2048665 00:19:44.831 01:13:59 -- common/autotest_common.sh@955 -- # kill 2048665 00:19:44.831 01:13:59 -- common/autotest_common.sh@960 -- # wait 2048665 00:19:45.090 01:13:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:45.090 01:13:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:45.090 01:13:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:45.090 01:13:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:45.090 01:13:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:45.090 01:13:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:45.090 01:13:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:45.090 01:13:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:47.627 01:14:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:47.627 00:19:47.627 real 0m10.796s 00:19:47.627 user 0m25.569s 00:19:47.627 sys 0m2.470s 00:19:47.627 01:14:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:47.627 01:14:01 -- common/autotest_common.sh@10 -- # set +x 00:19:47.627 ************************************ 00:19:47.627 END TEST nvmf_nmic 00:19:47.627 ************************************ 00:19:47.627 01:14:01 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:47.627 01:14:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:47.627 01:14:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:47.627 01:14:01 -- common/autotest_common.sh@10 -- # set +x 00:19:47.627 ************************************ 00:19:47.627 START TEST nvmf_fio_target 00:19:47.627 ************************************ 00:19:47.627 01:14:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:47.627 * Looking for test storage... 00:19:47.627 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:47.627 01:14:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:47.627 01:14:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:47.627 01:14:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:47.627 01:14:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:47.627 01:14:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:47.627 01:14:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:47.627 01:14:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:47.627 01:14:01 -- scripts/common.sh@335 -- # IFS=.-: 00:19:47.627 01:14:01 -- scripts/common.sh@335 -- # read -ra ver1 00:19:47.627 01:14:01 -- scripts/common.sh@336 -- # IFS=.-: 00:19:47.627 01:14:01 -- scripts/common.sh@336 -- # read -ra ver2 00:19:47.627 01:14:01 -- scripts/common.sh@337 -- # local 'op=<' 00:19:47.627 01:14:01 -- scripts/common.sh@339 -- # ver1_l=2 00:19:47.627 01:14:01 -- scripts/common.sh@340 -- # ver2_l=1 00:19:47.627 01:14:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:47.627 01:14:01 -- scripts/common.sh@343 -- # case "$op" in 00:19:47.627 01:14:01 -- scripts/common.sh@344 -- # : 1 00:19:47.627 01:14:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:47.627 01:14:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:47.627 01:14:01 -- scripts/common.sh@364 -- # decimal 1 00:19:47.627 01:14:01 -- scripts/common.sh@352 -- # local d=1 00:19:47.627 01:14:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:47.627 01:14:01 -- scripts/common.sh@354 -- # echo 1 00:19:47.627 01:14:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:47.627 01:14:01 -- scripts/common.sh@365 -- # decimal 2 00:19:47.627 01:14:01 -- scripts/common.sh@352 -- # local d=2 00:19:47.627 01:14:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:47.627 01:14:01 -- scripts/common.sh@354 -- # echo 2 00:19:47.627 01:14:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:47.627 01:14:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:47.627 01:14:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:47.627 01:14:01 -- scripts/common.sh@367 -- # return 0 00:19:47.627 01:14:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:47.627 01:14:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:47.627 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:47.627 --rc genhtml_branch_coverage=1 00:19:47.627 --rc genhtml_function_coverage=1 00:19:47.627 --rc genhtml_legend=1 00:19:47.627 --rc geninfo_all_blocks=1 00:19:47.627 --rc geninfo_unexecuted_blocks=1 00:19:47.627 00:19:47.627 ' 00:19:47.627 01:14:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:47.627 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:47.627 --rc genhtml_branch_coverage=1 00:19:47.627 --rc genhtml_function_coverage=1 00:19:47.627 --rc genhtml_legend=1 00:19:47.627 --rc geninfo_all_blocks=1 00:19:47.627 --rc geninfo_unexecuted_blocks=1 00:19:47.627 00:19:47.627 ' 00:19:47.627 01:14:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:47.627 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:47.627 --rc genhtml_branch_coverage=1 00:19:47.627 --rc genhtml_function_coverage=1 00:19:47.627 --rc genhtml_legend=1 00:19:47.627 --rc geninfo_all_blocks=1 00:19:47.627 --rc geninfo_unexecuted_blocks=1 00:19:47.627 00:19:47.627 ' 00:19:47.627 01:14:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:47.627 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:47.627 --rc genhtml_branch_coverage=1 00:19:47.627 --rc genhtml_function_coverage=1 00:19:47.627 --rc genhtml_legend=1 00:19:47.627 --rc geninfo_all_blocks=1 00:19:47.627 --rc geninfo_unexecuted_blocks=1 00:19:47.627 00:19:47.627 ' 00:19:47.627 01:14:01 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:47.627 01:14:01 -- nvmf/common.sh@7 -- # uname -s 00:19:47.627 01:14:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:47.627 01:14:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:47.627 01:14:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:47.627 01:14:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:47.627 01:14:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:47.627 01:14:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:47.627 01:14:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:47.627 01:14:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:47.627 01:14:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:47.627 01:14:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:47.627 01:14:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:47.627 01:14:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:47.627 01:14:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:47.627 01:14:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:47.627 01:14:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:47.627 01:14:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:47.627 01:14:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:47.627 01:14:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:47.627 01:14:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:47.627 01:14:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:47.627 01:14:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:47.627 01:14:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:47.627 01:14:01 -- paths/export.sh@5 -- # export PATH 00:19:47.627 01:14:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:47.627 01:14:01 -- nvmf/common.sh@46 -- # : 0 00:19:47.627 01:14:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:47.627 01:14:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:47.627 01:14:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:47.627 01:14:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:47.627 01:14:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:47.627 01:14:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:47.627 01:14:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:47.628 01:14:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:47.628 01:14:01 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:47.628 01:14:01 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:47.628 01:14:01 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:47.628 01:14:01 -- target/fio.sh@16 -- # nvmftestinit 00:19:47.628 01:14:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:47.628 01:14:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:47.628 01:14:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:47.628 01:14:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:47.628 01:14:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:47.628 01:14:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:47.628 01:14:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:47.628 01:14:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:47.628 01:14:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:47.628 01:14:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:47.628 01:14:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:47.628 01:14:01 -- common/autotest_common.sh@10 -- # set +x 00:19:49.530 01:14:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:49.530 01:14:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:49.530 01:14:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:49.530 01:14:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:49.530 01:14:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:49.530 01:14:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:49.530 01:14:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:49.530 01:14:03 -- nvmf/common.sh@294 -- # net_devs=() 00:19:49.530 01:14:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:49.530 01:14:03 -- nvmf/common.sh@295 -- # e810=() 00:19:49.530 01:14:03 -- nvmf/common.sh@295 -- # local -ga e810 00:19:49.530 01:14:03 -- nvmf/common.sh@296 -- # x722=() 00:19:49.530 01:14:03 -- nvmf/common.sh@296 -- # local -ga x722 00:19:49.530 01:14:03 -- nvmf/common.sh@297 -- # mlx=() 00:19:49.530 01:14:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:49.530 01:14:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:49.530 01:14:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:49.530 01:14:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:49.530 01:14:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:49.530 01:14:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:49.530 01:14:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:49.530 01:14:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:49.530 01:14:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:49.530 01:14:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:49.530 01:14:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:49.530 01:14:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:49.530 01:14:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:49.530 01:14:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:49.530 01:14:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:49.530 01:14:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:49.530 01:14:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:49.530 01:14:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:49.530 01:14:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:49.531 01:14:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:49.531 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:49.531 01:14:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:49.531 01:14:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:49.531 01:14:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:49.531 01:14:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:49.531 01:14:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:49.531 01:14:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:49.531 01:14:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:49.531 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:49.531 01:14:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:49.531 01:14:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:49.531 01:14:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:49.531 01:14:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:49.531 01:14:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:49.531 01:14:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:49.531 01:14:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:49.531 01:14:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:49.531 01:14:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:49.531 01:14:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:49.531 01:14:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:49.531 01:14:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:49.531 01:14:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:49.531 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:49.531 01:14:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:49.531 01:14:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:49.531 01:14:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:49.531 01:14:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:49.531 01:14:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:49.531 01:14:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:49.531 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:49.531 01:14:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:49.531 01:14:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:49.531 01:14:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:49.531 01:14:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:49.531 01:14:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:49.531 01:14:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:49.531 01:14:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:49.531 01:14:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:49.531 01:14:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:49.531 01:14:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:49.531 01:14:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:49.531 01:14:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:49.531 01:14:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:49.531 01:14:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:49.531 01:14:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:49.531 01:14:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:49.531 01:14:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:49.531 01:14:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:49.531 01:14:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:49.531 01:14:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:49.531 01:14:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:49.531 01:14:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:49.531 01:14:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:49.531 01:14:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:49.531 01:14:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:49.531 01:14:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:49.531 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:49.531 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.245 ms 00:19:49.531 00:19:49.531 --- 10.0.0.2 ping statistics --- 00:19:49.531 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:49.531 rtt min/avg/max/mdev = 0.245/0.245/0.245/0.000 ms 00:19:49.531 01:14:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:49.531 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:49.531 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.130 ms 00:19:49.531 00:19:49.531 --- 10.0.0.1 ping statistics --- 00:19:49.531 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:49.531 rtt min/avg/max/mdev = 0.130/0.130/0.130/0.000 ms 00:19:49.531 01:14:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:49.531 01:14:04 -- nvmf/common.sh@410 -- # return 0 00:19:49.531 01:14:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:49.531 01:14:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:49.531 01:14:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:49.531 01:14:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:49.531 01:14:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:49.531 01:14:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:49.531 01:14:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:49.531 01:14:04 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:19:49.531 01:14:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:49.531 01:14:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:49.531 01:14:04 -- common/autotest_common.sh@10 -- # set +x 00:19:49.531 01:14:04 -- nvmf/common.sh@469 -- # nvmfpid=2051479 00:19:49.531 01:14:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:49.531 01:14:04 -- nvmf/common.sh@470 -- # waitforlisten 2051479 00:19:49.531 01:14:04 -- common/autotest_common.sh@829 -- # '[' -z 2051479 ']' 00:19:49.531 01:14:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:49.531 01:14:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:49.531 01:14:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:49.531 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:49.531 01:14:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:49.531 01:14:04 -- common/autotest_common.sh@10 -- # set +x 00:19:49.790 [2024-11-28 01:14:04.149419] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:49.790 [2024-11-28 01:14:04.149491] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:49.790 EAL: No free 2048 kB hugepages reported on node 1 00:19:49.790 [2024-11-28 01:14:04.235699] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:49.790 [2024-11-28 01:14:04.336703] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:49.790 [2024-11-28 01:14:04.336885] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:49.790 [2024-11-28 01:14:04.336918] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:49.790 [2024-11-28 01:14:04.336943] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:49.790 [2024-11-28 01:14:04.337004] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:49.790 [2024-11-28 01:14:04.337062] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:49.790 [2024-11-28 01:14:04.337129] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:49.790 [2024-11-28 01:14:04.337136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:50.048 01:14:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:50.048 01:14:04 -- common/autotest_common.sh@862 -- # return 0 00:19:50.048 01:14:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:50.048 01:14:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:50.048 01:14:04 -- common/autotest_common.sh@10 -- # set +x 00:19:50.048 01:14:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:50.048 01:14:04 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:19:50.307 [2024-11-28 01:14:04.743748] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:50.307 01:14:04 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:50.565 01:14:05 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:19:50.565 01:14:05 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:50.823 01:14:05 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:19:50.823 01:14:05 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:51.080 01:14:05 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:19:51.080 01:14:05 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:51.338 01:14:05 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:19:51.338 01:14:05 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:19:51.596 01:14:06 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:51.854 01:14:06 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:19:51.854 01:14:06 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:52.113 01:14:06 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:19:52.113 01:14:06 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:52.371 01:14:06 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:19:52.371 01:14:06 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:19:52.629 01:14:07 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:52.887 01:14:07 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:52.887 01:14:07 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:53.146 01:14:07 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:53.146 01:14:07 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:53.404 01:14:07 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:53.662 [2024-11-28 01:14:08.130931] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:53.662 01:14:08 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:19:53.919 01:14:08 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:19:54.177 01:14:08 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:55.110 01:14:09 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:19:55.110 01:14:09 -- common/autotest_common.sh@1187 -- # local i=0 00:19:55.110 01:14:09 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:55.110 01:14:09 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:19:55.110 01:14:09 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:19:55.110 01:14:09 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:57.009 01:14:11 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:57.009 01:14:11 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:57.009 01:14:11 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:57.009 01:14:11 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:19:57.009 01:14:11 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:57.009 01:14:11 -- common/autotest_common.sh@1197 -- # return 0 00:19:57.009 01:14:11 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:57.009 [global] 00:19:57.009 thread=1 00:19:57.009 invalidate=1 00:19:57.009 rw=write 00:19:57.009 time_based=1 00:19:57.009 runtime=1 00:19:57.009 ioengine=libaio 00:19:57.009 direct=1 00:19:57.009 bs=4096 00:19:57.009 iodepth=1 00:19:57.009 norandommap=0 00:19:57.009 numjobs=1 00:19:57.009 00:19:57.009 verify_dump=1 00:19:57.009 verify_backlog=512 00:19:57.009 verify_state_save=0 00:19:57.009 do_verify=1 00:19:57.010 verify=crc32c-intel 00:19:57.010 [job0] 00:19:57.010 filename=/dev/nvme0n1 00:19:57.010 [job1] 00:19:57.010 filename=/dev/nvme0n2 00:19:57.010 [job2] 00:19:57.010 filename=/dev/nvme0n3 00:19:57.010 [job3] 00:19:57.010 filename=/dev/nvme0n4 00:19:57.010 Could not set queue depth (nvme0n1) 00:19:57.010 Could not set queue depth (nvme0n2) 00:19:57.010 Could not set queue depth (nvme0n3) 00:19:57.010 Could not set queue depth (nvme0n4) 00:19:57.266 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:57.266 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:57.266 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:57.266 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:57.266 fio-3.35 00:19:57.266 Starting 4 threads 00:19:58.638 00:19:58.638 job0: (groupid=0, jobs=1): err= 0: pid=2052520: Thu Nov 28 01:14:12 2024 00:19:58.638 read: IOPS=21, BW=87.0KiB/s (89.0kB/s)(88.0KiB/1012msec) 00:19:58.638 slat (nsec): min=8841, max=35113, avg=23149.86, stdev=9201.99 00:19:58.638 clat (usec): min=40750, max=41058, avg=40962.42, stdev=57.59 00:19:58.638 lat (usec): min=40759, max=41071, avg=40985.57, stdev=59.01 00:19:58.638 clat percentiles (usec): 00:19:58.638 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:58.638 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:58.638 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:58.638 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:58.638 | 99.99th=[41157] 00:19:58.638 write: IOPS=505, BW=2024KiB/s (2072kB/s)(2048KiB/1012msec); 0 zone resets 00:19:58.638 slat (nsec): min=7503, max=45276, avg=12038.70, stdev=5470.50 00:19:58.638 clat (usec): min=157, max=361, avg=199.52, stdev=23.48 00:19:58.638 lat (usec): min=165, max=380, avg=211.56, stdev=25.23 00:19:58.638 clat percentiles (usec): 00:19:58.638 | 1.00th=[ 159], 5.00th=[ 167], 10.00th=[ 174], 20.00th=[ 182], 00:19:58.638 | 30.00th=[ 188], 40.00th=[ 192], 50.00th=[ 196], 60.00th=[ 202], 00:19:58.638 | 70.00th=[ 208], 80.00th=[ 215], 90.00th=[ 231], 95.00th=[ 237], 00:19:58.638 | 99.00th=[ 281], 99.50th=[ 310], 99.90th=[ 363], 99.95th=[ 363], 00:19:58.638 | 99.99th=[ 363] 00:19:58.638 bw ( KiB/s): min= 4096, max= 4096, per=28.10%, avg=4096.00, stdev= 0.00, samples=1 00:19:58.638 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:58.638 lat (usec) : 250=93.63%, 500=2.25% 00:19:58.639 lat (msec) : 50=4.12% 00:19:58.639 cpu : usr=0.20%, sys=1.09%, ctx=534, majf=0, minf=1 00:19:58.639 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:58.639 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:58.639 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:58.639 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:58.639 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:58.639 job1: (groupid=0, jobs=1): err= 0: pid=2052521: Thu Nov 28 01:14:12 2024 00:19:58.639 read: IOPS=21, BW=86.6KiB/s (88.7kB/s)(88.0KiB/1016msec) 00:19:58.639 slat (nsec): min=10601, max=34140, avg=21342.14, stdev=10439.01 00:19:58.639 clat (usec): min=18870, max=41029, avg=39969.73, stdev=4712.66 00:19:58.639 lat (usec): min=18903, max=41040, avg=39991.08, stdev=4709.97 00:19:58.639 clat percentiles (usec): 00:19:58.639 | 1.00th=[18744], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:58.639 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:58.639 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:58.639 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:58.639 | 99.99th=[41157] 00:19:58.639 write: IOPS=503, BW=2016KiB/s (2064kB/s)(2048KiB/1016msec); 0 zone resets 00:19:58.639 slat (nsec): min=6729, max=45393, avg=14467.99, stdev=5955.02 00:19:58.639 clat (usec): min=160, max=1270, avg=247.33, stdev=55.52 00:19:58.639 lat (usec): min=168, max=1281, avg=261.80, stdev=55.92 00:19:58.639 clat percentiles (usec): 00:19:58.639 | 1.00th=[ 176], 5.00th=[ 192], 10.00th=[ 210], 20.00th=[ 229], 00:19:58.639 | 30.00th=[ 235], 40.00th=[ 239], 50.00th=[ 241], 60.00th=[ 245], 00:19:58.639 | 70.00th=[ 255], 80.00th=[ 265], 90.00th=[ 281], 95.00th=[ 306], 00:19:58.639 | 99.00th=[ 363], 99.50th=[ 392], 99.90th=[ 1270], 99.95th=[ 1270], 00:19:58.639 | 99.99th=[ 1270] 00:19:58.639 bw ( KiB/s): min= 4096, max= 4096, per=28.10%, avg=4096.00, stdev= 0.00, samples=1 00:19:58.639 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:58.639 lat (usec) : 250=64.79%, 500=30.90% 00:19:58.639 lat (msec) : 2=0.19%, 20=0.19%, 50=3.93% 00:19:58.639 cpu : usr=0.20%, sys=0.89%, ctx=534, majf=0, minf=1 00:19:58.639 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:58.639 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:58.639 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:58.639 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:58.639 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:58.639 job2: (groupid=0, jobs=1): err= 0: pid=2052522: Thu Nov 28 01:14:12 2024 00:19:58.639 read: IOPS=150, BW=601KiB/s (615kB/s)(608KiB/1012msec) 00:19:58.639 slat (nsec): min=4922, max=36777, avg=9467.37, stdev=7572.88 00:19:58.639 clat (usec): min=206, max=41046, avg=5887.07, stdev=14078.25 00:19:58.639 lat (usec): min=211, max=41061, avg=5896.54, stdev=14083.53 00:19:58.639 clat percentiles (usec): 00:19:58.639 | 1.00th=[ 210], 5.00th=[ 215], 10.00th=[ 225], 20.00th=[ 239], 00:19:58.639 | 30.00th=[ 245], 40.00th=[ 249], 50.00th=[ 255], 60.00th=[ 273], 00:19:58.639 | 70.00th=[ 306], 80.00th=[ 371], 90.00th=[41157], 95.00th=[41157], 00:19:58.639 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:58.639 | 99.99th=[41157] 00:19:58.639 write: IOPS=505, BW=2024KiB/s (2072kB/s)(2048KiB/1012msec); 0 zone resets 00:19:58.639 slat (nsec): min=6577, max=42431, avg=11725.02, stdev=6436.38 00:19:58.639 clat (usec): min=156, max=429, avg=210.22, stdev=44.39 00:19:58.639 lat (usec): min=164, max=460, avg=221.94, stdev=46.59 00:19:58.639 clat percentiles (usec): 00:19:58.639 | 1.00th=[ 159], 5.00th=[ 165], 10.00th=[ 172], 20.00th=[ 178], 00:19:58.639 | 30.00th=[ 184], 40.00th=[ 190], 50.00th=[ 196], 60.00th=[ 204], 00:19:58.639 | 70.00th=[ 223], 80.00th=[ 239], 90.00th=[ 269], 95.00th=[ 293], 00:19:58.639 | 99.00th=[ 367], 99.50th=[ 388], 99.90th=[ 429], 99.95th=[ 429], 00:19:58.639 | 99.99th=[ 429] 00:19:58.639 bw ( KiB/s): min= 4096, max= 4096, per=28.10%, avg=4096.00, stdev= 0.00, samples=1 00:19:58.639 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:58.639 lat (usec) : 250=75.90%, 500=20.93% 00:19:58.639 lat (msec) : 50=3.16% 00:19:58.639 cpu : usr=0.49%, sys=0.59%, ctx=665, majf=0, minf=1 00:19:58.639 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:58.639 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:58.639 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:58.639 issued rwts: total=152,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:58.639 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:58.639 job3: (groupid=0, jobs=1): err= 0: pid=2052523: Thu Nov 28 01:14:12 2024 00:19:58.639 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:19:58.639 slat (nsec): min=4272, max=54811, avg=11608.06, stdev=7062.49 00:19:58.639 clat (usec): min=192, max=4748, avg=254.15, stdev=117.14 00:19:58.639 lat (usec): min=197, max=4758, avg=265.76, stdev=117.82 00:19:58.639 clat percentiles (usec): 00:19:58.639 | 1.00th=[ 196], 5.00th=[ 202], 10.00th=[ 206], 20.00th=[ 212], 00:19:58.639 | 30.00th=[ 217], 40.00th=[ 221], 50.00th=[ 225], 60.00th=[ 237], 00:19:58.639 | 70.00th=[ 265], 80.00th=[ 285], 90.00th=[ 334], 95.00th=[ 379], 00:19:58.639 | 99.00th=[ 498], 99.50th=[ 529], 99.90th=[ 586], 99.95th=[ 627], 00:19:58.639 | 99.99th=[ 4752] 00:19:58.639 write: IOPS=2164, BW=8659KiB/s (8867kB/s)(8668KiB/1001msec); 0 zone resets 00:19:58.639 slat (nsec): min=5871, max=62483, avg=12338.52, stdev=8135.33 00:19:58.639 clat (usec): min=136, max=695, avg=191.71, stdev=56.16 00:19:58.639 lat (usec): min=143, max=702, avg=204.05, stdev=59.39 00:19:58.639 clat percentiles (usec): 00:19:58.639 | 1.00th=[ 141], 5.00th=[ 143], 10.00th=[ 147], 20.00th=[ 149], 00:19:58.639 | 30.00th=[ 153], 40.00th=[ 159], 50.00th=[ 165], 60.00th=[ 182], 00:19:58.639 | 70.00th=[ 212], 80.00th=[ 241], 90.00th=[ 262], 95.00th=[ 306], 00:19:58.639 | 99.00th=[ 359], 99.50th=[ 388], 99.90th=[ 545], 99.95th=[ 627], 00:19:58.639 | 99.99th=[ 693] 00:19:58.639 bw ( KiB/s): min= 8192, max= 8192, per=56.19%, avg=8192.00, stdev= 0.00, samples=1 00:19:58.639 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:58.639 lat (usec) : 250=77.30%, 500=22.14%, 750=0.55% 00:19:58.639 lat (msec) : 10=0.02% 00:19:58.639 cpu : usr=3.10%, sys=4.80%, ctx=4217, majf=0, minf=1 00:19:58.639 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:58.639 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:58.639 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:58.639 issued rwts: total=2048,2167,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:58.639 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:58.639 00:19:58.639 Run status group 0 (all jobs): 00:19:58.639 READ: bw=8835KiB/s (9047kB/s), 86.6KiB/s-8184KiB/s (88.7kB/s-8380kB/s), io=8976KiB (9191kB), run=1001-1016msec 00:19:58.639 WRITE: bw=14.2MiB/s (14.9MB/s), 2016KiB/s-8659KiB/s (2064kB/s-8867kB/s), io=14.5MiB (15.2MB), run=1001-1016msec 00:19:58.639 00:19:58.639 Disk stats (read/write): 00:19:58.639 nvme0n1: ios=68/512, merge=0/0, ticks=767/101, in_queue=868, util=86.67% 00:19:58.639 nvme0n2: ios=22/512, merge=0/0, ticks=697/127, in_queue=824, util=86.65% 00:19:58.639 nvme0n3: ios=177/512, merge=0/0, ticks=1195/108, in_queue=1303, util=98.64% 00:19:58.639 nvme0n4: ios=1615/2048, merge=0/0, ticks=1344/377, in_queue=1721, util=98.21% 00:19:58.639 01:14:12 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:58.639 [global] 00:19:58.639 thread=1 00:19:58.639 invalidate=1 00:19:58.639 rw=randwrite 00:19:58.639 time_based=1 00:19:58.639 runtime=1 00:19:58.639 ioengine=libaio 00:19:58.639 direct=1 00:19:58.639 bs=4096 00:19:58.639 iodepth=1 00:19:58.639 norandommap=0 00:19:58.639 numjobs=1 00:19:58.639 00:19:58.639 verify_dump=1 00:19:58.639 verify_backlog=512 00:19:58.639 verify_state_save=0 00:19:58.639 do_verify=1 00:19:58.639 verify=crc32c-intel 00:19:58.639 [job0] 00:19:58.639 filename=/dev/nvme0n1 00:19:58.639 [job1] 00:19:58.639 filename=/dev/nvme0n2 00:19:58.639 [job2] 00:19:58.639 filename=/dev/nvme0n3 00:19:58.639 [job3] 00:19:58.639 filename=/dev/nvme0n4 00:19:58.639 Could not set queue depth (nvme0n1) 00:19:58.639 Could not set queue depth (nvme0n2) 00:19:58.639 Could not set queue depth (nvme0n3) 00:19:58.639 Could not set queue depth (nvme0n4) 00:19:58.639 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:58.639 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:58.639 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:58.639 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:58.639 fio-3.35 00:19:58.639 Starting 4 threads 00:20:00.015 00:20:00.015 job0: (groupid=0, jobs=1): err= 0: pid=2052821: Thu Nov 28 01:14:14 2024 00:20:00.015 read: IOPS=21, BW=84.5KiB/s (86.6kB/s)(88.0KiB/1041msec) 00:20:00.015 slat (nsec): min=7768, max=38176, avg=18271.82, stdev=8629.77 00:20:00.015 clat (usec): min=40863, max=41287, avg=40993.13, stdev=75.09 00:20:00.015 lat (usec): min=40901, max=41294, avg=41011.40, stdev=70.94 00:20:00.015 clat percentiles (usec): 00:20:00.015 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:20:00.015 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:20:00.015 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:20:00.015 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:20:00.015 | 99.99th=[41157] 00:20:00.015 write: IOPS=491, BW=1967KiB/s (2015kB/s)(2048KiB/1041msec); 0 zone resets 00:20:00.015 slat (nsec): min=7901, max=55602, avg=18224.23, stdev=8075.44 00:20:00.015 clat (usec): min=186, max=446, avg=247.34, stdev=23.78 00:20:00.015 lat (usec): min=194, max=459, avg=265.56, stdev=27.07 00:20:00.015 clat percentiles (usec): 00:20:00.015 | 1.00th=[ 196], 5.00th=[ 208], 10.00th=[ 217], 20.00th=[ 229], 00:20:00.015 | 30.00th=[ 237], 40.00th=[ 243], 50.00th=[ 249], 60.00th=[ 253], 00:20:00.015 | 70.00th=[ 260], 80.00th=[ 265], 90.00th=[ 273], 95.00th=[ 281], 00:20:00.015 | 99.00th=[ 306], 99.50th=[ 330], 99.90th=[ 449], 99.95th=[ 449], 00:20:00.015 | 99.99th=[ 449] 00:20:00.015 bw ( KiB/s): min= 4096, max= 4096, per=16.02%, avg=4096.00, stdev= 0.00, samples=1 00:20:00.015 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:20:00.015 lat (usec) : 250=51.69%, 500=44.19% 00:20:00.015 lat (msec) : 50=4.12% 00:20:00.015 cpu : usr=0.38%, sys=1.35%, ctx=535, majf=0, minf=1 00:20:00.015 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:00.015 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:00.015 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:00.015 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:00.015 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:00.015 job1: (groupid=0, jobs=1): err= 0: pid=2052838: Thu Nov 28 01:14:14 2024 00:20:00.015 read: IOPS=1501, BW=6006KiB/s (6150kB/s)(6156KiB/1025msec) 00:20:00.015 slat (nsec): min=5870, max=40245, avg=9042.30, stdev=4207.36 00:20:00.015 clat (usec): min=251, max=41010, avg=367.02, stdev=1789.04 00:20:00.015 lat (usec): min=258, max=41025, avg=376.06, stdev=1789.24 00:20:00.015 clat percentiles (usec): 00:20:00.015 | 1.00th=[ 260], 5.00th=[ 265], 10.00th=[ 269], 20.00th=[ 273], 00:20:00.015 | 30.00th=[ 277], 40.00th=[ 281], 50.00th=[ 285], 60.00th=[ 289], 00:20:00.015 | 70.00th=[ 293], 80.00th=[ 297], 90.00th=[ 306], 95.00th=[ 322], 00:20:00.015 | 99.00th=[ 392], 99.50th=[ 441], 99.90th=[41157], 99.95th=[41157], 00:20:00.015 | 99.99th=[41157] 00:20:00.015 write: IOPS=1998, BW=7992KiB/s (8184kB/s)(8192KiB/1025msec); 0 zone resets 00:20:00.015 slat (nsec): min=7440, max=52375, avg=13055.49, stdev=6795.10 00:20:00.015 clat (usec): min=142, max=348, avg=199.00, stdev=19.30 00:20:00.015 lat (usec): min=150, max=389, avg=212.05, stdev=20.89 00:20:00.015 clat percentiles (usec): 00:20:00.015 | 1.00th=[ 151], 5.00th=[ 159], 10.00th=[ 176], 20.00th=[ 190], 00:20:00.015 | 30.00th=[ 194], 40.00th=[ 196], 50.00th=[ 200], 60.00th=[ 202], 00:20:00.015 | 70.00th=[ 206], 80.00th=[ 212], 90.00th=[ 221], 95.00th=[ 229], 00:20:00.015 | 99.00th=[ 253], 99.50th=[ 265], 99.90th=[ 277], 99.95th=[ 293], 00:20:00.015 | 99.99th=[ 351] 00:20:00.015 bw ( KiB/s): min= 8192, max= 8192, per=32.03%, avg=8192.00, stdev= 0.00, samples=2 00:20:00.015 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=2 00:20:00.015 lat (usec) : 250=56.40%, 500=43.46%, 750=0.06% 00:20:00.015 lat (msec) : 50=0.08% 00:20:00.015 cpu : usr=3.22%, sys=4.79%, ctx=3588, majf=0, minf=1 00:20:00.015 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:00.015 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:00.015 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:00.015 issued rwts: total=1539,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:00.015 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:00.015 job2: (groupid=0, jobs=1): err= 0: pid=2052885: Thu Nov 28 01:14:14 2024 00:20:00.015 read: IOPS=1482, BW=5931KiB/s (6073kB/s)(6156KiB/1038msec) 00:20:00.015 slat (nsec): min=5694, max=35196, avg=10968.35, stdev=3880.64 00:20:00.015 clat (usec): min=208, max=41041, avg=363.57, stdev=1796.77 00:20:00.016 lat (usec): min=216, max=41049, avg=374.54, stdev=1796.83 00:20:00.016 clat percentiles (usec): 00:20:00.016 | 1.00th=[ 247], 5.00th=[ 258], 10.00th=[ 262], 20.00th=[ 269], 00:20:00.016 | 30.00th=[ 273], 40.00th=[ 277], 50.00th=[ 281], 60.00th=[ 285], 00:20:00.016 | 70.00th=[ 293], 80.00th=[ 297], 90.00th=[ 310], 95.00th=[ 322], 00:20:00.016 | 99.00th=[ 371], 99.50th=[ 383], 99.90th=[41157], 99.95th=[41157], 00:20:00.016 | 99.99th=[41157] 00:20:00.016 write: IOPS=1973, BW=7892KiB/s (8082kB/s)(8192KiB/1038msec); 0 zone resets 00:20:00.016 slat (nsec): min=6646, max=45986, avg=13898.16, stdev=4551.50 00:20:00.016 clat (usec): min=141, max=429, avg=205.39, stdev=27.80 00:20:00.016 lat (usec): min=150, max=449, avg=219.29, stdev=28.40 00:20:00.016 clat percentiles (usec): 00:20:00.016 | 1.00th=[ 151], 5.00th=[ 174], 10.00th=[ 182], 20.00th=[ 188], 00:20:00.016 | 30.00th=[ 194], 40.00th=[ 198], 50.00th=[ 202], 60.00th=[ 206], 00:20:00.016 | 70.00th=[ 212], 80.00th=[ 219], 90.00th=[ 233], 95.00th=[ 247], 00:20:00.016 | 99.00th=[ 318], 99.50th=[ 359], 99.90th=[ 400], 99.95th=[ 412], 00:20:00.016 | 99.99th=[ 429] 00:20:00.016 bw ( KiB/s): min= 8192, max= 8192, per=32.03%, avg=8192.00, stdev= 0.00, samples=2 00:20:00.016 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=2 00:20:00.016 lat (usec) : 250=55.42%, 500=44.49% 00:20:00.016 lat (msec) : 50=0.08% 00:20:00.016 cpu : usr=2.03%, sys=4.73%, ctx=3590, majf=0, minf=1 00:20:00.016 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:00.016 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:00.016 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:00.016 issued rwts: total=1539,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:00.016 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:00.016 job3: (groupid=0, jobs=1): err= 0: pid=2052889: Thu Nov 28 01:14:14 2024 00:20:00.016 read: IOPS=1737, BW=6949KiB/s (7116kB/s)(6956KiB/1001msec) 00:20:00.016 slat (nsec): min=5711, max=48984, avg=8568.18, stdev=4678.72 00:20:00.016 clat (usec): min=228, max=40679, avg=317.47, stdev=971.42 00:20:00.016 lat (usec): min=234, max=40695, avg=326.03, stdev=971.81 00:20:00.016 clat percentiles (usec): 00:20:00.016 | 1.00th=[ 237], 5.00th=[ 245], 10.00th=[ 247], 20.00th=[ 253], 00:20:00.016 | 30.00th=[ 255], 40.00th=[ 260], 50.00th=[ 265], 60.00th=[ 269], 00:20:00.016 | 70.00th=[ 277], 80.00th=[ 289], 90.00th=[ 453], 95.00th=[ 478], 00:20:00.016 | 99.00th=[ 515], 99.50th=[ 545], 99.90th=[ 660], 99.95th=[40633], 00:20:00.016 | 99.99th=[40633] 00:20:00.016 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:20:00.016 slat (nsec): min=6898, max=58083, avg=14186.65, stdev=7384.84 00:20:00.016 clat (usec): min=152, max=296, avg=191.22, stdev=18.75 00:20:00.016 lat (usec): min=159, max=327, avg=205.40, stdev=24.11 00:20:00.016 clat percentiles (usec): 00:20:00.016 | 1.00th=[ 159], 5.00th=[ 165], 10.00th=[ 169], 20.00th=[ 174], 00:20:00.016 | 30.00th=[ 178], 40.00th=[ 184], 50.00th=[ 190], 60.00th=[ 198], 00:20:00.016 | 70.00th=[ 202], 80.00th=[ 208], 90.00th=[ 215], 95.00th=[ 223], 00:20:00.016 | 99.00th=[ 239], 99.50th=[ 243], 99.90th=[ 265], 99.95th=[ 273], 00:20:00.016 | 99.99th=[ 297] 00:20:00.016 bw ( KiB/s): min= 8424, max= 8424, per=32.94%, avg=8424.00, stdev= 0.00, samples=1 00:20:00.016 iops : min= 2106, max= 2106, avg=2106.00, stdev= 0.00, samples=1 00:20:00.016 lat (usec) : 250=61.26%, 500=37.84%, 750=0.87% 00:20:00.016 lat (msec) : 50=0.03% 00:20:00.016 cpu : usr=2.60%, sys=6.20%, ctx=3787, majf=0, minf=2 00:20:00.016 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:00.016 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:00.016 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:00.016 issued rwts: total=1739,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:00.016 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:00.016 00:20:00.016 Run status group 0 (all jobs): 00:20:00.016 READ: bw=18.2MiB/s (19.0MB/s), 84.5KiB/s-6949KiB/s (86.6kB/s-7116kB/s), io=18.9MiB (19.8MB), run=1001-1041msec 00:20:00.016 WRITE: bw=25.0MiB/s (26.2MB/s), 1967KiB/s-8184KiB/s (2015kB/s-8380kB/s), io=26.0MiB (27.3MB), run=1001-1041msec 00:20:00.016 00:20:00.016 Disk stats (read/write): 00:20:00.016 nvme0n1: ios=53/512, merge=0/0, ticks=1486/118, in_queue=1604, util=97.80% 00:20:00.016 nvme0n2: ios=1560/1711, merge=0/0, ticks=1403/331, in_queue=1734, util=97.14% 00:20:00.016 nvme0n3: ios=1559/1717, merge=0/0, ticks=1359/336, in_queue=1695, util=96.72% 00:20:00.016 nvme0n4: ios=1536/1951, merge=0/0, ticks=384/358, in_queue=742, util=89.45% 00:20:00.016 01:14:14 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:20:00.016 [global] 00:20:00.016 thread=1 00:20:00.016 invalidate=1 00:20:00.016 rw=write 00:20:00.016 time_based=1 00:20:00.016 runtime=1 00:20:00.016 ioengine=libaio 00:20:00.016 direct=1 00:20:00.016 bs=4096 00:20:00.016 iodepth=128 00:20:00.016 norandommap=0 00:20:00.016 numjobs=1 00:20:00.016 00:20:00.016 verify_dump=1 00:20:00.016 verify_backlog=512 00:20:00.016 verify_state_save=0 00:20:00.016 do_verify=1 00:20:00.016 verify=crc32c-intel 00:20:00.016 [job0] 00:20:00.016 filename=/dev/nvme0n1 00:20:00.016 [job1] 00:20:00.016 filename=/dev/nvme0n2 00:20:00.016 [job2] 00:20:00.016 filename=/dev/nvme0n3 00:20:00.016 [job3] 00:20:00.016 filename=/dev/nvme0n4 00:20:00.016 Could not set queue depth (nvme0n1) 00:20:00.016 Could not set queue depth (nvme0n2) 00:20:00.016 Could not set queue depth (nvme0n3) 00:20:00.016 Could not set queue depth (nvme0n4) 00:20:00.016 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:00.016 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:00.016 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:00.016 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:00.016 fio-3.35 00:20:00.016 Starting 4 threads 00:20:01.391 00:20:01.391 job0: (groupid=0, jobs=1): err= 0: pid=2053117: Thu Nov 28 01:14:15 2024 00:20:01.391 read: IOPS=5094, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1005msec) 00:20:01.391 slat (usec): min=2, max=12895, avg=93.47, stdev=624.25 00:20:01.391 clat (usec): min=3934, max=25747, avg=12225.61, stdev=2568.78 00:20:01.391 lat (usec): min=3951, max=25781, avg=12319.08, stdev=2609.87 00:20:01.391 clat percentiles (usec): 00:20:01.391 | 1.00th=[ 7701], 5.00th=[ 8979], 10.00th=[ 9765], 20.00th=[10814], 00:20:01.391 | 30.00th=[11076], 40.00th=[11338], 50.00th=[11469], 60.00th=[11731], 00:20:01.391 | 70.00th=[12518], 80.00th=[13698], 90.00th=[16188], 95.00th=[17433], 00:20:01.391 | 99.00th=[20579], 99.50th=[21365], 99.90th=[22676], 99.95th=[23987], 00:20:01.391 | 99.99th=[25822] 00:20:01.391 write: IOPS=5388, BW=21.0MiB/s (22.1MB/s)(21.2MiB/1005msec); 0 zone resets 00:20:01.391 slat (usec): min=3, max=14280, avg=83.18, stdev=537.66 00:20:01.391 clat (usec): min=1241, max=57337, avg=11962.39, stdev=4419.63 00:20:01.391 lat (usec): min=1251, max=57343, avg=12045.58, stdev=4446.60 00:20:01.391 clat percentiles (usec): 00:20:01.391 | 1.00th=[ 3556], 5.00th=[ 6521], 10.00th=[ 7701], 20.00th=[10552], 00:20:01.391 | 30.00th=[11338], 40.00th=[11863], 50.00th=[12125], 60.00th=[12256], 00:20:01.391 | 70.00th=[12387], 80.00th=[12649], 90.00th=[14615], 95.00th=[16319], 00:20:01.391 | 99.00th=[30540], 99.50th=[42206], 99.90th=[56886], 99.95th=[57410], 00:20:01.391 | 99.99th=[57410] 00:20:01.391 bw ( KiB/s): min=19848, max=22501, per=28.10%, avg=21174.50, stdev=1875.95, samples=2 00:20:01.391 iops : min= 4962, max= 5625, avg=5293.50, stdev=468.81, samples=2 00:20:01.391 lat (msec) : 2=0.02%, 4=0.98%, 10=12.56%, 20=84.31%, 50=1.96% 00:20:01.391 lat (msec) : 100=0.18% 00:20:01.391 cpu : usr=5.48%, sys=8.37%, ctx=504, majf=0, minf=1 00:20:01.391 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:20:01.391 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:01.391 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:01.391 issued rwts: total=5120,5415,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:01.391 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:01.391 job1: (groupid=0, jobs=1): err= 0: pid=2053118: Thu Nov 28 01:14:15 2024 00:20:01.391 read: IOPS=5471, BW=21.4MiB/s (22.4MB/s)(21.5MiB/1005msec) 00:20:01.391 slat (usec): min=2, max=10696, avg=93.72, stdev=662.29 00:20:01.391 clat (usec): min=2572, max=22833, avg=11927.77, stdev=3104.69 00:20:01.391 lat (usec): min=3876, max=22853, avg=12021.49, stdev=3142.44 00:20:01.391 clat percentiles (usec): 00:20:01.391 | 1.00th=[ 4752], 5.00th=[ 7898], 10.00th=[ 8356], 20.00th=[10028], 00:20:01.391 | 30.00th=[10683], 40.00th=[10945], 50.00th=[11076], 60.00th=[11338], 00:20:01.391 | 70.00th=[11994], 80.00th=[14091], 90.00th=[16188], 95.00th=[18482], 00:20:01.391 | 99.00th=[21365], 99.50th=[21890], 99.90th=[22676], 99.95th=[22938], 00:20:01.391 | 99.99th=[22938] 00:20:01.391 write: IOPS=5603, BW=21.9MiB/s (23.0MB/s)(22.0MiB/1005msec); 0 zone resets 00:20:01.391 slat (usec): min=3, max=9984, avg=78.17, stdev=472.69 00:20:01.391 clat (usec): min=1480, max=22870, avg=10994.34, stdev=2227.10 00:20:01.391 lat (usec): min=1494, max=22879, avg=11072.51, stdev=2281.51 00:20:01.391 clat percentiles (usec): 00:20:01.391 | 1.00th=[ 3818], 5.00th=[ 6390], 10.00th=[ 8160], 20.00th=[ 9634], 00:20:01.391 | 30.00th=[10552], 40.00th=[11207], 50.00th=[11600], 60.00th=[12125], 00:20:01.391 | 70.00th=[12387], 80.00th=[12518], 90.00th=[12780], 95.00th=[12911], 00:20:01.391 | 99.00th=[13960], 99.50th=[17695], 99.90th=[22152], 99.95th=[22676], 00:20:01.391 | 99.99th=[22938] 00:20:01.391 bw ( KiB/s): min=22224, max=22832, per=29.90%, avg=22528.00, stdev=429.92, samples=2 00:20:01.392 iops : min= 5556, max= 5708, avg=5632.00, stdev=107.48, samples=2 00:20:01.392 lat (msec) : 2=0.03%, 4=0.83%, 10=20.10%, 20=77.51%, 50=1.54% 00:20:01.392 cpu : usr=6.47%, sys=8.67%, ctx=557, majf=0, minf=1 00:20:01.392 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:20:01.392 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:01.392 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:01.392 issued rwts: total=5499,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:01.392 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:01.392 job2: (groupid=0, jobs=1): err= 0: pid=2053119: Thu Nov 28 01:14:15 2024 00:20:01.392 read: IOPS=3576, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1002msec) 00:20:01.392 slat (usec): min=3, max=16786, avg=127.88, stdev=821.79 00:20:01.392 clat (usec): min=8383, max=61244, avg=15931.70, stdev=5842.87 00:20:01.392 lat (usec): min=8395, max=61258, avg=16059.58, stdev=5915.33 00:20:01.392 clat percentiles (usec): 00:20:01.392 | 1.00th=[ 9765], 5.00th=[11076], 10.00th=[12387], 20.00th=[13304], 00:20:01.392 | 30.00th=[13698], 40.00th=[13829], 50.00th=[14222], 60.00th=[14746], 00:20:01.392 | 70.00th=[15533], 80.00th=[17171], 90.00th=[19530], 95.00th=[27132], 00:20:01.392 | 99.00th=[44303], 99.50th=[44303], 99.90th=[46400], 99.95th=[48497], 00:20:01.392 | 99.99th=[61080] 00:20:01.392 write: IOPS=4022, BW=15.7MiB/s (16.5MB/s)(15.7MiB/1002msec); 0 zone resets 00:20:01.392 slat (usec): min=4, max=38156, avg=125.34, stdev=940.49 00:20:01.392 clat (usec): min=1554, max=65845, avg=15995.03, stdev=5600.24 00:20:01.392 lat (usec): min=1561, max=65852, avg=16120.38, stdev=5680.99 00:20:01.392 clat percentiles (usec): 00:20:01.392 | 1.00th=[ 8356], 5.00th=[11994], 10.00th=[13698], 20.00th=[14353], 00:20:01.392 | 30.00th=[14615], 40.00th=[14746], 50.00th=[15008], 60.00th=[15401], 00:20:01.392 | 70.00th=[15795], 80.00th=[16188], 90.00th=[17695], 95.00th=[19792], 00:20:01.392 | 99.00th=[51119], 99.50th=[51119], 99.90th=[51119], 99.95th=[51119], 00:20:01.392 | 99.99th=[65799] 00:20:01.392 bw ( KiB/s): min=14848, max=16384, per=20.72%, avg=15616.00, stdev=1086.12, samples=2 00:20:01.392 iops : min= 3712, max= 4096, avg=3904.00, stdev=271.53, samples=2 00:20:01.392 lat (msec) : 2=0.17%, 10=2.51%, 20=90.78%, 50=5.75%, 100=0.79% 00:20:01.392 cpu : usr=5.39%, sys=6.89%, ctx=407, majf=0, minf=1 00:20:01.392 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:01.392 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:01.392 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:01.392 issued rwts: total=3584,4031,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:01.392 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:01.392 job3: (groupid=0, jobs=1): err= 0: pid=2053120: Thu Nov 28 01:14:15 2024 00:20:01.392 read: IOPS=4281, BW=16.7MiB/s (17.5MB/s)(17.5MiB/1045msec) 00:20:01.392 slat (usec): min=3, max=13875, avg=115.24, stdev=807.81 00:20:01.392 clat (usec): min=1831, max=60803, avg=15844.09, stdev=7437.93 00:20:01.392 lat (usec): min=5170, max=60817, avg=15959.33, stdev=7459.02 00:20:01.392 clat percentiles (usec): 00:20:01.392 | 1.00th=[ 7701], 5.00th=[10290], 10.00th=[11338], 20.00th=[11994], 00:20:01.392 | 30.00th=[12649], 40.00th=[13042], 50.00th=[13698], 60.00th=[14353], 00:20:01.392 | 70.00th=[15270], 80.00th=[18220], 90.00th=[22938], 95.00th=[26870], 00:20:01.392 | 99.00th=[54789], 99.50th=[54789], 99.90th=[55313], 99.95th=[55313], 00:20:01.392 | 99.99th=[60556] 00:20:01.392 write: IOPS=4409, BW=17.2MiB/s (18.1MB/s)(18.0MiB/1045msec); 0 zone resets 00:20:01.392 slat (usec): min=4, max=11307, avg=96.01, stdev=645.49 00:20:01.392 clat (usec): min=1335, max=29666, avg=13352.21, stdev=2786.10 00:20:01.392 lat (usec): min=1367, max=29676, avg=13448.22, stdev=2852.58 00:20:01.392 clat percentiles (usec): 00:20:01.392 | 1.00th=[ 4883], 5.00th=[ 8455], 10.00th=[10028], 20.00th=[11469], 00:20:01.392 | 30.00th=[12518], 40.00th=[12780], 50.00th=[13304], 60.00th=[14091], 00:20:01.392 | 70.00th=[15008], 80.00th=[15664], 90.00th=[16319], 95.00th=[16909], 00:20:01.392 | 99.00th=[20055], 99.50th=[20055], 99.90th=[28967], 99.95th=[29492], 00:20:01.392 | 99.99th=[29754] 00:20:01.392 bw ( KiB/s): min=18256, max=18608, per=24.46%, avg=18432.00, stdev=248.90, samples=2 00:20:01.392 iops : min= 4564, max= 4652, avg=4608.00, stdev=62.23, samples=2 00:20:01.392 lat (msec) : 2=0.02%, 4=0.07%, 10=6.71%, 20=84.61%, 50=7.94% 00:20:01.392 lat (msec) : 100=0.66% 00:20:01.392 cpu : usr=3.74%, sys=9.10%, ctx=403, majf=0, minf=1 00:20:01.392 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:20:01.392 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:01.392 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:01.392 issued rwts: total=4474,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:01.392 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:01.392 00:20:01.392 Run status group 0 (all jobs): 00:20:01.392 READ: bw=69.8MiB/s (73.2MB/s), 14.0MiB/s-21.4MiB/s (14.7MB/s-22.4MB/s), io=73.0MiB (76.5MB), run=1002-1045msec 00:20:01.392 WRITE: bw=73.6MiB/s (77.2MB/s), 15.7MiB/s-21.9MiB/s (16.5MB/s-23.0MB/s), io=76.9MiB (80.6MB), run=1002-1045msec 00:20:01.392 00:20:01.392 Disk stats (read/write): 00:20:01.392 nvme0n1: ios=4327/4608, merge=0/0, ticks=38028/38370, in_queue=76398, util=97.19% 00:20:01.392 nvme0n2: ios=4623/4863, merge=0/0, ticks=52930/51415, in_queue=104345, util=87.11% 00:20:01.392 nvme0n3: ios=3092/3271, merge=0/0, ticks=26033/24272, in_queue=50305, util=98.13% 00:20:01.392 nvme0n4: ios=3604/4012, merge=0/0, ticks=47434/49268, in_queue=96702, util=98.22% 00:20:01.392 01:14:15 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:20:01.392 [global] 00:20:01.392 thread=1 00:20:01.392 invalidate=1 00:20:01.392 rw=randwrite 00:20:01.392 time_based=1 00:20:01.392 runtime=1 00:20:01.392 ioengine=libaio 00:20:01.392 direct=1 00:20:01.392 bs=4096 00:20:01.392 iodepth=128 00:20:01.392 norandommap=0 00:20:01.392 numjobs=1 00:20:01.392 00:20:01.392 verify_dump=1 00:20:01.392 verify_backlog=512 00:20:01.392 verify_state_save=0 00:20:01.392 do_verify=1 00:20:01.392 verify=crc32c-intel 00:20:01.392 [job0] 00:20:01.392 filename=/dev/nvme0n1 00:20:01.392 [job1] 00:20:01.392 filename=/dev/nvme0n2 00:20:01.392 [job2] 00:20:01.392 filename=/dev/nvme0n3 00:20:01.392 [job3] 00:20:01.392 filename=/dev/nvme0n4 00:20:01.392 Could not set queue depth (nvme0n1) 00:20:01.392 Could not set queue depth (nvme0n2) 00:20:01.392 Could not set queue depth (nvme0n3) 00:20:01.392 Could not set queue depth (nvme0n4) 00:20:01.650 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:01.650 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:01.650 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:01.650 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:20:01.650 fio-3.35 00:20:01.650 Starting 4 threads 00:20:03.025 00:20:03.025 job0: (groupid=0, jobs=1): err= 0: pid=2053350: Thu Nov 28 01:14:17 2024 00:20:03.025 read: IOPS=5119, BW=20.0MiB/s (21.0MB/s)(20.2MiB/1010msec) 00:20:03.025 slat (usec): min=2, max=9220, avg=85.98, stdev=487.54 00:20:03.025 clat (usec): min=3091, max=23549, avg=11252.81, stdev=2294.62 00:20:03.025 lat (usec): min=3097, max=25668, avg=11338.79, stdev=2312.81 00:20:03.025 clat percentiles (usec): 00:20:03.025 | 1.00th=[ 5669], 5.00th=[ 8356], 10.00th=[ 9110], 20.00th=[ 9765], 00:20:03.025 | 30.00th=[10028], 40.00th=[10683], 50.00th=[11076], 60.00th=[11469], 00:20:03.025 | 70.00th=[11863], 80.00th=[12256], 90.00th=[13698], 95.00th=[16188], 00:20:03.025 | 99.00th=[18220], 99.50th=[18482], 99.90th=[21365], 99.95th=[21365], 00:20:03.025 | 99.99th=[23462] 00:20:03.025 write: IOPS=5576, BW=21.8MiB/s (22.8MB/s)(22.0MiB/1010msec); 0 zone resets 00:20:03.025 slat (usec): min=3, max=10281, avg=91.44, stdev=503.56 00:20:03.025 clat (usec): min=2506, max=28501, avg=12287.45, stdev=3981.97 00:20:03.025 lat (usec): min=2513, max=28525, avg=12378.89, stdev=4002.53 00:20:03.025 clat percentiles (usec): 00:20:03.025 | 1.00th=[ 5800], 5.00th=[ 8356], 10.00th=[ 8979], 20.00th=[10421], 00:20:03.025 | 30.00th=[10552], 40.00th=[10945], 50.00th=[11207], 60.00th=[11600], 00:20:03.025 | 70.00th=[12256], 80.00th=[13435], 90.00th=[17433], 95.00th=[22152], 00:20:03.025 | 99.00th=[27657], 99.50th=[28443], 99.90th=[28443], 99.95th=[28443], 00:20:03.025 | 99.99th=[28443] 00:20:03.025 bw ( KiB/s): min=20480, max=23968, per=32.83%, avg=22224.00, stdev=2466.39, samples=2 00:20:03.025 iops : min= 5120, max= 5992, avg=5556.00, stdev=616.60, samples=2 00:20:03.025 lat (msec) : 4=0.58%, 10=20.56%, 20=75.09%, 50=3.77% 00:20:03.025 cpu : usr=4.56%, sys=6.94%, ctx=665, majf=0, minf=1 00:20:03.025 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:20:03.025 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:03.025 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:03.025 issued rwts: total=5171,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:03.025 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:03.025 job1: (groupid=0, jobs=1): err= 0: pid=2053351: Thu Nov 28 01:14:17 2024 00:20:03.025 read: IOPS=3044, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1009msec) 00:20:03.025 slat (usec): min=2, max=18977, avg=144.49, stdev=975.98 00:20:03.025 clat (usec): min=7222, max=39902, avg=18417.52, stdev=7116.11 00:20:03.025 lat (usec): min=7236, max=42236, avg=18562.02, stdev=7171.00 00:20:03.025 clat percentiles (usec): 00:20:03.025 | 1.00th=[ 8356], 5.00th=[10290], 10.00th=[12256], 20.00th=[12649], 00:20:03.025 | 30.00th=[13698], 40.00th=[14222], 50.00th=[14746], 60.00th=[18482], 00:20:03.025 | 70.00th=[21627], 80.00th=[24773], 90.00th=[28705], 95.00th=[32375], 00:20:03.025 | 99.00th=[38011], 99.50th=[39060], 99.90th=[39584], 99.95th=[40109], 00:20:03.025 | 99.99th=[40109] 00:20:03.025 write: IOPS=3241, BW=12.7MiB/s (13.3MB/s)(12.8MiB/1009msec); 0 zone resets 00:20:03.025 slat (usec): min=3, max=21704, avg=153.58, stdev=851.77 00:20:03.025 clat (usec): min=1539, max=98425, avg=21749.30, stdev=12837.62 00:20:03.025 lat (usec): min=1543, max=98587, avg=21902.89, stdev=12926.38 00:20:03.025 clat percentiles (usec): 00:20:03.025 | 1.00th=[ 3851], 5.00th=[ 6980], 10.00th=[ 8291], 20.00th=[11600], 00:20:03.025 | 30.00th=[12518], 40.00th=[15008], 50.00th=[18482], 60.00th=[23725], 00:20:03.025 | 70.00th=[27132], 80.00th=[32637], 90.00th=[40109], 95.00th=[42730], 00:20:03.025 | 99.00th=[57934], 99.50th=[74974], 99.90th=[98042], 99.95th=[98042], 00:20:03.025 | 99.99th=[98042] 00:20:03.025 bw ( KiB/s): min= 8984, max=16160, per=18.57%, avg=12572.00, stdev=5074.20, samples=2 00:20:03.025 iops : min= 2246, max= 4040, avg=3143.00, stdev=1268.55, samples=2 00:20:03.025 lat (msec) : 2=0.13%, 4=0.41%, 10=10.26%, 20=47.44%, 50=40.88% 00:20:03.025 lat (msec) : 100=0.88% 00:20:03.025 cpu : usr=2.08%, sys=3.17%, ctx=331, majf=0, minf=1 00:20:03.025 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:03.025 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:03.025 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:03.025 issued rwts: total=3072,3271,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:03.025 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:03.025 job2: (groupid=0, jobs=1): err= 0: pid=2053352: Thu Nov 28 01:14:17 2024 00:20:03.025 read: IOPS=4530, BW=17.7MiB/s (18.6MB/s)(17.8MiB/1003msec) 00:20:03.025 slat (usec): min=2, max=11998, avg=110.33, stdev=657.72 00:20:03.025 clat (usec): min=879, max=33333, avg=14635.81, stdev=4241.99 00:20:03.025 lat (usec): min=3200, max=33340, avg=14746.14, stdev=4249.00 00:20:03.025 clat percentiles (usec): 00:20:03.025 | 1.00th=[ 6718], 5.00th=[10159], 10.00th=[11207], 20.00th=[12256], 00:20:03.025 | 30.00th=[12649], 40.00th=[13042], 50.00th=[13304], 60.00th=[13960], 00:20:03.026 | 70.00th=[14877], 80.00th=[16057], 90.00th=[20841], 95.00th=[23462], 00:20:03.026 | 99.00th=[29492], 99.50th=[30540], 99.90th=[33424], 99.95th=[33424], 00:20:03.026 | 99.99th=[33424] 00:20:03.026 write: IOPS=4594, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1003msec); 0 zone resets 00:20:03.026 slat (usec): min=3, max=13594, avg=99.04, stdev=655.83 00:20:03.026 clat (usec): min=5219, max=29825, avg=13173.41, stdev=2365.60 00:20:03.026 lat (usec): min=5234, max=29911, avg=13272.45, stdev=2397.53 00:20:03.026 clat percentiles (usec): 00:20:03.026 | 1.00th=[ 8225], 5.00th=[ 9896], 10.00th=[10552], 20.00th=[11600], 00:20:03.026 | 30.00th=[12256], 40.00th=[12649], 50.00th=[12911], 60.00th=[13304], 00:20:03.026 | 70.00th=[13698], 80.00th=[14091], 90.00th=[16319], 95.00th=[16909], 00:20:03.026 | 99.00th=[22152], 99.50th=[23462], 99.90th=[24773], 99.95th=[27919], 00:20:03.026 | 99.99th=[29754] 00:20:03.026 bw ( KiB/s): min=17624, max=19240, per=27.22%, avg=18432.00, stdev=1142.68, samples=2 00:20:03.026 iops : min= 4406, max= 4810, avg=4608.00, stdev=285.67, samples=2 00:20:03.026 lat (usec) : 1000=0.01% 00:20:03.026 lat (msec) : 4=0.31%, 10=4.39%, 20=88.10%, 50=7.19% 00:20:03.026 cpu : usr=4.59%, sys=6.19%, ctx=431, majf=0, minf=1 00:20:03.026 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:20:03.026 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:03.026 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:03.026 issued rwts: total=4544,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:03.026 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:03.026 job3: (groupid=0, jobs=1): err= 0: pid=2053353: Thu Nov 28 01:14:17 2024 00:20:03.026 read: IOPS=3517, BW=13.7MiB/s (14.4MB/s)(13.9MiB/1008msec) 00:20:03.026 slat (usec): min=2, max=12823, avg=127.21, stdev=733.03 00:20:03.026 clat (usec): min=2235, max=40000, avg=15851.94, stdev=4685.07 00:20:03.026 lat (usec): min=8345, max=40012, avg=15979.15, stdev=4732.66 00:20:03.026 clat percentiles (usec): 00:20:03.026 | 1.00th=[ 8848], 5.00th=[11469], 10.00th=[12125], 20.00th=[12911], 00:20:03.026 | 30.00th=[13566], 40.00th=[14091], 50.00th=[14746], 60.00th=[15533], 00:20:03.026 | 70.00th=[16057], 80.00th=[17171], 90.00th=[20841], 95.00th=[28181], 00:20:03.026 | 99.00th=[32637], 99.50th=[33817], 99.90th=[33817], 99.95th=[39060], 00:20:03.026 | 99.99th=[40109] 00:20:03.026 write: IOPS=3555, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1008msec); 0 zone resets 00:20:03.026 slat (usec): min=3, max=15315, avg=147.18, stdev=887.01 00:20:03.026 clat (usec): min=861, max=39064, avg=19982.73, stdev=6913.31 00:20:03.026 lat (usec): min=885, max=39094, avg=20129.91, stdev=6982.43 00:20:03.026 clat percentiles (usec): 00:20:03.026 | 1.00th=[ 8717], 5.00th=[11338], 10.00th=[12911], 20.00th=[14353], 00:20:03.026 | 30.00th=[15270], 40.00th=[15795], 50.00th=[17695], 60.00th=[20841], 00:20:03.026 | 70.00th=[23725], 80.00th=[25035], 90.00th=[30278], 95.00th=[34341], 00:20:03.026 | 99.00th=[38011], 99.50th=[38536], 99.90th=[39060], 99.95th=[39060], 00:20:03.026 | 99.99th=[39060] 00:20:03.026 bw ( KiB/s): min=12288, max=16384, per=21.17%, avg=14336.00, stdev=2896.31, samples=2 00:20:03.026 iops : min= 3072, max= 4096, avg=3584.00, stdev=724.08, samples=2 00:20:03.026 lat (usec) : 1000=0.03% 00:20:03.026 lat (msec) : 4=0.01%, 10=2.52%, 20=71.22%, 50=26.21% 00:20:03.026 cpu : usr=3.67%, sys=4.57%, ctx=357, majf=0, minf=1 00:20:03.026 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:20:03.026 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:03.026 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:03.026 issued rwts: total=3546,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:03.026 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:03.026 00:20:03.026 Run status group 0 (all jobs): 00:20:03.026 READ: bw=63.2MiB/s (66.2MB/s), 11.9MiB/s-20.0MiB/s (12.5MB/s-21.0MB/s), io=63.8MiB (66.9MB), run=1003-1010msec 00:20:03.026 WRITE: bw=66.1MiB/s (69.3MB/s), 12.7MiB/s-21.8MiB/s (13.3MB/s-22.8MB/s), io=66.8MiB (70.0MB), run=1003-1010msec 00:20:03.026 00:20:03.026 Disk stats (read/write): 00:20:03.026 nvme0n1: ios=4361/4608, merge=0/0, ticks=20054/21151, in_queue=41205, util=97.39% 00:20:03.026 nvme0n2: ios=2575/2775, merge=0/0, ticks=30020/36917, in_queue=66937, util=87.01% 00:20:03.026 nvme0n3: ios=3637/4096, merge=0/0, ticks=25704/26140, in_queue=51844, util=89.59% 00:20:03.026 nvme0n4: ios=3063/3087, merge=0/0, ticks=21226/28286, in_queue=49512, util=89.62% 00:20:03.026 01:14:17 -- target/fio.sh@55 -- # sync 00:20:03.026 01:14:17 -- target/fio.sh@59 -- # fio_pid=2053499 00:20:03.026 01:14:17 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:20:03.026 01:14:17 -- target/fio.sh@61 -- # sleep 3 00:20:03.026 [global] 00:20:03.026 thread=1 00:20:03.026 invalidate=1 00:20:03.026 rw=read 00:20:03.026 time_based=1 00:20:03.026 runtime=10 00:20:03.026 ioengine=libaio 00:20:03.026 direct=1 00:20:03.026 bs=4096 00:20:03.026 iodepth=1 00:20:03.026 norandommap=1 00:20:03.026 numjobs=1 00:20:03.026 00:20:03.026 [job0] 00:20:03.026 filename=/dev/nvme0n1 00:20:03.026 [job1] 00:20:03.026 filename=/dev/nvme0n2 00:20:03.026 [job2] 00:20:03.026 filename=/dev/nvme0n3 00:20:03.026 [job3] 00:20:03.026 filename=/dev/nvme0n4 00:20:03.026 Could not set queue depth (nvme0n1) 00:20:03.026 Could not set queue depth (nvme0n2) 00:20:03.026 Could not set queue depth (nvme0n3) 00:20:03.026 Could not set queue depth (nvme0n4) 00:20:03.026 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:03.026 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:03.026 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:03.026 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:03.026 fio-3.35 00:20:03.026 Starting 4 threads 00:20:06.304 01:14:20 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:20:06.304 01:14:20 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:20:06.304 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=21774336, buflen=4096 00:20:06.304 fio: pid=2053614, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:20:06.304 01:14:20 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:06.304 01:14:20 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:20:06.304 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=24629248, buflen=4096 00:20:06.304 fio: pid=2053609, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:20:06.569 01:14:21 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:06.569 01:14:21 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:20:06.569 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=16113664, buflen=4096 00:20:06.569 fio: pid=2053587, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:20:06.828 01:14:21 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:06.828 01:14:21 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:20:06.828 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=745472, buflen=4096 00:20:06.828 fio: pid=2053589, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:20:07.086 00:20:07.086 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2053587: Thu Nov 28 01:14:21 2024 00:20:07.086 read: IOPS=1142, BW=4568KiB/s (4677kB/s)(15.4MiB/3445msec) 00:20:07.086 slat (usec): min=4, max=11888, avg=16.37, stdev=319.19 00:20:07.086 clat (usec): min=204, max=42035, avg=851.35, stdev=4787.71 00:20:07.086 lat (usec): min=210, max=52966, avg=867.72, stdev=4824.83 00:20:07.086 clat percentiles (usec): 00:20:07.086 | 1.00th=[ 221], 5.00th=[ 227], 10.00th=[ 233], 20.00th=[ 247], 00:20:07.086 | 30.00th=[ 260], 40.00th=[ 265], 50.00th=[ 273], 60.00th=[ 277], 00:20:07.086 | 70.00th=[ 285], 80.00th=[ 293], 90.00th=[ 314], 95.00th=[ 351], 00:20:07.086 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:20:07.086 | 99.99th=[42206] 00:20:07.086 bw ( KiB/s): min= 96, max=13872, per=26.46%, avg=4409.33, stdev=5707.39, samples=6 00:20:07.086 iops : min= 24, max= 3468, avg=1102.33, stdev=1426.85, samples=6 00:20:07.086 lat (usec) : 250=22.11%, 500=75.35%, 750=0.66%, 1000=0.28% 00:20:07.086 lat (msec) : 2=0.15%, 20=0.03%, 50=1.40% 00:20:07.086 cpu : usr=0.87%, sys=1.07%, ctx=3938, majf=0, minf=1 00:20:07.086 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:07.086 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:07.086 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:07.086 issued rwts: total=3935,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:07.086 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:07.086 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2053589: Thu Nov 28 01:14:21 2024 00:20:07.087 read: IOPS=49, BW=196KiB/s (201kB/s)(728KiB/3707msec) 00:20:07.087 slat (usec): min=5, max=4822, avg=44.31, stdev=355.26 00:20:07.087 clat (usec): min=204, max=41288, avg=20187.34, stdev=20398.38 00:20:07.087 lat (usec): min=220, max=45936, avg=20231.54, stdev=20432.54 00:20:07.087 clat percentiles (usec): 00:20:07.087 | 1.00th=[ 210], 5.00th=[ 229], 10.00th=[ 245], 20.00th=[ 273], 00:20:07.087 | 30.00th=[ 297], 40.00th=[ 314], 50.00th=[ 449], 60.00th=[41157], 00:20:07.087 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:20:07.087 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:20:07.087 | 99.99th=[41157] 00:20:07.087 bw ( KiB/s): min= 94, max= 480, per=1.21%, avg=202.00, stdev=174.11, samples=7 00:20:07.087 iops : min= 23, max= 120, avg=50.43, stdev=43.58, samples=7 00:20:07.087 lat (usec) : 250=12.02%, 500=38.80% 00:20:07.087 lat (msec) : 50=48.63% 00:20:07.087 cpu : usr=0.00%, sys=0.13%, ctx=188, majf=0, minf=1 00:20:07.087 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:07.087 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:07.087 complete : 0=0.5%, 4=99.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:07.087 issued rwts: total=183,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:07.087 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:07.087 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2053609: Thu Nov 28 01:14:21 2024 00:20:07.087 read: IOPS=1888, BW=7552KiB/s (7733kB/s)(23.5MiB/3185msec) 00:20:07.087 slat (usec): min=5, max=6886, avg=13.25, stdev=88.87 00:20:07.087 clat (usec): min=212, max=42046, avg=508.35, stdev=3089.34 00:20:07.087 lat (usec): min=219, max=47969, avg=521.60, stdev=3106.24 00:20:07.087 clat percentiles (usec): 00:20:07.087 | 1.00th=[ 223], 5.00th=[ 231], 10.00th=[ 237], 20.00th=[ 247], 00:20:07.087 | 30.00th=[ 253], 40.00th=[ 260], 50.00th=[ 265], 60.00th=[ 269], 00:20:07.087 | 70.00th=[ 273], 80.00th=[ 281], 90.00th=[ 297], 95.00th=[ 424], 00:20:07.087 | 99.00th=[ 570], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:20:07.087 | 99.99th=[42206] 00:20:07.087 bw ( KiB/s): min= 96, max=14648, per=48.07%, avg=8012.00, stdev=6593.91, samples=6 00:20:07.087 iops : min= 24, max= 3662, avg=2003.00, stdev=1648.48, samples=6 00:20:07.087 lat (usec) : 250=25.97%, 500=71.17%, 750=2.05%, 1000=0.18% 00:20:07.087 lat (msec) : 2=0.05%, 50=0.57% 00:20:07.087 cpu : usr=2.04%, sys=3.05%, ctx=6015, majf=0, minf=1 00:20:07.087 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:07.087 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:07.087 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:07.087 issued rwts: total=6014,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:07.087 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:07.087 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2053614: Thu Nov 28 01:14:21 2024 00:20:07.087 read: IOPS=1842, BW=7368KiB/s (7545kB/s)(20.8MiB/2886msec) 00:20:07.087 slat (nsec): min=4245, max=60170, avg=16948.45, stdev=10417.51 00:20:07.087 clat (usec): min=202, max=41005, avg=517.33, stdev=2781.40 00:20:07.087 lat (usec): min=215, max=41020, avg=534.28, stdev=2781.79 00:20:07.087 clat percentiles (usec): 00:20:07.087 | 1.00th=[ 221], 5.00th=[ 241], 10.00th=[ 258], 20.00th=[ 281], 00:20:07.087 | 30.00th=[ 293], 40.00th=[ 302], 50.00th=[ 322], 60.00th=[ 347], 00:20:07.087 | 70.00th=[ 355], 80.00th=[ 371], 90.00th=[ 383], 95.00th=[ 404], 00:20:07.087 | 99.00th=[ 537], 99.50th=[ 2212], 99.90th=[41157], 99.95th=[41157], 00:20:07.087 | 99.99th=[41157] 00:20:07.087 bw ( KiB/s): min= 104, max=11888, per=41.05%, avg=6841.60, stdev=6019.65, samples=5 00:20:07.087 iops : min= 26, max= 2972, avg=1710.40, stdev=1504.91, samples=5 00:20:07.087 lat (usec) : 250=8.20%, 500=90.24%, 750=0.87%, 1000=0.09% 00:20:07.087 lat (msec) : 2=0.08%, 4=0.04%, 50=0.47% 00:20:07.087 cpu : usr=1.49%, sys=3.50%, ctx=5318, majf=0, minf=2 00:20:07.087 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:07.087 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:07.087 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:07.087 issued rwts: total=5317,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:07.087 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:07.087 00:20:07.087 Run status group 0 (all jobs): 00:20:07.087 READ: bw=16.3MiB/s (17.1MB/s), 196KiB/s-7552KiB/s (201kB/s-7733kB/s), io=60.3MiB (63.3MB), run=2886-3707msec 00:20:07.087 00:20:07.087 Disk stats (read/write): 00:20:07.087 nvme0n1: ios=3932/0, merge=0/0, ticks=3244/0, in_queue=3244, util=94.88% 00:20:07.087 nvme0n2: ios=218/0, merge=0/0, ticks=4112/0, in_queue=4112, util=98.98% 00:20:07.087 nvme0n3: ios=6011/0, merge=0/0, ticks=2910/0, in_queue=2910, util=96.57% 00:20:07.087 nvme0n4: ios=5279/0, merge=0/0, ticks=2723/0, in_queue=2723, util=96.74% 00:20:07.087 01:14:21 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:07.087 01:14:21 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:20:07.344 01:14:21 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:07.344 01:14:21 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:20:07.629 01:14:22 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:07.629 01:14:22 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:20:07.912 01:14:22 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:20:07.912 01:14:22 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:20:08.169 01:14:22 -- target/fio.sh@69 -- # fio_status=0 00:20:08.169 01:14:22 -- target/fio.sh@70 -- # wait 2053499 00:20:08.169 01:14:22 -- target/fio.sh@70 -- # fio_status=4 00:20:08.169 01:14:22 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:08.428 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:08.428 01:14:22 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:20:08.428 01:14:22 -- common/autotest_common.sh@1208 -- # local i=0 00:20:08.428 01:14:22 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:08.428 01:14:22 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:20:08.428 01:14:22 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:08.428 01:14:22 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:20:08.428 01:14:22 -- common/autotest_common.sh@1220 -- # return 0 00:20:08.428 01:14:22 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:20:08.428 01:14:22 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:20:08.428 nvmf hotplug test: fio failed as expected 00:20:08.428 01:14:22 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:08.686 01:14:23 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:20:08.686 01:14:23 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:20:08.686 01:14:23 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:20:08.686 01:14:23 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:20:08.686 01:14:23 -- target/fio.sh@91 -- # nvmftestfini 00:20:08.686 01:14:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:08.686 01:14:23 -- nvmf/common.sh@116 -- # sync 00:20:08.686 01:14:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:08.686 01:14:23 -- nvmf/common.sh@119 -- # set +e 00:20:08.686 01:14:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:08.686 01:14:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:08.686 rmmod nvme_tcp 00:20:08.686 rmmod nvme_fabrics 00:20:08.686 rmmod nvme_keyring 00:20:08.686 01:14:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:08.686 01:14:23 -- nvmf/common.sh@123 -- # set -e 00:20:08.686 01:14:23 -- nvmf/common.sh@124 -- # return 0 00:20:08.686 01:14:23 -- nvmf/common.sh@477 -- # '[' -n 2051479 ']' 00:20:08.686 01:14:23 -- nvmf/common.sh@478 -- # killprocess 2051479 00:20:08.686 01:14:23 -- common/autotest_common.sh@936 -- # '[' -z 2051479 ']' 00:20:08.686 01:14:23 -- common/autotest_common.sh@940 -- # kill -0 2051479 00:20:08.686 01:14:23 -- common/autotest_common.sh@941 -- # uname 00:20:08.686 01:14:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:08.686 01:14:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2051479 00:20:08.686 01:14:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:08.686 01:14:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:08.686 01:14:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2051479' 00:20:08.686 killing process with pid 2051479 00:20:08.686 01:14:23 -- common/autotest_common.sh@955 -- # kill 2051479 00:20:08.686 01:14:23 -- common/autotest_common.sh@960 -- # wait 2051479 00:20:08.946 01:14:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:08.946 01:14:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:08.946 01:14:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:08.946 01:14:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:08.946 01:14:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:08.946 01:14:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:08.946 01:14:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:08.946 01:14:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:11.481 01:14:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:11.481 00:20:11.481 real 0m23.794s 00:20:11.481 user 1m21.842s 00:20:11.481 sys 0m7.301s 00:20:11.481 01:14:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:11.481 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:20:11.481 ************************************ 00:20:11.481 END TEST nvmf_fio_target 00:20:11.481 ************************************ 00:20:11.481 01:14:25 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:20:11.481 01:14:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:11.481 01:14:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:11.481 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:20:11.481 ************************************ 00:20:11.481 START TEST nvmf_bdevio 00:20:11.481 ************************************ 00:20:11.481 01:14:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:20:11.481 * Looking for test storage... 00:20:11.481 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:11.481 01:14:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:11.481 01:14:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:11.481 01:14:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:11.481 01:14:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:11.481 01:14:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:11.481 01:14:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:11.481 01:14:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:11.481 01:14:25 -- scripts/common.sh@335 -- # IFS=.-: 00:20:11.481 01:14:25 -- scripts/common.sh@335 -- # read -ra ver1 00:20:11.481 01:14:25 -- scripts/common.sh@336 -- # IFS=.-: 00:20:11.481 01:14:25 -- scripts/common.sh@336 -- # read -ra ver2 00:20:11.481 01:14:25 -- scripts/common.sh@337 -- # local 'op=<' 00:20:11.481 01:14:25 -- scripts/common.sh@339 -- # ver1_l=2 00:20:11.481 01:14:25 -- scripts/common.sh@340 -- # ver2_l=1 00:20:11.481 01:14:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:11.481 01:14:25 -- scripts/common.sh@343 -- # case "$op" in 00:20:11.481 01:14:25 -- scripts/common.sh@344 -- # : 1 00:20:11.481 01:14:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:11.481 01:14:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:11.481 01:14:25 -- scripts/common.sh@364 -- # decimal 1 00:20:11.481 01:14:25 -- scripts/common.sh@352 -- # local d=1 00:20:11.481 01:14:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:11.481 01:14:25 -- scripts/common.sh@354 -- # echo 1 00:20:11.481 01:14:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:11.481 01:14:25 -- scripts/common.sh@365 -- # decimal 2 00:20:11.481 01:14:25 -- scripts/common.sh@352 -- # local d=2 00:20:11.481 01:14:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:11.481 01:14:25 -- scripts/common.sh@354 -- # echo 2 00:20:11.481 01:14:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:11.481 01:14:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:11.481 01:14:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:11.481 01:14:25 -- scripts/common.sh@367 -- # return 0 00:20:11.481 01:14:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:11.481 01:14:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:11.481 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:11.481 --rc genhtml_branch_coverage=1 00:20:11.481 --rc genhtml_function_coverage=1 00:20:11.481 --rc genhtml_legend=1 00:20:11.481 --rc geninfo_all_blocks=1 00:20:11.481 --rc geninfo_unexecuted_blocks=1 00:20:11.481 00:20:11.481 ' 00:20:11.481 01:14:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:11.481 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:11.481 --rc genhtml_branch_coverage=1 00:20:11.481 --rc genhtml_function_coverage=1 00:20:11.481 --rc genhtml_legend=1 00:20:11.481 --rc geninfo_all_blocks=1 00:20:11.481 --rc geninfo_unexecuted_blocks=1 00:20:11.481 00:20:11.481 ' 00:20:11.481 01:14:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:11.481 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:11.481 --rc genhtml_branch_coverage=1 00:20:11.481 --rc genhtml_function_coverage=1 00:20:11.481 --rc genhtml_legend=1 00:20:11.481 --rc geninfo_all_blocks=1 00:20:11.481 --rc geninfo_unexecuted_blocks=1 00:20:11.481 00:20:11.481 ' 00:20:11.481 01:14:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:11.481 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:11.481 --rc genhtml_branch_coverage=1 00:20:11.481 --rc genhtml_function_coverage=1 00:20:11.481 --rc genhtml_legend=1 00:20:11.481 --rc geninfo_all_blocks=1 00:20:11.481 --rc geninfo_unexecuted_blocks=1 00:20:11.481 00:20:11.481 ' 00:20:11.481 01:14:25 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:11.481 01:14:25 -- nvmf/common.sh@7 -- # uname -s 00:20:11.481 01:14:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:11.482 01:14:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:11.482 01:14:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:11.482 01:14:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:11.482 01:14:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:11.482 01:14:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:11.482 01:14:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:11.482 01:14:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:11.482 01:14:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:11.482 01:14:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:11.482 01:14:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:11.482 01:14:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:11.482 01:14:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:11.482 01:14:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:11.482 01:14:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:11.482 01:14:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:11.482 01:14:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:11.482 01:14:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:11.482 01:14:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:11.482 01:14:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:11.482 01:14:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:11.482 01:14:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:11.482 01:14:25 -- paths/export.sh@5 -- # export PATH 00:20:11.482 01:14:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:11.482 01:14:25 -- nvmf/common.sh@46 -- # : 0 00:20:11.482 01:14:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:11.482 01:14:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:11.482 01:14:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:11.482 01:14:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:11.482 01:14:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:11.482 01:14:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:11.482 01:14:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:11.482 01:14:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:11.482 01:14:25 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:11.482 01:14:25 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:11.482 01:14:25 -- target/bdevio.sh@14 -- # nvmftestinit 00:20:11.482 01:14:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:11.482 01:14:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:11.482 01:14:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:11.482 01:14:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:11.482 01:14:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:11.482 01:14:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:11.482 01:14:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:11.482 01:14:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:11.482 01:14:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:11.482 01:14:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:11.482 01:14:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:11.482 01:14:25 -- common/autotest_common.sh@10 -- # set +x 00:20:13.383 01:14:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:13.383 01:14:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:13.383 01:14:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:13.383 01:14:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:13.383 01:14:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:13.383 01:14:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:13.383 01:14:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:13.383 01:14:27 -- nvmf/common.sh@294 -- # net_devs=() 00:20:13.383 01:14:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:13.383 01:14:27 -- nvmf/common.sh@295 -- # e810=() 00:20:13.383 01:14:27 -- nvmf/common.sh@295 -- # local -ga e810 00:20:13.383 01:14:27 -- nvmf/common.sh@296 -- # x722=() 00:20:13.383 01:14:27 -- nvmf/common.sh@296 -- # local -ga x722 00:20:13.383 01:14:27 -- nvmf/common.sh@297 -- # mlx=() 00:20:13.383 01:14:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:13.383 01:14:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:13.383 01:14:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:13.383 01:14:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:13.383 01:14:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:13.383 01:14:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:13.383 01:14:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:13.383 01:14:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:13.383 01:14:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:13.383 01:14:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:13.383 01:14:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:13.383 01:14:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:13.383 01:14:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:13.383 01:14:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:13.383 01:14:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:13.383 01:14:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:13.383 01:14:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:13.383 01:14:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:13.383 01:14:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:13.383 01:14:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:13.383 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:13.383 01:14:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:13.383 01:14:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:13.383 01:14:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:13.383 01:14:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:13.383 01:14:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:13.383 01:14:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:13.383 01:14:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:13.383 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:13.383 01:14:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:13.383 01:14:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:13.383 01:14:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:13.383 01:14:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:13.383 01:14:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:13.383 01:14:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:13.383 01:14:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:13.383 01:14:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:13.383 01:14:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:13.383 01:14:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:13.383 01:14:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:13.383 01:14:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:13.383 01:14:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:13.383 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:13.383 01:14:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:13.383 01:14:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:13.383 01:14:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:13.383 01:14:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:13.383 01:14:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:13.384 01:14:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:13.384 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:13.384 01:14:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:13.384 01:14:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:13.384 01:14:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:13.384 01:14:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:13.384 01:14:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:13.384 01:14:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:13.384 01:14:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:13.384 01:14:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:13.384 01:14:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:13.384 01:14:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:13.384 01:14:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:13.384 01:14:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:13.384 01:14:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:13.384 01:14:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:13.384 01:14:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:13.384 01:14:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:13.384 01:14:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:13.384 01:14:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:13.384 01:14:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:13.384 01:14:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:13.384 01:14:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:13.384 01:14:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:13.384 01:14:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:13.384 01:14:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:13.384 01:14:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:13.384 01:14:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:13.384 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:13.384 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.245 ms 00:20:13.384 00:20:13.384 --- 10.0.0.2 ping statistics --- 00:20:13.384 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:13.384 rtt min/avg/max/mdev = 0.245/0.245/0.245/0.000 ms 00:20:13.384 01:14:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:13.384 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:13.384 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:20:13.384 00:20:13.384 --- 10.0.0.1 ping statistics --- 00:20:13.384 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:13.384 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:20:13.384 01:14:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:13.384 01:14:27 -- nvmf/common.sh@410 -- # return 0 00:20:13.384 01:14:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:13.384 01:14:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:13.384 01:14:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:13.384 01:14:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:13.384 01:14:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:13.384 01:14:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:13.384 01:14:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:13.384 01:14:27 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:20:13.384 01:14:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:13.384 01:14:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:13.384 01:14:27 -- common/autotest_common.sh@10 -- # set +x 00:20:13.384 01:14:27 -- nvmf/common.sh@469 -- # nvmfpid=2056281 00:20:13.384 01:14:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:20:13.384 01:14:27 -- nvmf/common.sh@470 -- # waitforlisten 2056281 00:20:13.384 01:14:27 -- common/autotest_common.sh@829 -- # '[' -z 2056281 ']' 00:20:13.384 01:14:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:13.384 01:14:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:13.384 01:14:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:13.384 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:13.384 01:14:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:13.384 01:14:27 -- common/autotest_common.sh@10 -- # set +x 00:20:13.384 [2024-11-28 01:14:27.829848] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:13.384 [2024-11-28 01:14:27.829941] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:13.384 EAL: No free 2048 kB hugepages reported on node 1 00:20:13.384 [2024-11-28 01:14:27.905935] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:13.642 [2024-11-28 01:14:27.997886] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:13.642 [2024-11-28 01:14:27.998051] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:13.642 [2024-11-28 01:14:27.998069] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:13.642 [2024-11-28 01:14:27.998083] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:13.642 [2024-11-28 01:14:27.998172] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:20:13.642 [2024-11-28 01:14:27.998226] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:20:13.642 [2024-11-28 01:14:27.998280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:20:13.642 [2024-11-28 01:14:27.998282] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:14.576 01:14:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:14.576 01:14:28 -- common/autotest_common.sh@862 -- # return 0 00:20:14.576 01:14:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:14.576 01:14:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:14.576 01:14:28 -- common/autotest_common.sh@10 -- # set +x 00:20:14.576 01:14:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:14.576 01:14:28 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:14.576 01:14:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:14.576 01:14:28 -- common/autotest_common.sh@10 -- # set +x 00:20:14.576 [2024-11-28 01:14:28.863156] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:14.576 01:14:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:14.576 01:14:28 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:14.576 01:14:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:14.576 01:14:28 -- common/autotest_common.sh@10 -- # set +x 00:20:14.576 Malloc0 00:20:14.576 01:14:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:14.576 01:14:28 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:14.576 01:14:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:14.576 01:14:28 -- common/autotest_common.sh@10 -- # set +x 00:20:14.576 01:14:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:14.576 01:14:28 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:14.576 01:14:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:14.576 01:14:28 -- common/autotest_common.sh@10 -- # set +x 00:20:14.576 01:14:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:14.576 01:14:28 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:14.576 01:14:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:14.576 01:14:28 -- common/autotest_common.sh@10 -- # set +x 00:20:14.576 [2024-11-28 01:14:28.915124] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:14.576 01:14:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:14.576 01:14:28 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:20:14.576 01:14:28 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:20:14.576 01:14:28 -- nvmf/common.sh@520 -- # config=() 00:20:14.576 01:14:28 -- nvmf/common.sh@520 -- # local subsystem config 00:20:14.576 01:14:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:20:14.576 01:14:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:20:14.576 { 00:20:14.576 "params": { 00:20:14.576 "name": "Nvme$subsystem", 00:20:14.576 "trtype": "$TEST_TRANSPORT", 00:20:14.576 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:14.576 "adrfam": "ipv4", 00:20:14.576 "trsvcid": "$NVMF_PORT", 00:20:14.576 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:14.576 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:14.576 "hdgst": ${hdgst:-false}, 00:20:14.576 "ddgst": ${ddgst:-false} 00:20:14.576 }, 00:20:14.576 "method": "bdev_nvme_attach_controller" 00:20:14.576 } 00:20:14.576 EOF 00:20:14.576 )") 00:20:14.576 01:14:28 -- nvmf/common.sh@542 -- # cat 00:20:14.576 01:14:28 -- nvmf/common.sh@544 -- # jq . 00:20:14.576 01:14:28 -- nvmf/common.sh@545 -- # IFS=, 00:20:14.576 01:14:28 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:20:14.576 "params": { 00:20:14.576 "name": "Nvme1", 00:20:14.576 "trtype": "tcp", 00:20:14.576 "traddr": "10.0.0.2", 00:20:14.576 "adrfam": "ipv4", 00:20:14.576 "trsvcid": "4420", 00:20:14.576 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:14.576 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:14.576 "hdgst": false, 00:20:14.576 "ddgst": false 00:20:14.576 }, 00:20:14.576 "method": "bdev_nvme_attach_controller" 00:20:14.576 }' 00:20:14.576 [2024-11-28 01:14:28.962286] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:14.576 [2024-11-28 01:14:28.962370] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2056443 ] 00:20:14.576 EAL: No free 2048 kB hugepages reported on node 1 00:20:14.576 [2024-11-28 01:14:29.027220] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:20:14.576 [2024-11-28 01:14:29.115012] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:14.576 [2024-11-28 01:14:29.115064] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:14.576 [2024-11-28 01:14:29.115067] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:15.142 [2024-11-28 01:14:29.447538] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:20:15.142 [2024-11-28 01:14:29.447587] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:20:15.142 I/O targets: 00:20:15.142 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:20:15.142 00:20:15.142 00:20:15.142 CUnit - A unit testing framework for C - Version 2.1-3 00:20:15.142 http://cunit.sourceforge.net/ 00:20:15.142 00:20:15.142 00:20:15.142 Suite: bdevio tests on: Nvme1n1 00:20:15.142 Test: blockdev write read block ...passed 00:20:15.142 Test: blockdev write zeroes read block ...passed 00:20:15.142 Test: blockdev write zeroes read no split ...passed 00:20:15.142 Test: blockdev write zeroes read split ...passed 00:20:15.142 Test: blockdev write zeroes read split partial ...passed 00:20:15.142 Test: blockdev reset ...[2024-11-28 01:14:29.643373] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:20:15.142 [2024-11-28 01:14:29.643480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x244c670 (9): Bad file descriptor 00:20:15.142 [2024-11-28 01:14:29.697409] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:20:15.142 passed 00:20:15.142 Test: blockdev write read 8 blocks ...passed 00:20:15.142 Test: blockdev write read size > 128k ...passed 00:20:15.142 Test: blockdev write read invalid size ...passed 00:20:15.415 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:20:15.415 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:20:15.415 Test: blockdev write read max offset ...passed 00:20:15.415 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:20:15.415 Test: blockdev writev readv 8 blocks ...passed 00:20:15.415 Test: blockdev writev readv 30 x 1block ...passed 00:20:15.415 Test: blockdev writev readv block ...passed 00:20:15.674 Test: blockdev writev readv size > 128k ...passed 00:20:15.674 Test: blockdev writev readv size > 128k in two iovs ...passed 00:20:15.674 Test: blockdev comparev and writev ...[2024-11-28 01:14:30.039422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:15.674 [2024-11-28 01:14:30.039473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:15.674 [2024-11-28 01:14:30.039496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:15.674 [2024-11-28 01:14:30.039513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:20:15.674 [2024-11-28 01:14:30.039859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:15.674 [2024-11-28 01:14:30.039882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:20:15.674 [2024-11-28 01:14:30.039903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:15.674 [2024-11-28 01:14:30.039919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:20:15.674 [2024-11-28 01:14:30.040238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:15.674 [2024-11-28 01:14:30.040262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:20:15.674 [2024-11-28 01:14:30.040282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:15.674 [2024-11-28 01:14:30.040297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:20:15.674 [2024-11-28 01:14:30.040628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:15.674 [2024-11-28 01:14:30.040654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:20:15.674 [2024-11-28 01:14:30.040674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:15.674 [2024-11-28 01:14:30.040690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:20:15.674 passed 00:20:15.674 Test: blockdev nvme passthru rw ...passed 00:20:15.674 Test: blockdev nvme passthru vendor specific ...[2024-11-28 01:14:30.123924] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:15.675 [2024-11-28 01:14:30.123997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:20:15.675 [2024-11-28 01:14:30.124175] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:15.675 [2024-11-28 01:14:30.124201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:20:15.675 [2024-11-28 01:14:30.124359] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:15.675 [2024-11-28 01:14:30.124383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:20:15.675 [2024-11-28 01:14:30.124548] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:15.675 [2024-11-28 01:14:30.124583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:20:15.675 passed 00:20:15.675 Test: blockdev nvme admin passthru ...passed 00:20:15.675 Test: blockdev copy ...passed 00:20:15.675 00:20:15.675 Run Summary: Type Total Ran Passed Failed Inactive 00:20:15.675 suites 1 1 n/a 0 0 00:20:15.675 tests 23 23 23 0 0 00:20:15.675 asserts 152 152 152 0 n/a 00:20:15.675 00:20:15.675 Elapsed time = 1.454 seconds 00:20:15.933 01:14:30 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:15.933 01:14:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:15.933 01:14:30 -- common/autotest_common.sh@10 -- # set +x 00:20:15.933 01:14:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:15.933 01:14:30 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:20:15.933 01:14:30 -- target/bdevio.sh@30 -- # nvmftestfini 00:20:15.933 01:14:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:15.933 01:14:30 -- nvmf/common.sh@116 -- # sync 00:20:15.933 01:14:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:15.933 01:14:30 -- nvmf/common.sh@119 -- # set +e 00:20:15.933 01:14:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:15.933 01:14:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:15.933 rmmod nvme_tcp 00:20:15.933 rmmod nvme_fabrics 00:20:15.933 rmmod nvme_keyring 00:20:15.933 01:14:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:15.933 01:14:30 -- nvmf/common.sh@123 -- # set -e 00:20:15.933 01:14:30 -- nvmf/common.sh@124 -- # return 0 00:20:15.933 01:14:30 -- nvmf/common.sh@477 -- # '[' -n 2056281 ']' 00:20:15.933 01:14:30 -- nvmf/common.sh@478 -- # killprocess 2056281 00:20:15.933 01:14:30 -- common/autotest_common.sh@936 -- # '[' -z 2056281 ']' 00:20:15.933 01:14:30 -- common/autotest_common.sh@940 -- # kill -0 2056281 00:20:15.933 01:14:30 -- common/autotest_common.sh@941 -- # uname 00:20:15.933 01:14:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:15.933 01:14:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2056281 00:20:15.933 01:14:30 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:20:15.933 01:14:30 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:20:15.933 01:14:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2056281' 00:20:15.933 killing process with pid 2056281 00:20:15.933 01:14:30 -- common/autotest_common.sh@955 -- # kill 2056281 00:20:15.933 01:14:30 -- common/autotest_common.sh@960 -- # wait 2056281 00:20:16.192 01:14:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:16.192 01:14:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:16.192 01:14:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:16.192 01:14:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:16.192 01:14:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:16.192 01:14:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:16.192 01:14:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:16.192 01:14:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:18.730 01:14:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:18.730 00:20:18.730 real 0m7.283s 00:20:18.730 user 0m14.676s 00:20:18.730 sys 0m2.126s 00:20:18.730 01:14:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:18.730 01:14:32 -- common/autotest_common.sh@10 -- # set +x 00:20:18.730 ************************************ 00:20:18.730 END TEST nvmf_bdevio 00:20:18.730 ************************************ 00:20:18.730 01:14:32 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:20:18.730 01:14:32 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:20:18.730 01:14:32 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:20:18.730 01:14:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:18.730 01:14:32 -- common/autotest_common.sh@10 -- # set +x 00:20:18.730 ************************************ 00:20:18.730 START TEST nvmf_bdevio_no_huge 00:20:18.730 ************************************ 00:20:18.730 01:14:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:20:18.730 * Looking for test storage... 00:20:18.730 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:18.730 01:14:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:18.730 01:14:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:18.730 01:14:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:18.730 01:14:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:18.730 01:14:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:18.730 01:14:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:18.730 01:14:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:18.730 01:14:32 -- scripts/common.sh@335 -- # IFS=.-: 00:20:18.730 01:14:32 -- scripts/common.sh@335 -- # read -ra ver1 00:20:18.730 01:14:32 -- scripts/common.sh@336 -- # IFS=.-: 00:20:18.730 01:14:32 -- scripts/common.sh@336 -- # read -ra ver2 00:20:18.730 01:14:32 -- scripts/common.sh@337 -- # local 'op=<' 00:20:18.730 01:14:32 -- scripts/common.sh@339 -- # ver1_l=2 00:20:18.730 01:14:32 -- scripts/common.sh@340 -- # ver2_l=1 00:20:18.730 01:14:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:18.730 01:14:32 -- scripts/common.sh@343 -- # case "$op" in 00:20:18.730 01:14:32 -- scripts/common.sh@344 -- # : 1 00:20:18.730 01:14:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:18.730 01:14:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:18.730 01:14:32 -- scripts/common.sh@364 -- # decimal 1 00:20:18.730 01:14:32 -- scripts/common.sh@352 -- # local d=1 00:20:18.730 01:14:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:18.730 01:14:32 -- scripts/common.sh@354 -- # echo 1 00:20:18.730 01:14:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:18.730 01:14:32 -- scripts/common.sh@365 -- # decimal 2 00:20:18.730 01:14:32 -- scripts/common.sh@352 -- # local d=2 00:20:18.730 01:14:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:18.730 01:14:32 -- scripts/common.sh@354 -- # echo 2 00:20:18.730 01:14:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:18.730 01:14:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:18.730 01:14:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:18.730 01:14:32 -- scripts/common.sh@367 -- # return 0 00:20:18.730 01:14:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:18.730 01:14:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:18.730 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:18.730 --rc genhtml_branch_coverage=1 00:20:18.730 --rc genhtml_function_coverage=1 00:20:18.730 --rc genhtml_legend=1 00:20:18.730 --rc geninfo_all_blocks=1 00:20:18.730 --rc geninfo_unexecuted_blocks=1 00:20:18.730 00:20:18.730 ' 00:20:18.730 01:14:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:18.730 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:18.730 --rc genhtml_branch_coverage=1 00:20:18.730 --rc genhtml_function_coverage=1 00:20:18.730 --rc genhtml_legend=1 00:20:18.730 --rc geninfo_all_blocks=1 00:20:18.730 --rc geninfo_unexecuted_blocks=1 00:20:18.730 00:20:18.730 ' 00:20:18.730 01:14:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:18.730 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:18.730 --rc genhtml_branch_coverage=1 00:20:18.730 --rc genhtml_function_coverage=1 00:20:18.730 --rc genhtml_legend=1 00:20:18.730 --rc geninfo_all_blocks=1 00:20:18.730 --rc geninfo_unexecuted_blocks=1 00:20:18.730 00:20:18.730 ' 00:20:18.730 01:14:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:18.730 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:18.730 --rc genhtml_branch_coverage=1 00:20:18.730 --rc genhtml_function_coverage=1 00:20:18.730 --rc genhtml_legend=1 00:20:18.730 --rc geninfo_all_blocks=1 00:20:18.730 --rc geninfo_unexecuted_blocks=1 00:20:18.730 00:20:18.730 ' 00:20:18.730 01:14:32 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:18.730 01:14:32 -- nvmf/common.sh@7 -- # uname -s 00:20:18.730 01:14:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:18.730 01:14:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:18.730 01:14:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:18.730 01:14:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:18.730 01:14:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:18.730 01:14:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:18.730 01:14:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:18.730 01:14:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:18.730 01:14:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:18.730 01:14:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:18.730 01:14:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:18.730 01:14:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:18.730 01:14:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:18.730 01:14:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:18.730 01:14:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:18.730 01:14:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:18.730 01:14:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:18.730 01:14:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:18.730 01:14:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:18.730 01:14:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:18.730 01:14:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:18.731 01:14:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:18.731 01:14:32 -- paths/export.sh@5 -- # export PATH 00:20:18.731 01:14:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:18.731 01:14:32 -- nvmf/common.sh@46 -- # : 0 00:20:18.731 01:14:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:18.731 01:14:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:18.731 01:14:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:18.731 01:14:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:18.731 01:14:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:18.731 01:14:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:18.731 01:14:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:18.731 01:14:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:18.731 01:14:32 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:18.731 01:14:32 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:18.731 01:14:32 -- target/bdevio.sh@14 -- # nvmftestinit 00:20:18.731 01:14:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:18.731 01:14:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:18.731 01:14:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:18.731 01:14:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:18.731 01:14:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:18.731 01:14:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:18.731 01:14:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:18.731 01:14:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:18.731 01:14:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:18.731 01:14:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:18.731 01:14:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:18.731 01:14:32 -- common/autotest_common.sh@10 -- # set +x 00:20:20.635 01:14:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:20.635 01:14:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:20.635 01:14:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:20.635 01:14:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:20.635 01:14:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:20.635 01:14:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:20.635 01:14:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:20.635 01:14:35 -- nvmf/common.sh@294 -- # net_devs=() 00:20:20.635 01:14:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:20.635 01:14:35 -- nvmf/common.sh@295 -- # e810=() 00:20:20.635 01:14:35 -- nvmf/common.sh@295 -- # local -ga e810 00:20:20.635 01:14:35 -- nvmf/common.sh@296 -- # x722=() 00:20:20.635 01:14:35 -- nvmf/common.sh@296 -- # local -ga x722 00:20:20.635 01:14:35 -- nvmf/common.sh@297 -- # mlx=() 00:20:20.635 01:14:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:20.635 01:14:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:20.635 01:14:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:20.635 01:14:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:20.635 01:14:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:20.635 01:14:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:20.635 01:14:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:20.635 01:14:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:20.635 01:14:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:20.635 01:14:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:20.635 01:14:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:20.635 01:14:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:20.635 01:14:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:20.635 01:14:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:20.635 01:14:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:20.635 01:14:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:20.635 01:14:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:20.635 01:14:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:20.635 01:14:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:20.635 01:14:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:20.635 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:20.635 01:14:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:20.635 01:14:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:20.635 01:14:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:20.635 01:14:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:20.635 01:14:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:20.635 01:14:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:20.635 01:14:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:20.635 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:20.635 01:14:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:20.635 01:14:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:20.635 01:14:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:20.635 01:14:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:20.635 01:14:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:20.635 01:14:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:20.635 01:14:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:20.635 01:14:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:20.635 01:14:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:20.635 01:14:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:20.635 01:14:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:20.635 01:14:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:20.636 01:14:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:20.636 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:20.636 01:14:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:20.636 01:14:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:20.636 01:14:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:20.636 01:14:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:20.636 01:14:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:20.636 01:14:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:20.636 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:20.636 01:14:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:20.636 01:14:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:20.636 01:14:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:20.636 01:14:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:20.636 01:14:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:20.636 01:14:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:20.636 01:14:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:20.636 01:14:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:20.636 01:14:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:20.636 01:14:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:20.636 01:14:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:20.636 01:14:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:20.636 01:14:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:20.636 01:14:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:20.636 01:14:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:20.636 01:14:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:20.636 01:14:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:20.636 01:14:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:20.636 01:14:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:20.636 01:14:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:20.636 01:14:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:20.636 01:14:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:20.636 01:14:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:20.636 01:14:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:20.636 01:14:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:20.636 01:14:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:20.636 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:20.636 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:20:20.636 00:20:20.636 --- 10.0.0.2 ping statistics --- 00:20:20.636 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:20.636 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:20:20.636 01:14:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:20.636 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:20.636 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:20:20.636 00:20:20.636 --- 10.0.0.1 ping statistics --- 00:20:20.636 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:20.636 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:20:20.636 01:14:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:20.636 01:14:35 -- nvmf/common.sh@410 -- # return 0 00:20:20.636 01:14:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:20.636 01:14:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:20.636 01:14:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:20.636 01:14:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:20.636 01:14:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:20.636 01:14:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:20.636 01:14:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:20.636 01:14:35 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:20:20.636 01:14:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:20.636 01:14:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:20.636 01:14:35 -- common/autotest_common.sh@10 -- # set +x 00:20:20.636 01:14:35 -- nvmf/common.sh@469 -- # nvmfpid=2058625 00:20:20.636 01:14:35 -- nvmf/common.sh@470 -- # waitforlisten 2058625 00:20:20.636 01:14:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:20:20.636 01:14:35 -- common/autotest_common.sh@829 -- # '[' -z 2058625 ']' 00:20:20.636 01:14:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:20.636 01:14:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:20.636 01:14:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:20.636 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:20.636 01:14:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:20.636 01:14:35 -- common/autotest_common.sh@10 -- # set +x 00:20:20.636 [2024-11-28 01:14:35.229179] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:20.636 [2024-11-28 01:14:35.229278] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:20:20.894 [2024-11-28 01:14:35.299945] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:20.894 [2024-11-28 01:14:35.377459] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:20.894 [2024-11-28 01:14:35.377628] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:20.894 [2024-11-28 01:14:35.377651] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:20.894 [2024-11-28 01:14:35.377664] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:20.894 [2024-11-28 01:14:35.377763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:20:20.894 [2024-11-28 01:14:35.377952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:20:20.895 [2024-11-28 01:14:35.378018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:20:20.895 [2024-11-28 01:14:35.378020] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:21.828 01:14:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:21.828 01:14:36 -- common/autotest_common.sh@862 -- # return 0 00:20:21.829 01:14:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:21.829 01:14:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:21.829 01:14:36 -- common/autotest_common.sh@10 -- # set +x 00:20:21.829 01:14:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:21.829 01:14:36 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:21.829 01:14:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:21.829 01:14:36 -- common/autotest_common.sh@10 -- # set +x 00:20:21.829 [2024-11-28 01:14:36.212872] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:21.829 01:14:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:21.829 01:14:36 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:21.829 01:14:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:21.829 01:14:36 -- common/autotest_common.sh@10 -- # set +x 00:20:21.829 Malloc0 00:20:21.829 01:14:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:21.829 01:14:36 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:21.829 01:14:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:21.829 01:14:36 -- common/autotest_common.sh@10 -- # set +x 00:20:21.829 01:14:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:21.829 01:14:36 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:21.829 01:14:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:21.829 01:14:36 -- common/autotest_common.sh@10 -- # set +x 00:20:21.829 01:14:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:21.829 01:14:36 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:21.829 01:14:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:21.829 01:14:36 -- common/autotest_common.sh@10 -- # set +x 00:20:21.829 [2024-11-28 01:14:36.251393] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:21.829 01:14:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:21.829 01:14:36 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:20:21.829 01:14:36 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:20:21.829 01:14:36 -- nvmf/common.sh@520 -- # config=() 00:20:21.829 01:14:36 -- nvmf/common.sh@520 -- # local subsystem config 00:20:21.829 01:14:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:20:21.829 01:14:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:20:21.829 { 00:20:21.829 "params": { 00:20:21.829 "name": "Nvme$subsystem", 00:20:21.829 "trtype": "$TEST_TRANSPORT", 00:20:21.829 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:21.829 "adrfam": "ipv4", 00:20:21.829 "trsvcid": "$NVMF_PORT", 00:20:21.829 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:21.829 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:21.829 "hdgst": ${hdgst:-false}, 00:20:21.829 "ddgst": ${ddgst:-false} 00:20:21.829 }, 00:20:21.829 "method": "bdev_nvme_attach_controller" 00:20:21.829 } 00:20:21.829 EOF 00:20:21.829 )") 00:20:21.829 01:14:36 -- nvmf/common.sh@542 -- # cat 00:20:21.829 01:14:36 -- nvmf/common.sh@544 -- # jq . 00:20:21.829 01:14:36 -- nvmf/common.sh@545 -- # IFS=, 00:20:21.829 01:14:36 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:20:21.829 "params": { 00:20:21.829 "name": "Nvme1", 00:20:21.829 "trtype": "tcp", 00:20:21.829 "traddr": "10.0.0.2", 00:20:21.829 "adrfam": "ipv4", 00:20:21.829 "trsvcid": "4420", 00:20:21.829 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:21.829 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:21.829 "hdgst": false, 00:20:21.829 "ddgst": false 00:20:21.829 }, 00:20:21.829 "method": "bdev_nvme_attach_controller" 00:20:21.829 }' 00:20:21.829 [2024-11-28 01:14:36.296128] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:21.829 [2024-11-28 01:14:36.296195] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid2058787 ] 00:20:21.829 [2024-11-28 01:14:36.355952] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:20:22.087 [2024-11-28 01:14:36.444268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:22.087 [2024-11-28 01:14:36.444321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:22.087 [2024-11-28 01:14:36.444324] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:22.087 [2024-11-28 01:14:36.635425] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:20:22.087 [2024-11-28 01:14:36.635484] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:20:22.087 I/O targets: 00:20:22.087 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:20:22.087 00:20:22.087 00:20:22.087 CUnit - A unit testing framework for C - Version 2.1-3 00:20:22.087 http://cunit.sourceforge.net/ 00:20:22.087 00:20:22.087 00:20:22.087 Suite: bdevio tests on: Nvme1n1 00:20:22.087 Test: blockdev write read block ...passed 00:20:22.345 Test: blockdev write zeroes read block ...passed 00:20:22.345 Test: blockdev write zeroes read no split ...passed 00:20:22.345 Test: blockdev write zeroes read split ...passed 00:20:22.345 Test: blockdev write zeroes read split partial ...passed 00:20:22.345 Test: blockdev reset ...[2024-11-28 01:14:36.757500] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:20:22.345 [2024-11-28 01:14:36.757619] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x201b150 (9): Bad file descriptor 00:20:22.345 [2024-11-28 01:14:36.895331] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:20:22.345 passed 00:20:22.345 Test: blockdev write read 8 blocks ...passed 00:20:22.345 Test: blockdev write read size > 128k ...passed 00:20:22.345 Test: blockdev write read invalid size ...passed 00:20:22.603 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:20:22.603 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:20:22.603 Test: blockdev write read max offset ...passed 00:20:22.603 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:20:22.603 Test: blockdev writev readv 8 blocks ...passed 00:20:22.603 Test: blockdev writev readv 30 x 1block ...passed 00:20:22.603 Test: blockdev writev readv block ...passed 00:20:22.603 Test: blockdev writev readv size > 128k ...passed 00:20:22.603 Test: blockdev writev readv size > 128k in two iovs ...passed 00:20:22.603 Test: blockdev comparev and writev ...[2024-11-28 01:14:37.109077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:22.603 [2024-11-28 01:14:37.109114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:22.603 [2024-11-28 01:14:37.109138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:22.603 [2024-11-28 01:14:37.109155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:20:22.603 [2024-11-28 01:14:37.109531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:22.603 [2024-11-28 01:14:37.109557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:20:22.603 [2024-11-28 01:14:37.109580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:22.603 [2024-11-28 01:14:37.109596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:20:22.603 [2024-11-28 01:14:37.109967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:22.603 [2024-11-28 01:14:37.109991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:20:22.603 [2024-11-28 01:14:37.110019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:22.603 [2024-11-28 01:14:37.110035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:20:22.603 [2024-11-28 01:14:37.110386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:22.603 [2024-11-28 01:14:37.110410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:20:22.603 [2024-11-28 01:14:37.110431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:22.603 [2024-11-28 01:14:37.110447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:20:22.603 passed 00:20:22.603 Test: blockdev nvme passthru rw ...passed 00:20:22.603 Test: blockdev nvme passthru vendor specific ...[2024-11-28 01:14:37.193798] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:22.603 [2024-11-28 01:14:37.193827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:20:22.603 [2024-11-28 01:14:37.193980] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:22.603 [2024-11-28 01:14:37.194003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:20:22.603 [2024-11-28 01:14:37.194157] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:22.603 [2024-11-28 01:14:37.194181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:20:22.603 [2024-11-28 01:14:37.194328] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:22.603 [2024-11-28 01:14:37.194351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:20:22.603 passed 00:20:22.861 Test: blockdev nvme admin passthru ...passed 00:20:22.861 Test: blockdev copy ...passed 00:20:22.861 00:20:22.861 Run Summary: Type Total Ran Passed Failed Inactive 00:20:22.861 suites 1 1 n/a 0 0 00:20:22.861 tests 23 23 23 0 0 00:20:22.862 asserts 152 152 152 0 n/a 00:20:22.862 00:20:22.862 Elapsed time = 1.226 seconds 00:20:23.120 01:14:37 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:23.120 01:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:23.120 01:14:37 -- common/autotest_common.sh@10 -- # set +x 00:20:23.120 01:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:23.120 01:14:37 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:20:23.120 01:14:37 -- target/bdevio.sh@30 -- # nvmftestfini 00:20:23.120 01:14:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:23.120 01:14:37 -- nvmf/common.sh@116 -- # sync 00:20:23.120 01:14:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:23.120 01:14:37 -- nvmf/common.sh@119 -- # set +e 00:20:23.120 01:14:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:23.120 01:14:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:23.120 rmmod nvme_tcp 00:20:23.120 rmmod nvme_fabrics 00:20:23.120 rmmod nvme_keyring 00:20:23.120 01:14:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:23.120 01:14:37 -- nvmf/common.sh@123 -- # set -e 00:20:23.120 01:14:37 -- nvmf/common.sh@124 -- # return 0 00:20:23.120 01:14:37 -- nvmf/common.sh@477 -- # '[' -n 2058625 ']' 00:20:23.120 01:14:37 -- nvmf/common.sh@478 -- # killprocess 2058625 00:20:23.120 01:14:37 -- common/autotest_common.sh@936 -- # '[' -z 2058625 ']' 00:20:23.120 01:14:37 -- common/autotest_common.sh@940 -- # kill -0 2058625 00:20:23.120 01:14:37 -- common/autotest_common.sh@941 -- # uname 00:20:23.120 01:14:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:23.120 01:14:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2058625 00:20:23.120 01:14:37 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:20:23.120 01:14:37 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:20:23.120 01:14:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2058625' 00:20:23.120 killing process with pid 2058625 00:20:23.120 01:14:37 -- common/autotest_common.sh@955 -- # kill 2058625 00:20:23.120 01:14:37 -- common/autotest_common.sh@960 -- # wait 2058625 00:20:23.687 01:14:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:23.687 01:14:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:23.687 01:14:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:23.687 01:14:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:23.687 01:14:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:23.687 01:14:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:23.687 01:14:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:23.687 01:14:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:25.590 01:14:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:25.590 00:20:25.590 real 0m7.303s 00:20:25.590 user 0m13.461s 00:20:25.590 sys 0m2.674s 00:20:25.590 01:14:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:25.590 01:14:40 -- common/autotest_common.sh@10 -- # set +x 00:20:25.590 ************************************ 00:20:25.590 END TEST nvmf_bdevio_no_huge 00:20:25.590 ************************************ 00:20:25.590 01:14:40 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:25.590 01:14:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:25.590 01:14:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:25.590 01:14:40 -- common/autotest_common.sh@10 -- # set +x 00:20:25.590 ************************************ 00:20:25.590 START TEST nvmf_tls 00:20:25.590 ************************************ 00:20:25.590 01:14:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:25.590 * Looking for test storage... 00:20:25.590 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:25.590 01:14:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:25.590 01:14:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:25.590 01:14:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:25.848 01:14:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:25.848 01:14:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:25.848 01:14:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:25.848 01:14:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:25.848 01:14:40 -- scripts/common.sh@335 -- # IFS=.-: 00:20:25.848 01:14:40 -- scripts/common.sh@335 -- # read -ra ver1 00:20:25.848 01:14:40 -- scripts/common.sh@336 -- # IFS=.-: 00:20:25.848 01:14:40 -- scripts/common.sh@336 -- # read -ra ver2 00:20:25.848 01:14:40 -- scripts/common.sh@337 -- # local 'op=<' 00:20:25.848 01:14:40 -- scripts/common.sh@339 -- # ver1_l=2 00:20:25.848 01:14:40 -- scripts/common.sh@340 -- # ver2_l=1 00:20:25.848 01:14:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:25.848 01:14:40 -- scripts/common.sh@343 -- # case "$op" in 00:20:25.848 01:14:40 -- scripts/common.sh@344 -- # : 1 00:20:25.848 01:14:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:25.848 01:14:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:25.848 01:14:40 -- scripts/common.sh@364 -- # decimal 1 00:20:25.848 01:14:40 -- scripts/common.sh@352 -- # local d=1 00:20:25.848 01:14:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:25.848 01:14:40 -- scripts/common.sh@354 -- # echo 1 00:20:25.848 01:14:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:25.848 01:14:40 -- scripts/common.sh@365 -- # decimal 2 00:20:25.848 01:14:40 -- scripts/common.sh@352 -- # local d=2 00:20:25.848 01:14:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:25.848 01:14:40 -- scripts/common.sh@354 -- # echo 2 00:20:25.848 01:14:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:25.848 01:14:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:25.848 01:14:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:25.849 01:14:40 -- scripts/common.sh@367 -- # return 0 00:20:25.849 01:14:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:25.849 01:14:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:25.849 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:25.849 --rc genhtml_branch_coverage=1 00:20:25.849 --rc genhtml_function_coverage=1 00:20:25.849 --rc genhtml_legend=1 00:20:25.849 --rc geninfo_all_blocks=1 00:20:25.849 --rc geninfo_unexecuted_blocks=1 00:20:25.849 00:20:25.849 ' 00:20:25.849 01:14:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:25.849 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:25.849 --rc genhtml_branch_coverage=1 00:20:25.849 --rc genhtml_function_coverage=1 00:20:25.849 --rc genhtml_legend=1 00:20:25.849 --rc geninfo_all_blocks=1 00:20:25.849 --rc geninfo_unexecuted_blocks=1 00:20:25.849 00:20:25.849 ' 00:20:25.849 01:14:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:25.849 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:25.849 --rc genhtml_branch_coverage=1 00:20:25.849 --rc genhtml_function_coverage=1 00:20:25.849 --rc genhtml_legend=1 00:20:25.849 --rc geninfo_all_blocks=1 00:20:25.849 --rc geninfo_unexecuted_blocks=1 00:20:25.849 00:20:25.849 ' 00:20:25.849 01:14:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:25.849 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:25.849 --rc genhtml_branch_coverage=1 00:20:25.849 --rc genhtml_function_coverage=1 00:20:25.849 --rc genhtml_legend=1 00:20:25.849 --rc geninfo_all_blocks=1 00:20:25.849 --rc geninfo_unexecuted_blocks=1 00:20:25.849 00:20:25.849 ' 00:20:25.849 01:14:40 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:25.849 01:14:40 -- nvmf/common.sh@7 -- # uname -s 00:20:25.849 01:14:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:25.849 01:14:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:25.849 01:14:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:25.849 01:14:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:25.849 01:14:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:25.849 01:14:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:25.849 01:14:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:25.849 01:14:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:25.849 01:14:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:25.849 01:14:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:25.849 01:14:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:25.849 01:14:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:25.849 01:14:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:25.849 01:14:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:25.849 01:14:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:25.849 01:14:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:25.849 01:14:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:25.849 01:14:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:25.849 01:14:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:25.849 01:14:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:25.849 01:14:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:25.849 01:14:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:25.849 01:14:40 -- paths/export.sh@5 -- # export PATH 00:20:25.849 01:14:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:25.849 01:14:40 -- nvmf/common.sh@46 -- # : 0 00:20:25.849 01:14:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:25.849 01:14:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:25.849 01:14:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:25.849 01:14:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:25.849 01:14:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:25.849 01:14:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:25.849 01:14:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:25.849 01:14:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:25.849 01:14:40 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:25.849 01:14:40 -- target/tls.sh@71 -- # nvmftestinit 00:20:25.849 01:14:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:25.849 01:14:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:25.849 01:14:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:25.849 01:14:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:25.849 01:14:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:25.849 01:14:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:25.849 01:14:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:25.849 01:14:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:25.849 01:14:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:25.849 01:14:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:25.849 01:14:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:25.849 01:14:40 -- common/autotest_common.sh@10 -- # set +x 00:20:27.749 01:14:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:27.749 01:14:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:27.749 01:14:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:27.749 01:14:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:27.749 01:14:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:27.749 01:14:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:27.749 01:14:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:27.749 01:14:42 -- nvmf/common.sh@294 -- # net_devs=() 00:20:27.749 01:14:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:27.749 01:14:42 -- nvmf/common.sh@295 -- # e810=() 00:20:27.749 01:14:42 -- nvmf/common.sh@295 -- # local -ga e810 00:20:27.749 01:14:42 -- nvmf/common.sh@296 -- # x722=() 00:20:27.749 01:14:42 -- nvmf/common.sh@296 -- # local -ga x722 00:20:27.749 01:14:42 -- nvmf/common.sh@297 -- # mlx=() 00:20:27.749 01:14:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:27.749 01:14:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:27.749 01:14:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:27.749 01:14:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:27.749 01:14:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:27.749 01:14:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:27.749 01:14:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:27.749 01:14:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:27.749 01:14:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:27.749 01:14:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:27.749 01:14:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:27.749 01:14:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:27.749 01:14:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:27.749 01:14:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:27.749 01:14:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:27.749 01:14:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:27.749 01:14:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:27.749 01:14:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:27.749 01:14:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:27.749 01:14:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:27.749 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:27.749 01:14:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:27.749 01:14:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:27.749 01:14:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:27.749 01:14:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:27.749 01:14:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:27.749 01:14:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:27.749 01:14:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:27.749 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:27.749 01:14:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:27.749 01:14:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:27.749 01:14:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:27.749 01:14:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:27.749 01:14:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:27.749 01:14:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:27.749 01:14:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:27.749 01:14:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:27.749 01:14:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:27.749 01:14:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:27.749 01:14:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:27.749 01:14:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:27.749 01:14:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:27.749 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:27.749 01:14:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:27.749 01:14:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:27.749 01:14:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:27.749 01:14:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:27.749 01:14:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:27.749 01:14:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:27.749 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:27.749 01:14:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:27.749 01:14:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:27.749 01:14:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:27.749 01:14:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:27.749 01:14:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:27.749 01:14:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:27.749 01:14:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:27.749 01:14:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:27.749 01:14:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:27.749 01:14:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:27.749 01:14:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:27.749 01:14:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:27.749 01:14:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:27.750 01:14:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:27.750 01:14:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:27.750 01:14:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:27.750 01:14:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:27.750 01:14:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:27.750 01:14:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:27.750 01:14:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:27.750 01:14:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:27.750 01:14:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:27.750 01:14:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:28.008 01:14:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:28.008 01:14:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:28.008 01:14:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:28.008 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:28.008 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.316 ms 00:20:28.008 00:20:28.008 --- 10.0.0.2 ping statistics --- 00:20:28.008 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:28.008 rtt min/avg/max/mdev = 0.316/0.316/0.316/0.000 ms 00:20:28.008 01:14:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:28.008 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:28.008 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:20:28.008 00:20:28.008 --- 10.0.0.1 ping statistics --- 00:20:28.008 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:28.008 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:20:28.008 01:14:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:28.008 01:14:42 -- nvmf/common.sh@410 -- # return 0 00:20:28.008 01:14:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:28.008 01:14:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:28.008 01:14:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:28.008 01:14:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:28.008 01:14:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:28.008 01:14:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:28.008 01:14:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:28.008 01:14:42 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:20:28.008 01:14:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:28.008 01:14:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:28.008 01:14:42 -- common/autotest_common.sh@10 -- # set +x 00:20:28.008 01:14:42 -- nvmf/common.sh@469 -- # nvmfpid=2060876 00:20:28.008 01:14:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:20:28.008 01:14:42 -- nvmf/common.sh@470 -- # waitforlisten 2060876 00:20:28.008 01:14:42 -- common/autotest_common.sh@829 -- # '[' -z 2060876 ']' 00:20:28.008 01:14:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:28.008 01:14:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:28.008 01:14:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:28.008 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:28.008 01:14:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:28.008 01:14:42 -- common/autotest_common.sh@10 -- # set +x 00:20:28.008 [2024-11-28 01:14:42.473437] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:28.008 [2024-11-28 01:14:42.473541] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:28.008 EAL: No free 2048 kB hugepages reported on node 1 00:20:28.008 [2024-11-28 01:14:42.546602] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:28.266 [2024-11-28 01:14:42.639251] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:28.266 [2024-11-28 01:14:42.639423] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:28.267 [2024-11-28 01:14:42.639442] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:28.267 [2024-11-28 01:14:42.639457] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:28.267 [2024-11-28 01:14:42.639488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:28.267 01:14:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:28.267 01:14:42 -- common/autotest_common.sh@862 -- # return 0 00:20:28.267 01:14:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:28.267 01:14:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:28.267 01:14:42 -- common/autotest_common.sh@10 -- # set +x 00:20:28.267 01:14:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:28.267 01:14:42 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:20:28.267 01:14:42 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:20:28.524 true 00:20:28.524 01:14:42 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:28.524 01:14:42 -- target/tls.sh@82 -- # jq -r .tls_version 00:20:28.782 01:14:43 -- target/tls.sh@82 -- # version=0 00:20:28.782 01:14:43 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:20:28.782 01:14:43 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:29.040 01:14:43 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:29.040 01:14:43 -- target/tls.sh@90 -- # jq -r .tls_version 00:20:29.298 01:14:43 -- target/tls.sh@90 -- # version=13 00:20:29.298 01:14:43 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:20:29.298 01:14:43 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:20:29.557 01:14:43 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:29.557 01:14:43 -- target/tls.sh@98 -- # jq -r .tls_version 00:20:29.815 01:14:44 -- target/tls.sh@98 -- # version=7 00:20:29.815 01:14:44 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:20:29.815 01:14:44 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:29.815 01:14:44 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:20:30.073 01:14:44 -- target/tls.sh@105 -- # ktls=false 00:20:30.073 01:14:44 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:20:30.073 01:14:44 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:20:30.330 01:14:44 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:30.330 01:14:44 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:20:30.588 01:14:45 -- target/tls.sh@113 -- # ktls=true 00:20:30.588 01:14:45 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:20:30.588 01:14:45 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:20:30.849 01:14:45 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:30.849 01:14:45 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:20:31.106 01:14:45 -- target/tls.sh@121 -- # ktls=false 00:20:31.106 01:14:45 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:20:31.106 01:14:45 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:20:31.106 01:14:45 -- target/tls.sh@49 -- # local key hash crc 00:20:31.106 01:14:45 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:20:31.106 01:14:45 -- target/tls.sh@51 -- # hash=01 00:20:31.106 01:14:45 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:20:31.106 01:14:45 -- target/tls.sh@52 -- # gzip -1 -c 00:20:31.106 01:14:45 -- target/tls.sh@52 -- # tail -c8 00:20:31.106 01:14:45 -- target/tls.sh@52 -- # head -c 4 00:20:31.106 01:14:45 -- target/tls.sh@52 -- # crc='p$H�' 00:20:31.106 01:14:45 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:31.106 01:14:45 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:20:31.106 01:14:45 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:31.106 01:14:45 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:31.106 01:14:45 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:20:31.106 01:14:45 -- target/tls.sh@49 -- # local key hash crc 00:20:31.106 01:14:45 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:20:31.106 01:14:45 -- target/tls.sh@51 -- # hash=01 00:20:31.106 01:14:45 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:20:31.106 01:14:45 -- target/tls.sh@52 -- # gzip -1 -c 00:20:31.106 01:14:45 -- target/tls.sh@52 -- # tail -c8 00:20:31.106 01:14:45 -- target/tls.sh@52 -- # head -c 4 00:20:31.106 01:14:45 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:20:31.106 01:14:45 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:31.106 01:14:45 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:20:31.106 01:14:45 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:31.106 01:14:45 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:31.106 01:14:45 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:31.106 01:14:45 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:31.106 01:14:45 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:31.106 01:14:45 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:31.106 01:14:45 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:31.106 01:14:45 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:31.106 01:14:45 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:31.364 01:14:45 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:20:31.929 01:14:46 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:31.929 01:14:46 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:31.929 01:14:46 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:31.929 [2024-11-28 01:14:46.496993] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:31.929 01:14:46 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:32.495 01:14:46 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:32.753 [2024-11-28 01:14:47.098702] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:32.753 [2024-11-28 01:14:47.099004] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:32.753 01:14:47 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:33.011 malloc0 00:20:33.011 01:14:47 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:33.269 01:14:47 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:33.528 01:14:48 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:33.528 EAL: No free 2048 kB hugepages reported on node 1 00:20:45.724 Initializing NVMe Controllers 00:20:45.724 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:20:45.724 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:20:45.724 Initialization complete. Launching workers. 00:20:45.724 ======================================================== 00:20:45.724 Latency(us) 00:20:45.724 Device Information : IOPS MiB/s Average min max 00:20:45.724 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7761.97 30.32 8248.04 1143.87 10202.61 00:20:45.724 ======================================================== 00:20:45.724 Total : 7761.97 30.32 8248.04 1143.87 10202.61 00:20:45.724 00:20:45.724 01:14:58 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:45.724 01:14:58 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:45.724 01:14:58 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:45.724 01:14:58 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:45.724 01:14:58 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:45.724 01:14:58 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:45.724 01:14:58 -- target/tls.sh@28 -- # bdevperf_pid=2062841 00:20:45.724 01:14:58 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:45.724 01:14:58 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:45.724 01:14:58 -- target/tls.sh@31 -- # waitforlisten 2062841 /var/tmp/bdevperf.sock 00:20:45.724 01:14:58 -- common/autotest_common.sh@829 -- # '[' -z 2062841 ']' 00:20:45.724 01:14:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:45.724 01:14:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:45.724 01:14:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:45.724 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:45.724 01:14:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:45.724 01:14:58 -- common/autotest_common.sh@10 -- # set +x 00:20:45.724 [2024-11-28 01:14:58.177280] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:45.724 [2024-11-28 01:14:58.177372] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2062841 ] 00:20:45.724 EAL: No free 2048 kB hugepages reported on node 1 00:20:45.724 [2024-11-28 01:14:58.235629] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:45.724 [2024-11-28 01:14:58.317551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:45.724 01:14:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:45.724 01:14:59 -- common/autotest_common.sh@862 -- # return 0 00:20:45.724 01:14:59 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:45.724 [2024-11-28 01:14:59.409504] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:45.724 TLSTESTn1 00:20:45.724 01:14:59 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:45.724 Running I/O for 10 seconds... 00:20:55.704 00:20:55.704 Latency(us) 00:20:55.704 [2024-11-28T00:15:10.307Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:55.704 [2024-11-28T00:15:10.307Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:55.704 Verification LBA range: start 0x0 length 0x2000 00:20:55.704 TLSTESTn1 : 10.02 4334.98 16.93 0.00 0.00 29476.88 4538.97 48545.19 00:20:55.704 [2024-11-28T00:15:10.307Z] =================================================================================================================== 00:20:55.704 [2024-11-28T00:15:10.307Z] Total : 4334.98 16.93 0.00 0.00 29476.88 4538.97 48545.19 00:20:55.704 0 00:20:55.704 01:15:09 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:55.704 01:15:09 -- target/tls.sh@45 -- # killprocess 2062841 00:20:55.704 01:15:09 -- common/autotest_common.sh@936 -- # '[' -z 2062841 ']' 00:20:55.704 01:15:09 -- common/autotest_common.sh@940 -- # kill -0 2062841 00:20:55.704 01:15:09 -- common/autotest_common.sh@941 -- # uname 00:20:55.704 01:15:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:55.704 01:15:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2062841 00:20:55.704 01:15:09 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:55.704 01:15:09 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:55.704 01:15:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2062841' 00:20:55.704 killing process with pid 2062841 00:20:55.704 01:15:09 -- common/autotest_common.sh@955 -- # kill 2062841 00:20:55.704 Received shutdown signal, test time was about 10.000000 seconds 00:20:55.704 00:20:55.704 Latency(us) 00:20:55.704 [2024-11-28T00:15:10.307Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:55.704 [2024-11-28T00:15:10.307Z] =================================================================================================================== 00:20:55.704 [2024-11-28T00:15:10.307Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:55.704 01:15:09 -- common/autotest_common.sh@960 -- # wait 2062841 00:20:55.704 01:15:09 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:55.704 01:15:09 -- common/autotest_common.sh@650 -- # local es=0 00:20:55.704 01:15:09 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:55.704 01:15:09 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:55.704 01:15:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:55.704 01:15:09 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:55.704 01:15:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:55.704 01:15:09 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:55.704 01:15:09 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:55.704 01:15:09 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:55.704 01:15:09 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:55.704 01:15:09 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:20:55.704 01:15:09 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:55.704 01:15:09 -- target/tls.sh@28 -- # bdevperf_pid=2064948 00:20:55.704 01:15:09 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:55.704 01:15:09 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:55.704 01:15:09 -- target/tls.sh@31 -- # waitforlisten 2064948 /var/tmp/bdevperf.sock 00:20:55.704 01:15:09 -- common/autotest_common.sh@829 -- # '[' -z 2064948 ']' 00:20:55.704 01:15:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:55.704 01:15:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:55.704 01:15:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:55.704 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:55.704 01:15:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:55.704 01:15:09 -- common/autotest_common.sh@10 -- # set +x 00:20:55.704 [2024-11-28 01:15:09.977613] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:55.704 [2024-11-28 01:15:09.977709] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2064948 ] 00:20:55.704 EAL: No free 2048 kB hugepages reported on node 1 00:20:55.704 [2024-11-28 01:15:10.039295] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:55.704 [2024-11-28 01:15:10.122069] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:56.691 01:15:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:56.691 01:15:10 -- common/autotest_common.sh@862 -- # return 0 00:20:56.691 01:15:10 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:56.691 [2024-11-28 01:15:11.171089] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:56.691 [2024-11-28 01:15:11.178662] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:56.691 [2024-11-28 01:15:11.178819] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa07cf0 (107): Transport endpoint is not connected 00:20:56.691 [2024-11-28 01:15:11.179809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa07cf0 (9): Bad file descriptor 00:20:56.691 [2024-11-28 01:15:11.180808] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:56.691 [2024-11-28 01:15:11.180842] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:56.691 [2024-11-28 01:15:11.180856] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:56.691 request: 00:20:56.691 { 00:20:56.691 "name": "TLSTEST", 00:20:56.691 "trtype": "tcp", 00:20:56.691 "traddr": "10.0.0.2", 00:20:56.691 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:56.691 "adrfam": "ipv4", 00:20:56.691 "trsvcid": "4420", 00:20:56.691 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:56.691 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:20:56.691 "method": "bdev_nvme_attach_controller", 00:20:56.691 "req_id": 1 00:20:56.691 } 00:20:56.691 Got JSON-RPC error response 00:20:56.691 response: 00:20:56.691 { 00:20:56.691 "code": -32602, 00:20:56.691 "message": "Invalid parameters" 00:20:56.691 } 00:20:56.691 01:15:11 -- target/tls.sh@36 -- # killprocess 2064948 00:20:56.691 01:15:11 -- common/autotest_common.sh@936 -- # '[' -z 2064948 ']' 00:20:56.691 01:15:11 -- common/autotest_common.sh@940 -- # kill -0 2064948 00:20:56.691 01:15:11 -- common/autotest_common.sh@941 -- # uname 00:20:56.691 01:15:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:56.691 01:15:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2064948 00:20:56.691 01:15:11 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:56.691 01:15:11 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:56.691 01:15:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2064948' 00:20:56.691 killing process with pid 2064948 00:20:56.691 01:15:11 -- common/autotest_common.sh@955 -- # kill 2064948 00:20:56.691 Received shutdown signal, test time was about 10.000000 seconds 00:20:56.691 00:20:56.691 Latency(us) 00:20:56.691 [2024-11-28T00:15:11.294Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:56.691 [2024-11-28T00:15:11.294Z] =================================================================================================================== 00:20:56.691 [2024-11-28T00:15:11.294Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:56.691 01:15:11 -- common/autotest_common.sh@960 -- # wait 2064948 00:20:56.949 01:15:11 -- target/tls.sh@37 -- # return 1 00:20:56.949 01:15:11 -- common/autotest_common.sh@653 -- # es=1 00:20:56.949 01:15:11 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:56.949 01:15:11 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:56.949 01:15:11 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:56.949 01:15:11 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:56.949 01:15:11 -- common/autotest_common.sh@650 -- # local es=0 00:20:56.949 01:15:11 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:56.949 01:15:11 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:56.949 01:15:11 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:56.949 01:15:11 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:56.949 01:15:11 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:56.949 01:15:11 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:56.949 01:15:11 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:56.949 01:15:11 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:56.949 01:15:11 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:20:56.949 01:15:11 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:56.949 01:15:11 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:56.949 01:15:11 -- target/tls.sh@28 -- # bdevperf_pid=2065099 00:20:56.949 01:15:11 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:56.949 01:15:11 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:56.949 01:15:11 -- target/tls.sh@31 -- # waitforlisten 2065099 /var/tmp/bdevperf.sock 00:20:56.949 01:15:11 -- common/autotest_common.sh@829 -- # '[' -z 2065099 ']' 00:20:56.949 01:15:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:56.949 01:15:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:56.949 01:15:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:56.949 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:56.949 01:15:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:56.949 01:15:11 -- common/autotest_common.sh@10 -- # set +x 00:20:56.949 [2024-11-28 01:15:11.502903] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:56.949 [2024-11-28 01:15:11.502996] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2065099 ] 00:20:56.949 EAL: No free 2048 kB hugepages reported on node 1 00:20:57.208 [2024-11-28 01:15:11.561996] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:57.208 [2024-11-28 01:15:11.640931] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:58.141 01:15:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:58.141 01:15:12 -- common/autotest_common.sh@862 -- # return 0 00:20:58.141 01:15:12 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:58.399 [2024-11-28 01:15:12.780076] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:58.399 [2024-11-28 01:15:12.785233] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:58.399 [2024-11-28 01:15:12.785268] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:58.399 [2024-11-28 01:15:12.785309] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:58.399 [2024-11-28 01:15:12.785785] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf51cf0 (107): Transport endpoint is not connected 00:20:58.399 [2024-11-28 01:15:12.786772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf51cf0 (9): Bad file descriptor 00:20:58.399 [2024-11-28 01:15:12.787772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:58.399 [2024-11-28 01:15:12.787793] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:58.399 [2024-11-28 01:15:12.787808] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:58.399 request: 00:20:58.399 { 00:20:58.399 "name": "TLSTEST", 00:20:58.399 "trtype": "tcp", 00:20:58.399 "traddr": "10.0.0.2", 00:20:58.399 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:58.399 "adrfam": "ipv4", 00:20:58.399 "trsvcid": "4420", 00:20:58.399 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:58.399 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:58.399 "method": "bdev_nvme_attach_controller", 00:20:58.399 "req_id": 1 00:20:58.399 } 00:20:58.399 Got JSON-RPC error response 00:20:58.399 response: 00:20:58.399 { 00:20:58.399 "code": -32602, 00:20:58.399 "message": "Invalid parameters" 00:20:58.399 } 00:20:58.399 01:15:12 -- target/tls.sh@36 -- # killprocess 2065099 00:20:58.399 01:15:12 -- common/autotest_common.sh@936 -- # '[' -z 2065099 ']' 00:20:58.399 01:15:12 -- common/autotest_common.sh@940 -- # kill -0 2065099 00:20:58.399 01:15:12 -- common/autotest_common.sh@941 -- # uname 00:20:58.399 01:15:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:58.399 01:15:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2065099 00:20:58.399 01:15:12 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:58.399 01:15:12 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:58.399 01:15:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2065099' 00:20:58.399 killing process with pid 2065099 00:20:58.399 01:15:12 -- common/autotest_common.sh@955 -- # kill 2065099 00:20:58.399 Received shutdown signal, test time was about 10.000000 seconds 00:20:58.399 00:20:58.399 Latency(us) 00:20:58.399 [2024-11-28T00:15:13.002Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:58.399 [2024-11-28T00:15:13.002Z] =================================================================================================================== 00:20:58.399 [2024-11-28T00:15:13.002Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:58.399 01:15:12 -- common/autotest_common.sh@960 -- # wait 2065099 00:20:58.658 01:15:13 -- target/tls.sh@37 -- # return 1 00:20:58.658 01:15:13 -- common/autotest_common.sh@653 -- # es=1 00:20:58.658 01:15:13 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:58.658 01:15:13 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:58.658 01:15:13 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:58.658 01:15:13 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:58.658 01:15:13 -- common/autotest_common.sh@650 -- # local es=0 00:20:58.658 01:15:13 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:58.658 01:15:13 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:58.658 01:15:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:58.658 01:15:13 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:58.658 01:15:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:58.658 01:15:13 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:58.658 01:15:13 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:58.658 01:15:13 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:20:58.658 01:15:13 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:58.658 01:15:13 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:58.658 01:15:13 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:58.658 01:15:13 -- target/tls.sh@28 -- # bdevperf_pid=2065258 00:20:58.658 01:15:13 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:58.658 01:15:13 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:58.658 01:15:13 -- target/tls.sh@31 -- # waitforlisten 2065258 /var/tmp/bdevperf.sock 00:20:58.658 01:15:13 -- common/autotest_common.sh@829 -- # '[' -z 2065258 ']' 00:20:58.658 01:15:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:58.658 01:15:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:58.658 01:15:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:58.658 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:58.658 01:15:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:58.658 01:15:13 -- common/autotest_common.sh@10 -- # set +x 00:20:58.658 [2024-11-28 01:15:13.100055] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:58.658 [2024-11-28 01:15:13.100150] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2065258 ] 00:20:58.658 EAL: No free 2048 kB hugepages reported on node 1 00:20:58.658 [2024-11-28 01:15:13.159567] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:58.658 [2024-11-28 01:15:13.241279] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:59.592 01:15:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:59.592 01:15:14 -- common/autotest_common.sh@862 -- # return 0 00:20:59.592 01:15:14 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:59.850 [2024-11-28 01:15:14.302534] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:59.850 [2024-11-28 01:15:14.307827] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:59.850 [2024-11-28 01:15:14.307879] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:59.850 [2024-11-28 01:15:14.307935] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:59.850 [2024-11-28 01:15:14.308377] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bbcf0 (107): Transport endpoint is not connected 00:20:59.850 [2024-11-28 01:15:14.309366] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bbcf0 (9): Bad file descriptor 00:20:59.850 [2024-11-28 01:15:14.310365] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:20:59.850 [2024-11-28 01:15:14.310387] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:59.850 [2024-11-28 01:15:14.310401] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:59.850 request: 00:20:59.850 { 00:20:59.850 "name": "TLSTEST", 00:20:59.850 "trtype": "tcp", 00:20:59.850 "traddr": "10.0.0.2", 00:20:59.850 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:59.850 "adrfam": "ipv4", 00:20:59.850 "trsvcid": "4420", 00:20:59.850 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:59.850 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:59.850 "method": "bdev_nvme_attach_controller", 00:20:59.850 "req_id": 1 00:20:59.850 } 00:20:59.850 Got JSON-RPC error response 00:20:59.850 response: 00:20:59.850 { 00:20:59.850 "code": -32602, 00:20:59.850 "message": "Invalid parameters" 00:20:59.850 } 00:20:59.850 01:15:14 -- target/tls.sh@36 -- # killprocess 2065258 00:20:59.850 01:15:14 -- common/autotest_common.sh@936 -- # '[' -z 2065258 ']' 00:20:59.850 01:15:14 -- common/autotest_common.sh@940 -- # kill -0 2065258 00:20:59.850 01:15:14 -- common/autotest_common.sh@941 -- # uname 00:20:59.850 01:15:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:59.850 01:15:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2065258 00:20:59.850 01:15:14 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:59.850 01:15:14 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:59.850 01:15:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2065258' 00:20:59.850 killing process with pid 2065258 00:20:59.850 01:15:14 -- common/autotest_common.sh@955 -- # kill 2065258 00:20:59.850 Received shutdown signal, test time was about 10.000000 seconds 00:20:59.850 00:20:59.850 Latency(us) 00:20:59.850 [2024-11-28T00:15:14.453Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:59.850 [2024-11-28T00:15:14.453Z] =================================================================================================================== 00:20:59.850 [2024-11-28T00:15:14.453Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:59.850 01:15:14 -- common/autotest_common.sh@960 -- # wait 2065258 00:21:00.108 01:15:14 -- target/tls.sh@37 -- # return 1 00:21:00.108 01:15:14 -- common/autotest_common.sh@653 -- # es=1 00:21:00.108 01:15:14 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:00.108 01:15:14 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:00.108 01:15:14 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:00.108 01:15:14 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:21:00.108 01:15:14 -- common/autotest_common.sh@650 -- # local es=0 00:21:00.108 01:15:14 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:21:00.108 01:15:14 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:21:00.108 01:15:14 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:00.108 01:15:14 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:21:00.108 01:15:14 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:00.108 01:15:14 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:21:00.108 01:15:14 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:21:00.108 01:15:14 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:21:00.108 01:15:14 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:21:00.108 01:15:14 -- target/tls.sh@23 -- # psk= 00:21:00.108 01:15:14 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:00.108 01:15:14 -- target/tls.sh@28 -- # bdevperf_pid=2065524 00:21:00.108 01:15:14 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:00.108 01:15:14 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:00.108 01:15:14 -- target/tls.sh@31 -- # waitforlisten 2065524 /var/tmp/bdevperf.sock 00:21:00.108 01:15:14 -- common/autotest_common.sh@829 -- # '[' -z 2065524 ']' 00:21:00.108 01:15:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:00.108 01:15:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:00.108 01:15:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:00.108 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:00.108 01:15:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:00.108 01:15:14 -- common/autotest_common.sh@10 -- # set +x 00:21:00.108 [2024-11-28 01:15:14.633203] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:00.108 [2024-11-28 01:15:14.633295] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2065524 ] 00:21:00.108 EAL: No free 2048 kB hugepages reported on node 1 00:21:00.108 [2024-11-28 01:15:14.690796] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:00.366 [2024-11-28 01:15:14.770692] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:01.306 01:15:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:01.306 01:15:15 -- common/autotest_common.sh@862 -- # return 0 00:21:01.306 01:15:15 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:21:01.306 [2024-11-28 01:15:15.830635] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:21:01.306 [2024-11-28 01:15:15.832704] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f05720 (9): Bad file descriptor 00:21:01.306 [2024-11-28 01:15:15.833700] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:01.307 [2024-11-28 01:15:15.833723] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:21:01.307 [2024-11-28 01:15:15.833737] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:01.307 request: 00:21:01.307 { 00:21:01.307 "name": "TLSTEST", 00:21:01.307 "trtype": "tcp", 00:21:01.307 "traddr": "10.0.0.2", 00:21:01.307 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:01.307 "adrfam": "ipv4", 00:21:01.307 "trsvcid": "4420", 00:21:01.307 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:01.307 "method": "bdev_nvme_attach_controller", 00:21:01.307 "req_id": 1 00:21:01.307 } 00:21:01.307 Got JSON-RPC error response 00:21:01.307 response: 00:21:01.307 { 00:21:01.307 "code": -32602, 00:21:01.307 "message": "Invalid parameters" 00:21:01.307 } 00:21:01.307 01:15:15 -- target/tls.sh@36 -- # killprocess 2065524 00:21:01.307 01:15:15 -- common/autotest_common.sh@936 -- # '[' -z 2065524 ']' 00:21:01.307 01:15:15 -- common/autotest_common.sh@940 -- # kill -0 2065524 00:21:01.307 01:15:15 -- common/autotest_common.sh@941 -- # uname 00:21:01.307 01:15:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:01.307 01:15:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2065524 00:21:01.307 01:15:15 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:01.307 01:15:15 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:01.307 01:15:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2065524' 00:21:01.307 killing process with pid 2065524 00:21:01.307 01:15:15 -- common/autotest_common.sh@955 -- # kill 2065524 00:21:01.307 Received shutdown signal, test time was about 10.000000 seconds 00:21:01.307 00:21:01.307 Latency(us) 00:21:01.307 [2024-11-28T00:15:15.910Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:01.307 [2024-11-28T00:15:15.910Z] =================================================================================================================== 00:21:01.307 [2024-11-28T00:15:15.910Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:01.307 01:15:15 -- common/autotest_common.sh@960 -- # wait 2065524 00:21:01.565 01:15:16 -- target/tls.sh@37 -- # return 1 00:21:01.565 01:15:16 -- common/autotest_common.sh@653 -- # es=1 00:21:01.565 01:15:16 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:01.565 01:15:16 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:01.565 01:15:16 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:01.565 01:15:16 -- target/tls.sh@167 -- # killprocess 2060876 00:21:01.565 01:15:16 -- common/autotest_common.sh@936 -- # '[' -z 2060876 ']' 00:21:01.565 01:15:16 -- common/autotest_common.sh@940 -- # kill -0 2060876 00:21:01.565 01:15:16 -- common/autotest_common.sh@941 -- # uname 00:21:01.565 01:15:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:01.565 01:15:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2060876 00:21:01.565 01:15:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:01.565 01:15:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:01.565 01:15:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2060876' 00:21:01.565 killing process with pid 2060876 00:21:01.565 01:15:16 -- common/autotest_common.sh@955 -- # kill 2060876 00:21:01.565 01:15:16 -- common/autotest_common.sh@960 -- # wait 2060876 00:21:01.824 01:15:16 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:21:01.824 01:15:16 -- target/tls.sh@49 -- # local key hash crc 00:21:01.824 01:15:16 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:21:01.824 01:15:16 -- target/tls.sh@51 -- # hash=02 00:21:01.824 01:15:16 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:21:01.824 01:15:16 -- target/tls.sh@52 -- # gzip -1 -c 00:21:01.824 01:15:16 -- target/tls.sh@52 -- # tail -c8 00:21:01.824 01:15:16 -- target/tls.sh@52 -- # head -c 4 00:21:01.824 01:15:16 -- target/tls.sh@52 -- # crc='�e�'\''' 00:21:01.824 01:15:16 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:21:01.824 01:15:16 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:21:01.824 01:15:16 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:21:01.824 01:15:16 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:21:01.824 01:15:16 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:01.824 01:15:16 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:21:01.824 01:15:16 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:01.824 01:15:16 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:21:01.824 01:15:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:01.824 01:15:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:01.824 01:15:16 -- common/autotest_common.sh@10 -- # set +x 00:21:01.824 01:15:16 -- nvmf/common.sh@469 -- # nvmfpid=2065698 00:21:01.824 01:15:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:01.824 01:15:16 -- nvmf/common.sh@470 -- # waitforlisten 2065698 00:21:01.824 01:15:16 -- common/autotest_common.sh@829 -- # '[' -z 2065698 ']' 00:21:01.824 01:15:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:01.824 01:15:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:01.824 01:15:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:01.824 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:01.824 01:15:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:01.824 01:15:16 -- common/autotest_common.sh@10 -- # set +x 00:21:02.082 [2024-11-28 01:15:16.462752] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:02.082 [2024-11-28 01:15:16.462849] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:02.082 EAL: No free 2048 kB hugepages reported on node 1 00:21:02.082 [2024-11-28 01:15:16.529860] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:02.082 [2024-11-28 01:15:16.621136] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:02.082 [2024-11-28 01:15:16.621285] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:02.082 [2024-11-28 01:15:16.621308] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:02.082 [2024-11-28 01:15:16.621320] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:02.082 [2024-11-28 01:15:16.621352] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:03.016 01:15:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:03.016 01:15:17 -- common/autotest_common.sh@862 -- # return 0 00:21:03.016 01:15:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:03.016 01:15:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:03.016 01:15:17 -- common/autotest_common.sh@10 -- # set +x 00:21:03.017 01:15:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:03.017 01:15:17 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:03.017 01:15:17 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:03.017 01:15:17 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:21:03.275 [2024-11-28 01:15:17.743122] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:03.275 01:15:17 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:21:03.534 01:15:18 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:21:03.792 [2024-11-28 01:15:18.240436] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:03.792 [2024-11-28 01:15:18.240697] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:03.792 01:15:18 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:21:04.049 malloc0 00:21:04.049 01:15:18 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:21:04.307 01:15:18 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:04.563 01:15:19 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:04.563 01:15:19 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:21:04.563 01:15:19 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:21:04.563 01:15:19 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:21:04.563 01:15:19 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:21:04.563 01:15:19 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:04.563 01:15:19 -- target/tls.sh@28 -- # bdevperf_pid=2066123 00:21:04.563 01:15:19 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:04.563 01:15:19 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:04.563 01:15:19 -- target/tls.sh@31 -- # waitforlisten 2066123 /var/tmp/bdevperf.sock 00:21:04.563 01:15:19 -- common/autotest_common.sh@829 -- # '[' -z 2066123 ']' 00:21:04.563 01:15:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:04.563 01:15:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:04.563 01:15:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:04.563 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:04.563 01:15:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:04.563 01:15:19 -- common/autotest_common.sh@10 -- # set +x 00:21:04.563 [2024-11-28 01:15:19.052922] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:04.563 [2024-11-28 01:15:19.052989] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2066123 ] 00:21:04.563 EAL: No free 2048 kB hugepages reported on node 1 00:21:04.563 [2024-11-28 01:15:19.110553] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:04.821 [2024-11-28 01:15:19.194067] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:04.821 01:15:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:04.821 01:15:19 -- common/autotest_common.sh@862 -- # return 0 00:21:04.821 01:15:19 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:05.078 [2024-11-28 01:15:19.607781] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:05.335 TLSTESTn1 00:21:05.335 01:15:19 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:21:05.335 Running I/O for 10 seconds... 00:21:15.296 00:21:15.296 Latency(us) 00:21:15.296 [2024-11-28T00:15:29.899Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:15.296 [2024-11-28T00:15:29.899Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:15.296 Verification LBA range: start 0x0 length 0x2000 00:21:15.296 TLSTESTn1 : 10.02 4403.04 17.20 0.00 0.00 29033.57 6116.69 46991.74 00:21:15.296 [2024-11-28T00:15:29.899Z] =================================================================================================================== 00:21:15.296 [2024-11-28T00:15:29.899Z] Total : 4403.04 17.20 0.00 0.00 29033.57 6116.69 46991.74 00:21:15.296 0 00:21:15.296 01:15:29 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:15.296 01:15:29 -- target/tls.sh@45 -- # killprocess 2066123 00:21:15.296 01:15:29 -- common/autotest_common.sh@936 -- # '[' -z 2066123 ']' 00:21:15.296 01:15:29 -- common/autotest_common.sh@940 -- # kill -0 2066123 00:21:15.296 01:15:29 -- common/autotest_common.sh@941 -- # uname 00:21:15.296 01:15:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:15.296 01:15:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2066123 00:21:15.555 01:15:29 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:15.555 01:15:29 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:15.555 01:15:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2066123' 00:21:15.555 killing process with pid 2066123 00:21:15.555 01:15:29 -- common/autotest_common.sh@955 -- # kill 2066123 00:21:15.555 Received shutdown signal, test time was about 10.000000 seconds 00:21:15.555 00:21:15.555 Latency(us) 00:21:15.555 [2024-11-28T00:15:30.158Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:15.555 [2024-11-28T00:15:30.158Z] =================================================================================================================== 00:21:15.555 [2024-11-28T00:15:30.158Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:15.555 01:15:29 -- common/autotest_common.sh@960 -- # wait 2066123 00:21:15.555 01:15:30 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:15.555 01:15:30 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:15.555 01:15:30 -- common/autotest_common.sh@650 -- # local es=0 00:21:15.555 01:15:30 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:15.555 01:15:30 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:21:15.555 01:15:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:15.555 01:15:30 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:21:15.555 01:15:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:15.555 01:15:30 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:15.555 01:15:30 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:21:15.555 01:15:30 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:21:15.555 01:15:30 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:21:15.555 01:15:30 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:21:15.555 01:15:30 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:15.555 01:15:30 -- target/tls.sh@28 -- # bdevperf_pid=2067354 00:21:15.555 01:15:30 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:15.555 01:15:30 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:15.555 01:15:30 -- target/tls.sh@31 -- # waitforlisten 2067354 /var/tmp/bdevperf.sock 00:21:15.555 01:15:30 -- common/autotest_common.sh@829 -- # '[' -z 2067354 ']' 00:21:15.555 01:15:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:15.555 01:15:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:15.555 01:15:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:15.555 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:15.555 01:15:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:15.555 01:15:30 -- common/autotest_common.sh@10 -- # set +x 00:21:15.555 [2024-11-28 01:15:30.151477] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:15.555 [2024-11-28 01:15:30.151590] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2067354 ] 00:21:15.813 EAL: No free 2048 kB hugepages reported on node 1 00:21:15.814 [2024-11-28 01:15:30.217258] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:15.814 [2024-11-28 01:15:30.310789] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:16.747 01:15:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:16.747 01:15:31 -- common/autotest_common.sh@862 -- # return 0 00:21:16.747 01:15:31 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:17.005 [2024-11-28 01:15:31.433716] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:17.005 [2024-11-28 01:15:31.433777] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:21:17.006 request: 00:21:17.006 { 00:21:17.006 "name": "TLSTEST", 00:21:17.006 "trtype": "tcp", 00:21:17.006 "traddr": "10.0.0.2", 00:21:17.006 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:17.006 "adrfam": "ipv4", 00:21:17.006 "trsvcid": "4420", 00:21:17.006 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:17.006 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:17.006 "method": "bdev_nvme_attach_controller", 00:21:17.006 "req_id": 1 00:21:17.006 } 00:21:17.006 Got JSON-RPC error response 00:21:17.006 response: 00:21:17.006 { 00:21:17.006 "code": -22, 00:21:17.006 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:17.006 } 00:21:17.006 01:15:31 -- target/tls.sh@36 -- # killprocess 2067354 00:21:17.006 01:15:31 -- common/autotest_common.sh@936 -- # '[' -z 2067354 ']' 00:21:17.006 01:15:31 -- common/autotest_common.sh@940 -- # kill -0 2067354 00:21:17.006 01:15:31 -- common/autotest_common.sh@941 -- # uname 00:21:17.006 01:15:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:17.006 01:15:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2067354 00:21:17.006 01:15:31 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:17.006 01:15:31 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:17.006 01:15:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2067354' 00:21:17.006 killing process with pid 2067354 00:21:17.006 01:15:31 -- common/autotest_common.sh@955 -- # kill 2067354 00:21:17.006 Received shutdown signal, test time was about 10.000000 seconds 00:21:17.006 00:21:17.006 Latency(us) 00:21:17.006 [2024-11-28T00:15:31.609Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:17.006 [2024-11-28T00:15:31.609Z] =================================================================================================================== 00:21:17.006 [2024-11-28T00:15:31.609Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:17.006 01:15:31 -- common/autotest_common.sh@960 -- # wait 2067354 00:21:17.264 01:15:31 -- target/tls.sh@37 -- # return 1 00:21:17.264 01:15:31 -- common/autotest_common.sh@653 -- # es=1 00:21:17.264 01:15:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:17.264 01:15:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:17.264 01:15:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:17.264 01:15:31 -- target/tls.sh@183 -- # killprocess 2065698 00:21:17.264 01:15:31 -- common/autotest_common.sh@936 -- # '[' -z 2065698 ']' 00:21:17.264 01:15:31 -- common/autotest_common.sh@940 -- # kill -0 2065698 00:21:17.264 01:15:31 -- common/autotest_common.sh@941 -- # uname 00:21:17.264 01:15:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:17.264 01:15:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2065698 00:21:17.264 01:15:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:17.264 01:15:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:17.264 01:15:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2065698' 00:21:17.264 killing process with pid 2065698 00:21:17.264 01:15:31 -- common/autotest_common.sh@955 -- # kill 2065698 00:21:17.264 01:15:31 -- common/autotest_common.sh@960 -- # wait 2065698 00:21:17.523 01:15:31 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:21:17.523 01:15:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:17.523 01:15:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:17.523 01:15:31 -- common/autotest_common.sh@10 -- # set +x 00:21:17.523 01:15:31 -- nvmf/common.sh@469 -- # nvmfpid=2067635 00:21:17.523 01:15:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:17.523 01:15:31 -- nvmf/common.sh@470 -- # waitforlisten 2067635 00:21:17.523 01:15:31 -- common/autotest_common.sh@829 -- # '[' -z 2067635 ']' 00:21:17.523 01:15:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:17.523 01:15:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:17.523 01:15:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:17.523 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:17.523 01:15:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:17.523 01:15:31 -- common/autotest_common.sh@10 -- # set +x 00:21:17.523 [2024-11-28 01:15:32.019627] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:17.523 [2024-11-28 01:15:32.019709] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:17.523 EAL: No free 2048 kB hugepages reported on node 1 00:21:17.523 [2024-11-28 01:15:32.088079] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:17.780 [2024-11-28 01:15:32.174610] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:17.780 [2024-11-28 01:15:32.174786] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:17.780 [2024-11-28 01:15:32.174806] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:17.780 [2024-11-28 01:15:32.174822] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:17.780 [2024-11-28 01:15:32.174862] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:18.713 01:15:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:18.713 01:15:32 -- common/autotest_common.sh@862 -- # return 0 00:21:18.713 01:15:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:18.713 01:15:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:18.713 01:15:32 -- common/autotest_common.sh@10 -- # set +x 00:21:18.713 01:15:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:18.713 01:15:32 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:18.713 01:15:32 -- common/autotest_common.sh@650 -- # local es=0 00:21:18.713 01:15:32 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:18.713 01:15:32 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:21:18.713 01:15:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:18.713 01:15:32 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:21:18.713 01:15:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:18.713 01:15:32 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:18.713 01:15:32 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:18.713 01:15:32 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:21:18.713 [2024-11-28 01:15:33.280955] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:18.713 01:15:33 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:21:19.280 01:15:33 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:21:19.280 [2024-11-28 01:15:33.870599] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:19.280 [2024-11-28 01:15:33.870890] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:19.537 01:15:33 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:21:19.796 malloc0 00:21:19.796 01:15:34 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:21:20.054 01:15:34 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:20.311 [2024-11-28 01:15:34.729372] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:21:20.311 [2024-11-28 01:15:34.729412] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:21:20.311 [2024-11-28 01:15:34.729443] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:21:20.311 request: 00:21:20.311 { 00:21:20.311 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:20.311 "host": "nqn.2016-06.io.spdk:host1", 00:21:20.311 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:20.311 "method": "nvmf_subsystem_add_host", 00:21:20.311 "req_id": 1 00:21:20.311 } 00:21:20.311 Got JSON-RPC error response 00:21:20.312 response: 00:21:20.312 { 00:21:20.312 "code": -32603, 00:21:20.312 "message": "Internal error" 00:21:20.312 } 00:21:20.312 01:15:34 -- common/autotest_common.sh@653 -- # es=1 00:21:20.312 01:15:34 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:20.312 01:15:34 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:20.312 01:15:34 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:20.312 01:15:34 -- target/tls.sh@189 -- # killprocess 2067635 00:21:20.312 01:15:34 -- common/autotest_common.sh@936 -- # '[' -z 2067635 ']' 00:21:20.312 01:15:34 -- common/autotest_common.sh@940 -- # kill -0 2067635 00:21:20.312 01:15:34 -- common/autotest_common.sh@941 -- # uname 00:21:20.312 01:15:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:20.312 01:15:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2067635 00:21:20.312 01:15:34 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:20.312 01:15:34 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:20.312 01:15:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2067635' 00:21:20.312 killing process with pid 2067635 00:21:20.312 01:15:34 -- common/autotest_common.sh@955 -- # kill 2067635 00:21:20.312 01:15:34 -- common/autotest_common.sh@960 -- # wait 2067635 00:21:20.570 01:15:35 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:20.570 01:15:35 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:21:20.570 01:15:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:20.570 01:15:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:20.570 01:15:35 -- common/autotest_common.sh@10 -- # set +x 00:21:20.570 01:15:35 -- nvmf/common.sh@469 -- # nvmfpid=2068073 00:21:20.570 01:15:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:20.570 01:15:35 -- nvmf/common.sh@470 -- # waitforlisten 2068073 00:21:20.570 01:15:35 -- common/autotest_common.sh@829 -- # '[' -z 2068073 ']' 00:21:20.570 01:15:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:20.570 01:15:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:20.570 01:15:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:20.570 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:20.570 01:15:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:20.570 01:15:35 -- common/autotest_common.sh@10 -- # set +x 00:21:20.570 [2024-11-28 01:15:35.069238] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:20.570 [2024-11-28 01:15:35.069328] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:20.570 EAL: No free 2048 kB hugepages reported on node 1 00:21:20.570 [2024-11-28 01:15:35.137283] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:20.828 [2024-11-28 01:15:35.223923] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:20.828 [2024-11-28 01:15:35.224066] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:20.828 [2024-11-28 01:15:35.224084] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:20.828 [2024-11-28 01:15:35.224097] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:20.828 [2024-11-28 01:15:35.224124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:21.764 01:15:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:21.764 01:15:36 -- common/autotest_common.sh@862 -- # return 0 00:21:21.764 01:15:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:21.764 01:15:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:21.764 01:15:36 -- common/autotest_common.sh@10 -- # set +x 00:21:21.765 01:15:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:21.765 01:15:36 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:21.765 01:15:36 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:21.765 01:15:36 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:21:21.765 [2024-11-28 01:15:36.346420] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:22.022 01:15:36 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:21:22.280 01:15:36 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:21:22.539 [2024-11-28 01:15:36.948111] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:22.539 [2024-11-28 01:15:36.948380] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:22.539 01:15:36 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:21:22.797 malloc0 00:21:22.797 01:15:37 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:21:23.054 01:15:37 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:23.313 01:15:37 -- target/tls.sh@197 -- # bdevperf_pid=2068377 00:21:23.313 01:15:37 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:23.313 01:15:37 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:23.313 01:15:37 -- target/tls.sh@200 -- # waitforlisten 2068377 /var/tmp/bdevperf.sock 00:21:23.313 01:15:37 -- common/autotest_common.sh@829 -- # '[' -z 2068377 ']' 00:21:23.313 01:15:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:23.313 01:15:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:23.313 01:15:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:23.313 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:23.313 01:15:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:23.313 01:15:37 -- common/autotest_common.sh@10 -- # set +x 00:21:23.313 [2024-11-28 01:15:37.875364] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:23.313 [2024-11-28 01:15:37.875439] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2068377 ] 00:21:23.313 EAL: No free 2048 kB hugepages reported on node 1 00:21:23.571 [2024-11-28 01:15:37.935901] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:23.571 [2024-11-28 01:15:38.020776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:24.508 01:15:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:24.508 01:15:38 -- common/autotest_common.sh@862 -- # return 0 00:21:24.508 01:15:38 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:24.766 [2024-11-28 01:15:39.191110] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:24.766 TLSTESTn1 00:21:24.766 01:15:39 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:21:25.024 01:15:39 -- target/tls.sh@205 -- # tgtconf='{ 00:21:25.024 "subsystems": [ 00:21:25.024 { 00:21:25.024 "subsystem": "iobuf", 00:21:25.024 "config": [ 00:21:25.024 { 00:21:25.024 "method": "iobuf_set_options", 00:21:25.024 "params": { 00:21:25.024 "small_pool_count": 8192, 00:21:25.024 "large_pool_count": 1024, 00:21:25.024 "small_bufsize": 8192, 00:21:25.024 "large_bufsize": 135168 00:21:25.024 } 00:21:25.024 } 00:21:25.024 ] 00:21:25.024 }, 00:21:25.024 { 00:21:25.024 "subsystem": "sock", 00:21:25.024 "config": [ 00:21:25.024 { 00:21:25.024 "method": "sock_impl_set_options", 00:21:25.024 "params": { 00:21:25.024 "impl_name": "posix", 00:21:25.024 "recv_buf_size": 2097152, 00:21:25.024 "send_buf_size": 2097152, 00:21:25.024 "enable_recv_pipe": true, 00:21:25.024 "enable_quickack": false, 00:21:25.024 "enable_placement_id": 0, 00:21:25.024 "enable_zerocopy_send_server": true, 00:21:25.024 "enable_zerocopy_send_client": false, 00:21:25.024 "zerocopy_threshold": 0, 00:21:25.024 "tls_version": 0, 00:21:25.024 "enable_ktls": false 00:21:25.024 } 00:21:25.024 }, 00:21:25.024 { 00:21:25.024 "method": "sock_impl_set_options", 00:21:25.024 "params": { 00:21:25.024 "impl_name": "ssl", 00:21:25.024 "recv_buf_size": 4096, 00:21:25.024 "send_buf_size": 4096, 00:21:25.024 "enable_recv_pipe": true, 00:21:25.024 "enable_quickack": false, 00:21:25.024 "enable_placement_id": 0, 00:21:25.024 "enable_zerocopy_send_server": true, 00:21:25.024 "enable_zerocopy_send_client": false, 00:21:25.024 "zerocopy_threshold": 0, 00:21:25.024 "tls_version": 0, 00:21:25.024 "enable_ktls": false 00:21:25.024 } 00:21:25.024 } 00:21:25.024 ] 00:21:25.024 }, 00:21:25.024 { 00:21:25.024 "subsystem": "vmd", 00:21:25.024 "config": [] 00:21:25.024 }, 00:21:25.024 { 00:21:25.024 "subsystem": "accel", 00:21:25.024 "config": [ 00:21:25.024 { 00:21:25.025 "method": "accel_set_options", 00:21:25.025 "params": { 00:21:25.025 "small_cache_size": 128, 00:21:25.025 "large_cache_size": 16, 00:21:25.025 "task_count": 2048, 00:21:25.025 "sequence_count": 2048, 00:21:25.025 "buf_count": 2048 00:21:25.025 } 00:21:25.025 } 00:21:25.025 ] 00:21:25.025 }, 00:21:25.025 { 00:21:25.025 "subsystem": "bdev", 00:21:25.025 "config": [ 00:21:25.025 { 00:21:25.025 "method": "bdev_set_options", 00:21:25.025 "params": { 00:21:25.025 "bdev_io_pool_size": 65535, 00:21:25.025 "bdev_io_cache_size": 256, 00:21:25.025 "bdev_auto_examine": true, 00:21:25.025 "iobuf_small_cache_size": 128, 00:21:25.025 "iobuf_large_cache_size": 16 00:21:25.025 } 00:21:25.025 }, 00:21:25.025 { 00:21:25.025 "method": "bdev_raid_set_options", 00:21:25.025 "params": { 00:21:25.025 "process_window_size_kb": 1024 00:21:25.025 } 00:21:25.025 }, 00:21:25.025 { 00:21:25.025 "method": "bdev_iscsi_set_options", 00:21:25.025 "params": { 00:21:25.025 "timeout_sec": 30 00:21:25.025 } 00:21:25.025 }, 00:21:25.025 { 00:21:25.025 "method": "bdev_nvme_set_options", 00:21:25.025 "params": { 00:21:25.025 "action_on_timeout": "none", 00:21:25.025 "timeout_us": 0, 00:21:25.025 "timeout_admin_us": 0, 00:21:25.025 "keep_alive_timeout_ms": 10000, 00:21:25.025 "transport_retry_count": 4, 00:21:25.025 "arbitration_burst": 0, 00:21:25.025 "low_priority_weight": 0, 00:21:25.025 "medium_priority_weight": 0, 00:21:25.025 "high_priority_weight": 0, 00:21:25.025 "nvme_adminq_poll_period_us": 10000, 00:21:25.025 "nvme_ioq_poll_period_us": 0, 00:21:25.025 "io_queue_requests": 0, 00:21:25.025 "delay_cmd_submit": true, 00:21:25.025 "bdev_retry_count": 3, 00:21:25.025 "transport_ack_timeout": 0, 00:21:25.025 "ctrlr_loss_timeout_sec": 0, 00:21:25.025 "reconnect_delay_sec": 0, 00:21:25.025 "fast_io_fail_timeout_sec": 0, 00:21:25.025 "generate_uuids": false, 00:21:25.025 "transport_tos": 0, 00:21:25.025 "io_path_stat": false, 00:21:25.025 "allow_accel_sequence": false 00:21:25.025 } 00:21:25.025 }, 00:21:25.025 { 00:21:25.025 "method": "bdev_nvme_set_hotplug", 00:21:25.025 "params": { 00:21:25.025 "period_us": 100000, 00:21:25.025 "enable": false 00:21:25.025 } 00:21:25.025 }, 00:21:25.025 { 00:21:25.025 "method": "bdev_malloc_create", 00:21:25.025 "params": { 00:21:25.025 "name": "malloc0", 00:21:25.025 "num_blocks": 8192, 00:21:25.025 "block_size": 4096, 00:21:25.025 "physical_block_size": 4096, 00:21:25.025 "uuid": "f2851ea7-2bfb-45be-9215-fc1bc34dc7aa", 00:21:25.025 "optimal_io_boundary": 0 00:21:25.025 } 00:21:25.025 }, 00:21:25.025 { 00:21:25.025 "method": "bdev_wait_for_examine" 00:21:25.025 } 00:21:25.025 ] 00:21:25.025 }, 00:21:25.025 { 00:21:25.025 "subsystem": "nbd", 00:21:25.025 "config": [] 00:21:25.025 }, 00:21:25.025 { 00:21:25.025 "subsystem": "scheduler", 00:21:25.025 "config": [ 00:21:25.025 { 00:21:25.025 "method": "framework_set_scheduler", 00:21:25.025 "params": { 00:21:25.025 "name": "static" 00:21:25.025 } 00:21:25.025 } 00:21:25.025 ] 00:21:25.025 }, 00:21:25.025 { 00:21:25.025 "subsystem": "nvmf", 00:21:25.025 "config": [ 00:21:25.025 { 00:21:25.025 "method": "nvmf_set_config", 00:21:25.025 "params": { 00:21:25.025 "discovery_filter": "match_any", 00:21:25.025 "admin_cmd_passthru": { 00:21:25.025 "identify_ctrlr": false 00:21:25.025 } 00:21:25.025 } 00:21:25.025 }, 00:21:25.025 { 00:21:25.025 "method": "nvmf_set_max_subsystems", 00:21:25.025 "params": { 00:21:25.025 "max_subsystems": 1024 00:21:25.025 } 00:21:25.025 }, 00:21:25.025 { 00:21:25.025 "method": "nvmf_set_crdt", 00:21:25.025 "params": { 00:21:25.025 "crdt1": 0, 00:21:25.025 "crdt2": 0, 00:21:25.025 "crdt3": 0 00:21:25.025 } 00:21:25.025 }, 00:21:25.025 { 00:21:25.025 "method": "nvmf_create_transport", 00:21:25.025 "params": { 00:21:25.025 "trtype": "TCP", 00:21:25.025 "max_queue_depth": 128, 00:21:25.025 "max_io_qpairs_per_ctrlr": 127, 00:21:25.025 "in_capsule_data_size": 4096, 00:21:25.025 "max_io_size": 131072, 00:21:25.025 "io_unit_size": 131072, 00:21:25.025 "max_aq_depth": 128, 00:21:25.025 "num_shared_buffers": 511, 00:21:25.025 "buf_cache_size": 4294967295, 00:21:25.025 "dif_insert_or_strip": false, 00:21:25.025 "zcopy": false, 00:21:25.025 "c2h_success": false, 00:21:25.025 "sock_priority": 0, 00:21:25.025 "abort_timeout_sec": 1 00:21:25.025 } 00:21:25.025 }, 00:21:25.025 { 00:21:25.025 "method": "nvmf_create_subsystem", 00:21:25.025 "params": { 00:21:25.025 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:25.025 "allow_any_host": false, 00:21:25.025 "serial_number": "SPDK00000000000001", 00:21:25.025 "model_number": "SPDK bdev Controller", 00:21:25.025 "max_namespaces": 10, 00:21:25.025 "min_cntlid": 1, 00:21:25.025 "max_cntlid": 65519, 00:21:25.025 "ana_reporting": false 00:21:25.025 } 00:21:25.025 }, 00:21:25.025 { 00:21:25.025 "method": "nvmf_subsystem_add_host", 00:21:25.025 "params": { 00:21:25.025 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:25.025 "host": "nqn.2016-06.io.spdk:host1", 00:21:25.025 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:25.025 } 00:21:25.025 }, 00:21:25.025 { 00:21:25.025 "method": "nvmf_subsystem_add_ns", 00:21:25.025 "params": { 00:21:25.025 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:25.025 "namespace": { 00:21:25.025 "nsid": 1, 00:21:25.025 "bdev_name": "malloc0", 00:21:25.025 "nguid": "F2851EA72BFB45BE9215FC1BC34DC7AA", 00:21:25.025 "uuid": "f2851ea7-2bfb-45be-9215-fc1bc34dc7aa" 00:21:25.025 } 00:21:25.025 } 00:21:25.025 }, 00:21:25.025 { 00:21:25.025 "method": "nvmf_subsystem_add_listener", 00:21:25.025 "params": { 00:21:25.025 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:25.025 "listen_address": { 00:21:25.025 "trtype": "TCP", 00:21:25.025 "adrfam": "IPv4", 00:21:25.025 "traddr": "10.0.0.2", 00:21:25.025 "trsvcid": "4420" 00:21:25.025 }, 00:21:25.025 "secure_channel": true 00:21:25.025 } 00:21:25.025 } 00:21:25.025 ] 00:21:25.025 } 00:21:25.025 ] 00:21:25.025 }' 00:21:25.025 01:15:39 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:21:25.592 01:15:39 -- target/tls.sh@206 -- # bdevperfconf='{ 00:21:25.592 "subsystems": [ 00:21:25.592 { 00:21:25.592 "subsystem": "iobuf", 00:21:25.592 "config": [ 00:21:25.592 { 00:21:25.592 "method": "iobuf_set_options", 00:21:25.592 "params": { 00:21:25.592 "small_pool_count": 8192, 00:21:25.592 "large_pool_count": 1024, 00:21:25.592 "small_bufsize": 8192, 00:21:25.592 "large_bufsize": 135168 00:21:25.592 } 00:21:25.592 } 00:21:25.592 ] 00:21:25.592 }, 00:21:25.592 { 00:21:25.592 "subsystem": "sock", 00:21:25.592 "config": [ 00:21:25.592 { 00:21:25.592 "method": "sock_impl_set_options", 00:21:25.592 "params": { 00:21:25.592 "impl_name": "posix", 00:21:25.592 "recv_buf_size": 2097152, 00:21:25.592 "send_buf_size": 2097152, 00:21:25.592 "enable_recv_pipe": true, 00:21:25.592 "enable_quickack": false, 00:21:25.592 "enable_placement_id": 0, 00:21:25.592 "enable_zerocopy_send_server": true, 00:21:25.592 "enable_zerocopy_send_client": false, 00:21:25.592 "zerocopy_threshold": 0, 00:21:25.592 "tls_version": 0, 00:21:25.592 "enable_ktls": false 00:21:25.592 } 00:21:25.592 }, 00:21:25.592 { 00:21:25.592 "method": "sock_impl_set_options", 00:21:25.592 "params": { 00:21:25.592 "impl_name": "ssl", 00:21:25.592 "recv_buf_size": 4096, 00:21:25.592 "send_buf_size": 4096, 00:21:25.592 "enable_recv_pipe": true, 00:21:25.592 "enable_quickack": false, 00:21:25.592 "enable_placement_id": 0, 00:21:25.592 "enable_zerocopy_send_server": true, 00:21:25.592 "enable_zerocopy_send_client": false, 00:21:25.592 "zerocopy_threshold": 0, 00:21:25.592 "tls_version": 0, 00:21:25.592 "enable_ktls": false 00:21:25.592 } 00:21:25.592 } 00:21:25.592 ] 00:21:25.592 }, 00:21:25.592 { 00:21:25.592 "subsystem": "vmd", 00:21:25.593 "config": [] 00:21:25.593 }, 00:21:25.593 { 00:21:25.593 "subsystem": "accel", 00:21:25.593 "config": [ 00:21:25.593 { 00:21:25.593 "method": "accel_set_options", 00:21:25.593 "params": { 00:21:25.593 "small_cache_size": 128, 00:21:25.593 "large_cache_size": 16, 00:21:25.593 "task_count": 2048, 00:21:25.593 "sequence_count": 2048, 00:21:25.593 "buf_count": 2048 00:21:25.593 } 00:21:25.593 } 00:21:25.593 ] 00:21:25.593 }, 00:21:25.593 { 00:21:25.593 "subsystem": "bdev", 00:21:25.593 "config": [ 00:21:25.593 { 00:21:25.593 "method": "bdev_set_options", 00:21:25.593 "params": { 00:21:25.593 "bdev_io_pool_size": 65535, 00:21:25.593 "bdev_io_cache_size": 256, 00:21:25.593 "bdev_auto_examine": true, 00:21:25.593 "iobuf_small_cache_size": 128, 00:21:25.593 "iobuf_large_cache_size": 16 00:21:25.593 } 00:21:25.593 }, 00:21:25.593 { 00:21:25.593 "method": "bdev_raid_set_options", 00:21:25.593 "params": { 00:21:25.593 "process_window_size_kb": 1024 00:21:25.593 } 00:21:25.593 }, 00:21:25.593 { 00:21:25.593 "method": "bdev_iscsi_set_options", 00:21:25.593 "params": { 00:21:25.593 "timeout_sec": 30 00:21:25.593 } 00:21:25.593 }, 00:21:25.593 { 00:21:25.593 "method": "bdev_nvme_set_options", 00:21:25.593 "params": { 00:21:25.593 "action_on_timeout": "none", 00:21:25.593 "timeout_us": 0, 00:21:25.593 "timeout_admin_us": 0, 00:21:25.593 "keep_alive_timeout_ms": 10000, 00:21:25.593 "transport_retry_count": 4, 00:21:25.593 "arbitration_burst": 0, 00:21:25.593 "low_priority_weight": 0, 00:21:25.593 "medium_priority_weight": 0, 00:21:25.593 "high_priority_weight": 0, 00:21:25.593 "nvme_adminq_poll_period_us": 10000, 00:21:25.593 "nvme_ioq_poll_period_us": 0, 00:21:25.593 "io_queue_requests": 512, 00:21:25.593 "delay_cmd_submit": true, 00:21:25.593 "bdev_retry_count": 3, 00:21:25.593 "transport_ack_timeout": 0, 00:21:25.593 "ctrlr_loss_timeout_sec": 0, 00:21:25.593 "reconnect_delay_sec": 0, 00:21:25.593 "fast_io_fail_timeout_sec": 0, 00:21:25.593 "generate_uuids": false, 00:21:25.593 "transport_tos": 0, 00:21:25.593 "io_path_stat": false, 00:21:25.593 "allow_accel_sequence": false 00:21:25.593 } 00:21:25.593 }, 00:21:25.593 { 00:21:25.593 "method": "bdev_nvme_attach_controller", 00:21:25.593 "params": { 00:21:25.593 "name": "TLSTEST", 00:21:25.593 "trtype": "TCP", 00:21:25.593 "adrfam": "IPv4", 00:21:25.593 "traddr": "10.0.0.2", 00:21:25.593 "trsvcid": "4420", 00:21:25.593 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:25.593 "prchk_reftag": false, 00:21:25.593 "prchk_guard": false, 00:21:25.593 "ctrlr_loss_timeout_sec": 0, 00:21:25.593 "reconnect_delay_sec": 0, 00:21:25.593 "fast_io_fail_timeout_sec": 0, 00:21:25.593 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:25.593 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:25.593 "hdgst": false, 00:21:25.593 "ddgst": false 00:21:25.593 } 00:21:25.593 }, 00:21:25.593 { 00:21:25.593 "method": "bdev_nvme_set_hotplug", 00:21:25.593 "params": { 00:21:25.593 "period_us": 100000, 00:21:25.593 "enable": false 00:21:25.593 } 00:21:25.593 }, 00:21:25.593 { 00:21:25.593 "method": "bdev_wait_for_examine" 00:21:25.593 } 00:21:25.593 ] 00:21:25.593 }, 00:21:25.593 { 00:21:25.593 "subsystem": "nbd", 00:21:25.593 "config": [] 00:21:25.593 } 00:21:25.593 ] 00:21:25.593 }' 00:21:25.593 01:15:39 -- target/tls.sh@208 -- # killprocess 2068377 00:21:25.593 01:15:39 -- common/autotest_common.sh@936 -- # '[' -z 2068377 ']' 00:21:25.593 01:15:39 -- common/autotest_common.sh@940 -- # kill -0 2068377 00:21:25.593 01:15:39 -- common/autotest_common.sh@941 -- # uname 00:21:25.593 01:15:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:25.593 01:15:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2068377 00:21:25.593 01:15:39 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:25.593 01:15:39 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:25.593 01:15:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2068377' 00:21:25.593 killing process with pid 2068377 00:21:25.593 01:15:39 -- common/autotest_common.sh@955 -- # kill 2068377 00:21:25.593 Received shutdown signal, test time was about 10.000000 seconds 00:21:25.593 00:21:25.593 Latency(us) 00:21:25.593 [2024-11-28T00:15:40.196Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:25.593 [2024-11-28T00:15:40.196Z] =================================================================================================================== 00:21:25.593 [2024-11-28T00:15:40.196Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:25.593 01:15:39 -- common/autotest_common.sh@960 -- # wait 2068377 00:21:25.593 01:15:40 -- target/tls.sh@209 -- # killprocess 2068073 00:21:25.593 01:15:40 -- common/autotest_common.sh@936 -- # '[' -z 2068073 ']' 00:21:25.593 01:15:40 -- common/autotest_common.sh@940 -- # kill -0 2068073 00:21:25.593 01:15:40 -- common/autotest_common.sh@941 -- # uname 00:21:25.593 01:15:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:25.593 01:15:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2068073 00:21:25.853 01:15:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:25.853 01:15:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:25.853 01:15:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2068073' 00:21:25.853 killing process with pid 2068073 00:21:25.853 01:15:40 -- common/autotest_common.sh@955 -- # kill 2068073 00:21:25.853 01:15:40 -- common/autotest_common.sh@960 -- # wait 2068073 00:21:25.853 01:15:40 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:21:25.853 01:15:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:25.853 01:15:40 -- target/tls.sh@212 -- # echo '{ 00:21:25.853 "subsystems": [ 00:21:25.853 { 00:21:25.853 "subsystem": "iobuf", 00:21:25.853 "config": [ 00:21:25.853 { 00:21:25.853 "method": "iobuf_set_options", 00:21:25.853 "params": { 00:21:25.853 "small_pool_count": 8192, 00:21:25.853 "large_pool_count": 1024, 00:21:25.853 "small_bufsize": 8192, 00:21:25.853 "large_bufsize": 135168 00:21:25.853 } 00:21:25.853 } 00:21:25.853 ] 00:21:25.853 }, 00:21:25.853 { 00:21:25.853 "subsystem": "sock", 00:21:25.853 "config": [ 00:21:25.853 { 00:21:25.853 "method": "sock_impl_set_options", 00:21:25.853 "params": { 00:21:25.853 "impl_name": "posix", 00:21:25.853 "recv_buf_size": 2097152, 00:21:25.853 "send_buf_size": 2097152, 00:21:25.853 "enable_recv_pipe": true, 00:21:25.853 "enable_quickack": false, 00:21:25.853 "enable_placement_id": 0, 00:21:25.853 "enable_zerocopy_send_server": true, 00:21:25.853 "enable_zerocopy_send_client": false, 00:21:25.853 "zerocopy_threshold": 0, 00:21:25.853 "tls_version": 0, 00:21:25.853 "enable_ktls": false 00:21:25.853 } 00:21:25.853 }, 00:21:25.853 { 00:21:25.853 "method": "sock_impl_set_options", 00:21:25.853 "params": { 00:21:25.853 "impl_name": "ssl", 00:21:25.853 "recv_buf_size": 4096, 00:21:25.853 "send_buf_size": 4096, 00:21:25.853 "enable_recv_pipe": true, 00:21:25.853 "enable_quickack": false, 00:21:25.853 "enable_placement_id": 0, 00:21:25.853 "enable_zerocopy_send_server": true, 00:21:25.853 "enable_zerocopy_send_client": false, 00:21:25.853 "zerocopy_threshold": 0, 00:21:25.853 "tls_version": 0, 00:21:25.853 "enable_ktls": false 00:21:25.853 } 00:21:25.853 } 00:21:25.853 ] 00:21:25.853 }, 00:21:25.853 { 00:21:25.853 "subsystem": "vmd", 00:21:25.853 "config": [] 00:21:25.853 }, 00:21:25.853 { 00:21:25.853 "subsystem": "accel", 00:21:25.853 "config": [ 00:21:25.853 { 00:21:25.853 "method": "accel_set_options", 00:21:25.853 "params": { 00:21:25.853 "small_cache_size": 128, 00:21:25.853 "large_cache_size": 16, 00:21:25.853 "task_count": 2048, 00:21:25.853 "sequence_count": 2048, 00:21:25.853 "buf_count": 2048 00:21:25.853 } 00:21:25.853 } 00:21:25.853 ] 00:21:25.853 }, 00:21:25.853 { 00:21:25.853 "subsystem": "bdev", 00:21:25.853 "config": [ 00:21:25.853 { 00:21:25.853 "method": "bdev_set_options", 00:21:25.853 "params": { 00:21:25.853 "bdev_io_pool_size": 65535, 00:21:25.853 "bdev_io_cache_size": 256, 00:21:25.853 "bdev_auto_examine": true, 00:21:25.853 "iobuf_small_cache_size": 128, 00:21:25.853 "iobuf_large_cache_size": 16 00:21:25.853 } 00:21:25.853 }, 00:21:25.853 { 00:21:25.853 "method": "bdev_raid_set_options", 00:21:25.853 "params": { 00:21:25.853 "process_window_size_kb": 1024 00:21:25.853 } 00:21:25.853 }, 00:21:25.853 { 00:21:25.853 "method": "bdev_iscsi_set_options", 00:21:25.853 "params": { 00:21:25.853 "timeout_sec": 30 00:21:25.853 } 00:21:25.853 }, 00:21:25.853 { 00:21:25.853 "method": "bdev_nvme_set_options", 00:21:25.853 "params": { 00:21:25.853 "action_on_timeout": "none", 00:21:25.853 "timeout_us": 0, 00:21:25.853 "timeout_admin_us": 0, 00:21:25.853 "keep_alive_timeout_ms": 10000, 00:21:25.853 "transport_retry_count": 4, 00:21:25.853 "arbitration_burst": 0, 00:21:25.853 "low_priority_weight": 0, 00:21:25.853 "medium_priority_weight": 0, 00:21:25.853 "high_priority_weight": 0, 00:21:25.853 "nvme_adminq_poll_period_us": 10000, 00:21:25.853 "nvme_ioq_poll_period_us": 0, 00:21:25.853 "io_queue_requests": 0, 00:21:25.853 "delay_cmd_submit": true, 00:21:25.853 "bdev_retry_count": 3, 00:21:25.853 "transport_ack_timeout": 0, 00:21:25.853 "ctrlr_loss_timeout_sec": 0, 00:21:25.853 "reconnect_delay_sec": 0, 00:21:25.853 "fast_io_fail_timeout_sec": 0, 00:21:25.853 "generate_uuids": false, 00:21:25.853 "transport_tos": 0, 00:21:25.853 "io_path_stat": false, 00:21:25.853 "allow_accel_sequence": false 00:21:25.853 } 00:21:25.853 }, 00:21:25.853 { 00:21:25.854 "method": "bdev_nvme_set_hotplug", 00:21:25.854 "params": { 00:21:25.854 "period_us": 100000, 00:21:25.854 "enable": false 00:21:25.854 } 00:21:25.854 }, 00:21:25.854 { 00:21:25.854 "method": "bdev_malloc_create", 00:21:25.854 "params": { 00:21:25.854 "name": "malloc0", 00:21:25.854 "num_blocks": 8192, 00:21:25.854 "block_size": 4096, 00:21:25.854 "physical_block_size": 4096, 00:21:25.854 "uuid": "f2851ea7-2bfb-45be-9215-fc1bc34dc7aa", 00:21:25.854 "optimal_io_boundary": 0 00:21:25.854 } 00:21:25.854 }, 00:21:25.854 { 00:21:25.854 "method": "bdev_wait_for_examine" 00:21:25.854 } 00:21:25.854 ] 00:21:25.854 }, 00:21:25.854 { 00:21:25.854 "subsystem": "nbd", 00:21:25.854 "config": [] 00:21:25.854 }, 00:21:25.854 { 00:21:25.854 "subsystem": "scheduler", 00:21:25.854 "config": [ 00:21:25.854 { 00:21:25.854 "method": "framework_set_scheduler", 00:21:25.854 "params": { 00:21:25.854 "name": "static" 00:21:25.854 } 00:21:25.854 } 00:21:25.854 ] 00:21:25.854 }, 00:21:25.854 { 00:21:25.854 "subsystem": "nvmf", 00:21:25.854 "config": [ 00:21:25.854 { 00:21:25.854 "method": "nvmf_set_config", 00:21:25.854 "params": { 00:21:25.854 "discovery_filter": "match_any", 00:21:25.854 "admin_cmd_passthru": { 00:21:25.854 "identify_ctrlr": false 00:21:25.854 } 00:21:25.854 } 00:21:25.854 }, 00:21:25.854 { 00:21:25.854 "method": "nvmf_set_max_subsystems", 00:21:25.854 "params": { 00:21:25.854 "max_subsystems": 1024 00:21:25.854 } 00:21:25.854 }, 00:21:25.854 { 00:21:25.854 "method": "nvmf_set_crdt", 00:21:25.854 "params": { 00:21:25.854 "crdt1": 0, 00:21:25.854 "crdt2": 0, 00:21:25.854 "crdt3": 0 00:21:25.854 } 00:21:25.854 }, 00:21:25.854 { 00:21:25.854 "method": "nvmf_create_transport", 00:21:25.854 "params": { 00:21:25.854 "trtype": "TCP", 00:21:25.854 "max_queue_depth": 128, 00:21:25.854 "max_io_qpairs_per_ctrlr": 127, 00:21:25.854 "in_capsule_data_size": 4096, 00:21:25.854 "max_io_size": 131072, 00:21:25.854 "io_unit_size": 131072, 00:21:25.854 "max_aq_depth": 128, 00:21:25.854 "num_shared_buffers": 511, 00:21:25.854 "buf_cache_size": 4294967295, 00:21:25.854 "dif_insert_or_strip": false, 00:21:25.854 "zcopy": false, 00:21:25.854 "c2h_success": false, 00:21:25.854 "sock_priority": 0, 00:21:25.854 "abort_timeout_sec": 1 00:21:25.854 } 00:21:25.854 }, 00:21:25.854 { 00:21:25.854 "method": "nvmf_create_subsystem", 00:21:25.854 "params": { 00:21:25.854 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:25.854 "allow_any_host": false, 00:21:25.854 "serial_number": "SPDK00000000000001", 00:21:25.854 "model_number": "SPDK bdev Controller", 00:21:25.854 "max_namespaces": 10, 00:21:25.854 "min_cntlid": 1, 00:21:25.854 "max_cntlid": 65519, 00:21:25.854 "ana_reporting": false 00:21:25.854 } 00:21:25.854 }, 00:21:25.854 { 00:21:25.854 "method": "nvmf_subsystem_add_host", 00:21:25.854 "params": { 00:21:25.854 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:25.854 "host": "nqn.2016-06.io.spdk:host1", 00:21:25.854 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:25.854 } 00:21:25.854 }, 00:21:25.854 { 00:21:25.854 "method": "nvmf_subsystem_add_ns", 00:21:25.854 "params": { 00:21:25.854 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:25.854 "namespace": { 00:21:25.854 "nsid": 1, 00:21:25.854 "bdev_name": "malloc0", 00:21:25.854 "nguid": "F2851EA72BFB45BE9215FC1BC34DC7AA", 00:21:25.854 "uuid": "f2851ea7-2bfb-45be-9215-fc1bc34dc7aa" 00:21:25.854 } 00:21:25.854 } 00:21:25.854 }, 00:21:25.854 { 00:21:25.854 "method": "nvmf_subsystem_add_listener", 00:21:25.854 "params": { 00:21:25.854 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:25.854 "listen_address": { 00:21:25.854 "trtype": "TCP", 00:21:25.854 "adrfam": "IPv4", 00:21:25.854 "traddr": "10.0.0.2", 00:21:25.854 "trsvcid": "4420" 00:21:25.854 }, 00:21:25.854 "secure_channel": true 00:21:25.854 } 00:21:25.854 } 00:21:25.854 ] 00:21:25.854 } 00:21:25.854 ] 00:21:25.854 }' 00:21:25.854 01:15:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:25.854 01:15:40 -- common/autotest_common.sh@10 -- # set +x 00:21:25.854 01:15:40 -- nvmf/common.sh@469 -- # nvmfpid=2068795 00:21:25.854 01:15:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:21:25.854 01:15:40 -- nvmf/common.sh@470 -- # waitforlisten 2068795 00:21:25.854 01:15:40 -- common/autotest_common.sh@829 -- # '[' -z 2068795 ']' 00:21:25.854 01:15:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:26.113 01:15:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:26.113 01:15:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:26.113 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:26.113 01:15:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:26.113 01:15:40 -- common/autotest_common.sh@10 -- # set +x 00:21:26.113 [2024-11-28 01:15:40.498693] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:26.113 [2024-11-28 01:15:40.498788] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:26.113 EAL: No free 2048 kB hugepages reported on node 1 00:21:26.113 [2024-11-28 01:15:40.567047] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:26.113 [2024-11-28 01:15:40.653169] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:26.113 [2024-11-28 01:15:40.653349] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:26.113 [2024-11-28 01:15:40.653370] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:26.113 [2024-11-28 01:15:40.653385] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:26.113 [2024-11-28 01:15:40.653416] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:26.371 [2024-11-28 01:15:40.873138] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:26.371 [2024-11-28 01:15:40.905157] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:26.371 [2024-11-28 01:15:40.905423] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:26.938 01:15:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:26.938 01:15:41 -- common/autotest_common.sh@862 -- # return 0 00:21:26.938 01:15:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:26.938 01:15:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:26.938 01:15:41 -- common/autotest_common.sh@10 -- # set +x 00:21:26.938 01:15:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:26.938 01:15:41 -- target/tls.sh@216 -- # bdevperf_pid=2068937 00:21:26.938 01:15:41 -- target/tls.sh@217 -- # waitforlisten 2068937 /var/tmp/bdevperf.sock 00:21:26.938 01:15:41 -- common/autotest_common.sh@829 -- # '[' -z 2068937 ']' 00:21:26.938 01:15:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:26.938 01:15:41 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:21:26.938 01:15:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:26.938 01:15:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:26.938 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:26.938 01:15:41 -- target/tls.sh@213 -- # echo '{ 00:21:26.938 "subsystems": [ 00:21:26.938 { 00:21:26.938 "subsystem": "iobuf", 00:21:26.938 "config": [ 00:21:26.938 { 00:21:26.938 "method": "iobuf_set_options", 00:21:26.938 "params": { 00:21:26.938 "small_pool_count": 8192, 00:21:26.938 "large_pool_count": 1024, 00:21:26.938 "small_bufsize": 8192, 00:21:26.938 "large_bufsize": 135168 00:21:26.938 } 00:21:26.938 } 00:21:26.938 ] 00:21:26.938 }, 00:21:26.938 { 00:21:26.938 "subsystem": "sock", 00:21:26.938 "config": [ 00:21:26.938 { 00:21:26.938 "method": "sock_impl_set_options", 00:21:26.938 "params": { 00:21:26.938 "impl_name": "posix", 00:21:26.938 "recv_buf_size": 2097152, 00:21:26.938 "send_buf_size": 2097152, 00:21:26.938 "enable_recv_pipe": true, 00:21:26.938 "enable_quickack": false, 00:21:26.938 "enable_placement_id": 0, 00:21:26.938 "enable_zerocopy_send_server": true, 00:21:26.938 "enable_zerocopy_send_client": false, 00:21:26.938 "zerocopy_threshold": 0, 00:21:26.938 "tls_version": 0, 00:21:26.938 "enable_ktls": false 00:21:26.938 } 00:21:26.938 }, 00:21:26.938 { 00:21:26.938 "method": "sock_impl_set_options", 00:21:26.938 "params": { 00:21:26.938 "impl_name": "ssl", 00:21:26.938 "recv_buf_size": 4096, 00:21:26.938 "send_buf_size": 4096, 00:21:26.938 "enable_recv_pipe": true, 00:21:26.938 "enable_quickack": false, 00:21:26.938 "enable_placement_id": 0, 00:21:26.938 "enable_zerocopy_send_server": true, 00:21:26.938 "enable_zerocopy_send_client": false, 00:21:26.938 "zerocopy_threshold": 0, 00:21:26.938 "tls_version": 0, 00:21:26.938 "enable_ktls": false 00:21:26.938 } 00:21:26.938 } 00:21:26.938 ] 00:21:26.938 }, 00:21:26.938 { 00:21:26.938 "subsystem": "vmd", 00:21:26.938 "config": [] 00:21:26.938 }, 00:21:26.938 { 00:21:26.938 "subsystem": "accel", 00:21:26.938 "config": [ 00:21:26.938 { 00:21:26.938 "method": "accel_set_options", 00:21:26.938 "params": { 00:21:26.938 "small_cache_size": 128, 00:21:26.938 "large_cache_size": 16, 00:21:26.938 "task_count": 2048, 00:21:26.938 "sequence_count": 2048, 00:21:26.938 "buf_count": 2048 00:21:26.938 } 00:21:26.938 } 00:21:26.938 ] 00:21:26.938 }, 00:21:26.938 { 00:21:26.938 "subsystem": "bdev", 00:21:26.938 "config": [ 00:21:26.938 { 00:21:26.938 "method": "bdev_set_options", 00:21:26.938 "params": { 00:21:26.938 "bdev_io_pool_size": 65535, 00:21:26.938 "bdev_io_cache_size": 256, 00:21:26.938 "bdev_auto_examine": true, 00:21:26.938 "iobuf_small_cache_size": 128, 00:21:26.938 "iobuf_large_cache_size": 16 00:21:26.938 } 00:21:26.938 }, 00:21:26.938 { 00:21:26.938 "method": "bdev_raid_set_options", 00:21:26.939 "params": { 00:21:26.939 "process_window_size_kb": 1024 00:21:26.939 } 00:21:26.939 }, 00:21:26.939 { 00:21:26.939 "method": "bdev_iscsi_set_options", 00:21:26.939 "params": { 00:21:26.939 "timeout_sec": 30 00:21:26.939 } 00:21:26.939 }, 00:21:26.939 { 00:21:26.939 "method": "bdev_nvme_set_options", 00:21:26.939 "params": { 00:21:26.939 "action_on_timeout": "none", 00:21:26.939 "timeout_us": 0, 00:21:26.939 "timeout_admin_us": 0, 00:21:26.939 "keep_alive_timeout_ms": 10000, 00:21:26.939 "transport_retry_count": 4, 00:21:26.939 "arbitration_burst": 0, 00:21:26.939 "low_priority_weight": 0, 00:21:26.939 "medium_priority_weight": 0, 00:21:26.939 "high_priority_weight": 0, 00:21:26.939 "nvme_adminq_poll_period_us": 10000, 00:21:26.939 "nvme_ioq_poll_period_us": 0, 00:21:26.939 "io_queue_requests": 512, 00:21:26.939 "delay_cmd_submit": true, 00:21:26.939 "bdev_retry_count": 3, 00:21:26.939 "transport_ack_timeout": 0, 00:21:26.939 "ctrlr_loss_timeout_sec": 0, 00:21:26.939 "reconnect_delay_sec": 0, 00:21:26.939 "fast_io_fail_timeout_sec": 0, 00:21:26.939 "generate_uuids": false, 00:21:26.939 "transport_tos": 0, 00:21:26.939 "io_path_stat": false, 00:21:26.939 "allow_accel_sequence": false 00:21:26.939 } 00:21:26.939 }, 00:21:26.939 { 00:21:26.939 "method": "bdev_nvme_attach_controller", 00:21:26.939 "params": { 00:21:26.939 "name": "TLSTEST", 00:21:26.939 "trtype": "TCP", 00:21:26.939 "adrfam": "IPv4", 00:21:26.939 "traddr": "10.0.0.2", 00:21:26.939 "trsvcid": "4420", 00:21:26.939 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:26.939 "prchk_reftag": false, 00:21:26.939 "prchk_guard": false, 00:21:26.939 "ctrlr_loss_timeout_sec": 0, 00:21:26.939 "reconnect_delay_sec": 0, 00:21:26.939 "fast_io_fail_timeout_sec": 0, 00:21:26.939 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:26.939 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:26.939 "hdgst": false, 00:21:26.939 "ddgst": false 00:21:26.939 } 00:21:26.939 }, 00:21:26.939 { 00:21:26.939 "method": "bdev_nvme_set_hotplug", 00:21:26.939 "params": { 00:21:26.939 "period_us": 100000, 00:21:26.939 "enable": false 00:21:26.939 } 00:21:26.939 }, 00:21:26.939 { 00:21:26.939 "method": "bdev_wait_for_examine" 00:21:26.939 } 00:21:26.939 ] 00:21:26.939 }, 00:21:26.939 { 00:21:26.939 "subsystem": "nbd", 00:21:26.939 "config": [] 00:21:26.939 } 00:21:26.939 ] 00:21:26.939 }' 00:21:26.939 01:15:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:26.939 01:15:41 -- common/autotest_common.sh@10 -- # set +x 00:21:27.197 [2024-11-28 01:15:41.545764] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:27.197 [2024-11-28 01:15:41.545859] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2068937 ] 00:21:27.197 EAL: No free 2048 kB hugepages reported on node 1 00:21:27.197 [2024-11-28 01:15:41.604585] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:27.197 [2024-11-28 01:15:41.686280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:27.455 [2024-11-28 01:15:41.846254] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:28.021 01:15:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:28.021 01:15:42 -- common/autotest_common.sh@862 -- # return 0 00:21:28.021 01:15:42 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:21:28.021 Running I/O for 10 seconds... 00:21:40.312 00:21:40.312 Latency(us) 00:21:40.312 [2024-11-28T00:15:54.915Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:40.312 [2024-11-28T00:15:54.915Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:40.312 Verification LBA range: start 0x0 length 0x2000 00:21:40.312 TLSTESTn1 : 10.04 3481.77 13.60 0.00 0.00 36691.51 5048.70 74565.40 00:21:40.312 [2024-11-28T00:15:54.915Z] =================================================================================================================== 00:21:40.312 [2024-11-28T00:15:54.915Z] Total : 3481.77 13.60 0.00 0.00 36691.51 5048.70 74565.40 00:21:40.312 0 00:21:40.312 01:15:52 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:40.312 01:15:52 -- target/tls.sh@223 -- # killprocess 2068937 00:21:40.312 01:15:52 -- common/autotest_common.sh@936 -- # '[' -z 2068937 ']' 00:21:40.312 01:15:52 -- common/autotest_common.sh@940 -- # kill -0 2068937 00:21:40.312 01:15:52 -- common/autotest_common.sh@941 -- # uname 00:21:40.312 01:15:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:40.312 01:15:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2068937 00:21:40.312 01:15:52 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:40.312 01:15:52 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:40.312 01:15:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2068937' 00:21:40.312 killing process with pid 2068937 00:21:40.312 01:15:52 -- common/autotest_common.sh@955 -- # kill 2068937 00:21:40.312 Received shutdown signal, test time was about 10.000000 seconds 00:21:40.312 00:21:40.312 Latency(us) 00:21:40.312 [2024-11-28T00:15:54.915Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:40.312 [2024-11-28T00:15:54.915Z] =================================================================================================================== 00:21:40.312 [2024-11-28T00:15:54.915Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:40.312 01:15:52 -- common/autotest_common.sh@960 -- # wait 2068937 00:21:40.312 01:15:52 -- target/tls.sh@224 -- # killprocess 2068795 00:21:40.312 01:15:52 -- common/autotest_common.sh@936 -- # '[' -z 2068795 ']' 00:21:40.312 01:15:52 -- common/autotest_common.sh@940 -- # kill -0 2068795 00:21:40.312 01:15:52 -- common/autotest_common.sh@941 -- # uname 00:21:40.312 01:15:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:40.312 01:15:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2068795 00:21:40.312 01:15:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:40.312 01:15:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:40.312 01:15:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2068795' 00:21:40.312 killing process with pid 2068795 00:21:40.312 01:15:52 -- common/autotest_common.sh@955 -- # kill 2068795 00:21:40.312 01:15:52 -- common/autotest_common.sh@960 -- # wait 2068795 00:21:40.312 01:15:53 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:21:40.312 01:15:53 -- target/tls.sh@227 -- # cleanup 00:21:40.312 01:15:53 -- target/tls.sh@15 -- # process_shm --id 0 00:21:40.312 01:15:53 -- common/autotest_common.sh@806 -- # type=--id 00:21:40.312 01:15:53 -- common/autotest_common.sh@807 -- # id=0 00:21:40.312 01:15:53 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:40.312 01:15:53 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:40.312 01:15:53 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:40.312 01:15:53 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:40.312 01:15:53 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:40.312 01:15:53 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:40.312 nvmf_trace.0 00:21:40.312 01:15:53 -- common/autotest_common.sh@821 -- # return 0 00:21:40.312 01:15:53 -- target/tls.sh@16 -- # killprocess 2068937 00:21:40.312 01:15:53 -- common/autotest_common.sh@936 -- # '[' -z 2068937 ']' 00:21:40.312 01:15:53 -- common/autotest_common.sh@940 -- # kill -0 2068937 00:21:40.312 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2068937) - No such process 00:21:40.312 01:15:53 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2068937 is not found' 00:21:40.312 Process with pid 2068937 is not found 00:21:40.312 01:15:53 -- target/tls.sh@17 -- # nvmftestfini 00:21:40.312 01:15:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:40.312 01:15:53 -- nvmf/common.sh@116 -- # sync 00:21:40.312 01:15:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:40.312 01:15:53 -- nvmf/common.sh@119 -- # set +e 00:21:40.312 01:15:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:40.312 01:15:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:40.312 rmmod nvme_tcp 00:21:40.312 rmmod nvme_fabrics 00:21:40.312 rmmod nvme_keyring 00:21:40.312 01:15:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:40.312 01:15:53 -- nvmf/common.sh@123 -- # set -e 00:21:40.312 01:15:53 -- nvmf/common.sh@124 -- # return 0 00:21:40.312 01:15:53 -- nvmf/common.sh@477 -- # '[' -n 2068795 ']' 00:21:40.312 01:15:53 -- nvmf/common.sh@478 -- # killprocess 2068795 00:21:40.312 01:15:53 -- common/autotest_common.sh@936 -- # '[' -z 2068795 ']' 00:21:40.312 01:15:53 -- common/autotest_common.sh@940 -- # kill -0 2068795 00:21:40.312 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2068795) - No such process 00:21:40.312 01:15:53 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2068795 is not found' 00:21:40.312 Process with pid 2068795 is not found 00:21:40.312 01:15:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:40.312 01:15:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:40.312 01:15:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:40.312 01:15:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:40.312 01:15:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:40.312 01:15:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:40.312 01:15:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:40.313 01:15:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:40.879 01:15:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:40.879 01:15:55 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:40.879 00:21:40.879 real 1m15.268s 00:21:40.879 user 2m2.367s 00:21:40.879 sys 0m23.449s 00:21:40.879 01:15:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:40.879 01:15:55 -- common/autotest_common.sh@10 -- # set +x 00:21:40.879 ************************************ 00:21:40.879 END TEST nvmf_tls 00:21:40.879 ************************************ 00:21:40.879 01:15:55 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:40.879 01:15:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:40.879 01:15:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:40.879 01:15:55 -- common/autotest_common.sh@10 -- # set +x 00:21:40.879 ************************************ 00:21:40.879 START TEST nvmf_fips 00:21:40.879 ************************************ 00:21:40.879 01:15:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:40.879 * Looking for test storage... 00:21:41.138 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:21:41.138 01:15:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:41.138 01:15:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:41.138 01:15:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:41.138 01:15:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:41.138 01:15:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:41.138 01:15:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:41.138 01:15:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:41.138 01:15:55 -- scripts/common.sh@335 -- # IFS=.-: 00:21:41.138 01:15:55 -- scripts/common.sh@335 -- # read -ra ver1 00:21:41.138 01:15:55 -- scripts/common.sh@336 -- # IFS=.-: 00:21:41.138 01:15:55 -- scripts/common.sh@336 -- # read -ra ver2 00:21:41.138 01:15:55 -- scripts/common.sh@337 -- # local 'op=<' 00:21:41.138 01:15:55 -- scripts/common.sh@339 -- # ver1_l=2 00:21:41.138 01:15:55 -- scripts/common.sh@340 -- # ver2_l=1 00:21:41.138 01:15:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:41.138 01:15:55 -- scripts/common.sh@343 -- # case "$op" in 00:21:41.138 01:15:55 -- scripts/common.sh@344 -- # : 1 00:21:41.138 01:15:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:41.138 01:15:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:41.138 01:15:55 -- scripts/common.sh@364 -- # decimal 1 00:21:41.138 01:15:55 -- scripts/common.sh@352 -- # local d=1 00:21:41.138 01:15:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:41.138 01:15:55 -- scripts/common.sh@354 -- # echo 1 00:21:41.138 01:15:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:41.138 01:15:55 -- scripts/common.sh@365 -- # decimal 2 00:21:41.138 01:15:55 -- scripts/common.sh@352 -- # local d=2 00:21:41.138 01:15:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:41.138 01:15:55 -- scripts/common.sh@354 -- # echo 2 00:21:41.138 01:15:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:41.138 01:15:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:41.138 01:15:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:41.138 01:15:55 -- scripts/common.sh@367 -- # return 0 00:21:41.138 01:15:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:41.138 01:15:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:41.138 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:41.138 --rc genhtml_branch_coverage=1 00:21:41.138 --rc genhtml_function_coverage=1 00:21:41.138 --rc genhtml_legend=1 00:21:41.138 --rc geninfo_all_blocks=1 00:21:41.138 --rc geninfo_unexecuted_blocks=1 00:21:41.138 00:21:41.138 ' 00:21:41.138 01:15:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:41.138 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:41.138 --rc genhtml_branch_coverage=1 00:21:41.138 --rc genhtml_function_coverage=1 00:21:41.138 --rc genhtml_legend=1 00:21:41.138 --rc geninfo_all_blocks=1 00:21:41.138 --rc geninfo_unexecuted_blocks=1 00:21:41.138 00:21:41.138 ' 00:21:41.138 01:15:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:41.138 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:41.138 --rc genhtml_branch_coverage=1 00:21:41.138 --rc genhtml_function_coverage=1 00:21:41.138 --rc genhtml_legend=1 00:21:41.138 --rc geninfo_all_blocks=1 00:21:41.138 --rc geninfo_unexecuted_blocks=1 00:21:41.138 00:21:41.138 ' 00:21:41.138 01:15:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:41.138 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:41.138 --rc genhtml_branch_coverage=1 00:21:41.138 --rc genhtml_function_coverage=1 00:21:41.138 --rc genhtml_legend=1 00:21:41.138 --rc geninfo_all_blocks=1 00:21:41.138 --rc geninfo_unexecuted_blocks=1 00:21:41.138 00:21:41.138 ' 00:21:41.138 01:15:55 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:41.138 01:15:55 -- nvmf/common.sh@7 -- # uname -s 00:21:41.138 01:15:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:41.138 01:15:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:41.138 01:15:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:41.138 01:15:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:41.138 01:15:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:41.138 01:15:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:41.138 01:15:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:41.138 01:15:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:41.138 01:15:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:41.138 01:15:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:41.138 01:15:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:41.138 01:15:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:41.138 01:15:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:41.138 01:15:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:41.138 01:15:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:41.138 01:15:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:41.138 01:15:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:41.138 01:15:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:41.138 01:15:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:41.138 01:15:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:41.139 01:15:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:41.139 01:15:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:41.139 01:15:55 -- paths/export.sh@5 -- # export PATH 00:21:41.139 01:15:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:41.139 01:15:55 -- nvmf/common.sh@46 -- # : 0 00:21:41.139 01:15:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:41.139 01:15:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:41.139 01:15:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:41.139 01:15:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:41.139 01:15:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:41.139 01:15:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:41.139 01:15:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:41.139 01:15:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:41.139 01:15:55 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:41.139 01:15:55 -- fips/fips.sh@89 -- # check_openssl_version 00:21:41.139 01:15:55 -- fips/fips.sh@83 -- # local target=3.0.0 00:21:41.139 01:15:55 -- fips/fips.sh@85 -- # openssl version 00:21:41.139 01:15:55 -- fips/fips.sh@85 -- # awk '{print $2}' 00:21:41.139 01:15:55 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:21:41.139 01:15:55 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:21:41.139 01:15:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:41.139 01:15:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:41.139 01:15:55 -- scripts/common.sh@335 -- # IFS=.-: 00:21:41.139 01:15:55 -- scripts/common.sh@335 -- # read -ra ver1 00:21:41.139 01:15:55 -- scripts/common.sh@336 -- # IFS=.-: 00:21:41.139 01:15:55 -- scripts/common.sh@336 -- # read -ra ver2 00:21:41.139 01:15:55 -- scripts/common.sh@337 -- # local 'op=>=' 00:21:41.139 01:15:55 -- scripts/common.sh@339 -- # ver1_l=3 00:21:41.139 01:15:55 -- scripts/common.sh@340 -- # ver2_l=3 00:21:41.139 01:15:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:41.139 01:15:55 -- scripts/common.sh@343 -- # case "$op" in 00:21:41.139 01:15:55 -- scripts/common.sh@347 -- # : 1 00:21:41.139 01:15:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:41.139 01:15:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:41.139 01:15:55 -- scripts/common.sh@364 -- # decimal 3 00:21:41.139 01:15:55 -- scripts/common.sh@352 -- # local d=3 00:21:41.139 01:15:55 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:41.139 01:15:55 -- scripts/common.sh@354 -- # echo 3 00:21:41.139 01:15:55 -- scripts/common.sh@364 -- # ver1[v]=3 00:21:41.139 01:15:55 -- scripts/common.sh@365 -- # decimal 3 00:21:41.139 01:15:55 -- scripts/common.sh@352 -- # local d=3 00:21:41.139 01:15:55 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:41.139 01:15:55 -- scripts/common.sh@354 -- # echo 3 00:21:41.139 01:15:55 -- scripts/common.sh@365 -- # ver2[v]=3 00:21:41.139 01:15:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:41.139 01:15:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:41.139 01:15:55 -- scripts/common.sh@363 -- # (( v++ )) 00:21:41.139 01:15:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:41.139 01:15:55 -- scripts/common.sh@364 -- # decimal 1 00:21:41.139 01:15:55 -- scripts/common.sh@352 -- # local d=1 00:21:41.139 01:15:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:41.139 01:15:55 -- scripts/common.sh@354 -- # echo 1 00:21:41.139 01:15:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:41.139 01:15:55 -- scripts/common.sh@365 -- # decimal 0 00:21:41.139 01:15:55 -- scripts/common.sh@352 -- # local d=0 00:21:41.139 01:15:55 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:21:41.139 01:15:55 -- scripts/common.sh@354 -- # echo 0 00:21:41.139 01:15:55 -- scripts/common.sh@365 -- # ver2[v]=0 00:21:41.139 01:15:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:41.139 01:15:55 -- scripts/common.sh@366 -- # return 0 00:21:41.139 01:15:55 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:21:41.139 01:15:55 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:21:41.139 01:15:55 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:21:41.139 01:15:55 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:21:41.139 01:15:55 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:21:41.139 01:15:55 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:21:41.139 01:15:55 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:21:41.139 01:15:55 -- fips/fips.sh@113 -- # build_openssl_config 00:21:41.139 01:15:55 -- fips/fips.sh@37 -- # cat 00:21:41.139 01:15:55 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:21:41.139 01:15:55 -- fips/fips.sh@58 -- # cat - 00:21:41.139 01:15:55 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:21:41.139 01:15:55 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:21:41.139 01:15:55 -- fips/fips.sh@116 -- # mapfile -t providers 00:21:41.139 01:15:55 -- fips/fips.sh@116 -- # openssl list -providers 00:21:41.139 01:15:55 -- fips/fips.sh@116 -- # grep name 00:21:41.139 01:15:55 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:21:41.139 01:15:55 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:21:41.139 01:15:55 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:21:41.139 01:15:55 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:21:41.139 01:15:55 -- common/autotest_common.sh@650 -- # local es=0 00:21:41.139 01:15:55 -- fips/fips.sh@127 -- # : 00:21:41.139 01:15:55 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:21:41.139 01:15:55 -- common/autotest_common.sh@638 -- # local arg=openssl 00:21:41.139 01:15:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:41.139 01:15:55 -- common/autotest_common.sh@642 -- # type -t openssl 00:21:41.139 01:15:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:41.139 01:15:55 -- common/autotest_common.sh@644 -- # type -P openssl 00:21:41.139 01:15:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:41.139 01:15:55 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:21:41.139 01:15:55 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:21:41.139 01:15:55 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:21:41.139 Error setting digest 00:21:41.139 40728B16BF7F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:21:41.139 40728B16BF7F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:21:41.139 01:15:55 -- common/autotest_common.sh@653 -- # es=1 00:21:41.139 01:15:55 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:41.139 01:15:55 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:41.139 01:15:55 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:41.139 01:15:55 -- fips/fips.sh@130 -- # nvmftestinit 00:21:41.139 01:15:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:41.139 01:15:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:41.139 01:15:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:41.139 01:15:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:41.139 01:15:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:41.139 01:15:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:41.139 01:15:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:41.139 01:15:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:41.139 01:15:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:41.139 01:15:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:41.139 01:15:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:41.139 01:15:55 -- common/autotest_common.sh@10 -- # set +x 00:21:43.041 01:15:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:43.041 01:15:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:43.041 01:15:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:43.041 01:15:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:43.041 01:15:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:43.041 01:15:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:43.041 01:15:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:43.041 01:15:57 -- nvmf/common.sh@294 -- # net_devs=() 00:21:43.041 01:15:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:43.041 01:15:57 -- nvmf/common.sh@295 -- # e810=() 00:21:43.041 01:15:57 -- nvmf/common.sh@295 -- # local -ga e810 00:21:43.041 01:15:57 -- nvmf/common.sh@296 -- # x722=() 00:21:43.041 01:15:57 -- nvmf/common.sh@296 -- # local -ga x722 00:21:43.041 01:15:57 -- nvmf/common.sh@297 -- # mlx=() 00:21:43.041 01:15:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:43.041 01:15:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:43.041 01:15:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:43.041 01:15:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:43.041 01:15:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:43.041 01:15:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:43.041 01:15:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:43.041 01:15:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:43.041 01:15:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:43.041 01:15:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:43.041 01:15:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:43.041 01:15:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:43.041 01:15:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:43.041 01:15:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:43.041 01:15:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:43.041 01:15:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:43.041 01:15:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:43.041 01:15:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:43.041 01:15:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:43.041 01:15:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:43.041 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:43.041 01:15:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:43.041 01:15:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:43.041 01:15:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:43.041 01:15:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:43.041 01:15:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:43.041 01:15:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:43.041 01:15:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:43.041 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:43.041 01:15:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:43.041 01:15:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:43.041 01:15:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:43.041 01:15:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:43.041 01:15:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:43.041 01:15:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:43.041 01:15:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:43.041 01:15:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:43.041 01:15:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:43.041 01:15:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:43.041 01:15:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:43.041 01:15:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:43.041 01:15:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:43.041 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:43.041 01:15:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:43.041 01:15:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:43.041 01:15:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:43.041 01:15:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:43.041 01:15:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:43.041 01:15:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:43.041 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:43.041 01:15:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:43.041 01:15:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:43.041 01:15:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:43.041 01:15:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:43.041 01:15:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:43.041 01:15:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:43.041 01:15:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:43.041 01:15:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:43.041 01:15:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:43.041 01:15:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:43.041 01:15:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:43.041 01:15:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:43.041 01:15:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:43.041 01:15:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:43.041 01:15:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:43.041 01:15:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:43.041 01:15:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:43.041 01:15:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:43.041 01:15:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:43.300 01:15:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:43.300 01:15:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:43.300 01:15:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:43.300 01:15:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:43.300 01:15:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:43.300 01:15:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:43.300 01:15:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:43.300 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:43.300 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.354 ms 00:21:43.300 00:21:43.300 --- 10.0.0.2 ping statistics --- 00:21:43.300 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:43.300 rtt min/avg/max/mdev = 0.354/0.354/0.354/0.000 ms 00:21:43.300 01:15:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:43.300 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:43.300 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:21:43.300 00:21:43.300 --- 10.0.0.1 ping statistics --- 00:21:43.300 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:43.300 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:21:43.300 01:15:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:43.300 01:15:57 -- nvmf/common.sh@410 -- # return 0 00:21:43.300 01:15:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:43.300 01:15:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:43.300 01:15:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:43.300 01:15:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:43.300 01:15:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:43.300 01:15:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:43.300 01:15:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:43.300 01:15:57 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:21:43.300 01:15:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:43.300 01:15:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:43.300 01:15:57 -- common/autotest_common.sh@10 -- # set +x 00:21:43.300 01:15:57 -- nvmf/common.sh@469 -- # nvmfpid=2072293 00:21:43.300 01:15:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:43.300 01:15:57 -- nvmf/common.sh@470 -- # waitforlisten 2072293 00:21:43.300 01:15:57 -- common/autotest_common.sh@829 -- # '[' -z 2072293 ']' 00:21:43.300 01:15:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:43.300 01:15:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:43.300 01:15:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:43.300 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:43.300 01:15:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:43.300 01:15:57 -- common/autotest_common.sh@10 -- # set +x 00:21:43.300 [2024-11-28 01:15:57.813377] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:43.300 [2024-11-28 01:15:57.813444] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:43.300 EAL: No free 2048 kB hugepages reported on node 1 00:21:43.300 [2024-11-28 01:15:57.882198] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:43.559 [2024-11-28 01:15:57.970988] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:43.559 [2024-11-28 01:15:57.971130] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:43.559 [2024-11-28 01:15:57.971146] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:43.559 [2024-11-28 01:15:57.971159] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:43.559 [2024-11-28 01:15:57.971192] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:44.493 01:15:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:44.493 01:15:58 -- common/autotest_common.sh@862 -- # return 0 00:21:44.493 01:15:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:44.493 01:15:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:44.493 01:15:58 -- common/autotest_common.sh@10 -- # set +x 00:21:44.493 01:15:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:44.493 01:15:58 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:21:44.493 01:15:58 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:44.493 01:15:58 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:44.493 01:15:58 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:44.493 01:15:58 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:44.493 01:15:58 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:44.493 01:15:58 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:44.493 01:15:58 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:44.493 [2024-11-28 01:15:59.067808] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:44.493 [2024-11-28 01:15:59.083797] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:44.493 [2024-11-28 01:15:59.084045] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:44.752 malloc0 00:21:44.752 01:15:59 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:44.752 01:15:59 -- fips/fips.sh@147 -- # bdevperf_pid=2072452 00:21:44.752 01:15:59 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:44.752 01:15:59 -- fips/fips.sh@148 -- # waitforlisten 2072452 /var/tmp/bdevperf.sock 00:21:44.752 01:15:59 -- common/autotest_common.sh@829 -- # '[' -z 2072452 ']' 00:21:44.752 01:15:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:44.752 01:15:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:44.752 01:15:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:44.752 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:44.752 01:15:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:44.752 01:15:59 -- common/autotest_common.sh@10 -- # set +x 00:21:44.752 [2024-11-28 01:15:59.201733] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:44.752 [2024-11-28 01:15:59.201821] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2072452 ] 00:21:44.752 EAL: No free 2048 kB hugepages reported on node 1 00:21:44.752 [2024-11-28 01:15:59.259589] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:44.752 [2024-11-28 01:15:59.341645] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:45.686 01:16:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:45.686 01:16:00 -- common/autotest_common.sh@862 -- # return 0 00:21:45.686 01:16:00 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:45.944 [2024-11-28 01:16:00.371316] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:45.944 TLSTESTn1 00:21:45.944 01:16:00 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:46.202 Running I/O for 10 seconds... 00:21:56.171 00:21:56.171 Latency(us) 00:21:56.171 [2024-11-28T00:16:10.774Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:56.171 [2024-11-28T00:16:10.774Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:56.171 Verification LBA range: start 0x0 length 0x2000 00:21:56.171 TLSTESTn1 : 10.03 3028.20 11.83 0.00 0.00 42216.69 5242.88 75730.49 00:21:56.171 [2024-11-28T00:16:10.774Z] =================================================================================================================== 00:21:56.171 [2024-11-28T00:16:10.774Z] Total : 3028.20 11.83 0.00 0.00 42216.69 5242.88 75730.49 00:21:56.171 0 00:21:56.171 01:16:10 -- fips/fips.sh@1 -- # cleanup 00:21:56.171 01:16:10 -- fips/fips.sh@15 -- # process_shm --id 0 00:21:56.171 01:16:10 -- common/autotest_common.sh@806 -- # type=--id 00:21:56.171 01:16:10 -- common/autotest_common.sh@807 -- # id=0 00:21:56.171 01:16:10 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:56.171 01:16:10 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:56.171 01:16:10 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:56.171 01:16:10 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:56.171 01:16:10 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:56.171 01:16:10 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:56.171 nvmf_trace.0 00:21:56.171 01:16:10 -- common/autotest_common.sh@821 -- # return 0 00:21:56.171 01:16:10 -- fips/fips.sh@16 -- # killprocess 2072452 00:21:56.171 01:16:10 -- common/autotest_common.sh@936 -- # '[' -z 2072452 ']' 00:21:56.171 01:16:10 -- common/autotest_common.sh@940 -- # kill -0 2072452 00:21:56.171 01:16:10 -- common/autotest_common.sh@941 -- # uname 00:21:56.171 01:16:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:56.171 01:16:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2072452 00:21:56.171 01:16:10 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:56.171 01:16:10 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:56.171 01:16:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2072452' 00:21:56.171 killing process with pid 2072452 00:21:56.171 01:16:10 -- common/autotest_common.sh@955 -- # kill 2072452 00:21:56.171 Received shutdown signal, test time was about 10.000000 seconds 00:21:56.171 00:21:56.171 Latency(us) 00:21:56.171 [2024-11-28T00:16:10.774Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:56.171 [2024-11-28T00:16:10.774Z] =================================================================================================================== 00:21:56.171 [2024-11-28T00:16:10.774Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:56.171 01:16:10 -- common/autotest_common.sh@960 -- # wait 2072452 00:21:56.430 01:16:10 -- fips/fips.sh@17 -- # nvmftestfini 00:21:56.430 01:16:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:56.430 01:16:10 -- nvmf/common.sh@116 -- # sync 00:21:56.430 01:16:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:56.430 01:16:10 -- nvmf/common.sh@119 -- # set +e 00:21:56.430 01:16:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:56.430 01:16:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:56.430 rmmod nvme_tcp 00:21:56.430 rmmod nvme_fabrics 00:21:56.430 rmmod nvme_keyring 00:21:56.430 01:16:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:56.430 01:16:11 -- nvmf/common.sh@123 -- # set -e 00:21:56.430 01:16:11 -- nvmf/common.sh@124 -- # return 0 00:21:56.430 01:16:11 -- nvmf/common.sh@477 -- # '[' -n 2072293 ']' 00:21:56.430 01:16:11 -- nvmf/common.sh@478 -- # killprocess 2072293 00:21:56.430 01:16:11 -- common/autotest_common.sh@936 -- # '[' -z 2072293 ']' 00:21:56.430 01:16:11 -- common/autotest_common.sh@940 -- # kill -0 2072293 00:21:56.430 01:16:11 -- common/autotest_common.sh@941 -- # uname 00:21:56.430 01:16:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:56.430 01:16:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2072293 00:21:56.687 01:16:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:56.687 01:16:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:56.687 01:16:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2072293' 00:21:56.687 killing process with pid 2072293 00:21:56.687 01:16:11 -- common/autotest_common.sh@955 -- # kill 2072293 00:21:56.687 01:16:11 -- common/autotest_common.sh@960 -- # wait 2072293 00:21:56.945 01:16:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:56.945 01:16:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:56.945 01:16:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:56.945 01:16:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:56.945 01:16:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:56.945 01:16:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:56.945 01:16:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:56.945 01:16:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:58.848 01:16:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:58.848 01:16:13 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:58.848 00:21:58.848 real 0m17.927s 00:21:58.848 user 0m23.150s 00:21:58.848 sys 0m6.299s 00:21:58.848 01:16:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:58.848 01:16:13 -- common/autotest_common.sh@10 -- # set +x 00:21:58.848 ************************************ 00:21:58.848 END TEST nvmf_fips 00:21:58.848 ************************************ 00:21:58.848 01:16:13 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:21:58.848 01:16:13 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:58.848 01:16:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:58.848 01:16:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:58.848 01:16:13 -- common/autotest_common.sh@10 -- # set +x 00:21:58.848 ************************************ 00:21:58.848 START TEST nvmf_fuzz 00:21:58.849 ************************************ 00:21:58.849 01:16:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:58.849 * Looking for test storage... 00:21:58.849 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:58.849 01:16:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:58.849 01:16:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:58.849 01:16:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:59.107 01:16:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:59.107 01:16:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:59.107 01:16:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:59.107 01:16:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:59.107 01:16:13 -- scripts/common.sh@335 -- # IFS=.-: 00:21:59.107 01:16:13 -- scripts/common.sh@335 -- # read -ra ver1 00:21:59.107 01:16:13 -- scripts/common.sh@336 -- # IFS=.-: 00:21:59.107 01:16:13 -- scripts/common.sh@336 -- # read -ra ver2 00:21:59.107 01:16:13 -- scripts/common.sh@337 -- # local 'op=<' 00:21:59.107 01:16:13 -- scripts/common.sh@339 -- # ver1_l=2 00:21:59.107 01:16:13 -- scripts/common.sh@340 -- # ver2_l=1 00:21:59.107 01:16:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:59.107 01:16:13 -- scripts/common.sh@343 -- # case "$op" in 00:21:59.107 01:16:13 -- scripts/common.sh@344 -- # : 1 00:21:59.107 01:16:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:59.107 01:16:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:59.107 01:16:13 -- scripts/common.sh@364 -- # decimal 1 00:21:59.107 01:16:13 -- scripts/common.sh@352 -- # local d=1 00:21:59.107 01:16:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:59.107 01:16:13 -- scripts/common.sh@354 -- # echo 1 00:21:59.107 01:16:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:59.107 01:16:13 -- scripts/common.sh@365 -- # decimal 2 00:21:59.107 01:16:13 -- scripts/common.sh@352 -- # local d=2 00:21:59.107 01:16:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:59.107 01:16:13 -- scripts/common.sh@354 -- # echo 2 00:21:59.107 01:16:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:59.107 01:16:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:59.107 01:16:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:59.107 01:16:13 -- scripts/common.sh@367 -- # return 0 00:21:59.107 01:16:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:59.107 01:16:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:59.107 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:59.107 --rc genhtml_branch_coverage=1 00:21:59.107 --rc genhtml_function_coverage=1 00:21:59.107 --rc genhtml_legend=1 00:21:59.107 --rc geninfo_all_blocks=1 00:21:59.107 --rc geninfo_unexecuted_blocks=1 00:21:59.107 00:21:59.107 ' 00:21:59.107 01:16:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:59.107 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:59.107 --rc genhtml_branch_coverage=1 00:21:59.107 --rc genhtml_function_coverage=1 00:21:59.107 --rc genhtml_legend=1 00:21:59.107 --rc geninfo_all_blocks=1 00:21:59.107 --rc geninfo_unexecuted_blocks=1 00:21:59.107 00:21:59.107 ' 00:21:59.107 01:16:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:59.107 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:59.107 --rc genhtml_branch_coverage=1 00:21:59.107 --rc genhtml_function_coverage=1 00:21:59.107 --rc genhtml_legend=1 00:21:59.107 --rc geninfo_all_blocks=1 00:21:59.107 --rc geninfo_unexecuted_blocks=1 00:21:59.107 00:21:59.107 ' 00:21:59.107 01:16:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:59.107 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:59.107 --rc genhtml_branch_coverage=1 00:21:59.107 --rc genhtml_function_coverage=1 00:21:59.108 --rc genhtml_legend=1 00:21:59.108 --rc geninfo_all_blocks=1 00:21:59.108 --rc geninfo_unexecuted_blocks=1 00:21:59.108 00:21:59.108 ' 00:21:59.108 01:16:13 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:59.108 01:16:13 -- nvmf/common.sh@7 -- # uname -s 00:21:59.108 01:16:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:59.108 01:16:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:59.108 01:16:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:59.108 01:16:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:59.108 01:16:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:59.108 01:16:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:59.108 01:16:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:59.108 01:16:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:59.108 01:16:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:59.108 01:16:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:59.108 01:16:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:59.108 01:16:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:59.108 01:16:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:59.108 01:16:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:59.108 01:16:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:59.108 01:16:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:59.108 01:16:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:59.108 01:16:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:59.108 01:16:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:59.108 01:16:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:59.108 01:16:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:59.108 01:16:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:59.108 01:16:13 -- paths/export.sh@5 -- # export PATH 00:21:59.108 01:16:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:59.108 01:16:13 -- nvmf/common.sh@46 -- # : 0 00:21:59.108 01:16:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:59.108 01:16:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:59.108 01:16:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:59.108 01:16:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:59.108 01:16:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:59.108 01:16:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:59.108 01:16:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:59.108 01:16:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:59.108 01:16:13 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:21:59.108 01:16:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:59.108 01:16:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:59.108 01:16:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:59.108 01:16:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:59.108 01:16:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:59.108 01:16:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:59.108 01:16:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:59.108 01:16:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:59.108 01:16:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:59.108 01:16:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:59.108 01:16:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:59.108 01:16:13 -- common/autotest_common.sh@10 -- # set +x 00:22:01.010 01:16:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:01.010 01:16:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:01.010 01:16:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:01.010 01:16:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:01.010 01:16:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:01.010 01:16:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:01.010 01:16:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:01.010 01:16:15 -- nvmf/common.sh@294 -- # net_devs=() 00:22:01.010 01:16:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:01.010 01:16:15 -- nvmf/common.sh@295 -- # e810=() 00:22:01.010 01:16:15 -- nvmf/common.sh@295 -- # local -ga e810 00:22:01.010 01:16:15 -- nvmf/common.sh@296 -- # x722=() 00:22:01.010 01:16:15 -- nvmf/common.sh@296 -- # local -ga x722 00:22:01.010 01:16:15 -- nvmf/common.sh@297 -- # mlx=() 00:22:01.010 01:16:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:01.010 01:16:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:01.010 01:16:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:01.010 01:16:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:01.010 01:16:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:01.010 01:16:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:01.010 01:16:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:01.010 01:16:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:01.010 01:16:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:01.010 01:16:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:01.010 01:16:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:01.010 01:16:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:01.010 01:16:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:01.010 01:16:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:01.010 01:16:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:01.010 01:16:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:01.010 01:16:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:01.010 01:16:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:01.010 01:16:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:01.010 01:16:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:01.010 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:01.010 01:16:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:01.010 01:16:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:01.010 01:16:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:01.010 01:16:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:01.010 01:16:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:01.010 01:16:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:01.010 01:16:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:01.010 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:01.010 01:16:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:01.010 01:16:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:01.010 01:16:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:01.010 01:16:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:01.010 01:16:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:01.010 01:16:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:01.010 01:16:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:01.010 01:16:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:01.010 01:16:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:01.010 01:16:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:01.010 01:16:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:01.010 01:16:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:01.010 01:16:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:01.010 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:01.010 01:16:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:01.011 01:16:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:01.011 01:16:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:01.011 01:16:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:01.011 01:16:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:01.011 01:16:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:01.011 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:01.011 01:16:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:01.011 01:16:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:01.011 01:16:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:01.011 01:16:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:01.011 01:16:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:01.011 01:16:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:01.011 01:16:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:01.011 01:16:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:01.011 01:16:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:01.011 01:16:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:01.011 01:16:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:01.011 01:16:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:01.011 01:16:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:01.011 01:16:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:01.011 01:16:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:01.011 01:16:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:01.011 01:16:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:01.011 01:16:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:01.011 01:16:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:01.269 01:16:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:01.269 01:16:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:01.269 01:16:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:01.269 01:16:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:01.269 01:16:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:01.269 01:16:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:01.269 01:16:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:01.269 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:01.269 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.407 ms 00:22:01.269 00:22:01.269 --- 10.0.0.2 ping statistics --- 00:22:01.269 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:01.269 rtt min/avg/max/mdev = 0.407/0.407/0.407/0.000 ms 00:22:01.269 01:16:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:01.269 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:01.269 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.149 ms 00:22:01.269 00:22:01.269 --- 10.0.0.1 ping statistics --- 00:22:01.269 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:01.269 rtt min/avg/max/mdev = 0.149/0.149/0.149/0.000 ms 00:22:01.269 01:16:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:01.269 01:16:15 -- nvmf/common.sh@410 -- # return 0 00:22:01.269 01:16:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:01.269 01:16:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:01.269 01:16:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:01.269 01:16:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:01.269 01:16:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:01.269 01:16:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:01.269 01:16:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:01.269 01:16:15 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=2075883 00:22:01.269 01:16:15 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:22:01.269 01:16:15 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:22:01.269 01:16:15 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 2075883 00:22:01.269 01:16:15 -- common/autotest_common.sh@829 -- # '[' -z 2075883 ']' 00:22:01.269 01:16:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:01.269 01:16:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:01.269 01:16:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:01.269 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:01.269 01:16:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:01.269 01:16:15 -- common/autotest_common.sh@10 -- # set +x 00:22:02.204 01:16:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:02.204 01:16:16 -- common/autotest_common.sh@862 -- # return 0 00:22:02.204 01:16:16 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:02.204 01:16:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:02.204 01:16:16 -- common/autotest_common.sh@10 -- # set +x 00:22:02.204 01:16:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:02.204 01:16:16 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:22:02.204 01:16:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:02.204 01:16:16 -- common/autotest_common.sh@10 -- # set +x 00:22:02.204 Malloc0 00:22:02.204 01:16:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:02.204 01:16:16 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:02.204 01:16:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:02.204 01:16:16 -- common/autotest_common.sh@10 -- # set +x 00:22:02.204 01:16:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:02.204 01:16:16 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:02.204 01:16:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:02.204 01:16:16 -- common/autotest_common.sh@10 -- # set +x 00:22:02.204 01:16:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:02.204 01:16:16 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:02.204 01:16:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:02.204 01:16:16 -- common/autotest_common.sh@10 -- # set +x 00:22:02.463 01:16:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:02.463 01:16:16 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:22:02.463 01:16:16 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:22:34.576 Fuzzing completed. Shutting down the fuzz application 00:22:34.576 00:22:34.576 Dumping successful admin opcodes: 00:22:34.576 8, 9, 10, 24, 00:22:34.576 Dumping successful io opcodes: 00:22:34.576 0, 9, 00:22:34.576 NS: 0x200003aeff00 I/O qp, Total commands completed: 470822, total successful commands: 2715, random_seed: 3198930880 00:22:34.576 NS: 0x200003aeff00 admin qp, Total commands completed: 57968, total successful commands: 462, random_seed: 2868719424 00:22:34.576 01:16:47 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:22:34.576 Fuzzing completed. Shutting down the fuzz application 00:22:34.576 00:22:34.576 Dumping successful admin opcodes: 00:22:34.576 24, 00:22:34.576 Dumping successful io opcodes: 00:22:34.576 00:22:34.576 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 3789370936 00:22:34.576 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 3789482779 00:22:34.576 01:16:48 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:34.576 01:16:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.576 01:16:48 -- common/autotest_common.sh@10 -- # set +x 00:22:34.576 01:16:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.576 01:16:48 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:22:34.576 01:16:48 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:22:34.576 01:16:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:34.576 01:16:48 -- nvmf/common.sh@116 -- # sync 00:22:34.576 01:16:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:34.576 01:16:48 -- nvmf/common.sh@119 -- # set +e 00:22:34.576 01:16:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:34.576 01:16:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:34.576 rmmod nvme_tcp 00:22:34.576 rmmod nvme_fabrics 00:22:34.576 rmmod nvme_keyring 00:22:34.576 01:16:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:34.576 01:16:48 -- nvmf/common.sh@123 -- # set -e 00:22:34.576 01:16:48 -- nvmf/common.sh@124 -- # return 0 00:22:34.576 01:16:48 -- nvmf/common.sh@477 -- # '[' -n 2075883 ']' 00:22:34.576 01:16:48 -- nvmf/common.sh@478 -- # killprocess 2075883 00:22:34.576 01:16:48 -- common/autotest_common.sh@936 -- # '[' -z 2075883 ']' 00:22:34.576 01:16:48 -- common/autotest_common.sh@940 -- # kill -0 2075883 00:22:34.576 01:16:48 -- common/autotest_common.sh@941 -- # uname 00:22:34.576 01:16:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:34.576 01:16:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2075883 00:22:34.576 01:16:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:34.576 01:16:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:34.576 01:16:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2075883' 00:22:34.576 killing process with pid 2075883 00:22:34.576 01:16:48 -- common/autotest_common.sh@955 -- # kill 2075883 00:22:34.576 01:16:48 -- common/autotest_common.sh@960 -- # wait 2075883 00:22:34.834 01:16:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:34.834 01:16:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:34.834 01:16:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:34.834 01:16:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:34.834 01:16:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:34.834 01:16:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:34.834 01:16:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:34.834 01:16:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:36.737 01:16:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:36.737 01:16:51 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:22:36.737 00:22:36.737 real 0m37.907s 00:22:36.737 user 0m52.484s 00:22:36.737 sys 0m14.984s 00:22:36.737 01:16:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:36.737 01:16:51 -- common/autotest_common.sh@10 -- # set +x 00:22:36.737 ************************************ 00:22:36.737 END TEST nvmf_fuzz 00:22:36.737 ************************************ 00:22:36.737 01:16:51 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:36.737 01:16:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:36.737 01:16:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:36.737 01:16:51 -- common/autotest_common.sh@10 -- # set +x 00:22:36.738 ************************************ 00:22:36.738 START TEST nvmf_multiconnection 00:22:36.738 ************************************ 00:22:36.738 01:16:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:36.996 * Looking for test storage... 00:22:36.996 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:36.996 01:16:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:36.996 01:16:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:36.996 01:16:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:36.996 01:16:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:36.996 01:16:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:36.996 01:16:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:36.996 01:16:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:36.996 01:16:51 -- scripts/common.sh@335 -- # IFS=.-: 00:22:36.996 01:16:51 -- scripts/common.sh@335 -- # read -ra ver1 00:22:36.996 01:16:51 -- scripts/common.sh@336 -- # IFS=.-: 00:22:36.996 01:16:51 -- scripts/common.sh@336 -- # read -ra ver2 00:22:36.996 01:16:51 -- scripts/common.sh@337 -- # local 'op=<' 00:22:36.996 01:16:51 -- scripts/common.sh@339 -- # ver1_l=2 00:22:36.996 01:16:51 -- scripts/common.sh@340 -- # ver2_l=1 00:22:36.996 01:16:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:36.997 01:16:51 -- scripts/common.sh@343 -- # case "$op" in 00:22:36.997 01:16:51 -- scripts/common.sh@344 -- # : 1 00:22:36.997 01:16:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:36.997 01:16:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:36.997 01:16:51 -- scripts/common.sh@364 -- # decimal 1 00:22:36.997 01:16:51 -- scripts/common.sh@352 -- # local d=1 00:22:36.997 01:16:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:36.997 01:16:51 -- scripts/common.sh@354 -- # echo 1 00:22:36.997 01:16:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:36.997 01:16:51 -- scripts/common.sh@365 -- # decimal 2 00:22:36.997 01:16:51 -- scripts/common.sh@352 -- # local d=2 00:22:36.997 01:16:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:36.997 01:16:51 -- scripts/common.sh@354 -- # echo 2 00:22:36.997 01:16:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:36.997 01:16:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:36.997 01:16:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:36.997 01:16:51 -- scripts/common.sh@367 -- # return 0 00:22:36.997 01:16:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:36.997 01:16:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:36.997 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:36.997 --rc genhtml_branch_coverage=1 00:22:36.997 --rc genhtml_function_coverage=1 00:22:36.997 --rc genhtml_legend=1 00:22:36.997 --rc geninfo_all_blocks=1 00:22:36.997 --rc geninfo_unexecuted_blocks=1 00:22:36.997 00:22:36.997 ' 00:22:36.997 01:16:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:36.997 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:36.997 --rc genhtml_branch_coverage=1 00:22:36.997 --rc genhtml_function_coverage=1 00:22:36.997 --rc genhtml_legend=1 00:22:36.997 --rc geninfo_all_blocks=1 00:22:36.997 --rc geninfo_unexecuted_blocks=1 00:22:36.997 00:22:36.997 ' 00:22:36.997 01:16:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:36.997 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:36.997 --rc genhtml_branch_coverage=1 00:22:36.997 --rc genhtml_function_coverage=1 00:22:36.997 --rc genhtml_legend=1 00:22:36.997 --rc geninfo_all_blocks=1 00:22:36.997 --rc geninfo_unexecuted_blocks=1 00:22:36.997 00:22:36.997 ' 00:22:36.997 01:16:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:36.997 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:36.997 --rc genhtml_branch_coverage=1 00:22:36.997 --rc genhtml_function_coverage=1 00:22:36.997 --rc genhtml_legend=1 00:22:36.997 --rc geninfo_all_blocks=1 00:22:36.997 --rc geninfo_unexecuted_blocks=1 00:22:36.997 00:22:36.997 ' 00:22:36.997 01:16:51 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:36.997 01:16:51 -- nvmf/common.sh@7 -- # uname -s 00:22:36.997 01:16:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:36.997 01:16:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:36.997 01:16:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:36.997 01:16:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:36.997 01:16:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:36.997 01:16:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:36.997 01:16:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:36.997 01:16:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:36.997 01:16:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:36.997 01:16:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:36.997 01:16:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:36.997 01:16:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:36.997 01:16:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:36.997 01:16:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:36.997 01:16:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:36.997 01:16:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:36.997 01:16:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:36.997 01:16:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:36.997 01:16:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:36.997 01:16:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:36.997 01:16:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:36.997 01:16:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:36.997 01:16:51 -- paths/export.sh@5 -- # export PATH 00:22:36.997 01:16:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:36.997 01:16:51 -- nvmf/common.sh@46 -- # : 0 00:22:36.997 01:16:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:36.997 01:16:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:36.997 01:16:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:36.997 01:16:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:36.997 01:16:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:36.997 01:16:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:36.997 01:16:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:36.997 01:16:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:36.997 01:16:51 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:36.997 01:16:51 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:36.997 01:16:51 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:22:36.997 01:16:51 -- target/multiconnection.sh@16 -- # nvmftestinit 00:22:36.997 01:16:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:36.997 01:16:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:36.997 01:16:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:36.997 01:16:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:36.997 01:16:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:36.997 01:16:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:36.997 01:16:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:36.997 01:16:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:36.997 01:16:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:36.997 01:16:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:36.998 01:16:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:36.998 01:16:51 -- common/autotest_common.sh@10 -- # set +x 00:22:39.549 01:16:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:39.549 01:16:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:39.549 01:16:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:39.549 01:16:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:39.549 01:16:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:39.549 01:16:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:39.549 01:16:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:39.549 01:16:53 -- nvmf/common.sh@294 -- # net_devs=() 00:22:39.549 01:16:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:39.549 01:16:53 -- nvmf/common.sh@295 -- # e810=() 00:22:39.549 01:16:53 -- nvmf/common.sh@295 -- # local -ga e810 00:22:39.549 01:16:53 -- nvmf/common.sh@296 -- # x722=() 00:22:39.549 01:16:53 -- nvmf/common.sh@296 -- # local -ga x722 00:22:39.549 01:16:53 -- nvmf/common.sh@297 -- # mlx=() 00:22:39.549 01:16:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:39.549 01:16:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:39.549 01:16:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:39.549 01:16:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:39.549 01:16:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:39.549 01:16:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:39.549 01:16:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:39.549 01:16:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:39.549 01:16:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:39.549 01:16:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:39.549 01:16:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:39.549 01:16:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:39.549 01:16:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:39.549 01:16:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:39.549 01:16:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:39.549 01:16:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:39.549 01:16:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:39.549 01:16:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:39.549 01:16:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:39.549 01:16:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:39.549 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:39.549 01:16:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:39.549 01:16:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:39.549 01:16:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:39.549 01:16:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:39.549 01:16:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:39.549 01:16:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:39.549 01:16:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:39.549 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:39.549 01:16:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:39.549 01:16:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:39.549 01:16:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:39.549 01:16:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:39.549 01:16:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:39.549 01:16:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:39.549 01:16:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:39.549 01:16:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:39.549 01:16:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:39.549 01:16:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:39.549 01:16:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:39.549 01:16:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:39.550 01:16:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:39.550 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:39.550 01:16:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:39.550 01:16:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:39.550 01:16:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:39.550 01:16:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:39.550 01:16:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:39.550 01:16:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:39.550 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:39.550 01:16:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:39.550 01:16:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:39.550 01:16:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:39.550 01:16:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:39.550 01:16:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:39.550 01:16:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:39.550 01:16:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:39.550 01:16:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:39.550 01:16:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:39.550 01:16:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:39.550 01:16:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:39.550 01:16:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:39.550 01:16:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:39.550 01:16:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:39.550 01:16:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:39.550 01:16:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:39.550 01:16:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:39.550 01:16:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:39.550 01:16:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:39.550 01:16:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:39.550 01:16:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:39.550 01:16:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:39.550 01:16:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:39.550 01:16:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:39.550 01:16:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:39.550 01:16:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:39.550 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:39.550 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.355 ms 00:22:39.550 00:22:39.550 --- 10.0.0.2 ping statistics --- 00:22:39.550 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:39.550 rtt min/avg/max/mdev = 0.355/0.355/0.355/0.000 ms 00:22:39.550 01:16:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:39.550 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:39.550 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.166 ms 00:22:39.550 00:22:39.550 --- 10.0.0.1 ping statistics --- 00:22:39.550 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:39.550 rtt min/avg/max/mdev = 0.166/0.166/0.166/0.000 ms 00:22:39.550 01:16:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:39.550 01:16:53 -- nvmf/common.sh@410 -- # return 0 00:22:39.550 01:16:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:39.550 01:16:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:39.550 01:16:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:39.550 01:16:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:39.550 01:16:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:39.550 01:16:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:39.550 01:16:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:39.550 01:16:53 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:22:39.550 01:16:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:39.550 01:16:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:39.550 01:16:53 -- common/autotest_common.sh@10 -- # set +x 00:22:39.550 01:16:53 -- nvmf/common.sh@469 -- # nvmfpid=2081760 00:22:39.550 01:16:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:39.550 01:16:53 -- nvmf/common.sh@470 -- # waitforlisten 2081760 00:22:39.550 01:16:53 -- common/autotest_common.sh@829 -- # '[' -z 2081760 ']' 00:22:39.550 01:16:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:39.550 01:16:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:39.550 01:16:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:39.550 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:39.550 01:16:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:39.550 01:16:53 -- common/autotest_common.sh@10 -- # set +x 00:22:39.550 [2024-11-28 01:16:53.788556] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:39.550 [2024-11-28 01:16:53.788641] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:39.550 EAL: No free 2048 kB hugepages reported on node 1 00:22:39.550 [2024-11-28 01:16:53.858355] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:39.550 [2024-11-28 01:16:53.946039] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:39.550 [2024-11-28 01:16:53.946177] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:39.550 [2024-11-28 01:16:53.946194] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:39.550 [2024-11-28 01:16:53.946206] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:39.550 [2024-11-28 01:16:53.946255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:39.550 [2024-11-28 01:16:53.946313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:39.550 [2024-11-28 01:16:53.946379] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:39.550 [2024-11-28 01:16:53.946382] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:40.485 01:16:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:40.485 01:16:54 -- common/autotest_common.sh@862 -- # return 0 00:22:40.485 01:16:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:40.485 01:16:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:40.485 01:16:54 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 01:16:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:40.485 01:16:54 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:40.485 01:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:54 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 [2024-11-28 01:16:54.779156] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:40.485 01:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:54 -- target/multiconnection.sh@21 -- # seq 1 11 00:22:40.485 01:16:54 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.485 01:16:54 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:40.485 01:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:54 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 Malloc1 00:22:40.485 01:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:54 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:22:40.485 01:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:54 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 01:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:54 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:40.485 01:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:54 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 01:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:54 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:40.485 01:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:54 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 [2024-11-28 01:16:54.834056] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:40.485 01:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:54 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.485 01:16:54 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:22:40.485 01:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:54 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 Malloc2 00:22:40.485 01:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:54 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:22:40.485 01:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:54 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 01:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:54 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:22:40.485 01:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:54 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 01:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:54 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:40.485 01:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:54 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 01:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:54 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.485 01:16:54 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:22:40.485 01:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:54 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 Malloc3 00:22:40.485 01:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:54 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:22:40.485 01:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:54 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 01:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:54 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:22:40.485 01:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:54 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 01:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:54 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:22:40.485 01:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:54 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 01:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:54 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.485 01:16:54 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:22:40.485 01:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:54 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 Malloc4 00:22:40.485 01:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:54 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:22:40.485 01:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:54 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 01:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:54 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:22:40.485 01:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:54 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 01:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:54 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:22:40.485 01:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:54 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 01:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:54 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.485 01:16:54 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:22:40.485 01:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:54 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 Malloc5 00:22:40.485 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:22:40.485 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:22:40.485 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:22:40.485 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.485 01:16:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:22:40.485 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 Malloc6 00:22:40.485 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:22:40.485 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:22:40.485 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:22:40.485 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.485 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.485 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.485 01:16:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.486 01:16:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:22:40.486 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.486 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.744 Malloc7 00:22:40.744 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.744 01:16:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:22:40.744 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.744 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.744 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.744 01:16:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:22:40.744 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.744 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.744 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.744 01:16:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:22:40.744 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.744 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.744 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.744 01:16:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.744 01:16:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:22:40.744 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.744 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.744 Malloc8 00:22:40.744 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.744 01:16:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:22:40.744 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.744 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.744 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.744 01:16:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:22:40.744 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.744 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.744 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.744 01:16:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:22:40.744 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.744 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.744 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.744 01:16:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.744 01:16:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:22:40.744 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.744 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.744 Malloc9 00:22:40.744 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.744 01:16:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:22:40.744 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.744 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.744 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.744 01:16:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:22:40.744 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.744 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.744 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.744 01:16:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:22:40.744 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.744 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.744 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.744 01:16:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.744 01:16:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:22:40.744 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.744 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.744 Malloc10 00:22:40.744 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.744 01:16:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:22:40.744 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.744 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.744 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.744 01:16:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:22:40.744 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.744 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.744 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.744 01:16:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:22:40.744 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.744 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.744 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.744 01:16:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.744 01:16:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:22:40.744 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.744 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.744 Malloc11 00:22:40.744 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.744 01:16:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:22:40.744 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.744 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.744 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.744 01:16:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:22:40.744 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.744 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.744 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.744 01:16:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:22:40.744 01:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.744 01:16:55 -- common/autotest_common.sh@10 -- # set +x 00:22:40.744 01:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.744 01:16:55 -- target/multiconnection.sh@28 -- # seq 1 11 00:22:40.744 01:16:55 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.744 01:16:55 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:22:41.677 01:16:55 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:22:41.677 01:16:55 -- common/autotest_common.sh@1187 -- # local i=0 00:22:41.677 01:16:55 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:41.677 01:16:55 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:41.677 01:16:55 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:43.576 01:16:57 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:43.576 01:16:57 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:43.576 01:16:57 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:22:43.576 01:16:57 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:43.576 01:16:57 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:43.576 01:16:57 -- common/autotest_common.sh@1197 -- # return 0 00:22:43.576 01:16:57 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:43.576 01:16:57 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:22:44.142 01:16:58 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:22:44.142 01:16:58 -- common/autotest_common.sh@1187 -- # local i=0 00:22:44.142 01:16:58 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:44.142 01:16:58 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:44.142 01:16:58 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:46.040 01:17:00 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:46.040 01:17:00 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:46.040 01:17:00 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:22:46.040 01:17:00 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:46.040 01:17:00 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:46.040 01:17:00 -- common/autotest_common.sh@1197 -- # return 0 00:22:46.040 01:17:00 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:46.040 01:17:00 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:22:46.974 01:17:01 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:22:46.974 01:17:01 -- common/autotest_common.sh@1187 -- # local i=0 00:22:46.974 01:17:01 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:46.974 01:17:01 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:46.974 01:17:01 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:48.937 01:17:03 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:48.937 01:17:03 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:48.937 01:17:03 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:22:48.937 01:17:03 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:48.937 01:17:03 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:48.937 01:17:03 -- common/autotest_common.sh@1197 -- # return 0 00:22:48.937 01:17:03 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:48.937 01:17:03 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:22:49.502 01:17:04 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:22:49.502 01:17:04 -- common/autotest_common.sh@1187 -- # local i=0 00:22:49.502 01:17:04 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:49.502 01:17:04 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:49.502 01:17:04 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:52.030 01:17:06 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:52.030 01:17:06 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:52.030 01:17:06 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:22:52.030 01:17:06 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:52.030 01:17:06 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:52.030 01:17:06 -- common/autotest_common.sh@1197 -- # return 0 00:22:52.030 01:17:06 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:52.030 01:17:06 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:22:52.288 01:17:06 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:22:52.288 01:17:06 -- common/autotest_common.sh@1187 -- # local i=0 00:22:52.288 01:17:06 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:52.288 01:17:06 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:52.288 01:17:06 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:54.200 01:17:08 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:54.200 01:17:08 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:54.200 01:17:08 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:22:54.200 01:17:08 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:54.200 01:17:08 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:54.200 01:17:08 -- common/autotest_common.sh@1197 -- # return 0 00:22:54.200 01:17:08 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:54.200 01:17:08 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:22:55.131 01:17:09 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:22:55.131 01:17:09 -- common/autotest_common.sh@1187 -- # local i=0 00:22:55.131 01:17:09 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:55.131 01:17:09 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:55.131 01:17:09 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:57.027 01:17:11 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:57.027 01:17:11 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:57.027 01:17:11 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:22:57.027 01:17:11 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:57.027 01:17:11 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:57.027 01:17:11 -- common/autotest_common.sh@1197 -- # return 0 00:22:57.027 01:17:11 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:57.027 01:17:11 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:22:57.960 01:17:12 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:22:57.960 01:17:12 -- common/autotest_common.sh@1187 -- # local i=0 00:22:57.960 01:17:12 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:57.960 01:17:12 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:57.960 01:17:12 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:59.856 01:17:14 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:59.856 01:17:14 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:59.856 01:17:14 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:22:59.856 01:17:14 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:59.856 01:17:14 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:59.856 01:17:14 -- common/autotest_common.sh@1197 -- # return 0 00:22:59.856 01:17:14 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:59.856 01:17:14 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:23:00.787 01:17:15 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:23:00.787 01:17:15 -- common/autotest_common.sh@1187 -- # local i=0 00:23:00.787 01:17:15 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:00.787 01:17:15 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:00.787 01:17:15 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:02.686 01:17:17 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:02.686 01:17:17 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:02.686 01:17:17 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:23:02.686 01:17:17 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:02.686 01:17:17 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:02.686 01:17:17 -- common/autotest_common.sh@1197 -- # return 0 00:23:02.686 01:17:17 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:02.686 01:17:17 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:23:03.619 01:17:17 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:23:03.619 01:17:17 -- common/autotest_common.sh@1187 -- # local i=0 00:23:03.619 01:17:17 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:03.619 01:17:17 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:03.619 01:17:17 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:05.518 01:17:19 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:05.519 01:17:19 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:05.519 01:17:19 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:23:05.519 01:17:19 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:05.519 01:17:19 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:05.519 01:17:19 -- common/autotest_common.sh@1197 -- # return 0 00:23:05.519 01:17:19 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:05.519 01:17:19 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:23:06.451 01:17:20 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:23:06.451 01:17:20 -- common/autotest_common.sh@1187 -- # local i=0 00:23:06.451 01:17:20 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:06.451 01:17:20 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:06.451 01:17:20 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:08.348 01:17:22 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:08.348 01:17:22 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:08.348 01:17:22 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:23:08.348 01:17:22 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:08.348 01:17:22 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:08.348 01:17:22 -- common/autotest_common.sh@1197 -- # return 0 00:23:08.348 01:17:22 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:08.348 01:17:22 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:23:09.280 01:17:23 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:23:09.280 01:17:23 -- common/autotest_common.sh@1187 -- # local i=0 00:23:09.280 01:17:23 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:09.280 01:17:23 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:09.280 01:17:23 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:11.186 01:17:25 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:11.186 01:17:25 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:11.186 01:17:25 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:23:11.186 01:17:25 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:11.186 01:17:25 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:11.186 01:17:25 -- common/autotest_common.sh@1197 -- # return 0 00:23:11.186 01:17:25 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:23:11.186 [global] 00:23:11.186 thread=1 00:23:11.186 invalidate=1 00:23:11.186 rw=read 00:23:11.186 time_based=1 00:23:11.186 runtime=10 00:23:11.186 ioengine=libaio 00:23:11.186 direct=1 00:23:11.186 bs=262144 00:23:11.186 iodepth=64 00:23:11.186 norandommap=1 00:23:11.186 numjobs=1 00:23:11.186 00:23:11.186 [job0] 00:23:11.186 filename=/dev/nvme0n1 00:23:11.186 [job1] 00:23:11.186 filename=/dev/nvme10n1 00:23:11.186 [job2] 00:23:11.186 filename=/dev/nvme1n1 00:23:11.186 [job3] 00:23:11.186 filename=/dev/nvme2n1 00:23:11.186 [job4] 00:23:11.186 filename=/dev/nvme3n1 00:23:11.186 [job5] 00:23:11.186 filename=/dev/nvme4n1 00:23:11.186 [job6] 00:23:11.186 filename=/dev/nvme5n1 00:23:11.186 [job7] 00:23:11.186 filename=/dev/nvme6n1 00:23:11.186 [job8] 00:23:11.186 filename=/dev/nvme7n1 00:23:11.186 [job9] 00:23:11.186 filename=/dev/nvme8n1 00:23:11.451 [job10] 00:23:11.451 filename=/dev/nvme9n1 00:23:11.451 Could not set queue depth (nvme0n1) 00:23:11.451 Could not set queue depth (nvme10n1) 00:23:11.451 Could not set queue depth (nvme1n1) 00:23:11.451 Could not set queue depth (nvme2n1) 00:23:11.451 Could not set queue depth (nvme3n1) 00:23:11.451 Could not set queue depth (nvme4n1) 00:23:11.451 Could not set queue depth (nvme5n1) 00:23:11.451 Could not set queue depth (nvme6n1) 00:23:11.451 Could not set queue depth (nvme7n1) 00:23:11.451 Could not set queue depth (nvme8n1) 00:23:11.451 Could not set queue depth (nvme9n1) 00:23:11.709 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:11.709 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:11.709 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:11.709 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:11.709 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:11.709 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:11.709 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:11.709 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:11.709 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:11.709 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:11.709 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:11.709 fio-3.35 00:23:11.709 Starting 11 threads 00:23:23.917 00:23:23.917 job0: (groupid=0, jobs=1): err= 0: pid=2086220: Thu Nov 28 01:17:36 2024 00:23:23.917 read: IOPS=720, BW=180MiB/s (189MB/s)(1823MiB/10112msec) 00:23:23.917 slat (usec): min=9, max=91576, avg=1203.47, stdev=4865.68 00:23:23.917 clat (usec): min=1949, max=314370, avg=87500.79, stdev=61022.11 00:23:23.917 lat (usec): min=1996, max=314394, avg=88704.26, stdev=62010.49 00:23:23.917 clat percentiles (msec): 00:23:23.917 | 1.00th=[ 17], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 34], 00:23:23.917 | 30.00th=[ 37], 40.00th=[ 51], 50.00th=[ 71], 60.00th=[ 84], 00:23:23.917 | 70.00th=[ 116], 80.00th=[ 146], 90.00th=[ 176], 95.00th=[ 209], 00:23:23.917 | 99.00th=[ 257], 99.50th=[ 266], 99.90th=[ 296], 99.95th=[ 296], 00:23:23.917 | 99.99th=[ 313] 00:23:23.917 bw ( KiB/s): min=70144, max=474624, per=9.90%, avg=184964.30, stdev=118453.54, samples=20 00:23:23.917 iops : min= 274, max= 1854, avg=722.50, stdev=462.67, samples=20 00:23:23.917 lat (msec) : 2=0.01%, 4=0.08%, 10=0.22%, 20=2.06%, 50=37.63% 00:23:23.917 lat (msec) : 100=26.15%, 250=32.66%, 500=1.19% 00:23:23.917 cpu : usr=0.55%, sys=2.66%, ctx=1331, majf=0, minf=4098 00:23:23.917 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:23:23.917 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:23.917 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:23.917 issued rwts: total=7290,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:23.917 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:23.917 job1: (groupid=0, jobs=1): err= 0: pid=2086248: Thu Nov 28 01:17:36 2024 00:23:23.917 read: IOPS=913, BW=228MiB/s (239MB/s)(2285MiB/10008msec) 00:23:23.917 slat (usec): min=13, max=122743, avg=1029.59, stdev=3732.37 00:23:23.917 clat (msec): min=2, max=280, avg=69.00, stdev=41.86 00:23:23.917 lat (msec): min=2, max=280, avg=70.03, stdev=42.40 00:23:23.917 clat percentiles (msec): 00:23:23.917 | 1.00th=[ 7], 5.00th=[ 27], 10.00th=[ 29], 20.00th=[ 32], 00:23:23.917 | 30.00th=[ 36], 40.00th=[ 46], 50.00th=[ 62], 60.00th=[ 78], 00:23:23.917 | 70.00th=[ 88], 80.00th=[ 101], 90.00th=[ 122], 95.00th=[ 146], 00:23:23.917 | 99.00th=[ 203], 99.50th=[ 234], 99.90th=[ 266], 99.95th=[ 279], 00:23:23.917 | 99.99th=[ 279] 00:23:23.917 bw ( KiB/s): min=110080, max=433664, per=11.68%, avg=218196.74, stdev=86616.17, samples=19 00:23:23.917 iops : min= 430, max= 1694, avg=852.32, stdev=338.36, samples=19 00:23:23.917 lat (msec) : 4=0.12%, 10=1.85%, 20=1.95%, 50=38.93%, 100=36.85% 00:23:23.917 lat (msec) : 250=20.16%, 500=0.14% 00:23:23.917 cpu : usr=0.54%, sys=3.12%, ctx=1609, majf=0, minf=4097 00:23:23.917 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:23:23.917 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:23.917 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:23.917 issued rwts: total=9140,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:23.917 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:23.917 job2: (groupid=0, jobs=1): err= 0: pid=2086272: Thu Nov 28 01:17:36 2024 00:23:23.917 read: IOPS=623, BW=156MiB/s (163MB/s)(1563MiB/10028msec) 00:23:23.917 slat (usec): min=11, max=84923, avg=1443.40, stdev=4561.20 00:23:23.917 clat (msec): min=4, max=310, avg=101.17, stdev=43.83 00:23:23.917 lat (msec): min=4, max=351, avg=102.62, stdev=44.47 00:23:23.917 clat percentiles (msec): 00:23:23.917 | 1.00th=[ 35], 5.00th=[ 42], 10.00th=[ 50], 20.00th=[ 59], 00:23:23.917 | 30.00th=[ 75], 40.00th=[ 88], 50.00th=[ 97], 60.00th=[ 107], 00:23:23.917 | 70.00th=[ 120], 80.00th=[ 136], 90.00th=[ 159], 95.00th=[ 174], 00:23:23.917 | 99.00th=[ 241], 99.50th=[ 255], 99.90th=[ 275], 99.95th=[ 279], 00:23:23.917 | 99.99th=[ 309] 00:23:23.917 bw ( KiB/s): min=65024, max=346624, per=8.48%, avg=158376.35, stdev=65591.69, samples=20 00:23:23.917 iops : min= 254, max= 1354, avg=618.65, stdev=256.22, samples=20 00:23:23.917 lat (msec) : 10=0.14%, 20=0.02%, 50=10.42%, 100=42.46%, 250=46.26% 00:23:23.917 lat (msec) : 500=0.70% 00:23:23.917 cpu : usr=0.37%, sys=2.22%, ctx=1174, majf=0, minf=3721 00:23:23.917 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:23.917 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:23.917 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:23.917 issued rwts: total=6250,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:23.917 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:23.917 job3: (groupid=0, jobs=1): err= 0: pid=2086273: Thu Nov 28 01:17:36 2024 00:23:23.917 read: IOPS=841, BW=210MiB/s (221MB/s)(2128MiB/10115msec) 00:23:23.917 slat (usec): min=13, max=97089, avg=1087.22, stdev=3937.74 00:23:23.917 clat (usec): min=1700, max=326768, avg=74888.26, stdev=42600.64 00:23:23.917 lat (usec): min=1722, max=326791, avg=75975.48, stdev=43286.46 00:23:23.917 clat percentiles (msec): 00:23:23.917 | 1.00th=[ 10], 5.00th=[ 26], 10.00th=[ 34], 20.00th=[ 40], 00:23:23.917 | 30.00th=[ 47], 40.00th=[ 56], 50.00th=[ 62], 60.00th=[ 79], 00:23:23.917 | 70.00th=[ 89], 80.00th=[ 110], 90.00th=[ 133], 95.00th=[ 150], 00:23:23.917 | 99.00th=[ 201], 99.50th=[ 241], 99.90th=[ 300], 99.95th=[ 309], 00:23:23.917 | 99.99th=[ 326] 00:23:23.917 bw ( KiB/s): min=74752, max=384000, per=11.58%, avg=216336.90, stdev=90045.08, samples=20 00:23:23.917 iops : min= 292, max= 1500, avg=845.05, stdev=351.74, samples=20 00:23:23.917 lat (msec) : 2=0.01%, 4=0.19%, 10=0.90%, 20=2.40%, 50=29.34% 00:23:23.917 lat (msec) : 100=43.30%, 250=23.39%, 500=0.47% 00:23:23.917 cpu : usr=0.62%, sys=2.66%, ctx=1353, majf=0, minf=4097 00:23:23.917 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:23:23.917 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:23.917 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:23.917 issued rwts: total=8513,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:23.917 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:23.917 job4: (groupid=0, jobs=1): err= 0: pid=2086274: Thu Nov 28 01:17:36 2024 00:23:23.917 read: IOPS=658, BW=165MiB/s (173MB/s)(1658MiB/10070msec) 00:23:23.917 slat (usec): min=14, max=123152, avg=1244.85, stdev=5400.25 00:23:23.917 clat (msec): min=5, max=347, avg=95.90, stdev=60.59 00:23:23.917 lat (msec): min=5, max=347, avg=97.14, stdev=61.64 00:23:23.917 clat percentiles (msec): 00:23:23.917 | 1.00th=[ 13], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 42], 00:23:23.917 | 30.00th=[ 55], 40.00th=[ 64], 50.00th=[ 84], 60.00th=[ 101], 00:23:23.917 | 70.00th=[ 117], 80.00th=[ 148], 90.00th=[ 190], 95.00th=[ 220], 00:23:23.917 | 99.00th=[ 257], 99.50th=[ 268], 99.90th=[ 284], 99.95th=[ 321], 00:23:23.917 | 99.99th=[ 347] 00:23:23.917 bw ( KiB/s): min=68608, max=416768, per=9.00%, avg=168092.15, stdev=86871.37, samples=20 00:23:23.917 iops : min= 268, max= 1628, avg=656.60, stdev=339.34, samples=20 00:23:23.917 lat (msec) : 10=0.48%, 20=1.89%, 50=23.67%, 100=33.65%, 250=38.84% 00:23:23.917 lat (msec) : 500=1.48% 00:23:23.917 cpu : usr=0.53%, sys=2.20%, ctx=1231, majf=0, minf=4097 00:23:23.917 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:23:23.917 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:23.917 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:23.917 issued rwts: total=6630,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:23.917 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:23.917 job5: (groupid=0, jobs=1): err= 0: pid=2086287: Thu Nov 28 01:17:36 2024 00:23:23.917 read: IOPS=583, BW=146MiB/s (153MB/s)(1477MiB/10116msec) 00:23:23.917 slat (usec): min=9, max=176619, avg=1225.55, stdev=5964.12 00:23:23.917 clat (usec): min=1780, max=363340, avg=108317.10, stdev=62952.50 00:23:23.917 lat (usec): min=1805, max=363369, avg=109542.65, stdev=63799.49 00:23:23.917 clat percentiles (msec): 00:23:23.917 | 1.00th=[ 5], 5.00th=[ 17], 10.00th=[ 25], 20.00th=[ 50], 00:23:23.917 | 30.00th=[ 64], 40.00th=[ 82], 50.00th=[ 106], 60.00th=[ 132], 00:23:23.917 | 70.00th=[ 148], 80.00th=[ 165], 90.00th=[ 186], 95.00th=[ 211], 00:23:23.917 | 99.00th=[ 271], 99.50th=[ 284], 99.90th=[ 296], 99.95th=[ 321], 00:23:23.917 | 99.99th=[ 363] 00:23:23.917 bw ( KiB/s): min=75264, max=338944, per=8.01%, avg=149545.70, stdev=66034.26, samples=20 00:23:23.917 iops : min= 294, max= 1324, avg=584.15, stdev=257.96, samples=20 00:23:23.917 lat (msec) : 2=0.08%, 4=0.30%, 10=2.74%, 20=4.22%, 50=13.04% 00:23:23.918 lat (msec) : 100=28.26%, 250=49.41%, 500=1.95% 00:23:23.918 cpu : usr=0.25%, sys=1.76%, ctx=1231, majf=0, minf=4098 00:23:23.918 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:23:23.918 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:23.918 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:23.918 issued rwts: total=5906,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:23.918 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:23.918 job6: (groupid=0, jobs=1): err= 0: pid=2086288: Thu Nov 28 01:17:36 2024 00:23:23.918 read: IOPS=529, BW=132MiB/s (139MB/s)(1339MiB/10119msec) 00:23:23.918 slat (usec): min=11, max=87102, avg=1633.19, stdev=5715.74 00:23:23.918 clat (usec): min=1094, max=323809, avg=119173.71, stdev=61219.37 00:23:23.918 lat (usec): min=1113, max=323847, avg=120806.90, stdev=62308.93 00:23:23.918 clat percentiles (msec): 00:23:23.918 | 1.00th=[ 5], 5.00th=[ 20], 10.00th=[ 33], 20.00th=[ 59], 00:23:23.918 | 30.00th=[ 88], 40.00th=[ 108], 50.00th=[ 124], 60.00th=[ 136], 00:23:23.918 | 70.00th=[ 150], 80.00th=[ 169], 90.00th=[ 190], 95.00th=[ 230], 00:23:23.918 | 99.00th=[ 284], 99.50th=[ 296], 99.90th=[ 309], 99.95th=[ 317], 00:23:23.918 | 99.99th=[ 326] 00:23:23.918 bw ( KiB/s): min=67584, max=287232, per=7.26%, avg=135490.50, stdev=59033.16, samples=20 00:23:23.918 iops : min= 264, max= 1122, avg=529.25, stdev=230.60, samples=20 00:23:23.918 lat (msec) : 2=0.62%, 4=0.21%, 10=1.16%, 20=3.42%, 50=11.11% 00:23:23.918 lat (msec) : 100=19.85%, 250=61.86%, 500=1.79% 00:23:23.918 cpu : usr=0.43%, sys=1.89%, ctx=1108, majf=0, minf=4097 00:23:23.918 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:23.918 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:23.918 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:23.918 issued rwts: total=5356,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:23.918 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:23.918 job7: (groupid=0, jobs=1): err= 0: pid=2086289: Thu Nov 28 01:17:36 2024 00:23:23.918 read: IOPS=718, BW=180MiB/s (188MB/s)(1809MiB/10069msec) 00:23:23.918 slat (usec): min=12, max=167552, avg=1245.87, stdev=4675.27 00:23:23.918 clat (usec): min=1263, max=352532, avg=87746.09, stdev=54841.87 00:23:23.918 lat (usec): min=1283, max=352609, avg=88991.96, stdev=55677.06 00:23:23.918 clat percentiles (msec): 00:23:23.918 | 1.00th=[ 9], 5.00th=[ 23], 10.00th=[ 29], 20.00th=[ 32], 00:23:23.918 | 30.00th=[ 37], 40.00th=[ 65], 50.00th=[ 87], 60.00th=[ 101], 00:23:23.918 | 70.00th=[ 114], 80.00th=[ 138], 90.00th=[ 167], 95.00th=[ 188], 00:23:23.918 | 99.00th=[ 224], 99.50th=[ 245], 99.90th=[ 257], 99.95th=[ 257], 00:23:23.918 | 99.99th=[ 355] 00:23:23.918 bw ( KiB/s): min=86701, max=453120, per=9.83%, avg=183626.15, stdev=103041.91, samples=20 00:23:23.918 iops : min= 338, max= 1770, avg=717.25, stdev=402.55, samples=20 00:23:23.918 lat (msec) : 2=0.10%, 4=0.46%, 10=1.22%, 20=2.38%, 50=30.15% 00:23:23.918 lat (msec) : 100=25.48%, 250=39.72%, 500=0.50% 00:23:23.918 cpu : usr=0.37%, sys=2.37%, ctx=1354, majf=0, minf=4097 00:23:23.918 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:23:23.918 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:23.918 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:23.918 issued rwts: total=7236,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:23.918 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:23.918 job8: (groupid=0, jobs=1): err= 0: pid=2086290: Thu Nov 28 01:17:36 2024 00:23:23.918 read: IOPS=498, BW=125MiB/s (131MB/s)(1249MiB/10028msec) 00:23:23.918 slat (usec): min=10, max=114175, avg=1583.05, stdev=5454.92 00:23:23.918 clat (usec): min=1612, max=380311, avg=126855.61, stdev=53343.07 00:23:23.918 lat (usec): min=1628, max=380330, avg=128438.66, stdev=53965.27 00:23:23.918 clat percentiles (msec): 00:23:23.918 | 1.00th=[ 16], 5.00th=[ 51], 10.00th=[ 59], 20.00th=[ 78], 00:23:23.918 | 30.00th=[ 99], 40.00th=[ 110], 50.00th=[ 125], 60.00th=[ 140], 00:23:23.918 | 70.00th=[ 153], 80.00th=[ 169], 90.00th=[ 199], 95.00th=[ 230], 00:23:23.918 | 99.00th=[ 262], 99.50th=[ 268], 99.90th=[ 305], 99.95th=[ 342], 00:23:23.918 | 99.99th=[ 380] 00:23:23.918 bw ( KiB/s): min=64000, max=274432, per=6.76%, avg=126238.10, stdev=50783.49, samples=20 00:23:23.918 iops : min= 250, max= 1072, avg=493.05, stdev=198.40, samples=20 00:23:23.918 lat (msec) : 2=0.08%, 4=0.28%, 10=0.30%, 20=0.74%, 50=3.30% 00:23:23.918 lat (msec) : 100=26.97%, 250=66.78%, 500=1.54% 00:23:23.918 cpu : usr=0.28%, sys=1.77%, ctx=1088, majf=0, minf=4097 00:23:23.918 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:23:23.918 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:23.918 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:23.918 issued rwts: total=4994,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:23.918 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:23.918 job9: (groupid=0, jobs=1): err= 0: pid=2086291: Thu Nov 28 01:17:36 2024 00:23:23.918 read: IOPS=437, BW=109MiB/s (115MB/s)(1108MiB/10121msec) 00:23:23.918 slat (usec): min=10, max=97553, avg=1959.81, stdev=6744.65 00:23:23.918 clat (msec): min=10, max=352, avg=144.11, stdev=48.92 00:23:23.918 lat (msec): min=10, max=352, avg=146.07, stdev=49.93 00:23:23.918 clat percentiles (msec): 00:23:23.918 | 1.00th=[ 29], 5.00th=[ 69], 10.00th=[ 82], 20.00th=[ 107], 00:23:23.918 | 30.00th=[ 121], 40.00th=[ 132], 50.00th=[ 142], 60.00th=[ 153], 00:23:23.918 | 70.00th=[ 163], 80.00th=[ 180], 90.00th=[ 209], 95.00th=[ 239], 00:23:23.918 | 99.00th=[ 275], 99.50th=[ 284], 99.90th=[ 300], 99.95th=[ 317], 00:23:23.918 | 99.99th=[ 351] 00:23:23.918 bw ( KiB/s): min=68096, max=164864, per=5.99%, avg=111785.30, stdev=29267.39, samples=20 00:23:23.918 iops : min= 266, max= 644, avg=436.65, stdev=114.33, samples=20 00:23:23.918 lat (msec) : 20=0.41%, 50=2.26%, 100=13.00%, 250=81.63%, 500=2.71% 00:23:23.918 cpu : usr=0.29%, sys=1.63%, ctx=951, majf=0, minf=4097 00:23:23.918 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:23:23.918 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:23.918 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:23.918 issued rwts: total=4431,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:23.918 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:23.918 job10: (groupid=0, jobs=1): err= 0: pid=2086292: Thu Nov 28 01:17:36 2024 00:23:23.918 read: IOPS=802, BW=201MiB/s (210MB/s)(2021MiB/10070msec) 00:23:23.918 slat (usec): min=10, max=66834, avg=913.57, stdev=3415.02 00:23:23.918 clat (usec): min=1198, max=220609, avg=78765.49, stdev=42867.04 00:23:23.918 lat (usec): min=1220, max=224799, avg=79679.06, stdev=43277.15 00:23:23.918 clat percentiles (msec): 00:23:23.918 | 1.00th=[ 4], 5.00th=[ 17], 10.00th=[ 28], 20.00th=[ 42], 00:23:23.918 | 30.00th=[ 57], 40.00th=[ 64], 50.00th=[ 72], 60.00th=[ 86], 00:23:23.918 | 70.00th=[ 97], 80.00th=[ 110], 90.00th=[ 140], 95.00th=[ 165], 00:23:23.918 | 99.00th=[ 199], 99.50th=[ 205], 99.90th=[ 215], 99.95th=[ 218], 00:23:23.918 | 99.99th=[ 222] 00:23:23.918 bw ( KiB/s): min=96768, max=397312, per=10.99%, avg=205297.50, stdev=72960.31, samples=20 00:23:23.918 iops : min= 378, max= 1552, avg=801.90, stdev=285.04, samples=20 00:23:23.918 lat (msec) : 2=0.26%, 4=0.74%, 10=1.65%, 20=3.81%, 50=17.32% 00:23:23.918 lat (msec) : 100=48.97%, 250=27.25% 00:23:23.918 cpu : usr=0.49%, sys=2.69%, ctx=1639, majf=0, minf=4097 00:23:23.918 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:23.918 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:23.918 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:23.918 issued rwts: total=8083,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:23.918 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:23.918 00:23:23.918 Run status group 0 (all jobs): 00:23:23.918 READ: bw=1824MiB/s (1912MB/s), 109MiB/s-228MiB/s (115MB/s-239MB/s), io=18.0GiB (19.4GB), run=10008-10121msec 00:23:23.918 00:23:23.918 Disk stats (read/write): 00:23:23.918 nvme0n1: ios=14352/0, merge=0/0, ticks=1223256/0, in_queue=1223256, util=97.12% 00:23:23.918 nvme10n1: ios=17913/0, merge=0/0, ticks=1237437/0, in_queue=1237437, util=97.33% 00:23:23.918 nvme1n1: ios=12232/0, merge=0/0, ticks=1236223/0, in_queue=1236223, util=97.63% 00:23:23.918 nvme2n1: ios=16872/0, merge=0/0, ticks=1226314/0, in_queue=1226314, util=97.76% 00:23:23.918 nvme3n1: ios=13036/0, merge=0/0, ticks=1232295/0, in_queue=1232295, util=97.84% 00:23:23.918 nvme4n1: ios=11669/0, merge=0/0, ticks=1232790/0, in_queue=1232790, util=98.21% 00:23:23.918 nvme5n1: ios=10429/0, merge=0/0, ticks=1226669/0, in_queue=1226669, util=98.37% 00:23:23.918 nvme6n1: ios=14244/0, merge=0/0, ticks=1230278/0, in_queue=1230278, util=98.49% 00:23:23.918 nvme7n1: ios=9671/0, merge=0/0, ticks=1236665/0, in_queue=1236665, util=98.92% 00:23:23.918 nvme8n1: ios=8723/0, merge=0/0, ticks=1229181/0, in_queue=1229181, util=99.11% 00:23:23.918 nvme9n1: ios=15940/0, merge=0/0, ticks=1238533/0, in_queue=1238533, util=99.26% 00:23:23.918 01:17:36 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:23:23.918 [global] 00:23:23.918 thread=1 00:23:23.918 invalidate=1 00:23:23.918 rw=randwrite 00:23:23.918 time_based=1 00:23:23.918 runtime=10 00:23:23.918 ioengine=libaio 00:23:23.918 direct=1 00:23:23.918 bs=262144 00:23:23.918 iodepth=64 00:23:23.918 norandommap=1 00:23:23.918 numjobs=1 00:23:23.918 00:23:23.918 [job0] 00:23:23.918 filename=/dev/nvme0n1 00:23:23.918 [job1] 00:23:23.918 filename=/dev/nvme10n1 00:23:23.918 [job2] 00:23:23.918 filename=/dev/nvme1n1 00:23:23.918 [job3] 00:23:23.918 filename=/dev/nvme2n1 00:23:23.918 [job4] 00:23:23.918 filename=/dev/nvme3n1 00:23:23.918 [job5] 00:23:23.918 filename=/dev/nvme4n1 00:23:23.918 [job6] 00:23:23.918 filename=/dev/nvme5n1 00:23:23.918 [job7] 00:23:23.918 filename=/dev/nvme6n1 00:23:23.918 [job8] 00:23:23.918 filename=/dev/nvme7n1 00:23:23.918 [job9] 00:23:23.918 filename=/dev/nvme8n1 00:23:23.918 [job10] 00:23:23.918 filename=/dev/nvme9n1 00:23:23.918 Could not set queue depth (nvme0n1) 00:23:23.918 Could not set queue depth (nvme10n1) 00:23:23.918 Could not set queue depth (nvme1n1) 00:23:23.918 Could not set queue depth (nvme2n1) 00:23:23.918 Could not set queue depth (nvme3n1) 00:23:23.918 Could not set queue depth (nvme4n1) 00:23:23.918 Could not set queue depth (nvme5n1) 00:23:23.919 Could not set queue depth (nvme6n1) 00:23:23.919 Could not set queue depth (nvme7n1) 00:23:23.919 Could not set queue depth (nvme8n1) 00:23:23.919 Could not set queue depth (nvme9n1) 00:23:23.919 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:23.919 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:23.919 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:23.919 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:23.919 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:23.919 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:23.919 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:23.919 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:23.919 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:23.919 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:23.919 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:23.919 fio-3.35 00:23:23.919 Starting 11 threads 00:23:33.887 00:23:33.887 job0: (groupid=0, jobs=1): err= 0: pid=2087335: Thu Nov 28 01:17:47 2024 00:23:33.887 write: IOPS=538, BW=135MiB/s (141MB/s)(1364MiB/10125msec); 0 zone resets 00:23:33.887 slat (usec): min=15, max=58711, avg=1495.25, stdev=4003.99 00:23:33.887 clat (usec): min=1229, max=343350, avg=117220.31, stdev=73609.26 00:23:33.887 lat (usec): min=1763, max=343425, avg=118715.56, stdev=74584.94 00:23:33.887 clat percentiles (msec): 00:23:33.887 | 1.00th=[ 7], 5.00th=[ 22], 10.00th=[ 34], 20.00th=[ 44], 00:23:33.887 | 30.00th=[ 69], 40.00th=[ 88], 50.00th=[ 101], 60.00th=[ 134], 00:23:33.887 | 70.00th=[ 153], 80.00th=[ 180], 90.00th=[ 218], 95.00th=[ 264], 00:23:33.887 | 99.00th=[ 309], 99.50th=[ 321], 99.90th=[ 338], 99.95th=[ 342], 00:23:33.887 | 99.99th=[ 342] 00:23:33.887 bw ( KiB/s): min=49152, max=280576, per=9.35%, avg=138028.55, stdev=64661.12, samples=20 00:23:33.887 iops : min= 192, max= 1096, avg=539.15, stdev=252.60, samples=20 00:23:33.887 lat (msec) : 2=0.04%, 4=0.31%, 10=1.65%, 20=2.62%, 50=19.35% 00:23:33.887 lat (msec) : 100=26.03%, 250=44.21%, 500=5.79% 00:23:33.887 cpu : usr=1.51%, sys=1.75%, ctx=2472, majf=0, minf=1 00:23:33.887 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:33.887 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:33.887 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:33.887 issued rwts: total=0,5456,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:33.887 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:33.887 job1: (groupid=0, jobs=1): err= 0: pid=2087352: Thu Nov 28 01:17:47 2024 00:23:33.887 write: IOPS=445, BW=111MiB/s (117MB/s)(1141MiB/10230msec); 0 zone resets 00:23:33.887 slat (usec): min=22, max=56792, avg=1307.85, stdev=4109.73 00:23:33.887 clat (msec): min=3, max=473, avg=142.03, stdev=78.09 00:23:33.887 lat (msec): min=3, max=489, avg=143.34, stdev=79.15 00:23:33.887 clat percentiles (msec): 00:23:33.887 | 1.00th=[ 11], 5.00th=[ 31], 10.00th=[ 53], 20.00th=[ 81], 00:23:33.887 | 30.00th=[ 105], 40.00th=[ 113], 50.00th=[ 125], 60.00th=[ 146], 00:23:33.887 | 70.00th=[ 169], 80.00th=[ 201], 90.00th=[ 251], 95.00th=[ 296], 00:23:33.887 | 99.00th=[ 372], 99.50th=[ 397], 99.90th=[ 451], 99.95th=[ 456], 00:23:33.887 | 99.99th=[ 472] 00:23:33.887 bw ( KiB/s): min=43008, max=170496, per=7.80%, avg=115130.80, stdev=36964.82, samples=20 00:23:33.887 iops : min= 168, max= 666, avg=449.70, stdev=144.42, samples=20 00:23:33.887 lat (msec) : 4=0.04%, 10=0.90%, 20=2.15%, 50=6.47%, 100=17.56% 00:23:33.887 lat (msec) : 250=62.91%, 500=9.97% 00:23:33.887 cpu : usr=1.37%, sys=1.48%, ctx=2866, majf=0, minf=1 00:23:33.887 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:23:33.887 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:33.887 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:33.887 issued rwts: total=0,4562,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:33.887 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:33.887 job2: (groupid=0, jobs=1): err= 0: pid=2087353: Thu Nov 28 01:17:47 2024 00:23:33.887 write: IOPS=445, BW=111MiB/s (117MB/s)(1138MiB/10229msec); 0 zone resets 00:23:33.887 slat (usec): min=22, max=97924, avg=1465.00, stdev=4419.89 00:23:33.887 clat (usec): min=865, max=494269, avg=142217.53, stdev=81795.19 00:23:33.887 lat (usec): min=911, max=494302, avg=143682.54, stdev=82671.82 00:23:33.887 clat percentiles (msec): 00:23:33.887 | 1.00th=[ 3], 5.00th=[ 14], 10.00th=[ 34], 20.00th=[ 71], 00:23:33.887 | 30.00th=[ 100], 40.00th=[ 127], 50.00th=[ 136], 60.00th=[ 153], 00:23:33.887 | 70.00th=[ 174], 80.00th=[ 201], 90.00th=[ 255], 95.00th=[ 296], 00:23:33.887 | 99.00th=[ 351], 99.50th=[ 405], 99.90th=[ 481], 99.95th=[ 481], 00:23:33.887 | 99.99th=[ 493] 00:23:33.887 bw ( KiB/s): min=45056, max=208896, per=7.79%, avg=114900.15, stdev=38366.96, samples=20 00:23:33.887 iops : min= 176, max= 816, avg=448.80, stdev=149.89, samples=20 00:23:33.887 lat (usec) : 1000=0.04% 00:23:33.887 lat (msec) : 2=0.35%, 4=1.23%, 10=2.42%, 20=2.44%, 50=6.90% 00:23:33.887 lat (msec) : 100=17.09%, 250=58.77%, 500=10.76% 00:23:33.887 cpu : usr=1.45%, sys=1.92%, ctx=2664, majf=0, minf=1 00:23:33.887 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:23:33.887 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:33.887 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:33.887 issued rwts: total=0,4552,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:33.887 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:33.887 job3: (groupid=0, jobs=1): err= 0: pid=2087354: Thu Nov 28 01:17:47 2024 00:23:33.887 write: IOPS=420, BW=105MiB/s (110MB/s)(1074MiB/10227msec); 0 zone resets 00:23:33.887 slat (usec): min=20, max=45656, avg=1818.02, stdev=4227.29 00:23:33.887 clat (msec): min=2, max=496, avg=150.42, stdev=66.37 00:23:33.887 lat (msec): min=2, max=496, avg=152.24, stdev=67.06 00:23:33.887 clat percentiles (msec): 00:23:33.887 | 1.00th=[ 9], 5.00th=[ 27], 10.00th=[ 48], 20.00th=[ 114], 00:23:33.887 | 30.00th=[ 128], 40.00th=[ 136], 50.00th=[ 146], 60.00th=[ 165], 00:23:33.887 | 70.00th=[ 182], 80.00th=[ 197], 90.00th=[ 232], 95.00th=[ 259], 00:23:33.887 | 99.00th=[ 300], 99.50th=[ 397], 99.90th=[ 477], 99.95th=[ 498], 00:23:33.887 | 99.99th=[ 498] 00:23:33.887 bw ( KiB/s): min=69120, max=165707, per=7.34%, avg=108371.10, stdev=27429.17, samples=20 00:23:33.887 iops : min= 270, max= 647, avg=423.30, stdev=107.12, samples=20 00:23:33.887 lat (msec) : 4=0.19%, 10=1.16%, 20=2.21%, 50=6.91%, 100=5.82% 00:23:33.887 lat (msec) : 250=77.22%, 500=6.49% 00:23:33.887 cpu : usr=1.17%, sys=1.46%, ctx=1876, majf=0, minf=1 00:23:33.887 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:23:33.887 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:33.887 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:33.887 issued rwts: total=0,4297,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:33.887 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:33.887 job4: (groupid=0, jobs=1): err= 0: pid=2087355: Thu Nov 28 01:17:47 2024 00:23:33.887 write: IOPS=527, BW=132MiB/s (138MB/s)(1341MiB/10177msec); 0 zone resets 00:23:33.887 slat (usec): min=15, max=157227, avg=1198.02, stdev=4383.66 00:23:33.887 clat (usec): min=972, max=458023, avg=120144.63, stdev=70920.43 00:23:33.887 lat (usec): min=1011, max=458114, avg=121342.65, stdev=71794.35 00:23:33.887 clat percentiles (msec): 00:23:33.887 | 1.00th=[ 8], 5.00th=[ 23], 10.00th=[ 39], 20.00th=[ 63], 00:23:33.887 | 30.00th=[ 80], 40.00th=[ 94], 50.00th=[ 111], 60.00th=[ 126], 00:23:33.887 | 70.00th=[ 146], 80.00th=[ 171], 90.00th=[ 215], 95.00th=[ 262], 00:23:33.887 | 99.00th=[ 338], 99.50th=[ 359], 99.90th=[ 409], 99.95th=[ 456], 00:23:33.887 | 99.99th=[ 460] 00:23:33.887 bw ( KiB/s): min=61440, max=205312, per=9.20%, avg=135699.60, stdev=42453.01, samples=20 00:23:33.887 iops : min= 240, max= 802, avg=530.05, stdev=165.80, samples=20 00:23:33.887 lat (usec) : 1000=0.04% 00:23:33.887 lat (msec) : 2=0.07%, 4=0.19%, 10=0.99%, 20=2.98%, 50=10.48% 00:23:33.887 lat (msec) : 100=29.45%, 250=49.95%, 500=5.85% 00:23:33.887 cpu : usr=1.70%, sys=2.04%, ctx=3215, majf=0, minf=2 00:23:33.887 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:33.887 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:33.887 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:33.887 issued rwts: total=0,5365,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:33.887 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:33.888 job5: (groupid=0, jobs=1): err= 0: pid=2087356: Thu Nov 28 01:17:47 2024 00:23:33.888 write: IOPS=533, BW=133MiB/s (140MB/s)(1342MiB/10066msec); 0 zone resets 00:23:33.888 slat (usec): min=18, max=47328, avg=1626.39, stdev=4137.88 00:23:33.888 clat (usec): min=1244, max=344758, avg=118374.07, stdev=82800.94 00:23:33.888 lat (usec): min=1918, max=344796, avg=120000.46, stdev=83982.68 00:23:33.888 clat percentiles (msec): 00:23:33.888 | 1.00th=[ 6], 5.00th=[ 25], 10.00th=[ 39], 20.00th=[ 41], 00:23:33.888 | 30.00th=[ 44], 40.00th=[ 57], 50.00th=[ 116], 60.00th=[ 136], 00:23:33.888 | 70.00th=[ 165], 80.00th=[ 188], 90.00th=[ 241], 95.00th=[ 271], 00:23:33.888 | 99.00th=[ 321], 99.50th=[ 330], 99.90th=[ 342], 99.95th=[ 347], 00:23:33.888 | 99.99th=[ 347] 00:23:33.888 bw ( KiB/s): min=53248, max=397540, per=9.20%, avg=135706.80, stdev=90031.60, samples=20 00:23:33.888 iops : min= 208, max= 1552, avg=530.00, stdev=351.59, samples=20 00:23:33.888 lat (msec) : 2=0.06%, 4=0.32%, 10=1.55%, 20=2.22%, 50=34.51% 00:23:33.888 lat (msec) : 100=9.60%, 250=43.34%, 500=8.42% 00:23:33.888 cpu : usr=1.66%, sys=1.91%, ctx=2167, majf=0, minf=1 00:23:33.888 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:33.888 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:33.888 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:33.888 issued rwts: total=0,5367,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:33.888 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:33.888 job6: (groupid=0, jobs=1): err= 0: pid=2087357: Thu Nov 28 01:17:47 2024 00:23:33.888 write: IOPS=605, BW=151MiB/s (159MB/s)(1529MiB/10106msec); 0 zone resets 00:23:33.888 slat (usec): min=23, max=46287, avg=875.43, stdev=2649.21 00:23:33.888 clat (msec): min=2, max=366, avg=104.80, stdev=61.00 00:23:33.888 lat (msec): min=3, max=366, avg=105.67, stdev=61.49 00:23:33.888 clat percentiles (msec): 00:23:33.888 | 1.00th=[ 11], 5.00th=[ 23], 10.00th=[ 33], 20.00th=[ 57], 00:23:33.888 | 30.00th=[ 71], 40.00th=[ 85], 50.00th=[ 96], 60.00th=[ 107], 00:23:33.888 | 70.00th=[ 128], 80.00th=[ 150], 90.00th=[ 180], 95.00th=[ 222], 00:23:33.888 | 99.00th=[ 305], 99.50th=[ 321], 99.90th=[ 347], 99.95th=[ 359], 00:23:33.888 | 99.99th=[ 368] 00:23:33.888 bw ( KiB/s): min=75264, max=256000, per=10.50%, avg=154911.40, stdev=44117.27, samples=20 00:23:33.888 iops : min= 294, max= 1000, avg=605.10, stdev=172.31, samples=20 00:23:33.888 lat (msec) : 4=0.11%, 10=0.85%, 20=3.07%, 50=13.24%, 100=39.29% 00:23:33.888 lat (msec) : 250=40.32%, 500=3.11% 00:23:33.888 cpu : usr=2.12%, sys=2.09%, ctx=3834, majf=0, minf=1 00:23:33.888 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:33.888 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:33.888 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:33.888 issued rwts: total=0,6116,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:33.888 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:33.888 job7: (groupid=0, jobs=1): err= 0: pid=2087358: Thu Nov 28 01:17:47 2024 00:23:33.888 write: IOPS=495, BW=124MiB/s (130MB/s)(1263MiB/10184msec); 0 zone resets 00:23:33.888 slat (usec): min=19, max=144692, avg=1544.97, stdev=4939.97 00:23:33.888 clat (usec): min=1910, max=412070, avg=127424.16, stdev=59602.08 00:23:33.888 lat (usec): min=1949, max=412109, avg=128969.12, stdev=60168.70 00:23:33.888 clat percentiles (msec): 00:23:33.888 | 1.00th=[ 12], 5.00th=[ 37], 10.00th=[ 61], 20.00th=[ 81], 00:23:33.888 | 30.00th=[ 102], 40.00th=[ 110], 50.00th=[ 117], 60.00th=[ 132], 00:23:33.888 | 70.00th=[ 150], 80.00th=[ 174], 90.00th=[ 205], 95.00th=[ 236], 00:23:33.888 | 99.00th=[ 309], 99.50th=[ 355], 99.90th=[ 401], 99.95th=[ 409], 00:23:33.888 | 99.99th=[ 414] 00:23:33.888 bw ( KiB/s): min=78690, max=219136, per=8.65%, avg=127640.40, stdev=37245.15, samples=20 00:23:33.888 iops : min= 307, max= 856, avg=498.50, stdev=145.52, samples=20 00:23:33.888 lat (msec) : 2=0.02%, 4=0.06%, 10=0.71%, 20=1.66%, 50=5.11% 00:23:33.888 lat (msec) : 100=22.22%, 250=66.91%, 500=3.31% 00:23:33.888 cpu : usr=1.45%, sys=1.73%, ctx=2234, majf=0, minf=1 00:23:33.888 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:33.888 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:33.888 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:33.888 issued rwts: total=0,5050,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:33.888 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:33.888 job8: (groupid=0, jobs=1): err= 0: pid=2087359: Thu Nov 28 01:17:47 2024 00:23:33.888 write: IOPS=620, BW=155MiB/s (163MB/s)(1558MiB/10043msec); 0 zone resets 00:23:33.888 slat (usec): min=17, max=105310, avg=1135.40, stdev=3774.06 00:23:33.888 clat (usec): min=1365, max=295821, avg=101940.20, stdev=58057.84 00:23:33.888 lat (usec): min=1425, max=295908, avg=103075.60, stdev=58744.54 00:23:33.888 clat percentiles (msec): 00:23:33.888 | 1.00th=[ 7], 5.00th=[ 21], 10.00th=[ 36], 20.00th=[ 50], 00:23:33.888 | 30.00th=[ 70], 40.00th=[ 75], 50.00th=[ 89], 60.00th=[ 117], 00:23:33.888 | 70.00th=[ 129], 80.00th=[ 148], 90.00th=[ 180], 95.00th=[ 209], 00:23:33.888 | 99.00th=[ 271], 99.50th=[ 284], 99.90th=[ 296], 99.95th=[ 296], 00:23:33.888 | 99.99th=[ 296] 00:23:33.888 bw ( KiB/s): min=57229, max=243200, per=10.70%, avg=157872.60, stdev=52889.73, samples=20 00:23:33.888 iops : min= 223, max= 950, avg=616.60, stdev=206.65, samples=20 00:23:33.888 lat (msec) : 2=0.13%, 4=0.50%, 10=1.08%, 20=3.02%, 50=15.47% 00:23:33.888 lat (msec) : 100=35.46%, 250=42.23%, 500=2.12% 00:23:33.888 cpu : usr=1.88%, sys=2.22%, ctx=3149, majf=0, minf=1 00:23:33.888 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:33.888 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:33.888 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:33.888 issued rwts: total=0,6232,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:33.888 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:33.888 job9: (groupid=0, jobs=1): err= 0: pid=2087360: Thu Nov 28 01:17:47 2024 00:23:33.888 write: IOPS=614, BW=154MiB/s (161MB/s)(1572MiB/10229msec); 0 zone resets 00:23:33.888 slat (usec): min=17, max=61102, avg=1214.40, stdev=3108.69 00:23:33.888 clat (usec): min=860, max=542169, avg=102836.62, stdev=63930.94 00:23:33.888 lat (usec): min=893, max=542216, avg=104051.02, stdev=64531.40 00:23:33.888 clat percentiles (msec): 00:23:33.888 | 1.00th=[ 6], 5.00th=[ 24], 10.00th=[ 37], 20.00th=[ 45], 00:23:33.888 | 30.00th=[ 71], 40.00th=[ 79], 50.00th=[ 96], 60.00th=[ 110], 00:23:33.888 | 70.00th=[ 120], 80.00th=[ 142], 90.00th=[ 182], 95.00th=[ 218], 00:23:33.888 | 99.00th=[ 300], 99.50th=[ 422], 99.90th=[ 527], 99.95th=[ 527], 00:23:33.888 | 99.99th=[ 542] 00:23:33.888 bw ( KiB/s): min=56320, max=325120, per=10.80%, avg=159315.05, stdev=65816.03, samples=20 00:23:33.888 iops : min= 220, max= 1270, avg=622.30, stdev=257.12, samples=20 00:23:33.888 lat (usec) : 1000=0.03% 00:23:33.888 lat (msec) : 2=0.16%, 4=0.43%, 10=1.29%, 20=2.07%, 50=18.56% 00:23:33.888 lat (msec) : 100=29.34%, 250=46.09%, 500=1.86%, 750=0.17% 00:23:33.888 cpu : usr=2.04%, sys=1.82%, ctx=2898, majf=0, minf=1 00:23:33.888 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:33.888 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:33.888 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:33.888 issued rwts: total=0,6288,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:33.888 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:33.888 job10: (groupid=0, jobs=1): err= 0: pid=2087361: Thu Nov 28 01:17:47 2024 00:23:33.888 write: IOPS=558, BW=140MiB/s (146MB/s)(1419MiB/10171msec); 0 zone resets 00:23:33.888 slat (usec): min=23, max=63404, avg=955.85, stdev=3234.40 00:23:33.888 clat (usec): min=1103, max=414209, avg=113613.40, stdev=69142.79 00:23:33.888 lat (usec): min=1131, max=428410, avg=114569.25, stdev=69794.46 00:23:33.888 clat percentiles (msec): 00:23:33.888 | 1.00th=[ 10], 5.00th=[ 28], 10.00th=[ 40], 20.00th=[ 55], 00:23:33.888 | 30.00th=[ 75], 40.00th=[ 83], 50.00th=[ 95], 60.00th=[ 115], 00:23:33.888 | 70.00th=[ 131], 80.00th=[ 180], 90.00th=[ 215], 95.00th=[ 245], 00:23:33.888 | 99.00th=[ 317], 99.50th=[ 326], 99.90th=[ 401], 99.95th=[ 414], 00:23:33.888 | 99.99th=[ 414] 00:23:33.888 bw ( KiB/s): min=61440, max=304640, per=9.74%, avg=143691.15, stdev=52540.98, samples=20 00:23:33.888 iops : min= 240, max= 1190, avg=561.20, stdev=205.28, samples=20 00:23:33.888 lat (msec) : 2=0.14%, 4=0.04%, 10=0.85%, 20=2.17%, 50=14.11% 00:23:33.888 lat (msec) : 100=35.55%, 250=42.72%, 500=4.44% 00:23:33.888 cpu : usr=1.84%, sys=2.04%, ctx=3584, majf=0, minf=1 00:23:33.888 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:33.888 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:33.888 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:33.888 issued rwts: total=0,5677,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:33.888 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:33.888 00:23:33.888 Run status group 0 (all jobs): 00:23:33.888 WRITE: bw=1441MiB/s (1511MB/s), 105MiB/s-155MiB/s (110MB/s-163MB/s), io=14.4GiB (15.5GB), run=10043-10230msec 00:23:33.888 00:23:33.888 Disk stats (read/write): 00:23:33.888 nvme0n1: ios=49/10710, merge=0/0, ticks=48/1216976, in_queue=1217024, util=97.48% 00:23:33.888 nvme10n1: ios=35/9085, merge=0/0, ticks=479/1248835, in_queue=1249314, util=99.95% 00:23:33.888 nvme1n1: ios=48/9068, merge=0/0, ticks=1530/1243506, in_queue=1245036, util=100.00% 00:23:33.888 nvme2n1: ios=0/8558, merge=0/0, ticks=0/1240669, in_queue=1240669, util=97.91% 00:23:33.888 nvme3n1: ios=0/10537, merge=0/0, ticks=0/1222137, in_queue=1222137, util=97.95% 00:23:33.888 nvme4n1: ios=0/10561, merge=0/0, ticks=0/1210845, in_queue=1210845, util=98.19% 00:23:33.888 nvme5n1: ios=42/12036, merge=0/0, ticks=465/1223397, in_queue=1223862, util=100.00% 00:23:33.888 nvme6n1: ios=48/9897, merge=0/0, ticks=4115/1178799, in_queue=1182914, util=99.82% 00:23:33.888 nvme7n1: ios=40/12160, merge=0/0, ticks=1308/1196179, in_queue=1197487, util=100.00% 00:23:33.888 nvme8n1: ios=0/12541, merge=0/0, ticks=0/1240897, in_queue=1240897, util=99.03% 00:23:33.888 nvme9n1: ios=43/11200, merge=0/0, ticks=1176/1217877, in_queue=1219053, util=100.00% 00:23:33.888 01:17:47 -- target/multiconnection.sh@36 -- # sync 00:23:33.888 01:17:47 -- target/multiconnection.sh@37 -- # seq 1 11 00:23:33.888 01:17:47 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:33.888 01:17:47 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:23:33.888 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:23:33.888 01:17:47 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:23:33.889 01:17:47 -- common/autotest_common.sh@1208 -- # local i=0 00:23:33.889 01:17:47 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:33.889 01:17:47 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:23:33.889 01:17:47 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:33.889 01:17:47 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:23:33.889 01:17:47 -- common/autotest_common.sh@1220 -- # return 0 00:23:33.889 01:17:47 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:33.889 01:17:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:33.889 01:17:47 -- common/autotest_common.sh@10 -- # set +x 00:23:33.889 01:17:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:33.889 01:17:47 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:33.889 01:17:47 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:23:33.889 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:23:33.889 01:17:47 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:23:33.889 01:17:47 -- common/autotest_common.sh@1208 -- # local i=0 00:23:33.889 01:17:47 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:33.889 01:17:47 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:23:33.889 01:17:47 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:33.889 01:17:47 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:23:33.889 01:17:47 -- common/autotest_common.sh@1220 -- # return 0 00:23:33.889 01:17:47 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:33.889 01:17:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:33.889 01:17:47 -- common/autotest_common.sh@10 -- # set +x 00:23:33.889 01:17:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:33.889 01:17:47 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:33.889 01:17:47 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:23:33.889 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:23:33.889 01:17:48 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:23:33.889 01:17:48 -- common/autotest_common.sh@1208 -- # local i=0 00:23:33.889 01:17:48 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:33.889 01:17:48 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:23:33.889 01:17:48 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:33.889 01:17:48 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:23:33.889 01:17:48 -- common/autotest_common.sh@1220 -- # return 0 00:23:33.889 01:17:48 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:23:33.889 01:17:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:33.889 01:17:48 -- common/autotest_common.sh@10 -- # set +x 00:23:33.889 01:17:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:33.889 01:17:48 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:33.889 01:17:48 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:23:34.147 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:23:34.147 01:17:48 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:23:34.147 01:17:48 -- common/autotest_common.sh@1208 -- # local i=0 00:23:34.147 01:17:48 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:34.147 01:17:48 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:23:34.147 01:17:48 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:34.147 01:17:48 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:23:34.147 01:17:48 -- common/autotest_common.sh@1220 -- # return 0 00:23:34.147 01:17:48 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:23:34.147 01:17:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:34.147 01:17:48 -- common/autotest_common.sh@10 -- # set +x 00:23:34.147 01:17:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:34.147 01:17:48 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:34.147 01:17:48 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:23:34.404 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:23:34.404 01:17:48 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:23:34.404 01:17:48 -- common/autotest_common.sh@1208 -- # local i=0 00:23:34.404 01:17:48 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:34.404 01:17:48 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:23:34.404 01:17:48 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:34.404 01:17:48 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:23:34.404 01:17:48 -- common/autotest_common.sh@1220 -- # return 0 00:23:34.404 01:17:48 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:23:34.404 01:17:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:34.404 01:17:48 -- common/autotest_common.sh@10 -- # set +x 00:23:34.404 01:17:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:34.404 01:17:48 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:34.404 01:17:48 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:23:34.662 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:23:34.662 01:17:49 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:23:34.662 01:17:49 -- common/autotest_common.sh@1208 -- # local i=0 00:23:34.662 01:17:49 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:34.662 01:17:49 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:23:34.662 01:17:49 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:34.662 01:17:49 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:23:34.662 01:17:49 -- common/autotest_common.sh@1220 -- # return 0 00:23:34.662 01:17:49 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:23:34.662 01:17:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:34.662 01:17:49 -- common/autotest_common.sh@10 -- # set +x 00:23:34.662 01:17:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:34.662 01:17:49 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:34.662 01:17:49 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:23:34.920 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:23:34.920 01:17:49 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:23:34.920 01:17:49 -- common/autotest_common.sh@1208 -- # local i=0 00:23:34.920 01:17:49 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:34.920 01:17:49 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:23:34.920 01:17:49 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:34.920 01:17:49 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:23:34.920 01:17:49 -- common/autotest_common.sh@1220 -- # return 0 00:23:34.920 01:17:49 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:23:34.920 01:17:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:34.920 01:17:49 -- common/autotest_common.sh@10 -- # set +x 00:23:34.920 01:17:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:34.920 01:17:49 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:34.920 01:17:49 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:23:35.178 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:23:35.178 01:17:49 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:23:35.178 01:17:49 -- common/autotest_common.sh@1208 -- # local i=0 00:23:35.178 01:17:49 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:35.178 01:17:49 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:23:35.178 01:17:49 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:35.178 01:17:49 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:23:35.178 01:17:49 -- common/autotest_common.sh@1220 -- # return 0 00:23:35.178 01:17:49 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:23:35.178 01:17:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:35.178 01:17:49 -- common/autotest_common.sh@10 -- # set +x 00:23:35.178 01:17:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:35.178 01:17:49 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:35.178 01:17:49 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:23:35.178 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:23:35.178 01:17:49 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:23:35.178 01:17:49 -- common/autotest_common.sh@1208 -- # local i=0 00:23:35.178 01:17:49 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:35.178 01:17:49 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:23:35.178 01:17:49 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:35.178 01:17:49 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:23:35.178 01:17:49 -- common/autotest_common.sh@1220 -- # return 0 00:23:35.178 01:17:49 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:23:35.178 01:17:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:35.178 01:17:49 -- common/autotest_common.sh@10 -- # set +x 00:23:35.178 01:17:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:35.178 01:17:49 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:35.178 01:17:49 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:23:35.436 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:23:35.436 01:17:49 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:23:35.436 01:17:49 -- common/autotest_common.sh@1208 -- # local i=0 00:23:35.436 01:17:49 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:35.436 01:17:49 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:23:35.436 01:17:49 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:35.436 01:17:49 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:23:35.436 01:17:49 -- common/autotest_common.sh@1220 -- # return 0 00:23:35.436 01:17:49 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:23:35.436 01:17:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:35.436 01:17:49 -- common/autotest_common.sh@10 -- # set +x 00:23:35.436 01:17:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:35.436 01:17:49 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:35.436 01:17:49 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:23:35.436 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:23:35.436 01:17:49 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:23:35.436 01:17:49 -- common/autotest_common.sh@1208 -- # local i=0 00:23:35.436 01:17:49 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:35.436 01:17:49 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:23:35.436 01:17:49 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:35.436 01:17:49 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:23:35.436 01:17:50 -- common/autotest_common.sh@1220 -- # return 0 00:23:35.436 01:17:50 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:23:35.436 01:17:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:35.436 01:17:50 -- common/autotest_common.sh@10 -- # set +x 00:23:35.436 01:17:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:35.436 01:17:50 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:23:35.436 01:17:50 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:23:35.436 01:17:50 -- target/multiconnection.sh@47 -- # nvmftestfini 00:23:35.436 01:17:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:35.436 01:17:50 -- nvmf/common.sh@116 -- # sync 00:23:35.436 01:17:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:35.436 01:17:50 -- nvmf/common.sh@119 -- # set +e 00:23:35.436 01:17:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:35.436 01:17:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:35.436 rmmod nvme_tcp 00:23:35.694 rmmod nvme_fabrics 00:23:35.694 rmmod nvme_keyring 00:23:35.694 01:17:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:35.694 01:17:50 -- nvmf/common.sh@123 -- # set -e 00:23:35.694 01:17:50 -- nvmf/common.sh@124 -- # return 0 00:23:35.694 01:17:50 -- nvmf/common.sh@477 -- # '[' -n 2081760 ']' 00:23:35.694 01:17:50 -- nvmf/common.sh@478 -- # killprocess 2081760 00:23:35.694 01:17:50 -- common/autotest_common.sh@936 -- # '[' -z 2081760 ']' 00:23:35.694 01:17:50 -- common/autotest_common.sh@940 -- # kill -0 2081760 00:23:35.694 01:17:50 -- common/autotest_common.sh@941 -- # uname 00:23:35.694 01:17:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:35.694 01:17:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2081760 00:23:35.694 01:17:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:35.694 01:17:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:35.694 01:17:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2081760' 00:23:35.694 killing process with pid 2081760 00:23:35.694 01:17:50 -- common/autotest_common.sh@955 -- # kill 2081760 00:23:35.694 01:17:50 -- common/autotest_common.sh@960 -- # wait 2081760 00:23:36.260 01:17:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:36.260 01:17:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:36.260 01:17:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:36.260 01:17:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:36.260 01:17:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:36.260 01:17:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:36.260 01:17:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:36.260 01:17:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:38.182 01:17:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:38.182 00:23:38.182 real 1m1.366s 00:23:38.182 user 3m19.627s 00:23:38.182 sys 0m27.972s 00:23:38.182 01:17:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:38.182 01:17:52 -- common/autotest_common.sh@10 -- # set +x 00:23:38.182 ************************************ 00:23:38.182 END TEST nvmf_multiconnection 00:23:38.182 ************************************ 00:23:38.182 01:17:52 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:38.182 01:17:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:38.182 01:17:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:38.182 01:17:52 -- common/autotest_common.sh@10 -- # set +x 00:23:38.182 ************************************ 00:23:38.182 START TEST nvmf_initiator_timeout 00:23:38.182 ************************************ 00:23:38.182 01:17:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:38.182 * Looking for test storage... 00:23:38.182 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:38.182 01:17:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:38.182 01:17:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:38.182 01:17:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:38.441 01:17:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:38.441 01:17:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:38.441 01:17:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:38.441 01:17:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:38.441 01:17:52 -- scripts/common.sh@335 -- # IFS=.-: 00:23:38.441 01:17:52 -- scripts/common.sh@335 -- # read -ra ver1 00:23:38.441 01:17:52 -- scripts/common.sh@336 -- # IFS=.-: 00:23:38.441 01:17:52 -- scripts/common.sh@336 -- # read -ra ver2 00:23:38.441 01:17:52 -- scripts/common.sh@337 -- # local 'op=<' 00:23:38.441 01:17:52 -- scripts/common.sh@339 -- # ver1_l=2 00:23:38.441 01:17:52 -- scripts/common.sh@340 -- # ver2_l=1 00:23:38.441 01:17:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:38.441 01:17:52 -- scripts/common.sh@343 -- # case "$op" in 00:23:38.441 01:17:52 -- scripts/common.sh@344 -- # : 1 00:23:38.441 01:17:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:38.441 01:17:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:38.441 01:17:52 -- scripts/common.sh@364 -- # decimal 1 00:23:38.441 01:17:52 -- scripts/common.sh@352 -- # local d=1 00:23:38.441 01:17:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:38.441 01:17:52 -- scripts/common.sh@354 -- # echo 1 00:23:38.441 01:17:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:38.441 01:17:52 -- scripts/common.sh@365 -- # decimal 2 00:23:38.441 01:17:52 -- scripts/common.sh@352 -- # local d=2 00:23:38.441 01:17:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:38.441 01:17:52 -- scripts/common.sh@354 -- # echo 2 00:23:38.441 01:17:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:38.441 01:17:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:38.441 01:17:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:38.441 01:17:52 -- scripts/common.sh@367 -- # return 0 00:23:38.441 01:17:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:38.441 01:17:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:38.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:38.441 --rc genhtml_branch_coverage=1 00:23:38.441 --rc genhtml_function_coverage=1 00:23:38.441 --rc genhtml_legend=1 00:23:38.441 --rc geninfo_all_blocks=1 00:23:38.441 --rc geninfo_unexecuted_blocks=1 00:23:38.441 00:23:38.441 ' 00:23:38.441 01:17:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:38.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:38.441 --rc genhtml_branch_coverage=1 00:23:38.441 --rc genhtml_function_coverage=1 00:23:38.441 --rc genhtml_legend=1 00:23:38.441 --rc geninfo_all_blocks=1 00:23:38.441 --rc geninfo_unexecuted_blocks=1 00:23:38.441 00:23:38.441 ' 00:23:38.441 01:17:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:38.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:38.441 --rc genhtml_branch_coverage=1 00:23:38.441 --rc genhtml_function_coverage=1 00:23:38.441 --rc genhtml_legend=1 00:23:38.441 --rc geninfo_all_blocks=1 00:23:38.441 --rc geninfo_unexecuted_blocks=1 00:23:38.441 00:23:38.441 ' 00:23:38.441 01:17:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:38.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:38.441 --rc genhtml_branch_coverage=1 00:23:38.441 --rc genhtml_function_coverage=1 00:23:38.441 --rc genhtml_legend=1 00:23:38.441 --rc geninfo_all_blocks=1 00:23:38.441 --rc geninfo_unexecuted_blocks=1 00:23:38.441 00:23:38.441 ' 00:23:38.441 01:17:52 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:38.441 01:17:52 -- nvmf/common.sh@7 -- # uname -s 00:23:38.441 01:17:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:38.441 01:17:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:38.441 01:17:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:38.441 01:17:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:38.441 01:17:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:38.441 01:17:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:38.441 01:17:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:38.441 01:17:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:38.441 01:17:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:38.441 01:17:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:38.441 01:17:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:38.441 01:17:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:38.441 01:17:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:38.441 01:17:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:38.441 01:17:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:38.441 01:17:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:38.441 01:17:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:38.441 01:17:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:38.441 01:17:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:38.441 01:17:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:38.441 01:17:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:38.441 01:17:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:38.441 01:17:52 -- paths/export.sh@5 -- # export PATH 00:23:38.441 01:17:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:38.441 01:17:52 -- nvmf/common.sh@46 -- # : 0 00:23:38.441 01:17:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:38.441 01:17:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:38.441 01:17:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:38.441 01:17:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:38.441 01:17:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:38.441 01:17:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:38.441 01:17:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:38.441 01:17:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:38.441 01:17:52 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:38.441 01:17:52 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:38.441 01:17:52 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:23:38.441 01:17:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:38.441 01:17:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:38.441 01:17:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:38.441 01:17:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:38.441 01:17:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:38.441 01:17:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:38.441 01:17:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:38.441 01:17:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:38.441 01:17:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:38.441 01:17:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:38.441 01:17:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:38.441 01:17:52 -- common/autotest_common.sh@10 -- # set +x 00:23:40.344 01:17:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:40.344 01:17:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:40.344 01:17:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:40.344 01:17:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:40.344 01:17:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:40.344 01:17:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:40.344 01:17:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:40.344 01:17:54 -- nvmf/common.sh@294 -- # net_devs=() 00:23:40.344 01:17:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:40.344 01:17:54 -- nvmf/common.sh@295 -- # e810=() 00:23:40.344 01:17:54 -- nvmf/common.sh@295 -- # local -ga e810 00:23:40.344 01:17:54 -- nvmf/common.sh@296 -- # x722=() 00:23:40.344 01:17:54 -- nvmf/common.sh@296 -- # local -ga x722 00:23:40.344 01:17:54 -- nvmf/common.sh@297 -- # mlx=() 00:23:40.344 01:17:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:40.344 01:17:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:40.344 01:17:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:40.344 01:17:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:40.344 01:17:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:40.344 01:17:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:40.344 01:17:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:40.344 01:17:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:40.344 01:17:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:40.344 01:17:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:40.344 01:17:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:40.344 01:17:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:40.344 01:17:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:40.344 01:17:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:40.344 01:17:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:40.344 01:17:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:40.344 01:17:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:40.344 01:17:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:40.344 01:17:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:40.344 01:17:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:40.344 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:40.344 01:17:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:40.344 01:17:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:40.344 01:17:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:40.344 01:17:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:40.344 01:17:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:40.344 01:17:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:40.344 01:17:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:40.344 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:40.344 01:17:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:40.344 01:17:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:40.344 01:17:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:40.344 01:17:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:40.344 01:17:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:40.344 01:17:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:40.344 01:17:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:40.344 01:17:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:40.344 01:17:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:40.345 01:17:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:40.345 01:17:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:40.345 01:17:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:40.345 01:17:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:40.345 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:40.345 01:17:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:40.345 01:17:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:40.345 01:17:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:40.345 01:17:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:40.345 01:17:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:40.345 01:17:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:40.345 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:40.345 01:17:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:40.345 01:17:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:40.345 01:17:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:40.345 01:17:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:40.345 01:17:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:40.345 01:17:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:40.345 01:17:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:40.345 01:17:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:40.345 01:17:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:40.345 01:17:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:40.345 01:17:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:40.345 01:17:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:40.345 01:17:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:40.345 01:17:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:40.345 01:17:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:40.345 01:17:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:40.345 01:17:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:40.345 01:17:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:40.345 01:17:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:40.345 01:17:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:40.345 01:17:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:40.345 01:17:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:40.345 01:17:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:40.607 01:17:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:40.607 01:17:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:40.607 01:17:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:40.607 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:40.607 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.278 ms 00:23:40.607 00:23:40.607 --- 10.0.0.2 ping statistics --- 00:23:40.607 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:40.607 rtt min/avg/max/mdev = 0.278/0.278/0.278/0.000 ms 00:23:40.607 01:17:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:40.607 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:40.607 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:23:40.607 00:23:40.607 --- 10.0.0.1 ping statistics --- 00:23:40.607 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:40.607 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:23:40.607 01:17:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:40.607 01:17:54 -- nvmf/common.sh@410 -- # return 0 00:23:40.607 01:17:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:40.608 01:17:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:40.608 01:17:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:40.608 01:17:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:40.608 01:17:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:40.608 01:17:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:40.608 01:17:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:40.608 01:17:55 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:23:40.608 01:17:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:40.608 01:17:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:40.608 01:17:55 -- common/autotest_common.sh@10 -- # set +x 00:23:40.608 01:17:55 -- nvmf/common.sh@469 -- # nvmfpid=2090746 00:23:40.608 01:17:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:40.608 01:17:55 -- nvmf/common.sh@470 -- # waitforlisten 2090746 00:23:40.608 01:17:55 -- common/autotest_common.sh@829 -- # '[' -z 2090746 ']' 00:23:40.608 01:17:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:40.608 01:17:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:40.608 01:17:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:40.608 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:40.608 01:17:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:40.608 01:17:55 -- common/autotest_common.sh@10 -- # set +x 00:23:40.608 [2024-11-28 01:17:55.072681] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:40.608 [2024-11-28 01:17:55.072780] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:40.608 EAL: No free 2048 kB hugepages reported on node 1 00:23:40.608 [2024-11-28 01:17:55.142632] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:40.871 [2024-11-28 01:17:55.235467] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:40.871 [2024-11-28 01:17:55.235653] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:40.871 [2024-11-28 01:17:55.235674] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:40.871 [2024-11-28 01:17:55.235690] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:40.871 [2024-11-28 01:17:55.235774] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:40.871 [2024-11-28 01:17:55.235832] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:40.871 [2024-11-28 01:17:55.235885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:40.871 [2024-11-28 01:17:55.235888] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:41.437 01:17:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:41.437 01:17:56 -- common/autotest_common.sh@862 -- # return 0 00:23:41.437 01:17:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:41.437 01:17:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:41.437 01:17:56 -- common/autotest_common.sh@10 -- # set +x 00:23:41.695 01:17:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:41.695 01:17:56 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:23:41.695 01:17:56 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:41.695 01:17:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:41.695 01:17:56 -- common/autotest_common.sh@10 -- # set +x 00:23:41.695 Malloc0 00:23:41.695 01:17:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:41.695 01:17:56 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:23:41.695 01:17:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:41.695 01:17:56 -- common/autotest_common.sh@10 -- # set +x 00:23:41.695 Delay0 00:23:41.695 01:17:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:41.695 01:17:56 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:41.695 01:17:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:41.695 01:17:56 -- common/autotest_common.sh@10 -- # set +x 00:23:41.695 [2024-11-28 01:17:56.074992] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:41.695 01:17:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:41.695 01:17:56 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:23:41.695 01:17:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:41.695 01:17:56 -- common/autotest_common.sh@10 -- # set +x 00:23:41.695 01:17:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:41.695 01:17:56 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:23:41.695 01:17:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:41.695 01:17:56 -- common/autotest_common.sh@10 -- # set +x 00:23:41.695 01:17:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:41.695 01:17:56 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:41.695 01:17:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:41.695 01:17:56 -- common/autotest_common.sh@10 -- # set +x 00:23:41.695 [2024-11-28 01:17:56.103239] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:41.695 01:17:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:41.695 01:17:56 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:23:42.261 01:17:56 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:23:42.261 01:17:56 -- common/autotest_common.sh@1187 -- # local i=0 00:23:42.261 01:17:56 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:42.261 01:17:56 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:42.261 01:17:56 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:44.159 01:17:58 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:44.159 01:17:58 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:44.159 01:17:58 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:23:44.159 01:17:58 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:44.159 01:17:58 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:44.159 01:17:58 -- common/autotest_common.sh@1197 -- # return 0 00:23:44.159 01:17:58 -- target/initiator_timeout.sh@35 -- # fio_pid=2091197 00:23:44.159 01:17:58 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:23:44.159 01:17:58 -- target/initiator_timeout.sh@37 -- # sleep 3 00:23:44.159 [global] 00:23:44.159 thread=1 00:23:44.159 invalidate=1 00:23:44.159 rw=write 00:23:44.159 time_based=1 00:23:44.159 runtime=60 00:23:44.159 ioengine=libaio 00:23:44.159 direct=1 00:23:44.159 bs=4096 00:23:44.159 iodepth=1 00:23:44.159 norandommap=0 00:23:44.159 numjobs=1 00:23:44.159 00:23:44.159 verify_dump=1 00:23:44.159 verify_backlog=512 00:23:44.159 verify_state_save=0 00:23:44.159 do_verify=1 00:23:44.159 verify=crc32c-intel 00:23:44.159 [job0] 00:23:44.159 filename=/dev/nvme0n1 00:23:44.159 Could not set queue depth (nvme0n1) 00:23:44.417 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:23:44.417 fio-3.35 00:23:44.417 Starting 1 thread 00:23:47.697 01:18:01 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:23:47.697 01:18:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:47.697 01:18:01 -- common/autotest_common.sh@10 -- # set +x 00:23:47.697 true 00:23:47.698 01:18:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:47.698 01:18:01 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:23:47.698 01:18:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:47.698 01:18:01 -- common/autotest_common.sh@10 -- # set +x 00:23:47.698 true 00:23:47.698 01:18:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:47.698 01:18:01 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:23:47.698 01:18:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:47.698 01:18:01 -- common/autotest_common.sh@10 -- # set +x 00:23:47.698 true 00:23:47.698 01:18:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:47.698 01:18:01 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:23:47.698 01:18:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:47.698 01:18:01 -- common/autotest_common.sh@10 -- # set +x 00:23:47.698 true 00:23:47.698 01:18:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:47.698 01:18:01 -- target/initiator_timeout.sh@45 -- # sleep 3 00:23:50.225 01:18:04 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:23:50.225 01:18:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:50.225 01:18:04 -- common/autotest_common.sh@10 -- # set +x 00:23:50.225 true 00:23:50.225 01:18:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:50.225 01:18:04 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:23:50.225 01:18:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:50.225 01:18:04 -- common/autotest_common.sh@10 -- # set +x 00:23:50.225 true 00:23:50.225 01:18:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:50.225 01:18:04 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:23:50.225 01:18:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:50.225 01:18:04 -- common/autotest_common.sh@10 -- # set +x 00:23:50.225 true 00:23:50.225 01:18:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:50.225 01:18:04 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:23:50.225 01:18:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:50.225 01:18:04 -- common/autotest_common.sh@10 -- # set +x 00:23:50.225 true 00:23:50.225 01:18:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:50.225 01:18:04 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:23:50.225 01:18:04 -- target/initiator_timeout.sh@54 -- # wait 2091197 00:24:46.436 00:24:46.436 job0: (groupid=0, jobs=1): err= 0: pid=2091388: Thu Nov 28 01:18:59 2024 00:24:46.436 read: IOPS=176, BW=705KiB/s (722kB/s)(41.4MiB/60038msec) 00:24:46.436 slat (nsec): min=5198, max=74792, avg=11765.62, stdev=6987.89 00:24:46.436 clat (usec): min=232, max=40997k, avg=5409.73, stdev=398506.26 00:24:46.436 lat (usec): min=238, max=40997k, avg=5421.49, stdev=398506.34 00:24:46.436 clat percentiles (usec): 00:24:46.436 | 1.00th=[ 243], 5.00th=[ 249], 10.00th=[ 251], 20.00th=[ 258], 00:24:46.436 | 30.00th=[ 265], 40.00th=[ 269], 50.00th=[ 277], 60.00th=[ 285], 00:24:46.436 | 70.00th=[ 293], 80.00th=[ 306], 90.00th=[ 379], 95.00th=[ 494], 00:24:46.436 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:24:46.436 | 99.99th=[44827] 00:24:46.436 write: IOPS=179, BW=716KiB/s (734kB/s)(42.0MiB/60038msec); 0 zone resets 00:24:46.436 slat (usec): min=6, max=9910, avg=15.48, stdev=121.40 00:24:46.436 clat (usec): min=176, max=1567, avg=222.74, stdev=40.36 00:24:46.436 lat (usec): min=183, max=10155, avg=238.21, stdev=128.96 00:24:46.436 clat percentiles (usec): 00:24:46.436 | 1.00th=[ 184], 5.00th=[ 190], 10.00th=[ 194], 20.00th=[ 198], 00:24:46.436 | 30.00th=[ 202], 40.00th=[ 208], 50.00th=[ 219], 60.00th=[ 225], 00:24:46.436 | 70.00th=[ 233], 80.00th=[ 241], 90.00th=[ 255], 95.00th=[ 269], 00:24:46.436 | 99.00th=[ 355], 99.50th=[ 396], 99.90th=[ 498], 99.95th=[ 758], 00:24:46.436 | 99.99th=[ 1500] 00:24:46.436 bw ( KiB/s): min= 2680, max= 8192, per=100.00%, avg=6616.62, stdev=1972.13, samples=13 00:24:46.436 iops : min= 670, max= 2048, avg=1654.15, stdev=493.03, samples=13 00:24:46.436 lat (usec) : 250=47.97%, 500=49.65%, 750=0.82%, 1000=0.01% 00:24:46.436 lat (msec) : 2=0.03%, 50=1.51%, >=2000=0.01% 00:24:46.436 cpu : usr=0.35%, sys=0.63%, ctx=21340, majf=0, minf=1 00:24:46.436 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:24:46.436 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:46.436 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:46.436 issued rwts: total=10586,10752,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:46.436 latency : target=0, window=0, percentile=100.00%, depth=1 00:24:46.436 00:24:46.436 Run status group 0 (all jobs): 00:24:46.436 READ: bw=705KiB/s (722kB/s), 705KiB/s-705KiB/s (722kB/s-722kB/s), io=41.4MiB (43.4MB), run=60038-60038msec 00:24:46.436 WRITE: bw=716KiB/s (734kB/s), 716KiB/s-716KiB/s (734kB/s-734kB/s), io=42.0MiB (44.0MB), run=60038-60038msec 00:24:46.436 00:24:46.436 Disk stats (read/write): 00:24:46.436 nvme0n1: ios=10681/10752, merge=0/0, ticks=16237/2293, in_queue=18530, util=99.77% 00:24:46.436 01:18:59 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:24:46.436 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:24:46.436 01:18:59 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:24:46.436 01:18:59 -- common/autotest_common.sh@1208 -- # local i=0 00:24:46.436 01:18:59 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:46.436 01:18:59 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:46.436 01:18:59 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:46.436 01:18:59 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:46.436 01:18:59 -- common/autotest_common.sh@1220 -- # return 0 00:24:46.436 01:18:59 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:24:46.436 01:18:59 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:24:46.436 nvmf hotplug test: fio successful as expected 00:24:46.436 01:18:59 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:46.436 01:18:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:46.436 01:18:59 -- common/autotest_common.sh@10 -- # set +x 00:24:46.436 01:18:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:46.436 01:18:59 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:24:46.436 01:18:59 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:24:46.436 01:18:59 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:24:46.436 01:18:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:46.436 01:18:59 -- nvmf/common.sh@116 -- # sync 00:24:46.436 01:18:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:46.436 01:18:59 -- nvmf/common.sh@119 -- # set +e 00:24:46.436 01:18:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:46.436 01:18:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:46.436 rmmod nvme_tcp 00:24:46.436 rmmod nvme_fabrics 00:24:46.436 rmmod nvme_keyring 00:24:46.436 01:18:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:46.436 01:18:59 -- nvmf/common.sh@123 -- # set -e 00:24:46.436 01:18:59 -- nvmf/common.sh@124 -- # return 0 00:24:46.436 01:18:59 -- nvmf/common.sh@477 -- # '[' -n 2090746 ']' 00:24:46.436 01:18:59 -- nvmf/common.sh@478 -- # killprocess 2090746 00:24:46.436 01:18:59 -- common/autotest_common.sh@936 -- # '[' -z 2090746 ']' 00:24:46.436 01:18:59 -- common/autotest_common.sh@940 -- # kill -0 2090746 00:24:46.436 01:18:59 -- common/autotest_common.sh@941 -- # uname 00:24:46.436 01:18:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:46.436 01:18:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2090746 00:24:46.436 01:18:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:46.436 01:18:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:46.436 01:18:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2090746' 00:24:46.436 killing process with pid 2090746 00:24:46.436 01:18:59 -- common/autotest_common.sh@955 -- # kill 2090746 00:24:46.436 01:18:59 -- common/autotest_common.sh@960 -- # wait 2090746 00:24:46.436 01:18:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:46.436 01:18:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:46.436 01:18:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:46.436 01:18:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:46.436 01:18:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:46.436 01:18:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:46.436 01:18:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:46.436 01:18:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:47.371 01:19:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:47.371 00:24:47.371 real 1m8.916s 00:24:47.371 user 4m13.355s 00:24:47.371 sys 0m7.310s 00:24:47.371 01:19:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:47.371 01:19:01 -- common/autotest_common.sh@10 -- # set +x 00:24:47.371 ************************************ 00:24:47.371 END TEST nvmf_initiator_timeout 00:24:47.371 ************************************ 00:24:47.371 01:19:01 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:24:47.371 01:19:01 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:24:47.371 01:19:01 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:24:47.371 01:19:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:47.371 01:19:01 -- common/autotest_common.sh@10 -- # set +x 00:24:49.271 01:19:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:49.271 01:19:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:49.271 01:19:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:49.271 01:19:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:49.271 01:19:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:49.271 01:19:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:49.271 01:19:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:49.271 01:19:03 -- nvmf/common.sh@294 -- # net_devs=() 00:24:49.271 01:19:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:49.271 01:19:03 -- nvmf/common.sh@295 -- # e810=() 00:24:49.271 01:19:03 -- nvmf/common.sh@295 -- # local -ga e810 00:24:49.271 01:19:03 -- nvmf/common.sh@296 -- # x722=() 00:24:49.271 01:19:03 -- nvmf/common.sh@296 -- # local -ga x722 00:24:49.271 01:19:03 -- nvmf/common.sh@297 -- # mlx=() 00:24:49.271 01:19:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:49.271 01:19:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:49.271 01:19:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:49.271 01:19:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:49.271 01:19:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:49.271 01:19:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:49.271 01:19:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:49.271 01:19:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:49.271 01:19:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:49.271 01:19:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:49.271 01:19:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:49.271 01:19:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:49.271 01:19:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:49.271 01:19:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:49.271 01:19:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:49.271 01:19:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:49.271 01:19:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:49.271 01:19:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:49.271 01:19:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:49.271 01:19:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:49.271 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:49.271 01:19:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:49.271 01:19:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:49.271 01:19:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:49.271 01:19:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:49.271 01:19:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:49.271 01:19:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:49.271 01:19:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:49.271 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:49.271 01:19:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:49.271 01:19:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:49.271 01:19:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:49.271 01:19:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:49.271 01:19:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:49.271 01:19:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:49.271 01:19:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:49.271 01:19:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:49.271 01:19:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:49.271 01:19:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:49.271 01:19:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:49.271 01:19:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:49.271 01:19:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:49.271 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:49.271 01:19:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:49.271 01:19:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:49.271 01:19:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:49.271 01:19:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:49.271 01:19:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:49.271 01:19:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:49.271 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:49.271 01:19:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:49.271 01:19:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:49.271 01:19:03 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:49.271 01:19:03 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:24:49.271 01:19:03 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:49.272 01:19:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:49.272 01:19:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:49.272 01:19:03 -- common/autotest_common.sh@10 -- # set +x 00:24:49.272 ************************************ 00:24:49.272 START TEST nvmf_perf_adq 00:24:49.272 ************************************ 00:24:49.272 01:19:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:49.272 * Looking for test storage... 00:24:49.272 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:49.272 01:19:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:49.272 01:19:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:49.272 01:19:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:49.272 01:19:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:49.272 01:19:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:49.272 01:19:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:49.272 01:19:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:49.272 01:19:03 -- scripts/common.sh@335 -- # IFS=.-: 00:24:49.272 01:19:03 -- scripts/common.sh@335 -- # read -ra ver1 00:24:49.272 01:19:03 -- scripts/common.sh@336 -- # IFS=.-: 00:24:49.272 01:19:03 -- scripts/common.sh@336 -- # read -ra ver2 00:24:49.272 01:19:03 -- scripts/common.sh@337 -- # local 'op=<' 00:24:49.272 01:19:03 -- scripts/common.sh@339 -- # ver1_l=2 00:24:49.272 01:19:03 -- scripts/common.sh@340 -- # ver2_l=1 00:24:49.272 01:19:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:49.272 01:19:03 -- scripts/common.sh@343 -- # case "$op" in 00:24:49.272 01:19:03 -- scripts/common.sh@344 -- # : 1 00:24:49.272 01:19:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:49.272 01:19:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:49.272 01:19:03 -- scripts/common.sh@364 -- # decimal 1 00:24:49.272 01:19:03 -- scripts/common.sh@352 -- # local d=1 00:24:49.272 01:19:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:49.272 01:19:03 -- scripts/common.sh@354 -- # echo 1 00:24:49.272 01:19:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:49.272 01:19:03 -- scripts/common.sh@365 -- # decimal 2 00:24:49.272 01:19:03 -- scripts/common.sh@352 -- # local d=2 00:24:49.272 01:19:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:49.272 01:19:03 -- scripts/common.sh@354 -- # echo 2 00:24:49.272 01:19:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:49.272 01:19:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:49.272 01:19:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:49.272 01:19:03 -- scripts/common.sh@367 -- # return 0 00:24:49.272 01:19:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:49.272 01:19:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:49.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:49.272 --rc genhtml_branch_coverage=1 00:24:49.272 --rc genhtml_function_coverage=1 00:24:49.272 --rc genhtml_legend=1 00:24:49.272 --rc geninfo_all_blocks=1 00:24:49.272 --rc geninfo_unexecuted_blocks=1 00:24:49.272 00:24:49.272 ' 00:24:49.272 01:19:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:49.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:49.272 --rc genhtml_branch_coverage=1 00:24:49.272 --rc genhtml_function_coverage=1 00:24:49.272 --rc genhtml_legend=1 00:24:49.272 --rc geninfo_all_blocks=1 00:24:49.272 --rc geninfo_unexecuted_blocks=1 00:24:49.272 00:24:49.272 ' 00:24:49.272 01:19:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:49.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:49.272 --rc genhtml_branch_coverage=1 00:24:49.272 --rc genhtml_function_coverage=1 00:24:49.272 --rc genhtml_legend=1 00:24:49.272 --rc geninfo_all_blocks=1 00:24:49.272 --rc geninfo_unexecuted_blocks=1 00:24:49.272 00:24:49.272 ' 00:24:49.272 01:19:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:49.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:49.272 --rc genhtml_branch_coverage=1 00:24:49.272 --rc genhtml_function_coverage=1 00:24:49.272 --rc genhtml_legend=1 00:24:49.272 --rc geninfo_all_blocks=1 00:24:49.272 --rc geninfo_unexecuted_blocks=1 00:24:49.272 00:24:49.272 ' 00:24:49.272 01:19:03 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:49.272 01:19:03 -- nvmf/common.sh@7 -- # uname -s 00:24:49.272 01:19:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:49.272 01:19:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:49.272 01:19:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:49.272 01:19:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:49.272 01:19:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:49.272 01:19:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:49.272 01:19:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:49.272 01:19:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:49.272 01:19:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:49.272 01:19:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:49.272 01:19:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:49.272 01:19:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:49.272 01:19:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:49.272 01:19:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:49.272 01:19:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:49.272 01:19:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:49.272 01:19:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:49.272 01:19:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:49.272 01:19:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:49.272 01:19:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:49.272 01:19:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:49.272 01:19:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:49.272 01:19:03 -- paths/export.sh@5 -- # export PATH 00:24:49.272 01:19:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:49.272 01:19:03 -- nvmf/common.sh@46 -- # : 0 00:24:49.272 01:19:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:49.272 01:19:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:49.272 01:19:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:49.272 01:19:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:49.272 01:19:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:49.272 01:19:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:49.272 01:19:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:49.272 01:19:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:49.272 01:19:03 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:24:49.272 01:19:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:49.272 01:19:03 -- common/autotest_common.sh@10 -- # set +x 00:24:51.803 01:19:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:51.803 01:19:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:51.803 01:19:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:51.803 01:19:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:51.803 01:19:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:51.803 01:19:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:51.803 01:19:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:51.803 01:19:05 -- nvmf/common.sh@294 -- # net_devs=() 00:24:51.803 01:19:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:51.803 01:19:05 -- nvmf/common.sh@295 -- # e810=() 00:24:51.803 01:19:05 -- nvmf/common.sh@295 -- # local -ga e810 00:24:51.803 01:19:05 -- nvmf/common.sh@296 -- # x722=() 00:24:51.803 01:19:05 -- nvmf/common.sh@296 -- # local -ga x722 00:24:51.803 01:19:05 -- nvmf/common.sh@297 -- # mlx=() 00:24:51.803 01:19:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:51.803 01:19:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:51.803 01:19:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:51.803 01:19:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:51.803 01:19:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:51.803 01:19:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:51.803 01:19:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:51.803 01:19:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:51.803 01:19:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:51.803 01:19:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:51.803 01:19:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:51.803 01:19:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:51.803 01:19:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:51.803 01:19:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:51.803 01:19:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:51.803 01:19:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:51.803 01:19:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:51.803 01:19:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:51.803 01:19:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:51.803 01:19:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:51.803 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:51.803 01:19:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:51.803 01:19:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:51.803 01:19:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:51.803 01:19:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:51.803 01:19:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:51.803 01:19:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:51.803 01:19:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:51.803 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:51.803 01:19:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:51.803 01:19:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:51.803 01:19:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:51.803 01:19:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:51.803 01:19:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:51.803 01:19:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:51.803 01:19:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:51.803 01:19:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:51.803 01:19:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:51.803 01:19:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:51.803 01:19:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:51.803 01:19:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:51.803 01:19:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:51.803 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:51.803 01:19:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:51.803 01:19:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:51.803 01:19:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:51.803 01:19:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:51.803 01:19:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:51.803 01:19:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:51.803 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:51.803 01:19:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:51.803 01:19:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:51.803 01:19:05 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:51.803 01:19:05 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:24:51.803 01:19:05 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:24:51.803 01:19:05 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:24:51.803 01:19:05 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:52.063 01:19:06 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:54.594 01:19:08 -- target/perf_adq.sh@54 -- # sleep 5 00:24:59.866 01:19:13 -- target/perf_adq.sh@67 -- # nvmftestinit 00:24:59.866 01:19:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:59.866 01:19:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:59.866 01:19:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:59.866 01:19:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:59.866 01:19:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:59.866 01:19:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:59.866 01:19:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:59.866 01:19:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:59.866 01:19:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:59.866 01:19:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:59.866 01:19:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:59.866 01:19:13 -- common/autotest_common.sh@10 -- # set +x 00:24:59.866 01:19:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:59.866 01:19:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:59.866 01:19:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:59.866 01:19:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:59.866 01:19:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:59.866 01:19:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:59.866 01:19:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:59.866 01:19:13 -- nvmf/common.sh@294 -- # net_devs=() 00:24:59.866 01:19:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:59.866 01:19:13 -- nvmf/common.sh@295 -- # e810=() 00:24:59.866 01:19:13 -- nvmf/common.sh@295 -- # local -ga e810 00:24:59.866 01:19:13 -- nvmf/common.sh@296 -- # x722=() 00:24:59.866 01:19:13 -- nvmf/common.sh@296 -- # local -ga x722 00:24:59.866 01:19:13 -- nvmf/common.sh@297 -- # mlx=() 00:24:59.866 01:19:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:59.866 01:19:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:59.867 01:19:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:59.867 01:19:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:59.867 01:19:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:59.867 01:19:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:59.867 01:19:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:59.867 01:19:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:59.867 01:19:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:59.867 01:19:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:59.867 01:19:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:59.867 01:19:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:59.867 01:19:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:59.867 01:19:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:59.867 01:19:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:59.867 01:19:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:59.867 01:19:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:59.867 01:19:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:59.867 01:19:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:59.867 01:19:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:59.867 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:59.867 01:19:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:59.867 01:19:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:59.867 01:19:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:59.867 01:19:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:59.867 01:19:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:59.867 01:19:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:59.867 01:19:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:59.867 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:59.867 01:19:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:59.867 01:19:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:59.867 01:19:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:59.867 01:19:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:59.867 01:19:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:59.867 01:19:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:59.867 01:19:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:59.867 01:19:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:59.867 01:19:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:59.867 01:19:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:59.867 01:19:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:59.867 01:19:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:59.867 01:19:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:59.867 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:59.867 01:19:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:59.867 01:19:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:59.867 01:19:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:59.867 01:19:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:59.867 01:19:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:59.867 01:19:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:59.867 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:59.867 01:19:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:59.867 01:19:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:59.867 01:19:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:59.867 01:19:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:59.867 01:19:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:59.867 01:19:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:59.867 01:19:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:59.867 01:19:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:59.867 01:19:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:59.867 01:19:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:59.867 01:19:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:59.867 01:19:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:59.867 01:19:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:59.867 01:19:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:59.867 01:19:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:59.867 01:19:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:59.867 01:19:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:59.867 01:19:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:59.867 01:19:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:59.867 01:19:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:59.867 01:19:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:59.867 01:19:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:59.867 01:19:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:59.867 01:19:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:59.867 01:19:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:59.867 01:19:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:59.867 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:59.867 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.175 ms 00:24:59.867 00:24:59.867 --- 10.0.0.2 ping statistics --- 00:24:59.867 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:59.867 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:24:59.867 01:19:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:59.867 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:59.867 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:24:59.867 00:24:59.867 --- 10.0.0.1 ping statistics --- 00:24:59.867 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:59.867 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:24:59.867 01:19:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:59.867 01:19:14 -- nvmf/common.sh@410 -- # return 0 00:24:59.867 01:19:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:59.867 01:19:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:59.867 01:19:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:59.867 01:19:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:59.867 01:19:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:59.867 01:19:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:59.867 01:19:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:59.867 01:19:14 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:59.867 01:19:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:59.867 01:19:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:59.867 01:19:14 -- common/autotest_common.sh@10 -- # set +x 00:24:59.867 01:19:14 -- nvmf/common.sh@469 -- # nvmfpid=2103863 00:24:59.867 01:19:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:59.867 01:19:14 -- nvmf/common.sh@470 -- # waitforlisten 2103863 00:24:59.867 01:19:14 -- common/autotest_common.sh@829 -- # '[' -z 2103863 ']' 00:24:59.867 01:19:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:59.867 01:19:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:59.867 01:19:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:59.867 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:59.867 01:19:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:59.867 01:19:14 -- common/autotest_common.sh@10 -- # set +x 00:24:59.867 [2024-11-28 01:19:14.093358] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:59.868 [2024-11-28 01:19:14.093435] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:59.868 EAL: No free 2048 kB hugepages reported on node 1 00:24:59.868 [2024-11-28 01:19:14.166028] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:59.868 [2024-11-28 01:19:14.262809] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:59.868 [2024-11-28 01:19:14.262963] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:59.868 [2024-11-28 01:19:14.262984] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:59.868 [2024-11-28 01:19:14.262998] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:59.868 [2024-11-28 01:19:14.263058] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:59.868 [2024-11-28 01:19:14.263115] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:59.868 [2024-11-28 01:19:14.263179] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:59.868 [2024-11-28 01:19:14.263182] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:59.868 01:19:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:59.868 01:19:14 -- common/autotest_common.sh@862 -- # return 0 00:24:59.868 01:19:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:59.868 01:19:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:59.868 01:19:14 -- common/autotest_common.sh@10 -- # set +x 00:24:59.868 01:19:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:59.868 01:19:14 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:24:59.868 01:19:14 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:24:59.868 01:19:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.868 01:19:14 -- common/autotest_common.sh@10 -- # set +x 00:24:59.868 01:19:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:59.868 01:19:14 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:59.868 01:19:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.868 01:19:14 -- common/autotest_common.sh@10 -- # set +x 00:24:59.868 01:19:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:59.868 01:19:14 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:24:59.868 01:19:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.868 01:19:14 -- common/autotest_common.sh@10 -- # set +x 00:24:59.868 [2024-11-28 01:19:14.456044] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:59.868 01:19:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:59.868 01:19:14 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:59.868 01:19:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.868 01:19:14 -- common/autotest_common.sh@10 -- # set +x 00:25:00.126 Malloc1 00:25:00.126 01:19:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:00.126 01:19:14 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:00.126 01:19:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:00.126 01:19:14 -- common/autotest_common.sh@10 -- # set +x 00:25:00.126 01:19:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:00.126 01:19:14 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:25:00.126 01:19:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:00.126 01:19:14 -- common/autotest_common.sh@10 -- # set +x 00:25:00.126 01:19:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:00.127 01:19:14 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:00.127 01:19:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:00.127 01:19:14 -- common/autotest_common.sh@10 -- # set +x 00:25:00.127 [2024-11-28 01:19:14.506941] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:00.127 01:19:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:00.127 01:19:14 -- target/perf_adq.sh@73 -- # perfpid=2103979 00:25:00.127 01:19:14 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:25:00.127 01:19:14 -- target/perf_adq.sh@74 -- # sleep 2 00:25:00.127 EAL: No free 2048 kB hugepages reported on node 1 00:25:02.036 01:19:16 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:25:02.036 01:19:16 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:25:02.036 01:19:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:02.036 01:19:16 -- target/perf_adq.sh@76 -- # wc -l 00:25:02.036 01:19:16 -- common/autotest_common.sh@10 -- # set +x 00:25:02.036 01:19:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:02.036 01:19:16 -- target/perf_adq.sh@76 -- # count=4 00:25:02.036 01:19:16 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:25:02.036 01:19:16 -- target/perf_adq.sh@81 -- # wait 2103979 00:25:10.141 Initializing NVMe Controllers 00:25:10.141 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:10.141 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:25:10.141 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:25:10.141 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:25:10.141 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:25:10.141 Initialization complete. Launching workers. 00:25:10.141 ======================================================== 00:25:10.141 Latency(us) 00:25:10.141 Device Information : IOPS MiB/s Average min max 00:25:10.141 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11169.60 43.63 5730.89 1930.76 8957.52 00:25:10.142 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11188.40 43.70 5721.79 1501.62 9432.43 00:25:10.142 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11462.50 44.78 5584.02 973.58 9522.22 00:25:10.142 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11298.80 44.14 5666.18 1880.26 9881.40 00:25:10.142 ======================================================== 00:25:10.142 Total : 45119.30 176.25 5675.12 973.58 9881.40 00:25:10.142 00:25:10.142 01:19:24 -- target/perf_adq.sh@82 -- # nvmftestfini 00:25:10.142 01:19:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:10.142 01:19:24 -- nvmf/common.sh@116 -- # sync 00:25:10.142 01:19:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:10.142 01:19:24 -- nvmf/common.sh@119 -- # set +e 00:25:10.142 01:19:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:10.142 01:19:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:10.142 rmmod nvme_tcp 00:25:10.142 rmmod nvme_fabrics 00:25:10.142 rmmod nvme_keyring 00:25:10.142 01:19:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:10.142 01:19:24 -- nvmf/common.sh@123 -- # set -e 00:25:10.142 01:19:24 -- nvmf/common.sh@124 -- # return 0 00:25:10.142 01:19:24 -- nvmf/common.sh@477 -- # '[' -n 2103863 ']' 00:25:10.142 01:19:24 -- nvmf/common.sh@478 -- # killprocess 2103863 00:25:10.142 01:19:24 -- common/autotest_common.sh@936 -- # '[' -z 2103863 ']' 00:25:10.142 01:19:24 -- common/autotest_common.sh@940 -- # kill -0 2103863 00:25:10.142 01:19:24 -- common/autotest_common.sh@941 -- # uname 00:25:10.142 01:19:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:10.142 01:19:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2103863 00:25:10.142 01:19:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:10.142 01:19:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:10.142 01:19:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2103863' 00:25:10.142 killing process with pid 2103863 00:25:10.142 01:19:24 -- common/autotest_common.sh@955 -- # kill 2103863 00:25:10.142 01:19:24 -- common/autotest_common.sh@960 -- # wait 2103863 00:25:10.400 01:19:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:10.400 01:19:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:10.400 01:19:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:10.400 01:19:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:10.400 01:19:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:10.400 01:19:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:10.400 01:19:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:10.400 01:19:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:13.064 01:19:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:13.064 01:19:27 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:25:13.064 01:19:27 -- target/perf_adq.sh@52 -- # rmmod ice 00:25:13.064 01:19:27 -- target/perf_adq.sh@53 -- # modprobe ice 00:25:15.593 01:19:29 -- target/perf_adq.sh@54 -- # sleep 5 00:25:20.866 01:19:34 -- target/perf_adq.sh@87 -- # nvmftestinit 00:25:20.866 01:19:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:20.866 01:19:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:20.866 01:19:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:20.866 01:19:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:20.866 01:19:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:20.866 01:19:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:20.866 01:19:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:20.866 01:19:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:20.866 01:19:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:20.866 01:19:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:20.866 01:19:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:20.866 01:19:34 -- common/autotest_common.sh@10 -- # set +x 00:25:20.866 01:19:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:20.866 01:19:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:20.866 01:19:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:20.866 01:19:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:20.866 01:19:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:20.866 01:19:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:20.866 01:19:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:20.866 01:19:34 -- nvmf/common.sh@294 -- # net_devs=() 00:25:20.866 01:19:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:20.866 01:19:34 -- nvmf/common.sh@295 -- # e810=() 00:25:20.866 01:19:34 -- nvmf/common.sh@295 -- # local -ga e810 00:25:20.866 01:19:34 -- nvmf/common.sh@296 -- # x722=() 00:25:20.866 01:19:34 -- nvmf/common.sh@296 -- # local -ga x722 00:25:20.866 01:19:34 -- nvmf/common.sh@297 -- # mlx=() 00:25:20.866 01:19:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:20.866 01:19:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:20.866 01:19:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:20.866 01:19:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:20.866 01:19:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:20.866 01:19:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:20.866 01:19:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:20.866 01:19:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:20.866 01:19:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:20.866 01:19:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:20.866 01:19:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:20.866 01:19:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:20.866 01:19:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:20.866 01:19:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:20.866 01:19:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:20.866 01:19:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:20.866 01:19:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:20.866 01:19:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:20.866 01:19:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:20.866 01:19:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:20.866 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:20.866 01:19:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:20.866 01:19:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:20.866 01:19:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:20.866 01:19:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:20.866 01:19:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:20.866 01:19:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:20.866 01:19:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:20.866 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:20.866 01:19:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:20.866 01:19:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:20.866 01:19:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:20.866 01:19:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:20.866 01:19:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:20.866 01:19:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:20.866 01:19:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:20.866 01:19:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:20.866 01:19:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:20.866 01:19:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:20.866 01:19:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:20.866 01:19:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:20.866 01:19:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:20.867 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:20.867 01:19:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:20.867 01:19:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:20.867 01:19:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:20.867 01:19:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:20.867 01:19:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:20.867 01:19:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:20.867 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:20.867 01:19:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:20.867 01:19:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:20.867 01:19:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:20.867 01:19:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:20.867 01:19:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:20.867 01:19:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:20.867 01:19:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:20.867 01:19:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:20.867 01:19:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:20.867 01:19:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:20.867 01:19:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:20.867 01:19:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:20.867 01:19:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:20.867 01:19:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:20.867 01:19:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:20.867 01:19:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:20.867 01:19:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:20.867 01:19:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:20.867 01:19:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:20.867 01:19:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:20.867 01:19:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:20.867 01:19:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:20.867 01:19:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:20.867 01:19:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:20.867 01:19:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:20.867 01:19:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:20.867 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:20.867 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.290 ms 00:25:20.867 00:25:20.867 --- 10.0.0.2 ping statistics --- 00:25:20.867 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:20.867 rtt min/avg/max/mdev = 0.290/0.290/0.290/0.000 ms 00:25:20.867 01:19:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:20.867 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:20.867 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.136 ms 00:25:20.867 00:25:20.867 --- 10.0.0.1 ping statistics --- 00:25:20.867 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:20.867 rtt min/avg/max/mdev = 0.136/0.136/0.136/0.000 ms 00:25:20.867 01:19:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:20.867 01:19:35 -- nvmf/common.sh@410 -- # return 0 00:25:20.867 01:19:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:20.867 01:19:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:20.867 01:19:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:20.867 01:19:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:20.867 01:19:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:20.867 01:19:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:20.867 01:19:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:20.867 01:19:35 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:25:20.867 01:19:35 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:25:20.867 01:19:35 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:25:20.867 01:19:35 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:25:20.867 net.core.busy_poll = 1 00:25:20.867 01:19:35 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:25:20.867 net.core.busy_read = 1 00:25:20.867 01:19:35 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:25:20.867 01:19:35 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:25:20.867 01:19:35 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:25:20.867 01:19:35 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:25:20.867 01:19:35 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:25:20.867 01:19:35 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:25:20.867 01:19:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:20.867 01:19:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:20.867 01:19:35 -- common/autotest_common.sh@10 -- # set +x 00:25:20.867 01:19:35 -- nvmf/common.sh@469 -- # nvmfpid=2106670 00:25:20.867 01:19:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:25:20.867 01:19:35 -- nvmf/common.sh@470 -- # waitforlisten 2106670 00:25:20.867 01:19:35 -- common/autotest_common.sh@829 -- # '[' -z 2106670 ']' 00:25:20.867 01:19:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:20.867 01:19:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:20.867 01:19:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:20.867 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:20.867 01:19:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:20.867 01:19:35 -- common/autotest_common.sh@10 -- # set +x 00:25:20.867 [2024-11-28 01:19:35.281332] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:20.867 [2024-11-28 01:19:35.281414] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:20.867 EAL: No free 2048 kB hugepages reported on node 1 00:25:20.867 [2024-11-28 01:19:35.346486] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:20.867 [2024-11-28 01:19:35.431374] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:20.867 [2024-11-28 01:19:35.431506] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:20.867 [2024-11-28 01:19:35.431541] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:20.867 [2024-11-28 01:19:35.431554] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:20.867 [2024-11-28 01:19:35.431611] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:20.867 [2024-11-28 01:19:35.431638] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:20.867 [2024-11-28 01:19:35.431695] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:20.867 [2024-11-28 01:19:35.431698] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:21.125 01:19:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:21.125 01:19:35 -- common/autotest_common.sh@862 -- # return 0 00:25:21.125 01:19:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:21.125 01:19:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:21.125 01:19:35 -- common/autotest_common.sh@10 -- # set +x 00:25:21.125 01:19:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:21.125 01:19:35 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:25:21.125 01:19:35 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:25:21.125 01:19:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:21.125 01:19:35 -- common/autotest_common.sh@10 -- # set +x 00:25:21.125 01:19:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:21.125 01:19:35 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:25:21.125 01:19:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:21.125 01:19:35 -- common/autotest_common.sh@10 -- # set +x 00:25:21.125 01:19:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:21.125 01:19:35 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:25:21.126 01:19:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:21.126 01:19:35 -- common/autotest_common.sh@10 -- # set +x 00:25:21.126 [2024-11-28 01:19:35.648343] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:21.126 01:19:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:21.126 01:19:35 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:21.126 01:19:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:21.126 01:19:35 -- common/autotest_common.sh@10 -- # set +x 00:25:21.126 Malloc1 00:25:21.126 01:19:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:21.126 01:19:35 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:21.126 01:19:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:21.126 01:19:35 -- common/autotest_common.sh@10 -- # set +x 00:25:21.126 01:19:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:21.126 01:19:35 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:25:21.126 01:19:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:21.126 01:19:35 -- common/autotest_common.sh@10 -- # set +x 00:25:21.126 01:19:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:21.126 01:19:35 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:21.126 01:19:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:21.126 01:19:35 -- common/autotest_common.sh@10 -- # set +x 00:25:21.126 [2024-11-28 01:19:35.701930] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:21.126 01:19:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:21.126 01:19:35 -- target/perf_adq.sh@94 -- # perfpid=2106714 00:25:21.126 01:19:35 -- target/perf_adq.sh@95 -- # sleep 2 00:25:21.126 01:19:35 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:25:21.385 EAL: No free 2048 kB hugepages reported on node 1 00:25:23.287 01:19:37 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:25:23.287 01:19:37 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:25:23.287 01:19:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:23.287 01:19:37 -- common/autotest_common.sh@10 -- # set +x 00:25:23.287 01:19:37 -- target/perf_adq.sh@97 -- # wc -l 00:25:23.287 01:19:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:23.287 01:19:37 -- target/perf_adq.sh@97 -- # count=2 00:25:23.287 01:19:37 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:25:23.287 01:19:37 -- target/perf_adq.sh@103 -- # wait 2106714 00:25:31.394 Initializing NVMe Controllers 00:25:31.394 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:31.394 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:25:31.394 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:25:31.394 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:25:31.394 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:25:31.394 Initialization complete. Launching workers. 00:25:31.394 ======================================================== 00:25:31.394 Latency(us) 00:25:31.394 Device Information : IOPS MiB/s Average min max 00:25:31.394 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 7001.06 27.35 9173.60 1126.14 53929.87 00:25:31.394 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 7660.75 29.92 8356.07 1071.40 52895.48 00:25:31.394 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 7739.74 30.23 8272.82 1065.39 53929.14 00:25:31.394 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 7330.45 28.63 8732.60 1536.77 52996.81 00:25:31.394 ======================================================== 00:25:31.394 Total : 29732.00 116.14 8619.74 1065.39 53929.87 00:25:31.394 00:25:31.394 01:19:45 -- target/perf_adq.sh@104 -- # nvmftestfini 00:25:31.394 01:19:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:31.394 01:19:45 -- nvmf/common.sh@116 -- # sync 00:25:31.394 01:19:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:31.394 01:19:45 -- nvmf/common.sh@119 -- # set +e 00:25:31.394 01:19:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:31.394 01:19:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:31.394 rmmod nvme_tcp 00:25:31.394 rmmod nvme_fabrics 00:25:31.394 rmmod nvme_keyring 00:25:31.394 01:19:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:31.394 01:19:45 -- nvmf/common.sh@123 -- # set -e 00:25:31.394 01:19:45 -- nvmf/common.sh@124 -- # return 0 00:25:31.394 01:19:45 -- nvmf/common.sh@477 -- # '[' -n 2106670 ']' 00:25:31.394 01:19:45 -- nvmf/common.sh@478 -- # killprocess 2106670 00:25:31.394 01:19:45 -- common/autotest_common.sh@936 -- # '[' -z 2106670 ']' 00:25:31.394 01:19:45 -- common/autotest_common.sh@940 -- # kill -0 2106670 00:25:31.394 01:19:45 -- common/autotest_common.sh@941 -- # uname 00:25:31.394 01:19:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:31.394 01:19:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2106670 00:25:31.394 01:19:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:31.394 01:19:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:31.394 01:19:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2106670' 00:25:31.394 killing process with pid 2106670 00:25:31.394 01:19:45 -- common/autotest_common.sh@955 -- # kill 2106670 00:25:31.394 01:19:45 -- common/autotest_common.sh@960 -- # wait 2106670 00:25:31.653 01:19:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:31.653 01:19:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:31.653 01:19:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:31.653 01:19:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:31.653 01:19:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:31.653 01:19:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:31.653 01:19:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:31.653 01:19:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:34.187 01:19:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:34.187 01:19:48 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:25:34.187 00:25:34.188 real 0m44.619s 00:25:34.188 user 2m39.225s 00:25:34.188 sys 0m9.522s 00:25:34.188 01:19:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:34.188 01:19:48 -- common/autotest_common.sh@10 -- # set +x 00:25:34.188 ************************************ 00:25:34.188 END TEST nvmf_perf_adq 00:25:34.188 ************************************ 00:25:34.188 01:19:48 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:34.188 01:19:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:34.188 01:19:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:34.188 01:19:48 -- common/autotest_common.sh@10 -- # set +x 00:25:34.188 ************************************ 00:25:34.188 START TEST nvmf_shutdown 00:25:34.188 ************************************ 00:25:34.188 01:19:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:34.188 * Looking for test storage... 00:25:34.188 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:25:34.188 01:19:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:34.188 01:19:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:34.188 01:19:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:34.188 01:19:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:34.188 01:19:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:34.188 01:19:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:34.188 01:19:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:34.188 01:19:48 -- scripts/common.sh@335 -- # IFS=.-: 00:25:34.188 01:19:48 -- scripts/common.sh@335 -- # read -ra ver1 00:25:34.188 01:19:48 -- scripts/common.sh@336 -- # IFS=.-: 00:25:34.188 01:19:48 -- scripts/common.sh@336 -- # read -ra ver2 00:25:34.188 01:19:48 -- scripts/common.sh@337 -- # local 'op=<' 00:25:34.188 01:19:48 -- scripts/common.sh@339 -- # ver1_l=2 00:25:34.188 01:19:48 -- scripts/common.sh@340 -- # ver2_l=1 00:25:34.188 01:19:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:34.188 01:19:48 -- scripts/common.sh@343 -- # case "$op" in 00:25:34.188 01:19:48 -- scripts/common.sh@344 -- # : 1 00:25:34.188 01:19:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:34.188 01:19:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:34.188 01:19:48 -- scripts/common.sh@364 -- # decimal 1 00:25:34.188 01:19:48 -- scripts/common.sh@352 -- # local d=1 00:25:34.188 01:19:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:34.188 01:19:48 -- scripts/common.sh@354 -- # echo 1 00:25:34.188 01:19:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:34.188 01:19:48 -- scripts/common.sh@365 -- # decimal 2 00:25:34.188 01:19:48 -- scripts/common.sh@352 -- # local d=2 00:25:34.188 01:19:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:34.188 01:19:48 -- scripts/common.sh@354 -- # echo 2 00:25:34.188 01:19:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:34.188 01:19:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:34.188 01:19:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:34.188 01:19:48 -- scripts/common.sh@367 -- # return 0 00:25:34.188 01:19:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:34.188 01:19:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:34.188 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:34.188 --rc genhtml_branch_coverage=1 00:25:34.188 --rc genhtml_function_coverage=1 00:25:34.188 --rc genhtml_legend=1 00:25:34.188 --rc geninfo_all_blocks=1 00:25:34.188 --rc geninfo_unexecuted_blocks=1 00:25:34.188 00:25:34.188 ' 00:25:34.188 01:19:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:34.188 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:34.188 --rc genhtml_branch_coverage=1 00:25:34.188 --rc genhtml_function_coverage=1 00:25:34.188 --rc genhtml_legend=1 00:25:34.188 --rc geninfo_all_blocks=1 00:25:34.188 --rc geninfo_unexecuted_blocks=1 00:25:34.188 00:25:34.188 ' 00:25:34.188 01:19:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:34.188 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:34.188 --rc genhtml_branch_coverage=1 00:25:34.188 --rc genhtml_function_coverage=1 00:25:34.188 --rc genhtml_legend=1 00:25:34.188 --rc geninfo_all_blocks=1 00:25:34.188 --rc geninfo_unexecuted_blocks=1 00:25:34.188 00:25:34.188 ' 00:25:34.188 01:19:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:34.188 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:34.188 --rc genhtml_branch_coverage=1 00:25:34.188 --rc genhtml_function_coverage=1 00:25:34.188 --rc genhtml_legend=1 00:25:34.188 --rc geninfo_all_blocks=1 00:25:34.188 --rc geninfo_unexecuted_blocks=1 00:25:34.188 00:25:34.188 ' 00:25:34.188 01:19:48 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:34.188 01:19:48 -- nvmf/common.sh@7 -- # uname -s 00:25:34.188 01:19:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:34.188 01:19:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:34.188 01:19:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:34.188 01:19:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:34.188 01:19:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:34.188 01:19:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:34.188 01:19:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:34.188 01:19:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:34.188 01:19:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:34.188 01:19:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:34.188 01:19:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:34.188 01:19:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:34.188 01:19:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:34.188 01:19:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:34.188 01:19:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:34.188 01:19:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:34.188 01:19:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:34.188 01:19:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:34.188 01:19:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:34.188 01:19:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:34.188 01:19:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:34.188 01:19:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:34.188 01:19:48 -- paths/export.sh@5 -- # export PATH 00:25:34.188 01:19:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:34.188 01:19:48 -- nvmf/common.sh@46 -- # : 0 00:25:34.189 01:19:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:34.189 01:19:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:34.189 01:19:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:34.189 01:19:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:34.189 01:19:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:34.189 01:19:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:34.189 01:19:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:34.189 01:19:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:34.189 01:19:48 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:34.189 01:19:48 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:34.189 01:19:48 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:25:34.189 01:19:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:34.189 01:19:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:34.189 01:19:48 -- common/autotest_common.sh@10 -- # set +x 00:25:34.189 ************************************ 00:25:34.189 START TEST nvmf_shutdown_tc1 00:25:34.189 ************************************ 00:25:34.189 01:19:48 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:25:34.189 01:19:48 -- target/shutdown.sh@74 -- # starttarget 00:25:34.189 01:19:48 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:34.189 01:19:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:34.189 01:19:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:34.189 01:19:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:34.189 01:19:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:34.189 01:19:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:34.189 01:19:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:34.189 01:19:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:34.189 01:19:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:34.189 01:19:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:34.189 01:19:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:34.189 01:19:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:34.189 01:19:48 -- common/autotest_common.sh@10 -- # set +x 00:25:36.089 01:19:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:36.089 01:19:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:36.089 01:19:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:36.089 01:19:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:36.089 01:19:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:36.089 01:19:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:36.089 01:19:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:36.089 01:19:50 -- nvmf/common.sh@294 -- # net_devs=() 00:25:36.089 01:19:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:36.089 01:19:50 -- nvmf/common.sh@295 -- # e810=() 00:25:36.089 01:19:50 -- nvmf/common.sh@295 -- # local -ga e810 00:25:36.089 01:19:50 -- nvmf/common.sh@296 -- # x722=() 00:25:36.089 01:19:50 -- nvmf/common.sh@296 -- # local -ga x722 00:25:36.089 01:19:50 -- nvmf/common.sh@297 -- # mlx=() 00:25:36.089 01:19:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:36.089 01:19:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:36.089 01:19:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:36.089 01:19:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:36.089 01:19:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:36.089 01:19:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:36.089 01:19:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:36.089 01:19:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:36.089 01:19:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:36.089 01:19:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:36.089 01:19:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:36.089 01:19:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:36.089 01:19:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:36.089 01:19:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:36.089 01:19:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:36.089 01:19:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:36.089 01:19:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:36.089 01:19:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:36.089 01:19:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:36.089 01:19:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:36.089 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:36.089 01:19:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:36.089 01:19:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:36.089 01:19:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:36.089 01:19:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:36.089 01:19:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:36.089 01:19:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:36.089 01:19:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:36.089 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:36.089 01:19:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:36.089 01:19:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:36.089 01:19:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:36.089 01:19:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:36.089 01:19:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:36.089 01:19:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:36.089 01:19:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:36.089 01:19:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:36.089 01:19:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:36.089 01:19:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:36.089 01:19:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:36.089 01:19:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:36.089 01:19:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:36.089 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:36.089 01:19:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:36.089 01:19:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:36.089 01:19:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:36.090 01:19:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:36.090 01:19:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:36.090 01:19:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:36.090 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:36.090 01:19:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:36.090 01:19:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:36.090 01:19:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:36.090 01:19:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:36.090 01:19:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:36.090 01:19:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:36.090 01:19:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:36.090 01:19:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:36.090 01:19:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:36.090 01:19:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:36.090 01:19:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:36.090 01:19:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:36.090 01:19:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:36.090 01:19:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:36.090 01:19:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:36.090 01:19:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:36.090 01:19:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:36.090 01:19:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:36.090 01:19:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:36.090 01:19:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:36.090 01:19:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:36.090 01:19:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:36.090 01:19:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:36.090 01:19:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:36.090 01:19:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:36.090 01:19:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:36.090 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:36.090 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.304 ms 00:25:36.090 00:25:36.090 --- 10.0.0.2 ping statistics --- 00:25:36.090 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:36.090 rtt min/avg/max/mdev = 0.304/0.304/0.304/0.000 ms 00:25:36.090 01:19:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:36.090 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:36.090 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.160 ms 00:25:36.090 00:25:36.090 --- 10.0.0.1 ping statistics --- 00:25:36.090 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:36.090 rtt min/avg/max/mdev = 0.160/0.160/0.160/0.000 ms 00:25:36.090 01:19:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:36.090 01:19:50 -- nvmf/common.sh@410 -- # return 0 00:25:36.090 01:19:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:36.090 01:19:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:36.090 01:19:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:36.090 01:19:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:36.090 01:19:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:36.090 01:19:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:36.090 01:19:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:36.348 01:19:50 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:36.348 01:19:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:36.348 01:19:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:36.348 01:19:50 -- common/autotest_common.sh@10 -- # set +x 00:25:36.348 01:19:50 -- nvmf/common.sh@469 -- # nvmfpid=2110033 00:25:36.348 01:19:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:36.348 01:19:50 -- nvmf/common.sh@470 -- # waitforlisten 2110033 00:25:36.348 01:19:50 -- common/autotest_common.sh@829 -- # '[' -z 2110033 ']' 00:25:36.348 01:19:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:36.348 01:19:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:36.348 01:19:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:36.348 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:36.348 01:19:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:36.348 01:19:50 -- common/autotest_common.sh@10 -- # set +x 00:25:36.348 [2024-11-28 01:19:50.758081] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:36.348 [2024-11-28 01:19:50.758164] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:36.348 EAL: No free 2048 kB hugepages reported on node 1 00:25:36.348 [2024-11-28 01:19:50.822401] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:36.348 [2024-11-28 01:19:50.906371] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:36.348 [2024-11-28 01:19:50.906516] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:36.348 [2024-11-28 01:19:50.906549] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:36.348 [2024-11-28 01:19:50.906569] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:36.348 [2024-11-28 01:19:50.906641] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:36.348 [2024-11-28 01:19:50.906674] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:36.348 [2024-11-28 01:19:50.906734] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:36.348 [2024-11-28 01:19:50.906737] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:37.281 01:19:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:37.281 01:19:51 -- common/autotest_common.sh@862 -- # return 0 00:25:37.281 01:19:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:37.281 01:19:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:37.281 01:19:51 -- common/autotest_common.sh@10 -- # set +x 00:25:37.282 01:19:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:37.282 01:19:51 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:37.282 01:19:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.282 01:19:51 -- common/autotest_common.sh@10 -- # set +x 00:25:37.282 [2024-11-28 01:19:51.780410] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:37.282 01:19:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.282 01:19:51 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:37.282 01:19:51 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:37.282 01:19:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:37.282 01:19:51 -- common/autotest_common.sh@10 -- # set +x 00:25:37.282 01:19:51 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:37.282 01:19:51 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:37.282 01:19:51 -- target/shutdown.sh@28 -- # cat 00:25:37.282 01:19:51 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:37.282 01:19:51 -- target/shutdown.sh@28 -- # cat 00:25:37.282 01:19:51 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:37.282 01:19:51 -- target/shutdown.sh@28 -- # cat 00:25:37.282 01:19:51 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:37.282 01:19:51 -- target/shutdown.sh@28 -- # cat 00:25:37.282 01:19:51 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:37.282 01:19:51 -- target/shutdown.sh@28 -- # cat 00:25:37.282 01:19:51 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:37.282 01:19:51 -- target/shutdown.sh@28 -- # cat 00:25:37.282 01:19:51 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:37.282 01:19:51 -- target/shutdown.sh@28 -- # cat 00:25:37.282 01:19:51 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:37.282 01:19:51 -- target/shutdown.sh@28 -- # cat 00:25:37.282 01:19:51 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:37.282 01:19:51 -- target/shutdown.sh@28 -- # cat 00:25:37.282 01:19:51 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:37.282 01:19:51 -- target/shutdown.sh@28 -- # cat 00:25:37.282 01:19:51 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:37.282 01:19:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.282 01:19:51 -- common/autotest_common.sh@10 -- # set +x 00:25:37.282 Malloc1 00:25:37.282 [2024-11-28 01:19:51.869785] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:37.540 Malloc2 00:25:37.540 Malloc3 00:25:37.540 Malloc4 00:25:37.540 Malloc5 00:25:37.540 Malloc6 00:25:37.540 Malloc7 00:25:37.799 Malloc8 00:25:37.799 Malloc9 00:25:37.799 Malloc10 00:25:37.799 01:19:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.799 01:19:52 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:37.799 01:19:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:37.799 01:19:52 -- common/autotest_common.sh@10 -- # set +x 00:25:37.799 01:19:52 -- target/shutdown.sh@78 -- # perfpid=2110225 00:25:37.799 01:19:52 -- target/shutdown.sh@79 -- # waitforlisten 2110225 /var/tmp/bdevperf.sock 00:25:37.799 01:19:52 -- common/autotest_common.sh@829 -- # '[' -z 2110225 ']' 00:25:37.799 01:19:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:37.799 01:19:52 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:25:37.799 01:19:52 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:37.799 01:19:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:37.799 01:19:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:37.799 01:19:52 -- nvmf/common.sh@520 -- # config=() 00:25:37.799 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:37.799 01:19:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:37.799 01:19:52 -- nvmf/common.sh@520 -- # local subsystem config 00:25:37.799 01:19:52 -- common/autotest_common.sh@10 -- # set +x 00:25:37.799 01:19:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.799 01:19:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.799 { 00:25:37.799 "params": { 00:25:37.799 "name": "Nvme$subsystem", 00:25:37.799 "trtype": "$TEST_TRANSPORT", 00:25:37.799 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.799 "adrfam": "ipv4", 00:25:37.799 "trsvcid": "$NVMF_PORT", 00:25:37.799 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.799 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.799 "hdgst": ${hdgst:-false}, 00:25:37.799 "ddgst": ${ddgst:-false} 00:25:37.799 }, 00:25:37.799 "method": "bdev_nvme_attach_controller" 00:25:37.799 } 00:25:37.799 EOF 00:25:37.799 )") 00:25:37.799 01:19:52 -- nvmf/common.sh@542 -- # cat 00:25:37.799 01:19:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.799 01:19:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.799 { 00:25:37.799 "params": { 00:25:37.799 "name": "Nvme$subsystem", 00:25:37.799 "trtype": "$TEST_TRANSPORT", 00:25:37.799 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.799 "adrfam": "ipv4", 00:25:37.799 "trsvcid": "$NVMF_PORT", 00:25:37.799 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.799 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.799 "hdgst": ${hdgst:-false}, 00:25:37.799 "ddgst": ${ddgst:-false} 00:25:37.799 }, 00:25:37.799 "method": "bdev_nvme_attach_controller" 00:25:37.799 } 00:25:37.799 EOF 00:25:37.799 )") 00:25:37.799 01:19:52 -- nvmf/common.sh@542 -- # cat 00:25:37.799 01:19:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.799 01:19:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.799 { 00:25:37.799 "params": { 00:25:37.799 "name": "Nvme$subsystem", 00:25:37.799 "trtype": "$TEST_TRANSPORT", 00:25:37.799 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.799 "adrfam": "ipv4", 00:25:37.799 "trsvcid": "$NVMF_PORT", 00:25:37.799 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.799 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.799 "hdgst": ${hdgst:-false}, 00:25:37.799 "ddgst": ${ddgst:-false} 00:25:37.799 }, 00:25:37.799 "method": "bdev_nvme_attach_controller" 00:25:37.799 } 00:25:37.799 EOF 00:25:37.799 )") 00:25:37.799 01:19:52 -- nvmf/common.sh@542 -- # cat 00:25:37.799 01:19:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.799 01:19:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.799 { 00:25:37.799 "params": { 00:25:37.799 "name": "Nvme$subsystem", 00:25:37.799 "trtype": "$TEST_TRANSPORT", 00:25:37.799 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.799 "adrfam": "ipv4", 00:25:37.799 "trsvcid": "$NVMF_PORT", 00:25:37.799 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.799 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.799 "hdgst": ${hdgst:-false}, 00:25:37.799 "ddgst": ${ddgst:-false} 00:25:37.799 }, 00:25:37.799 "method": "bdev_nvme_attach_controller" 00:25:37.799 } 00:25:37.799 EOF 00:25:37.799 )") 00:25:37.799 01:19:52 -- nvmf/common.sh@542 -- # cat 00:25:37.799 01:19:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.799 01:19:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.799 { 00:25:37.799 "params": { 00:25:37.799 "name": "Nvme$subsystem", 00:25:37.799 "trtype": "$TEST_TRANSPORT", 00:25:37.799 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.799 "adrfam": "ipv4", 00:25:37.799 "trsvcid": "$NVMF_PORT", 00:25:37.799 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.799 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.799 "hdgst": ${hdgst:-false}, 00:25:37.799 "ddgst": ${ddgst:-false} 00:25:37.799 }, 00:25:37.799 "method": "bdev_nvme_attach_controller" 00:25:37.799 } 00:25:37.799 EOF 00:25:37.799 )") 00:25:37.799 01:19:52 -- nvmf/common.sh@542 -- # cat 00:25:37.799 01:19:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.799 01:19:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.799 { 00:25:37.799 "params": { 00:25:37.799 "name": "Nvme$subsystem", 00:25:37.799 "trtype": "$TEST_TRANSPORT", 00:25:37.799 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.799 "adrfam": "ipv4", 00:25:37.799 "trsvcid": "$NVMF_PORT", 00:25:37.799 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.799 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.799 "hdgst": ${hdgst:-false}, 00:25:37.799 "ddgst": ${ddgst:-false} 00:25:37.799 }, 00:25:37.799 "method": "bdev_nvme_attach_controller" 00:25:37.799 } 00:25:37.799 EOF 00:25:37.799 )") 00:25:37.799 01:19:52 -- nvmf/common.sh@542 -- # cat 00:25:37.799 01:19:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.799 01:19:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.799 { 00:25:37.799 "params": { 00:25:37.799 "name": "Nvme$subsystem", 00:25:37.800 "trtype": "$TEST_TRANSPORT", 00:25:37.800 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.800 "adrfam": "ipv4", 00:25:37.800 "trsvcid": "$NVMF_PORT", 00:25:37.800 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.800 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.800 "hdgst": ${hdgst:-false}, 00:25:37.800 "ddgst": ${ddgst:-false} 00:25:37.800 }, 00:25:37.800 "method": "bdev_nvme_attach_controller" 00:25:37.800 } 00:25:37.800 EOF 00:25:37.800 )") 00:25:37.800 01:19:52 -- nvmf/common.sh@542 -- # cat 00:25:37.800 01:19:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.800 01:19:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.800 { 00:25:37.800 "params": { 00:25:37.800 "name": "Nvme$subsystem", 00:25:37.800 "trtype": "$TEST_TRANSPORT", 00:25:37.800 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.800 "adrfam": "ipv4", 00:25:37.800 "trsvcid": "$NVMF_PORT", 00:25:37.800 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.800 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.800 "hdgst": ${hdgst:-false}, 00:25:37.800 "ddgst": ${ddgst:-false} 00:25:37.800 }, 00:25:37.800 "method": "bdev_nvme_attach_controller" 00:25:37.800 } 00:25:37.800 EOF 00:25:37.800 )") 00:25:37.800 01:19:52 -- nvmf/common.sh@542 -- # cat 00:25:37.800 01:19:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.800 01:19:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.800 { 00:25:37.800 "params": { 00:25:37.800 "name": "Nvme$subsystem", 00:25:37.800 "trtype": "$TEST_TRANSPORT", 00:25:37.800 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.800 "adrfam": "ipv4", 00:25:37.800 "trsvcid": "$NVMF_PORT", 00:25:37.800 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.800 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.800 "hdgst": ${hdgst:-false}, 00:25:37.800 "ddgst": ${ddgst:-false} 00:25:37.800 }, 00:25:37.800 "method": "bdev_nvme_attach_controller" 00:25:37.800 } 00:25:37.800 EOF 00:25:37.800 )") 00:25:37.800 01:19:52 -- nvmf/common.sh@542 -- # cat 00:25:37.800 01:19:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.800 01:19:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.800 { 00:25:37.800 "params": { 00:25:37.800 "name": "Nvme$subsystem", 00:25:37.800 "trtype": "$TEST_TRANSPORT", 00:25:37.800 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.800 "adrfam": "ipv4", 00:25:37.800 "trsvcid": "$NVMF_PORT", 00:25:37.800 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.800 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.800 "hdgst": ${hdgst:-false}, 00:25:37.800 "ddgst": ${ddgst:-false} 00:25:37.800 }, 00:25:37.800 "method": "bdev_nvme_attach_controller" 00:25:37.800 } 00:25:37.800 EOF 00:25:37.800 )") 00:25:37.800 01:19:52 -- nvmf/common.sh@542 -- # cat 00:25:37.800 01:19:52 -- nvmf/common.sh@544 -- # jq . 00:25:37.800 01:19:52 -- nvmf/common.sh@545 -- # IFS=, 00:25:37.800 01:19:52 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:37.800 "params": { 00:25:37.800 "name": "Nvme1", 00:25:37.800 "trtype": "tcp", 00:25:37.800 "traddr": "10.0.0.2", 00:25:37.800 "adrfam": "ipv4", 00:25:37.800 "trsvcid": "4420", 00:25:37.800 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:37.800 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:37.800 "hdgst": false, 00:25:37.800 "ddgst": false 00:25:37.800 }, 00:25:37.800 "method": "bdev_nvme_attach_controller" 00:25:37.800 },{ 00:25:37.800 "params": { 00:25:37.800 "name": "Nvme2", 00:25:37.800 "trtype": "tcp", 00:25:37.800 "traddr": "10.0.0.2", 00:25:37.800 "adrfam": "ipv4", 00:25:37.800 "trsvcid": "4420", 00:25:37.800 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:37.800 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:37.800 "hdgst": false, 00:25:37.800 "ddgst": false 00:25:37.800 }, 00:25:37.800 "method": "bdev_nvme_attach_controller" 00:25:37.800 },{ 00:25:37.800 "params": { 00:25:37.800 "name": "Nvme3", 00:25:37.800 "trtype": "tcp", 00:25:37.800 "traddr": "10.0.0.2", 00:25:37.800 "adrfam": "ipv4", 00:25:37.800 "trsvcid": "4420", 00:25:37.800 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:37.800 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:37.800 "hdgst": false, 00:25:37.800 "ddgst": false 00:25:37.800 }, 00:25:37.800 "method": "bdev_nvme_attach_controller" 00:25:37.800 },{ 00:25:37.800 "params": { 00:25:37.800 "name": "Nvme4", 00:25:37.800 "trtype": "tcp", 00:25:37.800 "traddr": "10.0.0.2", 00:25:37.800 "adrfam": "ipv4", 00:25:37.800 "trsvcid": "4420", 00:25:37.800 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:37.800 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:37.800 "hdgst": false, 00:25:37.800 "ddgst": false 00:25:37.800 }, 00:25:37.800 "method": "bdev_nvme_attach_controller" 00:25:37.800 },{ 00:25:37.800 "params": { 00:25:37.800 "name": "Nvme5", 00:25:37.800 "trtype": "tcp", 00:25:37.800 "traddr": "10.0.0.2", 00:25:37.800 "adrfam": "ipv4", 00:25:37.800 "trsvcid": "4420", 00:25:37.800 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:37.800 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:37.800 "hdgst": false, 00:25:37.800 "ddgst": false 00:25:37.800 }, 00:25:37.800 "method": "bdev_nvme_attach_controller" 00:25:37.800 },{ 00:25:37.800 "params": { 00:25:37.800 "name": "Nvme6", 00:25:37.800 "trtype": "tcp", 00:25:37.800 "traddr": "10.0.0.2", 00:25:37.800 "adrfam": "ipv4", 00:25:37.800 "trsvcid": "4420", 00:25:37.800 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:37.800 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:37.800 "hdgst": false, 00:25:37.800 "ddgst": false 00:25:37.800 }, 00:25:37.800 "method": "bdev_nvme_attach_controller" 00:25:37.800 },{ 00:25:37.800 "params": { 00:25:37.800 "name": "Nvme7", 00:25:37.800 "trtype": "tcp", 00:25:37.800 "traddr": "10.0.0.2", 00:25:37.800 "adrfam": "ipv4", 00:25:37.800 "trsvcid": "4420", 00:25:37.800 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:37.800 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:37.800 "hdgst": false, 00:25:37.800 "ddgst": false 00:25:37.800 }, 00:25:37.800 "method": "bdev_nvme_attach_controller" 00:25:37.800 },{ 00:25:37.800 "params": { 00:25:37.800 "name": "Nvme8", 00:25:37.800 "trtype": "tcp", 00:25:37.800 "traddr": "10.0.0.2", 00:25:37.800 "adrfam": "ipv4", 00:25:37.800 "trsvcid": "4420", 00:25:37.800 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:37.800 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:37.800 "hdgst": false, 00:25:37.800 "ddgst": false 00:25:37.800 }, 00:25:37.800 "method": "bdev_nvme_attach_controller" 00:25:37.800 },{ 00:25:37.800 "params": { 00:25:37.800 "name": "Nvme9", 00:25:37.800 "trtype": "tcp", 00:25:37.800 "traddr": "10.0.0.2", 00:25:37.800 "adrfam": "ipv4", 00:25:37.800 "trsvcid": "4420", 00:25:37.800 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:37.800 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:37.800 "hdgst": false, 00:25:37.800 "ddgst": false 00:25:37.800 }, 00:25:37.800 "method": "bdev_nvme_attach_controller" 00:25:37.800 },{ 00:25:37.800 "params": { 00:25:37.800 "name": "Nvme10", 00:25:37.800 "trtype": "tcp", 00:25:37.800 "traddr": "10.0.0.2", 00:25:37.800 "adrfam": "ipv4", 00:25:37.800 "trsvcid": "4420", 00:25:37.800 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:37.800 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:37.800 "hdgst": false, 00:25:37.800 "ddgst": false 00:25:37.800 }, 00:25:37.800 "method": "bdev_nvme_attach_controller" 00:25:37.800 }' 00:25:37.800 [2024-11-28 01:19:52.387189] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:37.800 [2024-11-28 01:19:52.387263] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:25:38.059 EAL: No free 2048 kB hugepages reported on node 1 00:25:38.059 [2024-11-28 01:19:52.451796] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:38.059 [2024-11-28 01:19:52.537008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:39.957 01:19:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:39.957 01:19:54 -- common/autotest_common.sh@862 -- # return 0 00:25:39.957 01:19:54 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:39.957 01:19:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.957 01:19:54 -- common/autotest_common.sh@10 -- # set +x 00:25:39.957 01:19:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.957 01:19:54 -- target/shutdown.sh@83 -- # kill -9 2110225 00:25:39.957 01:19:54 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:25:39.957 01:19:54 -- target/shutdown.sh@87 -- # sleep 1 00:25:40.890 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 2110225 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:25:40.890 01:19:55 -- target/shutdown.sh@88 -- # kill -0 2110033 00:25:40.890 01:19:55 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:25:40.890 01:19:55 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:40.890 01:19:55 -- nvmf/common.sh@520 -- # config=() 00:25:40.890 01:19:55 -- nvmf/common.sh@520 -- # local subsystem config 00:25:40.890 01:19:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:40.890 01:19:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:40.890 { 00:25:40.890 "params": { 00:25:40.890 "name": "Nvme$subsystem", 00:25:40.890 "trtype": "$TEST_TRANSPORT", 00:25:40.890 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:40.890 "adrfam": "ipv4", 00:25:40.890 "trsvcid": "$NVMF_PORT", 00:25:40.890 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:40.890 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:40.890 "hdgst": ${hdgst:-false}, 00:25:40.890 "ddgst": ${ddgst:-false} 00:25:40.890 }, 00:25:40.890 "method": "bdev_nvme_attach_controller" 00:25:40.890 } 00:25:40.890 EOF 00:25:40.890 )") 00:25:40.890 01:19:55 -- nvmf/common.sh@542 -- # cat 00:25:40.890 01:19:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:40.890 01:19:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:40.890 { 00:25:40.890 "params": { 00:25:40.890 "name": "Nvme$subsystem", 00:25:40.890 "trtype": "$TEST_TRANSPORT", 00:25:40.890 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:40.890 "adrfam": "ipv4", 00:25:40.890 "trsvcid": "$NVMF_PORT", 00:25:40.890 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:40.890 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:40.890 "hdgst": ${hdgst:-false}, 00:25:40.890 "ddgst": ${ddgst:-false} 00:25:40.890 }, 00:25:40.890 "method": "bdev_nvme_attach_controller" 00:25:40.890 } 00:25:40.890 EOF 00:25:40.890 )") 00:25:40.890 01:19:55 -- nvmf/common.sh@542 -- # cat 00:25:40.890 01:19:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:40.890 01:19:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:40.890 { 00:25:40.890 "params": { 00:25:40.890 "name": "Nvme$subsystem", 00:25:40.890 "trtype": "$TEST_TRANSPORT", 00:25:40.890 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:40.890 "adrfam": "ipv4", 00:25:40.890 "trsvcid": "$NVMF_PORT", 00:25:40.890 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:40.890 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:40.890 "hdgst": ${hdgst:-false}, 00:25:40.890 "ddgst": ${ddgst:-false} 00:25:40.890 }, 00:25:40.890 "method": "bdev_nvme_attach_controller" 00:25:40.890 } 00:25:40.890 EOF 00:25:40.890 )") 00:25:40.890 01:19:55 -- nvmf/common.sh@542 -- # cat 00:25:40.890 01:19:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:40.890 01:19:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:40.890 { 00:25:40.890 "params": { 00:25:40.890 "name": "Nvme$subsystem", 00:25:40.890 "trtype": "$TEST_TRANSPORT", 00:25:40.890 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:40.890 "adrfam": "ipv4", 00:25:40.890 "trsvcid": "$NVMF_PORT", 00:25:40.890 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:40.890 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:40.890 "hdgst": ${hdgst:-false}, 00:25:40.890 "ddgst": ${ddgst:-false} 00:25:40.890 }, 00:25:40.890 "method": "bdev_nvme_attach_controller" 00:25:40.890 } 00:25:40.890 EOF 00:25:40.890 )") 00:25:40.890 01:19:55 -- nvmf/common.sh@542 -- # cat 00:25:40.890 01:19:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:40.890 01:19:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:40.890 { 00:25:40.890 "params": { 00:25:40.890 "name": "Nvme$subsystem", 00:25:40.890 "trtype": "$TEST_TRANSPORT", 00:25:40.890 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:40.890 "adrfam": "ipv4", 00:25:40.890 "trsvcid": "$NVMF_PORT", 00:25:40.890 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:40.890 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:40.890 "hdgst": ${hdgst:-false}, 00:25:40.890 "ddgst": ${ddgst:-false} 00:25:40.890 }, 00:25:40.890 "method": "bdev_nvme_attach_controller" 00:25:40.890 } 00:25:40.890 EOF 00:25:40.890 )") 00:25:40.890 01:19:55 -- nvmf/common.sh@542 -- # cat 00:25:40.890 01:19:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:40.890 01:19:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:40.890 { 00:25:40.890 "params": { 00:25:40.890 "name": "Nvme$subsystem", 00:25:40.890 "trtype": "$TEST_TRANSPORT", 00:25:40.890 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:40.890 "adrfam": "ipv4", 00:25:40.890 "trsvcid": "$NVMF_PORT", 00:25:40.890 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:40.890 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:40.890 "hdgst": ${hdgst:-false}, 00:25:40.890 "ddgst": ${ddgst:-false} 00:25:40.890 }, 00:25:40.890 "method": "bdev_nvme_attach_controller" 00:25:40.890 } 00:25:40.890 EOF 00:25:40.890 )") 00:25:40.890 01:19:55 -- nvmf/common.sh@542 -- # cat 00:25:40.890 01:19:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:40.890 01:19:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:40.890 { 00:25:40.890 "params": { 00:25:40.890 "name": "Nvme$subsystem", 00:25:40.890 "trtype": "$TEST_TRANSPORT", 00:25:40.890 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:40.890 "adrfam": "ipv4", 00:25:40.890 "trsvcid": "$NVMF_PORT", 00:25:40.890 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:40.890 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:40.890 "hdgst": ${hdgst:-false}, 00:25:40.890 "ddgst": ${ddgst:-false} 00:25:40.890 }, 00:25:40.890 "method": "bdev_nvme_attach_controller" 00:25:40.890 } 00:25:40.890 EOF 00:25:40.890 )") 00:25:40.890 01:19:55 -- nvmf/common.sh@542 -- # cat 00:25:40.890 01:19:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:40.890 01:19:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:40.890 { 00:25:40.890 "params": { 00:25:40.890 "name": "Nvme$subsystem", 00:25:40.890 "trtype": "$TEST_TRANSPORT", 00:25:40.890 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:40.890 "adrfam": "ipv4", 00:25:40.890 "trsvcid": "$NVMF_PORT", 00:25:40.890 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:40.890 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:40.890 "hdgst": ${hdgst:-false}, 00:25:40.890 "ddgst": ${ddgst:-false} 00:25:40.890 }, 00:25:40.890 "method": "bdev_nvme_attach_controller" 00:25:40.890 } 00:25:40.890 EOF 00:25:40.890 )") 00:25:40.890 01:19:55 -- nvmf/common.sh@542 -- # cat 00:25:40.890 01:19:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:40.890 01:19:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:40.890 { 00:25:40.890 "params": { 00:25:40.890 "name": "Nvme$subsystem", 00:25:40.890 "trtype": "$TEST_TRANSPORT", 00:25:40.890 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:40.890 "adrfam": "ipv4", 00:25:40.890 "trsvcid": "$NVMF_PORT", 00:25:40.890 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:40.890 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:40.890 "hdgst": ${hdgst:-false}, 00:25:40.890 "ddgst": ${ddgst:-false} 00:25:40.890 }, 00:25:40.890 "method": "bdev_nvme_attach_controller" 00:25:40.890 } 00:25:40.890 EOF 00:25:40.890 )") 00:25:40.890 01:19:55 -- nvmf/common.sh@542 -- # cat 00:25:40.890 01:19:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:40.890 01:19:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:40.890 { 00:25:40.890 "params": { 00:25:40.890 "name": "Nvme$subsystem", 00:25:40.890 "trtype": "$TEST_TRANSPORT", 00:25:40.891 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:40.891 "adrfam": "ipv4", 00:25:40.891 "trsvcid": "$NVMF_PORT", 00:25:40.891 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:40.891 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:40.891 "hdgst": ${hdgst:-false}, 00:25:40.891 "ddgst": ${ddgst:-false} 00:25:40.891 }, 00:25:40.891 "method": "bdev_nvme_attach_controller" 00:25:40.891 } 00:25:40.891 EOF 00:25:40.891 )") 00:25:40.891 01:19:55 -- nvmf/common.sh@542 -- # cat 00:25:40.891 01:19:55 -- nvmf/common.sh@544 -- # jq . 00:25:40.891 01:19:55 -- nvmf/common.sh@545 -- # IFS=, 00:25:40.891 01:19:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:40.891 "params": { 00:25:40.891 "name": "Nvme1", 00:25:40.891 "trtype": "tcp", 00:25:40.891 "traddr": "10.0.0.2", 00:25:40.891 "adrfam": "ipv4", 00:25:40.891 "trsvcid": "4420", 00:25:40.891 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:40.891 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:40.891 "hdgst": false, 00:25:40.891 "ddgst": false 00:25:40.891 }, 00:25:40.891 "method": "bdev_nvme_attach_controller" 00:25:40.891 },{ 00:25:40.891 "params": { 00:25:40.891 "name": "Nvme2", 00:25:40.891 "trtype": "tcp", 00:25:40.891 "traddr": "10.0.0.2", 00:25:40.891 "adrfam": "ipv4", 00:25:40.891 "trsvcid": "4420", 00:25:40.891 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:40.891 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:40.891 "hdgst": false, 00:25:40.891 "ddgst": false 00:25:40.891 }, 00:25:40.891 "method": "bdev_nvme_attach_controller" 00:25:40.891 },{ 00:25:40.891 "params": { 00:25:40.891 "name": "Nvme3", 00:25:40.891 "trtype": "tcp", 00:25:40.891 "traddr": "10.0.0.2", 00:25:40.891 "adrfam": "ipv4", 00:25:40.891 "trsvcid": "4420", 00:25:40.891 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:40.891 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:40.891 "hdgst": false, 00:25:40.891 "ddgst": false 00:25:40.891 }, 00:25:40.891 "method": "bdev_nvme_attach_controller" 00:25:40.891 },{ 00:25:40.891 "params": { 00:25:40.891 "name": "Nvme4", 00:25:40.891 "trtype": "tcp", 00:25:40.891 "traddr": "10.0.0.2", 00:25:40.891 "adrfam": "ipv4", 00:25:40.891 "trsvcid": "4420", 00:25:40.891 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:40.891 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:40.891 "hdgst": false, 00:25:40.891 "ddgst": false 00:25:40.891 }, 00:25:40.891 "method": "bdev_nvme_attach_controller" 00:25:40.891 },{ 00:25:40.891 "params": { 00:25:40.891 "name": "Nvme5", 00:25:40.891 "trtype": "tcp", 00:25:40.891 "traddr": "10.0.0.2", 00:25:40.891 "adrfam": "ipv4", 00:25:40.891 "trsvcid": "4420", 00:25:40.891 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:40.891 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:40.891 "hdgst": false, 00:25:40.891 "ddgst": false 00:25:40.891 }, 00:25:40.891 "method": "bdev_nvme_attach_controller" 00:25:40.891 },{ 00:25:40.891 "params": { 00:25:40.891 "name": "Nvme6", 00:25:40.891 "trtype": "tcp", 00:25:40.891 "traddr": "10.0.0.2", 00:25:40.891 "adrfam": "ipv4", 00:25:40.891 "trsvcid": "4420", 00:25:40.891 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:40.891 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:40.891 "hdgst": false, 00:25:40.891 "ddgst": false 00:25:40.891 }, 00:25:40.891 "method": "bdev_nvme_attach_controller" 00:25:40.891 },{ 00:25:40.891 "params": { 00:25:40.891 "name": "Nvme7", 00:25:40.891 "trtype": "tcp", 00:25:40.891 "traddr": "10.0.0.2", 00:25:40.891 "adrfam": "ipv4", 00:25:40.891 "trsvcid": "4420", 00:25:40.891 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:40.891 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:40.891 "hdgst": false, 00:25:40.891 "ddgst": false 00:25:40.891 }, 00:25:40.891 "method": "bdev_nvme_attach_controller" 00:25:40.891 },{ 00:25:40.891 "params": { 00:25:40.891 "name": "Nvme8", 00:25:40.891 "trtype": "tcp", 00:25:40.891 "traddr": "10.0.0.2", 00:25:40.891 "adrfam": "ipv4", 00:25:40.891 "trsvcid": "4420", 00:25:40.891 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:40.891 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:40.891 "hdgst": false, 00:25:40.891 "ddgst": false 00:25:40.891 }, 00:25:40.891 "method": "bdev_nvme_attach_controller" 00:25:40.891 },{ 00:25:40.891 "params": { 00:25:40.891 "name": "Nvme9", 00:25:40.891 "trtype": "tcp", 00:25:40.891 "traddr": "10.0.0.2", 00:25:40.891 "adrfam": "ipv4", 00:25:40.891 "trsvcid": "4420", 00:25:40.891 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:40.891 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:40.891 "hdgst": false, 00:25:40.891 "ddgst": false 00:25:40.891 }, 00:25:40.891 "method": "bdev_nvme_attach_controller" 00:25:40.891 },{ 00:25:40.891 "params": { 00:25:40.891 "name": "Nvme10", 00:25:40.891 "trtype": "tcp", 00:25:40.891 "traddr": "10.0.0.2", 00:25:40.891 "adrfam": "ipv4", 00:25:40.891 "trsvcid": "4420", 00:25:40.891 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:40.891 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:40.891 "hdgst": false, 00:25:40.891 "ddgst": false 00:25:40.891 }, 00:25:40.891 "method": "bdev_nvme_attach_controller" 00:25:40.891 }' 00:25:40.891 [2024-11-28 01:19:55.200600] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:40.891 [2024-11-28 01:19:55.200688] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2110656 ] 00:25:40.891 EAL: No free 2048 kB hugepages reported on node 1 00:25:40.891 [2024-11-28 01:19:55.266450] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:40.891 [2024-11-28 01:19:55.355768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:42.263 Running I/O for 1 seconds... 00:25:43.635 00:25:43.635 Latency(us) 00:25:43.635 [2024-11-28T00:19:58.238Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:43.635 [2024-11-28T00:19:58.238Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:43.635 Verification LBA range: start 0x0 length 0x400 00:25:43.635 Nvme1n1 : 1.10 396.32 24.77 0.00 0.00 158934.36 16019.91 120392.06 00:25:43.635 [2024-11-28T00:19:58.238Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:43.635 Verification LBA range: start 0x0 length 0x400 00:25:43.635 Nvme2n1 : 1.08 368.33 23.02 0.00 0.00 166821.26 41360.50 142917.03 00:25:43.635 [2024-11-28T00:19:58.238Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:43.635 Verification LBA range: start 0x0 length 0x400 00:25:43.635 Nvme3n1 : 1.10 394.76 24.67 0.00 0.00 157141.10 17379.18 131266.18 00:25:43.635 [2024-11-28T00:19:58.239Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:43.636 Verification LBA range: start 0x0 length 0x400 00:25:43.636 Nvme4n1 : 1.10 393.66 24.60 0.00 0.00 156495.02 17185.00 118061.89 00:25:43.636 [2024-11-28T00:19:58.239Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:43.636 Verification LBA range: start 0x0 length 0x400 00:25:43.636 Nvme5n1 : 1.11 392.13 24.51 0.00 0.00 155870.87 18252.99 115731.72 00:25:43.636 [2024-11-28T00:19:58.239Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:43.636 Verification LBA range: start 0x0 length 0x400 00:25:43.636 Nvme6n1 : 1.11 390.13 24.38 0.00 0.00 155431.73 4587.52 123498.95 00:25:43.636 [2024-11-28T00:19:58.239Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:43.636 Verification LBA range: start 0x0 length 0x400 00:25:43.636 Nvme7n1 : 1.11 390.67 24.42 0.00 0.00 154100.65 19515.16 124275.67 00:25:43.636 [2024-11-28T00:19:58.239Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:43.636 Verification LBA range: start 0x0 length 0x400 00:25:43.636 Nvme8n1 : 1.12 388.51 24.28 0.00 0.00 154730.62 12621.75 125829.12 00:25:43.636 [2024-11-28T00:19:58.239Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:43.636 Verification LBA range: start 0x0 length 0x400 00:25:43.636 Nvme9n1 : 1.12 387.82 24.24 0.00 0.00 154347.46 9466.31 127382.57 00:25:43.636 [2024-11-28T00:19:58.239Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:43.636 Verification LBA range: start 0x0 length 0x400 00:25:43.636 Nvme10n1 : 1.12 386.81 24.18 0.00 0.00 154013.77 5291.43 135926.52 00:25:43.636 [2024-11-28T00:19:58.239Z] =================================================================================================================== 00:25:43.636 [2024-11-28T00:19:58.239Z] Total : 3889.15 243.07 0.00 0.00 156704.77 4587.52 142917.03 00:25:43.636 01:19:58 -- target/shutdown.sh@93 -- # stoptarget 00:25:43.636 01:19:58 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:43.636 01:19:58 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:43.636 01:19:58 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:43.636 01:19:58 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:43.636 01:19:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:43.636 01:19:58 -- nvmf/common.sh@116 -- # sync 00:25:43.636 01:19:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:43.636 01:19:58 -- nvmf/common.sh@119 -- # set +e 00:25:43.636 01:19:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:43.636 01:19:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:43.636 rmmod nvme_tcp 00:25:43.636 rmmod nvme_fabrics 00:25:43.636 rmmod nvme_keyring 00:25:43.636 01:19:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:43.636 01:19:58 -- nvmf/common.sh@123 -- # set -e 00:25:43.636 01:19:58 -- nvmf/common.sh@124 -- # return 0 00:25:43.636 01:19:58 -- nvmf/common.sh@477 -- # '[' -n 2110033 ']' 00:25:43.636 01:19:58 -- nvmf/common.sh@478 -- # killprocess 2110033 00:25:43.636 01:19:58 -- common/autotest_common.sh@936 -- # '[' -z 2110033 ']' 00:25:43.636 01:19:58 -- common/autotest_common.sh@940 -- # kill -0 2110033 00:25:43.636 01:19:58 -- common/autotest_common.sh@941 -- # uname 00:25:43.636 01:19:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:43.636 01:19:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2110033 00:25:43.636 01:19:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:43.636 01:19:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:43.636 01:19:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2110033' 00:25:43.636 killing process with pid 2110033 00:25:43.636 01:19:58 -- common/autotest_common.sh@955 -- # kill 2110033 00:25:43.636 01:19:58 -- common/autotest_common.sh@960 -- # wait 2110033 00:25:44.203 01:19:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:44.203 01:19:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:44.203 01:19:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:44.203 01:19:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:44.203 01:19:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:44.203 01:19:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:44.203 01:19:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:44.203 01:19:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:46.734 01:20:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:46.734 00:25:46.734 real 0m12.240s 00:25:46.734 user 0m35.599s 00:25:46.734 sys 0m3.366s 00:25:46.734 01:20:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:46.734 01:20:00 -- common/autotest_common.sh@10 -- # set +x 00:25:46.734 ************************************ 00:25:46.734 END TEST nvmf_shutdown_tc1 00:25:46.734 ************************************ 00:25:46.734 01:20:00 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:25:46.734 01:20:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:46.734 01:20:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:46.734 01:20:00 -- common/autotest_common.sh@10 -- # set +x 00:25:46.734 ************************************ 00:25:46.734 START TEST nvmf_shutdown_tc2 00:25:46.734 ************************************ 00:25:46.734 01:20:00 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:25:46.734 01:20:00 -- target/shutdown.sh@98 -- # starttarget 00:25:46.734 01:20:00 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:46.734 01:20:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:46.734 01:20:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:46.734 01:20:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:46.734 01:20:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:46.734 01:20:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:46.734 01:20:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:46.734 01:20:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:46.734 01:20:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:46.734 01:20:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:46.734 01:20:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:46.734 01:20:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:46.734 01:20:00 -- common/autotest_common.sh@10 -- # set +x 00:25:46.734 01:20:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:46.734 01:20:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:46.734 01:20:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:46.734 01:20:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:46.734 01:20:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:46.734 01:20:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:46.734 01:20:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:46.734 01:20:00 -- nvmf/common.sh@294 -- # net_devs=() 00:25:46.734 01:20:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:46.734 01:20:00 -- nvmf/common.sh@295 -- # e810=() 00:25:46.734 01:20:00 -- nvmf/common.sh@295 -- # local -ga e810 00:25:46.734 01:20:00 -- nvmf/common.sh@296 -- # x722=() 00:25:46.734 01:20:00 -- nvmf/common.sh@296 -- # local -ga x722 00:25:46.734 01:20:00 -- nvmf/common.sh@297 -- # mlx=() 00:25:46.734 01:20:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:46.734 01:20:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:46.734 01:20:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:46.734 01:20:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:46.734 01:20:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:46.734 01:20:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:46.734 01:20:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:46.734 01:20:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:46.734 01:20:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:46.734 01:20:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:46.734 01:20:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:46.734 01:20:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:46.734 01:20:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:46.734 01:20:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:46.734 01:20:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:46.734 01:20:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:46.734 01:20:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:46.734 01:20:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:46.734 01:20:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:46.734 01:20:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:46.734 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:46.734 01:20:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:46.734 01:20:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:46.734 01:20:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:46.734 01:20:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:46.734 01:20:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:46.734 01:20:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:46.734 01:20:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:46.734 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:46.734 01:20:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:46.734 01:20:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:46.734 01:20:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:46.734 01:20:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:46.734 01:20:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:46.734 01:20:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:46.734 01:20:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:46.734 01:20:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:46.734 01:20:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:46.734 01:20:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:46.734 01:20:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:46.734 01:20:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:46.734 01:20:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:46.734 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:46.734 01:20:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:46.734 01:20:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:46.734 01:20:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:46.734 01:20:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:46.734 01:20:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:46.734 01:20:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:46.734 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:46.734 01:20:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:46.734 01:20:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:46.734 01:20:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:46.734 01:20:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:46.734 01:20:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:46.734 01:20:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:46.734 01:20:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:46.734 01:20:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:46.734 01:20:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:46.734 01:20:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:46.734 01:20:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:46.734 01:20:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:46.734 01:20:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:46.734 01:20:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:46.734 01:20:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:46.734 01:20:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:46.734 01:20:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:46.734 01:20:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:46.734 01:20:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:46.734 01:20:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:46.734 01:20:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:46.734 01:20:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:46.734 01:20:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:46.734 01:20:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:46.734 01:20:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:46.734 01:20:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:46.734 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:46.734 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.324 ms 00:25:46.734 00:25:46.734 --- 10.0.0.2 ping statistics --- 00:25:46.734 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:46.734 rtt min/avg/max/mdev = 0.324/0.324/0.324/0.000 ms 00:25:46.734 01:20:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:46.734 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:46.734 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.131 ms 00:25:46.734 00:25:46.734 --- 10.0.0.1 ping statistics --- 00:25:46.734 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:46.734 rtt min/avg/max/mdev = 0.131/0.131/0.131/0.000 ms 00:25:46.734 01:20:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:46.734 01:20:00 -- nvmf/common.sh@410 -- # return 0 00:25:46.734 01:20:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:46.734 01:20:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:46.734 01:20:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:46.734 01:20:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:46.734 01:20:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:46.734 01:20:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:46.734 01:20:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:46.734 01:20:00 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:46.734 01:20:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:46.734 01:20:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:46.734 01:20:00 -- common/autotest_common.sh@10 -- # set +x 00:25:46.734 01:20:00 -- nvmf/common.sh@469 -- # nvmfpid=2111436 00:25:46.734 01:20:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:46.734 01:20:00 -- nvmf/common.sh@470 -- # waitforlisten 2111436 00:25:46.734 01:20:00 -- common/autotest_common.sh@829 -- # '[' -z 2111436 ']' 00:25:46.734 01:20:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:46.734 01:20:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:46.734 01:20:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:46.734 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:46.734 01:20:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:46.734 01:20:00 -- common/autotest_common.sh@10 -- # set +x 00:25:46.734 [2024-11-28 01:20:00.969798] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:46.734 [2024-11-28 01:20:00.969866] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:46.734 EAL: No free 2048 kB hugepages reported on node 1 00:25:46.734 [2024-11-28 01:20:01.038655] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:46.734 [2024-11-28 01:20:01.129513] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:46.734 [2024-11-28 01:20:01.129688] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:46.734 [2024-11-28 01:20:01.129706] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:46.734 [2024-11-28 01:20:01.129717] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:46.734 [2024-11-28 01:20:01.129775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:46.734 [2024-11-28 01:20:01.129837] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:46.734 [2024-11-28 01:20:01.129968] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:46.734 [2024-11-28 01:20:01.129971] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:47.669 01:20:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:47.669 01:20:01 -- common/autotest_common.sh@862 -- # return 0 00:25:47.669 01:20:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:47.669 01:20:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:47.669 01:20:01 -- common/autotest_common.sh@10 -- # set +x 00:25:47.669 01:20:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:47.669 01:20:01 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:47.669 01:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.669 01:20:01 -- common/autotest_common.sh@10 -- # set +x 00:25:47.669 [2024-11-28 01:20:01.986238] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:47.669 01:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.669 01:20:01 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:47.669 01:20:01 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:47.669 01:20:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:47.669 01:20:01 -- common/autotest_common.sh@10 -- # set +x 00:25:47.669 01:20:01 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:47.669 01:20:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:47.669 01:20:02 -- target/shutdown.sh@28 -- # cat 00:25:47.669 01:20:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:47.669 01:20:02 -- target/shutdown.sh@28 -- # cat 00:25:47.669 01:20:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:47.669 01:20:02 -- target/shutdown.sh@28 -- # cat 00:25:47.669 01:20:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:47.669 01:20:02 -- target/shutdown.sh@28 -- # cat 00:25:47.669 01:20:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:47.669 01:20:02 -- target/shutdown.sh@28 -- # cat 00:25:47.669 01:20:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:47.669 01:20:02 -- target/shutdown.sh@28 -- # cat 00:25:47.669 01:20:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:47.669 01:20:02 -- target/shutdown.sh@28 -- # cat 00:25:47.669 01:20:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:47.669 01:20:02 -- target/shutdown.sh@28 -- # cat 00:25:47.669 01:20:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:47.669 01:20:02 -- target/shutdown.sh@28 -- # cat 00:25:47.669 01:20:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:47.669 01:20:02 -- target/shutdown.sh@28 -- # cat 00:25:47.669 01:20:02 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:47.669 01:20:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.669 01:20:02 -- common/autotest_common.sh@10 -- # set +x 00:25:47.669 Malloc1 00:25:47.669 [2024-11-28 01:20:02.071576] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:47.669 Malloc2 00:25:47.669 Malloc3 00:25:47.669 Malloc4 00:25:47.669 Malloc5 00:25:47.927 Malloc6 00:25:47.927 Malloc7 00:25:47.927 Malloc8 00:25:47.927 Malloc9 00:25:47.927 Malloc10 00:25:47.927 01:20:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.927 01:20:02 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:47.927 01:20:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:47.927 01:20:02 -- common/autotest_common.sh@10 -- # set +x 00:25:48.185 01:20:02 -- target/shutdown.sh@102 -- # perfpid=2111629 00:25:48.185 01:20:02 -- target/shutdown.sh@103 -- # waitforlisten 2111629 /var/tmp/bdevperf.sock 00:25:48.185 01:20:02 -- common/autotest_common.sh@829 -- # '[' -z 2111629 ']' 00:25:48.185 01:20:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:48.185 01:20:02 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:48.185 01:20:02 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:48.185 01:20:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:48.185 01:20:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:48.185 01:20:02 -- nvmf/common.sh@520 -- # config=() 00:25:48.185 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:48.185 01:20:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:48.185 01:20:02 -- nvmf/common.sh@520 -- # local subsystem config 00:25:48.185 01:20:02 -- common/autotest_common.sh@10 -- # set +x 00:25:48.185 01:20:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:48.186 01:20:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:48.186 { 00:25:48.186 "params": { 00:25:48.186 "name": "Nvme$subsystem", 00:25:48.186 "trtype": "$TEST_TRANSPORT", 00:25:48.186 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:48.186 "adrfam": "ipv4", 00:25:48.186 "trsvcid": "$NVMF_PORT", 00:25:48.186 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:48.186 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:48.186 "hdgst": ${hdgst:-false}, 00:25:48.186 "ddgst": ${ddgst:-false} 00:25:48.186 }, 00:25:48.186 "method": "bdev_nvme_attach_controller" 00:25:48.186 } 00:25:48.186 EOF 00:25:48.186 )") 00:25:48.186 01:20:02 -- nvmf/common.sh@542 -- # cat 00:25:48.186 01:20:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:48.186 01:20:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:48.186 { 00:25:48.186 "params": { 00:25:48.186 "name": "Nvme$subsystem", 00:25:48.186 "trtype": "$TEST_TRANSPORT", 00:25:48.186 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:48.186 "adrfam": "ipv4", 00:25:48.186 "trsvcid": "$NVMF_PORT", 00:25:48.186 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:48.186 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:48.186 "hdgst": ${hdgst:-false}, 00:25:48.186 "ddgst": ${ddgst:-false} 00:25:48.186 }, 00:25:48.186 "method": "bdev_nvme_attach_controller" 00:25:48.186 } 00:25:48.186 EOF 00:25:48.186 )") 00:25:48.186 01:20:02 -- nvmf/common.sh@542 -- # cat 00:25:48.186 01:20:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:48.186 01:20:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:48.186 { 00:25:48.186 "params": { 00:25:48.186 "name": "Nvme$subsystem", 00:25:48.186 "trtype": "$TEST_TRANSPORT", 00:25:48.186 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:48.186 "adrfam": "ipv4", 00:25:48.186 "trsvcid": "$NVMF_PORT", 00:25:48.186 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:48.186 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:48.186 "hdgst": ${hdgst:-false}, 00:25:48.186 "ddgst": ${ddgst:-false} 00:25:48.186 }, 00:25:48.186 "method": "bdev_nvme_attach_controller" 00:25:48.186 } 00:25:48.186 EOF 00:25:48.186 )") 00:25:48.186 01:20:02 -- nvmf/common.sh@542 -- # cat 00:25:48.186 01:20:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:48.186 01:20:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:48.186 { 00:25:48.186 "params": { 00:25:48.186 "name": "Nvme$subsystem", 00:25:48.186 "trtype": "$TEST_TRANSPORT", 00:25:48.186 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:48.186 "adrfam": "ipv4", 00:25:48.186 "trsvcid": "$NVMF_PORT", 00:25:48.186 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:48.186 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:48.186 "hdgst": ${hdgst:-false}, 00:25:48.186 "ddgst": ${ddgst:-false} 00:25:48.186 }, 00:25:48.186 "method": "bdev_nvme_attach_controller" 00:25:48.186 } 00:25:48.186 EOF 00:25:48.186 )") 00:25:48.186 01:20:02 -- nvmf/common.sh@542 -- # cat 00:25:48.186 01:20:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:48.186 01:20:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:48.186 { 00:25:48.186 "params": { 00:25:48.186 "name": "Nvme$subsystem", 00:25:48.186 "trtype": "$TEST_TRANSPORT", 00:25:48.186 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:48.186 "adrfam": "ipv4", 00:25:48.186 "trsvcid": "$NVMF_PORT", 00:25:48.186 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:48.186 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:48.186 "hdgst": ${hdgst:-false}, 00:25:48.186 "ddgst": ${ddgst:-false} 00:25:48.186 }, 00:25:48.186 "method": "bdev_nvme_attach_controller" 00:25:48.186 } 00:25:48.186 EOF 00:25:48.186 )") 00:25:48.186 01:20:02 -- nvmf/common.sh@542 -- # cat 00:25:48.186 01:20:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:48.186 01:20:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:48.186 { 00:25:48.186 "params": { 00:25:48.186 "name": "Nvme$subsystem", 00:25:48.186 "trtype": "$TEST_TRANSPORT", 00:25:48.186 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:48.186 "adrfam": "ipv4", 00:25:48.186 "trsvcid": "$NVMF_PORT", 00:25:48.186 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:48.186 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:48.186 "hdgst": ${hdgst:-false}, 00:25:48.186 "ddgst": ${ddgst:-false} 00:25:48.186 }, 00:25:48.186 "method": "bdev_nvme_attach_controller" 00:25:48.186 } 00:25:48.186 EOF 00:25:48.186 )") 00:25:48.186 01:20:02 -- nvmf/common.sh@542 -- # cat 00:25:48.186 01:20:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:48.186 01:20:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:48.186 { 00:25:48.186 "params": { 00:25:48.186 "name": "Nvme$subsystem", 00:25:48.186 "trtype": "$TEST_TRANSPORT", 00:25:48.186 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:48.186 "adrfam": "ipv4", 00:25:48.186 "trsvcid": "$NVMF_PORT", 00:25:48.186 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:48.186 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:48.186 "hdgst": ${hdgst:-false}, 00:25:48.186 "ddgst": ${ddgst:-false} 00:25:48.186 }, 00:25:48.186 "method": "bdev_nvme_attach_controller" 00:25:48.186 } 00:25:48.186 EOF 00:25:48.186 )") 00:25:48.186 01:20:02 -- nvmf/common.sh@542 -- # cat 00:25:48.186 01:20:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:48.186 01:20:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:48.186 { 00:25:48.186 "params": { 00:25:48.186 "name": "Nvme$subsystem", 00:25:48.186 "trtype": "$TEST_TRANSPORT", 00:25:48.186 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:48.186 "adrfam": "ipv4", 00:25:48.186 "trsvcid": "$NVMF_PORT", 00:25:48.186 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:48.186 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:48.186 "hdgst": ${hdgst:-false}, 00:25:48.186 "ddgst": ${ddgst:-false} 00:25:48.186 }, 00:25:48.186 "method": "bdev_nvme_attach_controller" 00:25:48.186 } 00:25:48.186 EOF 00:25:48.186 )") 00:25:48.186 01:20:02 -- nvmf/common.sh@542 -- # cat 00:25:48.186 01:20:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:48.186 01:20:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:48.186 { 00:25:48.186 "params": { 00:25:48.186 "name": "Nvme$subsystem", 00:25:48.186 "trtype": "$TEST_TRANSPORT", 00:25:48.186 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:48.186 "adrfam": "ipv4", 00:25:48.186 "trsvcid": "$NVMF_PORT", 00:25:48.186 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:48.186 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:48.186 "hdgst": ${hdgst:-false}, 00:25:48.186 "ddgst": ${ddgst:-false} 00:25:48.186 }, 00:25:48.186 "method": "bdev_nvme_attach_controller" 00:25:48.186 } 00:25:48.186 EOF 00:25:48.186 )") 00:25:48.186 01:20:02 -- nvmf/common.sh@542 -- # cat 00:25:48.186 01:20:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:48.186 01:20:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:48.186 { 00:25:48.186 "params": { 00:25:48.186 "name": "Nvme$subsystem", 00:25:48.186 "trtype": "$TEST_TRANSPORT", 00:25:48.186 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:48.186 "adrfam": "ipv4", 00:25:48.186 "trsvcid": "$NVMF_PORT", 00:25:48.186 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:48.186 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:48.186 "hdgst": ${hdgst:-false}, 00:25:48.186 "ddgst": ${ddgst:-false} 00:25:48.186 }, 00:25:48.186 "method": "bdev_nvme_attach_controller" 00:25:48.186 } 00:25:48.186 EOF 00:25:48.186 )") 00:25:48.186 01:20:02 -- nvmf/common.sh@542 -- # cat 00:25:48.186 01:20:02 -- nvmf/common.sh@544 -- # jq . 00:25:48.186 01:20:02 -- nvmf/common.sh@545 -- # IFS=, 00:25:48.186 01:20:02 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:48.186 "params": { 00:25:48.186 "name": "Nvme1", 00:25:48.186 "trtype": "tcp", 00:25:48.186 "traddr": "10.0.0.2", 00:25:48.186 "adrfam": "ipv4", 00:25:48.186 "trsvcid": "4420", 00:25:48.186 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:48.186 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:48.186 "hdgst": false, 00:25:48.186 "ddgst": false 00:25:48.186 }, 00:25:48.186 "method": "bdev_nvme_attach_controller" 00:25:48.186 },{ 00:25:48.186 "params": { 00:25:48.186 "name": "Nvme2", 00:25:48.186 "trtype": "tcp", 00:25:48.186 "traddr": "10.0.0.2", 00:25:48.186 "adrfam": "ipv4", 00:25:48.186 "trsvcid": "4420", 00:25:48.186 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:48.187 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:48.187 "hdgst": false, 00:25:48.187 "ddgst": false 00:25:48.187 }, 00:25:48.187 "method": "bdev_nvme_attach_controller" 00:25:48.187 },{ 00:25:48.187 "params": { 00:25:48.187 "name": "Nvme3", 00:25:48.187 "trtype": "tcp", 00:25:48.187 "traddr": "10.0.0.2", 00:25:48.187 "adrfam": "ipv4", 00:25:48.187 "trsvcid": "4420", 00:25:48.187 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:48.187 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:48.187 "hdgst": false, 00:25:48.187 "ddgst": false 00:25:48.187 }, 00:25:48.187 "method": "bdev_nvme_attach_controller" 00:25:48.187 },{ 00:25:48.187 "params": { 00:25:48.187 "name": "Nvme4", 00:25:48.187 "trtype": "tcp", 00:25:48.187 "traddr": "10.0.0.2", 00:25:48.187 "adrfam": "ipv4", 00:25:48.187 "trsvcid": "4420", 00:25:48.187 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:48.187 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:48.187 "hdgst": false, 00:25:48.187 "ddgst": false 00:25:48.187 }, 00:25:48.187 "method": "bdev_nvme_attach_controller" 00:25:48.187 },{ 00:25:48.187 "params": { 00:25:48.187 "name": "Nvme5", 00:25:48.187 "trtype": "tcp", 00:25:48.187 "traddr": "10.0.0.2", 00:25:48.187 "adrfam": "ipv4", 00:25:48.187 "trsvcid": "4420", 00:25:48.187 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:48.187 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:48.187 "hdgst": false, 00:25:48.187 "ddgst": false 00:25:48.187 }, 00:25:48.187 "method": "bdev_nvme_attach_controller" 00:25:48.187 },{ 00:25:48.187 "params": { 00:25:48.187 "name": "Nvme6", 00:25:48.187 "trtype": "tcp", 00:25:48.187 "traddr": "10.0.0.2", 00:25:48.187 "adrfam": "ipv4", 00:25:48.187 "trsvcid": "4420", 00:25:48.187 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:48.187 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:48.187 "hdgst": false, 00:25:48.187 "ddgst": false 00:25:48.187 }, 00:25:48.187 "method": "bdev_nvme_attach_controller" 00:25:48.187 },{ 00:25:48.187 "params": { 00:25:48.187 "name": "Nvme7", 00:25:48.187 "trtype": "tcp", 00:25:48.187 "traddr": "10.0.0.2", 00:25:48.187 "adrfam": "ipv4", 00:25:48.187 "trsvcid": "4420", 00:25:48.187 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:48.187 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:48.187 "hdgst": false, 00:25:48.187 "ddgst": false 00:25:48.187 }, 00:25:48.187 "method": "bdev_nvme_attach_controller" 00:25:48.187 },{ 00:25:48.187 "params": { 00:25:48.187 "name": "Nvme8", 00:25:48.187 "trtype": "tcp", 00:25:48.187 "traddr": "10.0.0.2", 00:25:48.187 "adrfam": "ipv4", 00:25:48.187 "trsvcid": "4420", 00:25:48.187 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:48.187 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:48.187 "hdgst": false, 00:25:48.187 "ddgst": false 00:25:48.187 }, 00:25:48.187 "method": "bdev_nvme_attach_controller" 00:25:48.187 },{ 00:25:48.187 "params": { 00:25:48.187 "name": "Nvme9", 00:25:48.187 "trtype": "tcp", 00:25:48.187 "traddr": "10.0.0.2", 00:25:48.187 "adrfam": "ipv4", 00:25:48.187 "trsvcid": "4420", 00:25:48.187 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:48.187 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:48.187 "hdgst": false, 00:25:48.187 "ddgst": false 00:25:48.187 }, 00:25:48.187 "method": "bdev_nvme_attach_controller" 00:25:48.187 },{ 00:25:48.187 "params": { 00:25:48.187 "name": "Nvme10", 00:25:48.187 "trtype": "tcp", 00:25:48.187 "traddr": "10.0.0.2", 00:25:48.187 "adrfam": "ipv4", 00:25:48.187 "trsvcid": "4420", 00:25:48.187 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:48.187 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:48.187 "hdgst": false, 00:25:48.187 "ddgst": false 00:25:48.187 }, 00:25:48.187 "method": "bdev_nvme_attach_controller" 00:25:48.187 }' 00:25:48.187 [2024-11-28 01:20:02.591487] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:48.187 [2024-11-28 01:20:02.591598] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2111629 ] 00:25:48.187 EAL: No free 2048 kB hugepages reported on node 1 00:25:48.187 [2024-11-28 01:20:02.655588] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:48.187 [2024-11-28 01:20:02.740660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:49.561 Running I/O for 10 seconds... 00:25:49.819 01:20:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:49.819 01:20:04 -- common/autotest_common.sh@862 -- # return 0 00:25:49.819 01:20:04 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:49.819 01:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:49.819 01:20:04 -- common/autotest_common.sh@10 -- # set +x 00:25:49.819 01:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:49.819 01:20:04 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:49.819 01:20:04 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:49.819 01:20:04 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:49.819 01:20:04 -- target/shutdown.sh@57 -- # local ret=1 00:25:49.819 01:20:04 -- target/shutdown.sh@58 -- # local i 00:25:49.820 01:20:04 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:49.820 01:20:04 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:49.820 01:20:04 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:49.820 01:20:04 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:49.820 01:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:49.820 01:20:04 -- common/autotest_common.sh@10 -- # set +x 00:25:50.077 01:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.077 01:20:04 -- target/shutdown.sh@60 -- # read_io_count=129 00:25:50.077 01:20:04 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:25:50.077 01:20:04 -- target/shutdown.sh@64 -- # ret=0 00:25:50.077 01:20:04 -- target/shutdown.sh@65 -- # break 00:25:50.077 01:20:04 -- target/shutdown.sh@69 -- # return 0 00:25:50.077 01:20:04 -- target/shutdown.sh@109 -- # killprocess 2111629 00:25:50.077 01:20:04 -- common/autotest_common.sh@936 -- # '[' -z 2111629 ']' 00:25:50.077 01:20:04 -- common/autotest_common.sh@940 -- # kill -0 2111629 00:25:50.077 01:20:04 -- common/autotest_common.sh@941 -- # uname 00:25:50.077 01:20:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:50.077 01:20:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2111629 00:25:50.077 01:20:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:50.077 01:20:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:50.077 01:20:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2111629' 00:25:50.077 killing process with pid 2111629 00:25:50.077 01:20:04 -- common/autotest_common.sh@955 -- # kill 2111629 00:25:50.077 01:20:04 -- common/autotest_common.sh@960 -- # wait 2111629 00:25:50.077 Received shutdown signal, test time was about 0.506568 seconds 00:25:50.077 00:25:50.077 Latency(us) 00:25:50.077 [2024-11-28T00:20:04.680Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:50.077 [2024-11-28T00:20:04.680Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:50.077 Verification LBA range: start 0x0 length 0x400 00:25:50.077 Nvme1n1 : 0.49 390.86 24.43 0.00 0.00 155703.32 31651.46 122722.23 00:25:50.077 [2024-11-28T00:20:04.680Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:50.077 Verification LBA range: start 0x0 length 0x400 00:25:50.077 Nvme2n1 : 0.50 378.46 23.65 0.00 0.00 157550.08 36700.16 147577.36 00:25:50.077 [2024-11-28T00:20:04.680Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:50.077 Verification LBA range: start 0x0 length 0x400 00:25:50.077 Nvme3n1 : 0.48 393.64 24.60 0.00 0.00 150282.61 26991.12 121168.78 00:25:50.077 [2024-11-28T00:20:04.680Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:50.077 Verification LBA range: start 0x0 length 0x400 00:25:50.077 Nvme4n1 : 0.48 392.40 24.53 0.00 0.00 148166.04 27185.30 121168.78 00:25:50.077 [2024-11-28T00:20:04.680Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:50.077 Verification LBA range: start 0x0 length 0x400 00:25:50.077 Nvme5n1 : 0.49 385.90 24.12 0.00 0.00 147044.90 33593.27 122722.23 00:25:50.077 [2024-11-28T00:20:04.680Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:50.077 Verification LBA range: start 0x0 length 0x400 00:25:50.077 Nvme6n1 : 0.49 387.82 24.24 0.00 0.00 145251.28 26408.58 128159.29 00:25:50.077 [2024-11-28T00:20:04.680Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:50.077 Verification LBA range: start 0x0 length 0x400 00:25:50.077 Nvme7n1 : 0.49 384.53 24.03 0.00 0.00 142675.83 34175.81 123498.95 00:25:50.077 [2024-11-28T00:20:04.680Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:50.077 Verification LBA range: start 0x0 length 0x400 00:25:50.078 Nvme8n1 : 0.50 382.27 23.89 0.00 0.00 140874.04 35535.08 123498.95 00:25:50.078 [2024-11-28T00:20:04.681Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:50.078 Verification LBA range: start 0x0 length 0x400 00:25:50.078 Nvme9n1 : 0.50 379.62 23.73 0.00 0.00 140074.83 33010.73 130489.46 00:25:50.078 [2024-11-28T00:20:04.681Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:50.078 Verification LBA range: start 0x0 length 0x400 00:25:50.078 Nvme10n1 : 0.51 375.69 23.48 0.00 0.00 140564.37 26408.58 132042.90 00:25:50.078 [2024-11-28T00:20:04.681Z] =================================================================================================================== 00:25:50.078 [2024-11-28T00:20:04.681Z] Total : 3851.19 240.70 0.00 0.00 146818.73 26408.58 147577.36 00:25:50.335 01:20:04 -- target/shutdown.sh@112 -- # sleep 1 00:25:51.270 01:20:05 -- target/shutdown.sh@113 -- # kill -0 2111436 00:25:51.270 01:20:05 -- target/shutdown.sh@115 -- # stoptarget 00:25:51.270 01:20:05 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:51.270 01:20:05 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:51.270 01:20:05 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:51.270 01:20:05 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:51.270 01:20:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:51.270 01:20:05 -- nvmf/common.sh@116 -- # sync 00:25:51.270 01:20:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:51.270 01:20:05 -- nvmf/common.sh@119 -- # set +e 00:25:51.270 01:20:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:51.270 01:20:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:51.270 rmmod nvme_tcp 00:25:51.270 rmmod nvme_fabrics 00:25:51.270 rmmod nvme_keyring 00:25:51.270 01:20:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:51.270 01:20:05 -- nvmf/common.sh@123 -- # set -e 00:25:51.270 01:20:05 -- nvmf/common.sh@124 -- # return 0 00:25:51.270 01:20:05 -- nvmf/common.sh@477 -- # '[' -n 2111436 ']' 00:25:51.270 01:20:05 -- nvmf/common.sh@478 -- # killprocess 2111436 00:25:51.270 01:20:05 -- common/autotest_common.sh@936 -- # '[' -z 2111436 ']' 00:25:51.270 01:20:05 -- common/autotest_common.sh@940 -- # kill -0 2111436 00:25:51.270 01:20:05 -- common/autotest_common.sh@941 -- # uname 00:25:51.270 01:20:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:51.270 01:20:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2111436 00:25:51.527 01:20:05 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:51.527 01:20:05 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:51.527 01:20:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2111436' 00:25:51.527 killing process with pid 2111436 00:25:51.527 01:20:05 -- common/autotest_common.sh@955 -- # kill 2111436 00:25:51.527 01:20:05 -- common/autotest_common.sh@960 -- # wait 2111436 00:25:51.786 01:20:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:51.786 01:20:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:51.786 01:20:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:51.786 01:20:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:51.786 01:20:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:51.786 01:20:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:51.786 01:20:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:51.786 01:20:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:54.322 01:20:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:54.322 00:25:54.322 real 0m7.653s 00:25:54.322 user 0m23.077s 00:25:54.322 sys 0m1.359s 00:25:54.322 01:20:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:54.322 01:20:08 -- common/autotest_common.sh@10 -- # set +x 00:25:54.322 ************************************ 00:25:54.322 END TEST nvmf_shutdown_tc2 00:25:54.322 ************************************ 00:25:54.322 01:20:08 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:25:54.322 01:20:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:54.322 01:20:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:54.322 01:20:08 -- common/autotest_common.sh@10 -- # set +x 00:25:54.322 ************************************ 00:25:54.322 START TEST nvmf_shutdown_tc3 00:25:54.322 ************************************ 00:25:54.322 01:20:08 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:25:54.322 01:20:08 -- target/shutdown.sh@120 -- # starttarget 00:25:54.322 01:20:08 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:54.322 01:20:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:54.322 01:20:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:54.322 01:20:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:54.322 01:20:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:54.322 01:20:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:54.322 01:20:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:54.322 01:20:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:54.322 01:20:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:54.322 01:20:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:54.322 01:20:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:54.322 01:20:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:54.322 01:20:08 -- common/autotest_common.sh@10 -- # set +x 00:25:54.322 01:20:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:54.322 01:20:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:54.322 01:20:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:54.322 01:20:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:54.322 01:20:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:54.322 01:20:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:54.322 01:20:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:54.322 01:20:08 -- nvmf/common.sh@294 -- # net_devs=() 00:25:54.322 01:20:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:54.322 01:20:08 -- nvmf/common.sh@295 -- # e810=() 00:25:54.322 01:20:08 -- nvmf/common.sh@295 -- # local -ga e810 00:25:54.322 01:20:08 -- nvmf/common.sh@296 -- # x722=() 00:25:54.322 01:20:08 -- nvmf/common.sh@296 -- # local -ga x722 00:25:54.322 01:20:08 -- nvmf/common.sh@297 -- # mlx=() 00:25:54.322 01:20:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:54.322 01:20:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:54.322 01:20:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:54.322 01:20:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:54.322 01:20:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:54.322 01:20:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:54.322 01:20:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:54.322 01:20:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:54.322 01:20:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:54.322 01:20:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:54.322 01:20:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:54.322 01:20:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:54.322 01:20:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:54.322 01:20:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:54.322 01:20:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:54.322 01:20:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:54.322 01:20:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:54.322 01:20:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:54.322 01:20:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:54.322 01:20:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:54.322 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:54.322 01:20:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:54.322 01:20:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:54.322 01:20:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:54.322 01:20:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:54.322 01:20:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:54.322 01:20:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:54.322 01:20:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:54.322 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:54.322 01:20:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:54.322 01:20:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:54.322 01:20:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:54.322 01:20:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:54.322 01:20:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:54.322 01:20:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:54.322 01:20:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:54.322 01:20:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:54.322 01:20:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:54.322 01:20:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:54.323 01:20:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:54.323 01:20:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:54.323 01:20:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:54.323 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:54.323 01:20:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:54.323 01:20:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:54.323 01:20:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:54.323 01:20:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:54.323 01:20:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:54.323 01:20:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:54.323 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:54.323 01:20:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:54.323 01:20:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:54.323 01:20:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:54.323 01:20:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:54.323 01:20:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:54.323 01:20:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:54.323 01:20:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:54.323 01:20:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:54.323 01:20:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:54.323 01:20:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:54.323 01:20:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:54.323 01:20:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:54.323 01:20:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:54.323 01:20:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:54.323 01:20:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:54.323 01:20:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:54.323 01:20:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:54.323 01:20:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:54.323 01:20:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:54.323 01:20:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:54.323 01:20:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:54.323 01:20:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:54.323 01:20:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:54.323 01:20:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:54.323 01:20:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:54.323 01:20:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:54.323 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:54.323 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.258 ms 00:25:54.323 00:25:54.323 --- 10.0.0.2 ping statistics --- 00:25:54.323 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:54.323 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:25:54.323 01:20:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:54.323 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:54.323 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.050 ms 00:25:54.323 00:25:54.323 --- 10.0.0.1 ping statistics --- 00:25:54.323 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:54.323 rtt min/avg/max/mdev = 0.050/0.050/0.050/0.000 ms 00:25:54.323 01:20:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:54.323 01:20:08 -- nvmf/common.sh@410 -- # return 0 00:25:54.323 01:20:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:54.323 01:20:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:54.323 01:20:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:54.323 01:20:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:54.323 01:20:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:54.323 01:20:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:54.323 01:20:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:54.323 01:20:08 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:54.323 01:20:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:54.323 01:20:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:54.323 01:20:08 -- common/autotest_common.sh@10 -- # set +x 00:25:54.323 01:20:08 -- nvmf/common.sh@469 -- # nvmfpid=2112536 00:25:54.323 01:20:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:54.323 01:20:08 -- nvmf/common.sh@470 -- # waitforlisten 2112536 00:25:54.323 01:20:08 -- common/autotest_common.sh@829 -- # '[' -z 2112536 ']' 00:25:54.323 01:20:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:54.323 01:20:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:54.323 01:20:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:54.323 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:54.323 01:20:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:54.323 01:20:08 -- common/autotest_common.sh@10 -- # set +x 00:25:54.323 [2024-11-28 01:20:08.780762] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:54.323 [2024-11-28 01:20:08.780849] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:54.323 EAL: No free 2048 kB hugepages reported on node 1 00:25:54.323 [2024-11-28 01:20:08.850343] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:54.581 [2024-11-28 01:20:08.941535] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:54.581 [2024-11-28 01:20:08.941693] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:54.581 [2024-11-28 01:20:08.941712] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:54.581 [2024-11-28 01:20:08.941726] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:54.581 [2024-11-28 01:20:08.941825] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:54.581 [2024-11-28 01:20:08.941873] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:54.581 [2024-11-28 01:20:08.941932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:54.581 [2024-11-28 01:20:08.941935] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:55.147 01:20:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:55.147 01:20:09 -- common/autotest_common.sh@862 -- # return 0 00:25:55.148 01:20:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:55.148 01:20:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:55.148 01:20:09 -- common/autotest_common.sh@10 -- # set +x 00:25:55.406 01:20:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:55.406 01:20:09 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:55.406 01:20:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.406 01:20:09 -- common/autotest_common.sh@10 -- # set +x 00:25:55.406 [2024-11-28 01:20:09.758165] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:55.406 01:20:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.406 01:20:09 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:55.406 01:20:09 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:55.406 01:20:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:55.406 01:20:09 -- common/autotest_common.sh@10 -- # set +x 00:25:55.406 01:20:09 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:55.406 01:20:09 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:55.406 01:20:09 -- target/shutdown.sh@28 -- # cat 00:25:55.406 01:20:09 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:55.406 01:20:09 -- target/shutdown.sh@28 -- # cat 00:25:55.406 01:20:09 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:55.406 01:20:09 -- target/shutdown.sh@28 -- # cat 00:25:55.406 01:20:09 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:55.406 01:20:09 -- target/shutdown.sh@28 -- # cat 00:25:55.406 01:20:09 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:55.406 01:20:09 -- target/shutdown.sh@28 -- # cat 00:25:55.406 01:20:09 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:55.406 01:20:09 -- target/shutdown.sh@28 -- # cat 00:25:55.406 01:20:09 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:55.406 01:20:09 -- target/shutdown.sh@28 -- # cat 00:25:55.406 01:20:09 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:55.406 01:20:09 -- target/shutdown.sh@28 -- # cat 00:25:55.406 01:20:09 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:55.406 01:20:09 -- target/shutdown.sh@28 -- # cat 00:25:55.406 01:20:09 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:55.406 01:20:09 -- target/shutdown.sh@28 -- # cat 00:25:55.406 01:20:09 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:55.406 01:20:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.406 01:20:09 -- common/autotest_common.sh@10 -- # set +x 00:25:55.406 Malloc1 00:25:55.406 [2024-11-28 01:20:09.834068] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:55.406 Malloc2 00:25:55.406 Malloc3 00:25:55.406 Malloc4 00:25:55.406 Malloc5 00:25:55.738 Malloc6 00:25:55.738 Malloc7 00:25:55.738 Malloc8 00:25:55.738 Malloc9 00:25:55.738 Malloc10 00:25:55.738 01:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.738 01:20:10 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:55.738 01:20:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:55.738 01:20:10 -- common/autotest_common.sh@10 -- # set +x 00:25:56.051 01:20:10 -- target/shutdown.sh@124 -- # perfpid=2112746 00:25:56.052 01:20:10 -- target/shutdown.sh@125 -- # waitforlisten 2112746 /var/tmp/bdevperf.sock 00:25:56.052 01:20:10 -- common/autotest_common.sh@829 -- # '[' -z 2112746 ']' 00:25:56.052 01:20:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:56.052 01:20:10 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:56.052 01:20:10 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:56.052 01:20:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:56.052 01:20:10 -- nvmf/common.sh@520 -- # config=() 00:25:56.052 01:20:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:56.052 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:56.052 01:20:10 -- nvmf/common.sh@520 -- # local subsystem config 00:25:56.052 01:20:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:56.052 01:20:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:56.052 01:20:10 -- common/autotest_common.sh@10 -- # set +x 00:25:56.052 01:20:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:56.052 { 00:25:56.052 "params": { 00:25:56.052 "name": "Nvme$subsystem", 00:25:56.052 "trtype": "$TEST_TRANSPORT", 00:25:56.052 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:56.052 "adrfam": "ipv4", 00:25:56.052 "trsvcid": "$NVMF_PORT", 00:25:56.052 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:56.052 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:56.052 "hdgst": ${hdgst:-false}, 00:25:56.052 "ddgst": ${ddgst:-false} 00:25:56.052 }, 00:25:56.052 "method": "bdev_nvme_attach_controller" 00:25:56.052 } 00:25:56.052 EOF 00:25:56.052 )") 00:25:56.052 01:20:10 -- nvmf/common.sh@542 -- # cat 00:25:56.052 01:20:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:56.052 01:20:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:56.052 { 00:25:56.052 "params": { 00:25:56.052 "name": "Nvme$subsystem", 00:25:56.052 "trtype": "$TEST_TRANSPORT", 00:25:56.052 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:56.052 "adrfam": "ipv4", 00:25:56.052 "trsvcid": "$NVMF_PORT", 00:25:56.052 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:56.052 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:56.052 "hdgst": ${hdgst:-false}, 00:25:56.052 "ddgst": ${ddgst:-false} 00:25:56.052 }, 00:25:56.052 "method": "bdev_nvme_attach_controller" 00:25:56.052 } 00:25:56.052 EOF 00:25:56.052 )") 00:25:56.052 01:20:10 -- nvmf/common.sh@542 -- # cat 00:25:56.052 01:20:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:56.052 01:20:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:56.052 { 00:25:56.052 "params": { 00:25:56.052 "name": "Nvme$subsystem", 00:25:56.052 "trtype": "$TEST_TRANSPORT", 00:25:56.052 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:56.052 "adrfam": "ipv4", 00:25:56.052 "trsvcid": "$NVMF_PORT", 00:25:56.052 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:56.052 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:56.052 "hdgst": ${hdgst:-false}, 00:25:56.052 "ddgst": ${ddgst:-false} 00:25:56.052 }, 00:25:56.052 "method": "bdev_nvme_attach_controller" 00:25:56.052 } 00:25:56.052 EOF 00:25:56.052 )") 00:25:56.052 01:20:10 -- nvmf/common.sh@542 -- # cat 00:25:56.052 01:20:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:56.052 01:20:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:56.052 { 00:25:56.052 "params": { 00:25:56.052 "name": "Nvme$subsystem", 00:25:56.052 "trtype": "$TEST_TRANSPORT", 00:25:56.052 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:56.052 "adrfam": "ipv4", 00:25:56.052 "trsvcid": "$NVMF_PORT", 00:25:56.052 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:56.052 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:56.052 "hdgst": ${hdgst:-false}, 00:25:56.052 "ddgst": ${ddgst:-false} 00:25:56.052 }, 00:25:56.052 "method": "bdev_nvme_attach_controller" 00:25:56.052 } 00:25:56.052 EOF 00:25:56.052 )") 00:25:56.052 01:20:10 -- nvmf/common.sh@542 -- # cat 00:25:56.052 01:20:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:56.052 01:20:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:56.052 { 00:25:56.052 "params": { 00:25:56.052 "name": "Nvme$subsystem", 00:25:56.052 "trtype": "$TEST_TRANSPORT", 00:25:56.052 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:56.052 "adrfam": "ipv4", 00:25:56.052 "trsvcid": "$NVMF_PORT", 00:25:56.052 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:56.052 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:56.052 "hdgst": ${hdgst:-false}, 00:25:56.052 "ddgst": ${ddgst:-false} 00:25:56.052 }, 00:25:56.052 "method": "bdev_nvme_attach_controller" 00:25:56.052 } 00:25:56.052 EOF 00:25:56.052 )") 00:25:56.052 01:20:10 -- nvmf/common.sh@542 -- # cat 00:25:56.052 01:20:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:56.052 01:20:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:56.052 { 00:25:56.052 "params": { 00:25:56.052 "name": "Nvme$subsystem", 00:25:56.052 "trtype": "$TEST_TRANSPORT", 00:25:56.052 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:56.052 "adrfam": "ipv4", 00:25:56.052 "trsvcid": "$NVMF_PORT", 00:25:56.052 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:56.052 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:56.052 "hdgst": ${hdgst:-false}, 00:25:56.052 "ddgst": ${ddgst:-false} 00:25:56.052 }, 00:25:56.052 "method": "bdev_nvme_attach_controller" 00:25:56.052 } 00:25:56.052 EOF 00:25:56.052 )") 00:25:56.052 01:20:10 -- nvmf/common.sh@542 -- # cat 00:25:56.052 01:20:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:56.052 01:20:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:56.052 { 00:25:56.052 "params": { 00:25:56.052 "name": "Nvme$subsystem", 00:25:56.052 "trtype": "$TEST_TRANSPORT", 00:25:56.052 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:56.052 "adrfam": "ipv4", 00:25:56.052 "trsvcid": "$NVMF_PORT", 00:25:56.052 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:56.052 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:56.052 "hdgst": ${hdgst:-false}, 00:25:56.052 "ddgst": ${ddgst:-false} 00:25:56.052 }, 00:25:56.052 "method": "bdev_nvme_attach_controller" 00:25:56.052 } 00:25:56.052 EOF 00:25:56.052 )") 00:25:56.052 01:20:10 -- nvmf/common.sh@542 -- # cat 00:25:56.052 01:20:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:56.052 01:20:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:56.052 { 00:25:56.052 "params": { 00:25:56.052 "name": "Nvme$subsystem", 00:25:56.052 "trtype": "$TEST_TRANSPORT", 00:25:56.052 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:56.052 "adrfam": "ipv4", 00:25:56.052 "trsvcid": "$NVMF_PORT", 00:25:56.052 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:56.052 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:56.052 "hdgst": ${hdgst:-false}, 00:25:56.052 "ddgst": ${ddgst:-false} 00:25:56.052 }, 00:25:56.052 "method": "bdev_nvme_attach_controller" 00:25:56.052 } 00:25:56.052 EOF 00:25:56.052 )") 00:25:56.052 01:20:10 -- nvmf/common.sh@542 -- # cat 00:25:56.052 01:20:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:56.052 01:20:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:56.052 { 00:25:56.052 "params": { 00:25:56.052 "name": "Nvme$subsystem", 00:25:56.052 "trtype": "$TEST_TRANSPORT", 00:25:56.052 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:56.052 "adrfam": "ipv4", 00:25:56.052 "trsvcid": "$NVMF_PORT", 00:25:56.052 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:56.052 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:56.052 "hdgst": ${hdgst:-false}, 00:25:56.052 "ddgst": ${ddgst:-false} 00:25:56.052 }, 00:25:56.052 "method": "bdev_nvme_attach_controller" 00:25:56.052 } 00:25:56.052 EOF 00:25:56.052 )") 00:25:56.052 01:20:10 -- nvmf/common.sh@542 -- # cat 00:25:56.052 01:20:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:56.052 01:20:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:56.052 { 00:25:56.052 "params": { 00:25:56.052 "name": "Nvme$subsystem", 00:25:56.052 "trtype": "$TEST_TRANSPORT", 00:25:56.052 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:56.052 "adrfam": "ipv4", 00:25:56.052 "trsvcid": "$NVMF_PORT", 00:25:56.052 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:56.052 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:56.052 "hdgst": ${hdgst:-false}, 00:25:56.052 "ddgst": ${ddgst:-false} 00:25:56.052 }, 00:25:56.052 "method": "bdev_nvme_attach_controller" 00:25:56.052 } 00:25:56.052 EOF 00:25:56.052 )") 00:25:56.052 01:20:10 -- nvmf/common.sh@542 -- # cat 00:25:56.052 01:20:10 -- nvmf/common.sh@544 -- # jq . 00:25:56.052 01:20:10 -- nvmf/common.sh@545 -- # IFS=, 00:25:56.053 01:20:10 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:56.053 "params": { 00:25:56.053 "name": "Nvme1", 00:25:56.053 "trtype": "tcp", 00:25:56.053 "traddr": "10.0.0.2", 00:25:56.053 "adrfam": "ipv4", 00:25:56.053 "trsvcid": "4420", 00:25:56.053 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:56.053 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:56.053 "hdgst": false, 00:25:56.053 "ddgst": false 00:25:56.053 }, 00:25:56.053 "method": "bdev_nvme_attach_controller" 00:25:56.053 },{ 00:25:56.053 "params": { 00:25:56.053 "name": "Nvme2", 00:25:56.053 "trtype": "tcp", 00:25:56.053 "traddr": "10.0.0.2", 00:25:56.053 "adrfam": "ipv4", 00:25:56.053 "trsvcid": "4420", 00:25:56.053 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:56.053 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:56.053 "hdgst": false, 00:25:56.053 "ddgst": false 00:25:56.053 }, 00:25:56.053 "method": "bdev_nvme_attach_controller" 00:25:56.053 },{ 00:25:56.053 "params": { 00:25:56.053 "name": "Nvme3", 00:25:56.053 "trtype": "tcp", 00:25:56.053 "traddr": "10.0.0.2", 00:25:56.053 "adrfam": "ipv4", 00:25:56.053 "trsvcid": "4420", 00:25:56.053 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:56.053 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:56.053 "hdgst": false, 00:25:56.053 "ddgst": false 00:25:56.053 }, 00:25:56.053 "method": "bdev_nvme_attach_controller" 00:25:56.053 },{ 00:25:56.053 "params": { 00:25:56.053 "name": "Nvme4", 00:25:56.053 "trtype": "tcp", 00:25:56.053 "traddr": "10.0.0.2", 00:25:56.053 "adrfam": "ipv4", 00:25:56.053 "trsvcid": "4420", 00:25:56.053 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:56.053 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:56.053 "hdgst": false, 00:25:56.053 "ddgst": false 00:25:56.053 }, 00:25:56.053 "method": "bdev_nvme_attach_controller" 00:25:56.053 },{ 00:25:56.053 "params": { 00:25:56.053 "name": "Nvme5", 00:25:56.053 "trtype": "tcp", 00:25:56.053 "traddr": "10.0.0.2", 00:25:56.053 "adrfam": "ipv4", 00:25:56.053 "trsvcid": "4420", 00:25:56.053 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:56.053 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:56.053 "hdgst": false, 00:25:56.053 "ddgst": false 00:25:56.053 }, 00:25:56.053 "method": "bdev_nvme_attach_controller" 00:25:56.053 },{ 00:25:56.053 "params": { 00:25:56.053 "name": "Nvme6", 00:25:56.053 "trtype": "tcp", 00:25:56.053 "traddr": "10.0.0.2", 00:25:56.053 "adrfam": "ipv4", 00:25:56.053 "trsvcid": "4420", 00:25:56.053 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:56.053 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:56.053 "hdgst": false, 00:25:56.053 "ddgst": false 00:25:56.053 }, 00:25:56.053 "method": "bdev_nvme_attach_controller" 00:25:56.053 },{ 00:25:56.053 "params": { 00:25:56.053 "name": "Nvme7", 00:25:56.053 "trtype": "tcp", 00:25:56.053 "traddr": "10.0.0.2", 00:25:56.053 "adrfam": "ipv4", 00:25:56.053 "trsvcid": "4420", 00:25:56.053 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:56.053 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:56.053 "hdgst": false, 00:25:56.053 "ddgst": false 00:25:56.053 }, 00:25:56.053 "method": "bdev_nvme_attach_controller" 00:25:56.053 },{ 00:25:56.053 "params": { 00:25:56.053 "name": "Nvme8", 00:25:56.053 "trtype": "tcp", 00:25:56.053 "traddr": "10.0.0.2", 00:25:56.053 "adrfam": "ipv4", 00:25:56.053 "trsvcid": "4420", 00:25:56.053 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:56.053 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:56.053 "hdgst": false, 00:25:56.053 "ddgst": false 00:25:56.053 }, 00:25:56.053 "method": "bdev_nvme_attach_controller" 00:25:56.053 },{ 00:25:56.053 "params": { 00:25:56.053 "name": "Nvme9", 00:25:56.053 "trtype": "tcp", 00:25:56.053 "traddr": "10.0.0.2", 00:25:56.053 "adrfam": "ipv4", 00:25:56.053 "trsvcid": "4420", 00:25:56.053 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:56.053 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:56.053 "hdgst": false, 00:25:56.053 "ddgst": false 00:25:56.053 }, 00:25:56.053 "method": "bdev_nvme_attach_controller" 00:25:56.053 },{ 00:25:56.053 "params": { 00:25:56.053 "name": "Nvme10", 00:25:56.053 "trtype": "tcp", 00:25:56.053 "traddr": "10.0.0.2", 00:25:56.053 "adrfam": "ipv4", 00:25:56.053 "trsvcid": "4420", 00:25:56.053 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:56.053 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:56.053 "hdgst": false, 00:25:56.053 "ddgst": false 00:25:56.053 }, 00:25:56.053 "method": "bdev_nvme_attach_controller" 00:25:56.053 }' 00:25:56.053 [2024-11-28 01:20:10.345571] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:56.053 [2024-11-28 01:20:10.345648] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2112746 ] 00:25:56.053 EAL: No free 2048 kB hugepages reported on node 1 00:25:56.053 [2024-11-28 01:20:10.412599] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:56.053 [2024-11-28 01:20:10.499747] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:57.951 Running I/O for 10 seconds... 00:25:58.533 01:20:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:58.533 01:20:12 -- common/autotest_common.sh@862 -- # return 0 00:25:58.533 01:20:12 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:58.533 01:20:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.533 01:20:12 -- common/autotest_common.sh@10 -- # set +x 00:25:58.533 01:20:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.533 01:20:12 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:58.533 01:20:12 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:58.533 01:20:12 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:58.533 01:20:12 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:58.533 01:20:12 -- target/shutdown.sh@57 -- # local ret=1 00:25:58.533 01:20:12 -- target/shutdown.sh@58 -- # local i 00:25:58.533 01:20:12 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:58.533 01:20:12 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:58.533 01:20:12 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:58.533 01:20:12 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:58.533 01:20:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.533 01:20:12 -- common/autotest_common.sh@10 -- # set +x 00:25:58.533 01:20:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.533 01:20:12 -- target/shutdown.sh@60 -- # read_io_count=254 00:25:58.533 01:20:12 -- target/shutdown.sh@63 -- # '[' 254 -ge 100 ']' 00:25:58.533 01:20:12 -- target/shutdown.sh@64 -- # ret=0 00:25:58.533 01:20:12 -- target/shutdown.sh@65 -- # break 00:25:58.533 01:20:12 -- target/shutdown.sh@69 -- # return 0 00:25:58.533 01:20:12 -- target/shutdown.sh@134 -- # killprocess 2112536 00:25:58.533 01:20:12 -- common/autotest_common.sh@936 -- # '[' -z 2112536 ']' 00:25:58.533 01:20:12 -- common/autotest_common.sh@940 -- # kill -0 2112536 00:25:58.533 01:20:12 -- common/autotest_common.sh@941 -- # uname 00:25:58.533 01:20:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:58.533 01:20:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2112536 00:25:58.533 01:20:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:58.533 01:20:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:58.533 01:20:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2112536' 00:25:58.533 killing process with pid 2112536 00:25:58.533 01:20:12 -- common/autotest_common.sh@955 -- # kill 2112536 00:25:58.533 01:20:12 -- common/autotest_common.sh@960 -- # wait 2112536 00:25:58.533 [2024-11-28 01:20:12.955119] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.533 [2024-11-28 01:20:12.955239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.533 [2024-11-28 01:20:12.955256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.533 [2024-11-28 01:20:12.955269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.533 [2024-11-28 01:20:12.955291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.533 [2024-11-28 01:20:12.955303] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.533 [2024-11-28 01:20:12.955315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.533 [2024-11-28 01:20:12.955343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.533 [2024-11-28 01:20:12.955355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.533 [2024-11-28 01:20:12.955368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.533 [2024-11-28 01:20:12.955380] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955426] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955472] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955572] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955597] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955609] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955645] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955759] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955783] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955826] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955862] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955874] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955886] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955960] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955972] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.955996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.956008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.956023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.956035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.956046] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.956058] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.956070] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dfe90 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.957194] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.534 [2024-11-28 01:20:12.957235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.534 [2024-11-28 01:20:12.957253] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.534 [2024-11-28 01:20:12.957267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.534 [2024-11-28 01:20:12.957281] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.534 [2024-11-28 01:20:12.957295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.534 [2024-11-28 01:20:12.957309] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.534 [2024-11-28 01:20:12.957322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.534 [2024-11-28 01:20:12.957336] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed36b0 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.962795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.962883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.962923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.962948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.962974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.962998] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.963019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.963045] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.963066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.963090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.963112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.963136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.963158] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.963191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.963215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.963239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.963261] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.963285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.963306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.963331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.963352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.534 [2024-11-28 01:20:12.963392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963826] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963871] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963937] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.963981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.964003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.964027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.964049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.964071] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.964094] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.964114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.964139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.964158] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.964182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.964202] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.964224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.964247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.964271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.964293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.964312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.964335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.964356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e2750 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.965806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.965846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.965870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.965905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.965936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.965959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.965984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966074] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966095] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966201] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966245] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966650] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966814] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966861] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.535 [2024-11-28 01:20:12.966941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.966966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.966987] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.967008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.967034] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.967056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.967080] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.967104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.967128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.967152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.967177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.967199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.967234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.967256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.967279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.967310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.967332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.967356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.967378] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.967402] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0340 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974560] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974573] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974597] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974690] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974714] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974822] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974875] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974887] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974961] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974973] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.974989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.975001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.975013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.975025] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.975037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.975049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e07f0 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.975261] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.536 [2024-11-28 01:20:12.975299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.536 [2024-11-28 01:20:12.975317] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.536 [2024-11-28 01:20:12.975331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.536 [2024-11-28 01:20:12.975344] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.536 [2024-11-28 01:20:12.975357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.536 [2024-11-28 01:20:12.975370] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.536 [2024-11-28 01:20:12.975384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.536 [2024-11-28 01:20:12.975396] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x209a100 is same with the state(5) to be set 00:25:58.536 [2024-11-28 01:20:12.975463] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.537 [2024-11-28 01:20:12.975484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.537 [2024-11-28 01:20:12.975498] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.537 [2024-11-28 01:20:12.975518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.537 [2024-11-28 01:20:12.975541] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.537 [2024-11-28 01:20:12.975556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.537 [2024-11-28 01:20:12.975569] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.537 [2024-11-28 01:20:12.975582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.537 [2024-11-28 01:20:12.975594] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2098c50 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.975682] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.537 [2024-11-28 01:20:12.975703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.537 [2024-11-28 01:20:12.975723] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.537 [2024-11-28 01:20:12.975737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.537 [2024-11-28 01:20:12.975751] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.537 [2024-11-28 01:20:12.975764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.537 [2024-11-28 01:20:12.975778] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.537 [2024-11-28 01:20:12.975790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.537 [2024-11-28 01:20:12.975802] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ee0d30 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.975850] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ed36b0 (9): Bad file descriptor 00:25:58.537 [2024-11-28 01:20:12.975948] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:58.537 [2024-11-28 01:20:12.982086] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982162] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982537] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982613] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982625] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982637] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982661] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982673] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982685] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982697] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982871] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.982939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0c80 is same with the state(5) to be set 00:25:58.537 [2024-11-28 01:20:12.983635] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983681] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983694] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983706] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983718] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983730] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983783] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983824] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983874] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983886] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983933] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.983991] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984059] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984078] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984258] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.984281] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1130 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.985306] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x209a100 (9): Bad file descriptor 00:25:58.538 [2024-11-28 01:20:12.985364] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2098c50 (9): Bad file descriptor 00:25:58.538 [2024-11-28 01:20:12.985422] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.538 [2024-11-28 01:20:12.985445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.538 [2024-11-28 01:20:12.985460] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.538 [2024-11-28 01:20:12.985473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.538 [2024-11-28 01:20:12.985487] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.538 [2024-11-28 01:20:12.985499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.538 [2024-11-28 01:20:12.985518] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.538 [2024-11-28 01:20:12.985540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.538 [2024-11-28 01:20:12.985554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2074c80 is same with the state(5) to be set 00:25:58.538 [2024-11-28 01:20:12.985614] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.538 [2024-11-28 01:20:12.985640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.538 [2024-11-28 01:20:12.985655] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.538 [2024-11-28 01:20:12.985667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.538 [2024-11-28 01:20:12.985681] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.538 [2024-11-28 01:20:12.985693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.538 [2024-11-28 01:20:12.985706] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.538 [2024-11-28 01:20:12.985719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.985731] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ef5a30 is same with the state(5) to be set 00:25:58.539 [2024-11-28 01:20:12.985757] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ee0d30 (9): Bad file descriptor 00:25:58.539 [2024-11-28 01:20:12.986791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.986833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.986875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.986895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.986912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.986926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.986942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.986955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.986970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.986984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.986999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.987974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.539 [2024-11-28 01:20:12.987987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.539 [2024-11-28 01:20:12.988002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.540 [2024-11-28 01:20:12.988746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.540 [2024-11-28 01:20:12.988760] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ea33c0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991109] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:58.540 [2024-11-28 01:20:12.991130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:58.540 [2024-11-28 01:20:12.991175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991261] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991303] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991317] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:58.540 [2024-11-28 01:20:12.991323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991377] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991400] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991597] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991619] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.540 [2024-11-28 01:20:12.991703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.991723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.991745] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.991766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.991789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.991811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.991831] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.991853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.991874] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.991895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.991916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.991936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.991959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.991982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.992013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.992035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.992058] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.992079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.992101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.992122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.992143] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.992166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.992185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.992208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.992230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.992251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.992273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.992293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.992316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.992337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.992356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.992379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e15e0 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.993359] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:58.541 [2024-11-28 01:20:12.993429] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:58.541 [2024-11-28 01:20:12.993818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.993851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.993848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.541 [2024-11-28 01:20:12.993866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.993875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.541 [2024-11-28 01:20:12.993879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.993892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.993899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.541 [2024-11-28 01:20:12.993911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.993916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.541 [2024-11-28 01:20:12.993925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.993933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.541 [2024-11-28 01:20:12.993938] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.993948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.541 [2024-11-28 01:20:12.993951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.993964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with [2024-11-28 01:20:12.993964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128the state(5) to be set 00:25:58.541 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.541 [2024-11-28 01:20:12.993978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.993980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.541 [2024-11-28 01:20:12.993991] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.993997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.541 [2024-11-28 01:20:12.994004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.994013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.541 [2024-11-28 01:20:12.994016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.994028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with [2024-11-28 01:20:12.994029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128the state(5) to be set 00:25:58.541 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.541 [2024-11-28 01:20:12.994042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with [2024-11-28 01:20:12.994044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:58.541 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.541 [2024-11-28 01:20:12.994057] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.994061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.541 [2024-11-28 01:20:12.994070] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.994074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.541 [2024-11-28 01:20:12.994083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.994091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.541 [2024-11-28 01:20:12.994099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.994105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.541 [2024-11-28 01:20:12.994112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.994120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.541 [2024-11-28 01:20:12.994125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.994134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.541 [2024-11-28 01:20:12.994138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.994149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36096 len:12[2024-11-28 01:20:12.994151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.541 the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.994164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 01:20:12.994164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.541 the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.994180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.994182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.541 [2024-11-28 01:20:12.994192] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.994196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.541 [2024-11-28 01:20:12.994205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.541 [2024-11-28 01:20:12.994211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 [2024-11-28 01:20:12.994218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 [2024-11-28 01:20:12.994230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36864 len:12[2024-11-28 01:20:12.994242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 01:20:12.994256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 [2024-11-28 01:20:12.994284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 [2024-11-28 01:20:12.994298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:37248 len:12[2024-11-28 01:20:12.994310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 01:20:12.994325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 [2024-11-28 01:20:12.994351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 [2024-11-28 01:20:12.994364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 [2024-11-28 01:20:12.994376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 [2024-11-28 01:20:12.994389] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:37888 len:12[2024-11-28 01:20:12.994401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with [2024-11-28 01:20:12.994416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:58.542 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 [2024-11-28 01:20:12.994431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 [2024-11-28 01:20:12.994443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 [2024-11-28 01:20:12.994456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:38400 len:12[2024-11-28 01:20:12.994468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with [2024-11-28 01:20:12.994483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:58.542 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 [2024-11-28 01:20:12.994497] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 [2024-11-28 01:20:12.994509] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 [2024-11-28 01:20:12.994521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with [2024-11-28 01:20:12.994541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:40960 len:12the state(5) to be set 00:25:58.542 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 [2024-11-28 01:20:12.994557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 [2024-11-28 01:20:12.994569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1a90 is same with the state(5) to be set 00:25:58.542 [2024-11-28 01:20:12.994575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 [2024-11-28 01:20:12.994589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 [2024-11-28 01:20:12.994604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 [2024-11-28 01:20:12.994617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 [2024-11-28 01:20:12.994632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 [2024-11-28 01:20:12.994646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 [2024-11-28 01:20:12.994661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 [2024-11-28 01:20:12.994674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 [2024-11-28 01:20:12.994690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 [2024-11-28 01:20:12.994703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 [2024-11-28 01:20:12.994718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 [2024-11-28 01:20:12.994731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 [2024-11-28 01:20:12.994754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 [2024-11-28 01:20:12.994768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 [2024-11-28 01:20:12.994783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 [2024-11-28 01:20:12.994796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 [2024-11-28 01:20:12.994811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 [2024-11-28 01:20:12.994824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 [2024-11-28 01:20:12.994839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 [2024-11-28 01:20:12.994852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 [2024-11-28 01:20:12.994867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.542 [2024-11-28 01:20:12.994880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.542 [2024-11-28 01:20:12.994895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.994908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.994923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.994936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.994955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.994968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.994999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with [2024-11-28 01:20:12.995485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:58.543 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:44032 len:12[2024-11-28 01:20:12.995505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 the state(5) to be set 00:25:58.543 [2024-11-28 01:20:12.995521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.543 [2024-11-28 01:20:12.995545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:44160 len:1[2024-11-28 01:20:12.995546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 the state(5) to be set 00:25:58.543 [2024-11-28 01:20:12.995561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 01:20:12.995562] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 the state(5) to be set 00:25:58.543 [2024-11-28 01:20:12.995576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.543 [2024-11-28 01:20:12.995578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.543 [2024-11-28 01:20:12.995591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.543 [2024-11-28 01:20:12.995607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995613] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.543 [2024-11-28 01:20:12.995620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995625] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.543 [2024-11-28 01:20:12.995636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.543 [2024-11-28 01:20:12.995648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.543 [2024-11-28 01:20:12.995663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with [2024-11-28 01:20:12.995663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:44672 len:12the state(5) to be set 00:25:58.543 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with [2024-11-28 01:20:12.995678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:58.543 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995690] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.543 [2024-11-28 01:20:12.995697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.543 [2024-11-28 01:20:12.995711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.543 [2024-11-28 01:20:12.995726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:44928 len:1[2024-11-28 01:20:12.995727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 the state(5) to be set 00:25:58.543 [2024-11-28 01:20:12.995741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 01:20:12.995742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 the state(5) to be set 00:25:58.543 [2024-11-28 01:20:12.995756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.543 [2024-11-28 01:20:12.995760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.543 [2024-11-28 01:20:12.995768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.543 [2024-11-28 01:20:12.995773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.543 [2024-11-28 01:20:12.995780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.995789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.995792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.995802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 [2024-11-28 01:20:12.995804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.995816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with [2024-11-28 01:20:12.995817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:45312 len:12the state(5) to be set 00:25:58.544 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.995830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.995832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 [2024-11-28 01:20:12.995843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.995847] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2054210 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.995855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.995867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.995879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.995896] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.995909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.995918] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2054210 was disconnected and fr[2024-11-28 01:20:12.995921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with eed. reset controller. 00:25:58.544 the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.995936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.995948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.995975] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.995988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.995987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.996000] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.996009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 [2024-11-28 01:20:12.996013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.996026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.996028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.996038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.996044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 [2024-11-28 01:20:12.996051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.996060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.996063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.996074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 [2024-11-28 01:20:12.996076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.996090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with [2024-11-28 01:20:12.996090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:35968 len:12the state(5) to be set 00:25:58.544 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.996104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with [2024-11-28 01:20:12.996106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:58.544 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 [2024-11-28 01:20:12.996118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with [2024-11-28 01:20:12.996122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:36096 len:1the state(5) to be set 00:25:58.544 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.996138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with [2024-11-28 01:20:12.996139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:58.544 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 [2024-11-28 01:20:12.996153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.996157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.996166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.996171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 [2024-11-28 01:20:12.996178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.996187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.996191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.996201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 01:20:12.996203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.996217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.996219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.996229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.996233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 [2024-11-28 01:20:12.996242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.996250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.996254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.996264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 [2024-11-28 01:20:12.996273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e1df0 is same with the state(5) to be set 00:25:58.544 [2024-11-28 01:20:12.996280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.996294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 [2024-11-28 01:20:12.996309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.996337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 [2024-11-28 01:20:12.996353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.996370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 [2024-11-28 01:20:12.996385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.996399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 [2024-11-28 01:20:12.996414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.996426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 [2024-11-28 01:20:12.996441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.996453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 [2024-11-28 01:20:12.996468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.996481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 [2024-11-28 01:20:12.996495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.996508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 [2024-11-28 01:20:12.996523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.996561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 [2024-11-28 01:20:12.996577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.544 [2024-11-28 01:20:12.996592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.544 [2024-11-28 01:20:12.996606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.996619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.996635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.996648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.996663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.996676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.996692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.996704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.996720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.996733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.996752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.996766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.996781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.996795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.996810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.996824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.996855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.996868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.996883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.996896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.996911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.996924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.996938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.996951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.996965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.996978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.996979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.996992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.997008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.997022] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.997035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.997047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.997064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.997077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.997090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.997102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:33024 len:12[2024-11-28 01:20:12.997114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 01:20:12.997128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.997156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.997168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.997180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.997193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.997205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.997218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with [2024-11-28 01:20:12.997231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:34304 len:12the state(5) to be set 00:25:58.545 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.997247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.997260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.997272] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.997284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.997296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.997309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with [2024-11-28 01:20:12.997323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:39680 len:1the state(5) to be set 00:25:58.545 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.997335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.997348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.545 [2024-11-28 01:20:12.997360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.545 [2024-11-28 01:20:12.997366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.545 [2024-11-28 01:20:12.997372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.546 [2024-11-28 01:20:12.997385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.546 [2024-11-28 01:20:12.997397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:40064 len:12[2024-11-28 01:20:12.997410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.546 the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.546 [2024-11-28 01:20:12.997437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.546 [2024-11-28 01:20:12.997452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.546 [2024-11-28 01:20:12.997464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.546 [2024-11-28 01:20:12.997489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.546 [2024-11-28 01:20:12.997501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997537] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with [2024-11-28 01:20:12.997538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40320 len:128the state(5) to be set 00:25:58.546 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.546 [2024-11-28 01:20:12.997553] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.546 [2024-11-28 01:20:12.997566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.546 [2024-11-28 01:20:12.997579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.546 [2024-11-28 01:20:12.997592] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.546 [2024-11-28 01:20:12.997605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.546 [2024-11-28 01:20:12.997617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997630] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with [2024-11-28 01:20:12.997630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34944 len:128the state(5) to be set 00:25:58.546 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.546 [2024-11-28 01:20:12.997647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.546 [2024-11-28 01:20:12.997660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.546 [2024-11-28 01:20:12.997673] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.546 [2024-11-28 01:20:12.997686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.546 [2024-11-28 01:20:12.997699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.546 [2024-11-28 01:20:12.997711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997723] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebafc0 is same [2024-11-28 01:20:12.997724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with with the state(5) to be set 00:25:58.546 the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997810] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1ebafc0 was disconnected and freed. reset controller. 00:25:58.546 [2024-11-28 01:20:12.997836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.997849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e22a0 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.998208] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:58.546 [2024-11-28 01:20:12.998260] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.546 [2024-11-28 01:20:12.998313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.546 [2024-11-28 01:20:12.998336] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.546 [2024-11-28 01:20:12.998350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.546 [2024-11-28 01:20:12.998364] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.546 [2024-11-28 01:20:12.998376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.546 [2024-11-28 01:20:12.998389] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.546 [2024-11-28 01:20:12.998402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.546 [2024-11-28 01:20:12.998415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f28070 is same with the state(5) to be set 00:25:58.546 [2024-11-28 01:20:12.998451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2074c80 (9): Bad file descriptor 00:25:58.546 [2024-11-28 01:20:12.998497] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.546 [2024-11-28 01:20:12.998516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.546 [2024-11-28 01:20:12.998541] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.546 [2024-11-28 01:20:12.998556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.546 [2024-11-28 01:20:12.998570] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.546 [2024-11-28 01:20:12.998588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.546 [2024-11-28 01:20:12.998606] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.546 [2024-11-28 01:20:12.998619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.546 [2024-11-28 01:20:12.998632] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2089700 is same with the state(5) to be set 00:25:58.547 [2024-11-28 01:20:12.998678] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.547 [2024-11-28 01:20:12.998698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:12.998713] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.547 [2024-11-28 01:20:12.998725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:12.998739] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.547 [2024-11-28 01:20:12.998752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:12.998766] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.547 [2024-11-28 01:20:12.998778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:12.998790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f2a650 is same with the state(5) to be set 00:25:58.547 [2024-11-28 01:20:12.998824] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ef5a30 (9): Bad file descriptor 00:25:58.547 [2024-11-28 01:20:12.998877] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.547 [2024-11-28 01:20:12.998898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:12.998913] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.547 [2024-11-28 01:20:12.998926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:12.998939] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.547 [2024-11-28 01:20:12.998951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:12.998965] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.547 [2024-11-28 01:20:12.998978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:12.998990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2084660 is same with the state(5) to be set 00:25:58.547 [2024-11-28 01:20:13.001472] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:58.547 [2024-11-28 01:20:13.001503] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:58.547 [2024-11-28 01:20:13.001569] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:58.547 [2024-11-28 01:20:13.001591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:13.001606] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed36b0 is same with the state(5) to be set 00:25:58.547 [2024-11-28 01:20:13.001625] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ed36b0 (9): Bad file descriptor 00:25:58.547 [2024-11-28 01:20:13.001680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.547 [2024-11-28 01:20:13.001701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:13.001722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.547 [2024-11-28 01:20:13.001737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:13.001753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.547 [2024-11-28 01:20:13.001767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:13.001783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.547 [2024-11-28 01:20:13.001797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:13.001812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.547 [2024-11-28 01:20:13.001825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:13.001845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.547 [2024-11-28 01:20:13.001860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:13.001876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.547 [2024-11-28 01:20:13.001889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:13.001904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.547 [2024-11-28 01:20:13.001916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:13.001931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.547 [2024-11-28 01:20:13.001945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:13.001960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.547 [2024-11-28 01:20:13.001973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:13.001988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.547 [2024-11-28 01:20:13.002001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:13.002016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.547 [2024-11-28 01:20:13.002029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:13.002044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.547 [2024-11-28 01:20:13.002057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:13.002072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.547 [2024-11-28 01:20:13.002085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:13.002100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.547 [2024-11-28 01:20:13.002113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:13.002128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.547 [2024-11-28 01:20:13.002141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:13.002157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.547 [2024-11-28 01:20:13.002170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:13.002185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.547 [2024-11-28 01:20:13.002202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.547 [2024-11-28 01:20:13.002219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.547 [2024-11-28 01:20:13.002232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.002247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.002261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.002276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.002288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.002304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.002317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.002332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.002345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.002360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.002373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.002389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.002402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.018927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.018979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.018998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.548 [2024-11-28 01:20:13.019958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.548 [2024-11-28 01:20:13.019974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.019988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.020004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.020018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.020033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.020047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.020063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.020076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.020092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.020114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.020130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.020144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.020160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2047e10 is same with the state(5) to be set 00:25:58.549 [2024-11-28 01:20:13.021850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.021876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.021904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.021921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.021938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.021951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.021978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.021993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.549 [2024-11-28 01:20:13.022739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.549 [2024-11-28 01:20:13.022760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.022774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.022791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.022805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.022821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.022835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.022851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.022865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.022887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.022900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.022917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.022931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.022947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.022968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.022984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.022998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.550 [2024-11-28 01:20:13.023852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.550 [2024-11-28 01:20:13.023867] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ec1d20 is same with the state(5) to be set 00:25:58.550 [2024-11-28 01:20:13.026074] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:58.550 [2024-11-28 01:20:13.026110] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:58.550 [2024-11-28 01:20:13.026327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.550 [2024-11-28 01:20:13.026450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.550 [2024-11-28 01:20:13.026476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x209a100 with addr=10.0.0.2, port=4420 00:25:58.550 [2024-11-28 01:20:13.026494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x209a100 is same with the state(5) to be set 00:25:58.551 [2024-11-28 01:20:13.026617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.551 [2024-11-28 01:20:13.026727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.551 [2024-11-28 01:20:13.026750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2074c80 with addr=10.0.0.2, port=4420 00:25:58.551 [2024-11-28 01:20:13.026767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2074c80 is same with the state(5) to be set 00:25:58.551 [2024-11-28 01:20:13.026819] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f28070 (9): Bad file descriptor 00:25:58.551 [2024-11-28 01:20:13.026862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2089700 (9): Bad file descriptor 00:25:58.551 [2024-11-28 01:20:13.026898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f2a650 (9): Bad file descriptor 00:25:58.551 [2024-11-28 01:20:13.026940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2084660 (9): Bad file descriptor 00:25:58.551 [2024-11-28 01:20:13.026974] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:58.551 [2024-11-28 01:20:13.026998] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2074c80 (9): Bad file descriptor 00:25:58.551 [2024-11-28 01:20:13.027022] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x209a100 (9): Bad file descriptor 00:25:58.551 [2024-11-28 01:20:13.027954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.551 [2024-11-28 01:20:13.028056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.551 [2024-11-28 01:20:13.028080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ee0d30 with addr=10.0.0.2, port=4420 00:25:58.551 [2024-11-28 01:20:13.028098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ee0d30 is same with the state(5) to be set 00:25:58.551 [2024-11-28 01:20:13.028239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.551 [2024-11-28 01:20:13.028341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.551 [2024-11-28 01:20:13.028366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2098c50 with addr=10.0.0.2, port=4420 00:25:58.551 [2024-11-28 01:20:13.028382] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2098c50 is same with the state(5) to be set 00:25:58.551 [2024-11-28 01:20:13.028401] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:58.551 [2024-11-28 01:20:13.028415] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:58.551 [2024-11-28 01:20:13.028433] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:58.551 [2024-11-28 01:20:13.028782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.028808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.028834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.028850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.028867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.028888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.028905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.028919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.028935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.028950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.028965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.028979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.028995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.029010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.029026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.029039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.029055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.029070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.029087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.029100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.029116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.029130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.029145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.029160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.029176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.029190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.029206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.029220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.029236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.029250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.029270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.029285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.029301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.029315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.029331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.029345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.029361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.029376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.029391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.029406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.029422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.029435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.029450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.029464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.029480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.029494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.551 [2024-11-28 01:20:13.029511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.551 [2024-11-28 01:20:13.029533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.029553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.029567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.029583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.029598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.029614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.029628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.029643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.029662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.029679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.029694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.029710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.029724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.029741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.029754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.029770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.029784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.029799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.029814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.029829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.029843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.029859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.029874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.029891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.029905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.029921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.029935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.029952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.029965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.029982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.029996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.552 [2024-11-28 01:20:13.030694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.552 [2024-11-28 01:20:13.030708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.030723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.030737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.030753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.030766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.030782] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1eb9a70 is same with the state(5) to be set 00:25:58.553 [2024-11-28 01:20:13.032033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.032981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.032996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.033012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.033025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.033041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.033055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.033071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.033085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.033100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.033114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.553 [2024-11-28 01:20:13.033130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.553 [2024-11-28 01:20:13.033144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.033966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.033985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.034008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.034023] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebc5a0 is same with the state(5) to be set 00:25:58.554 [2024-11-28 01:20:13.034096] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1ebc5a0 was disconnected and freed. reset controller. 00:25:58.554 [2024-11-28 01:20:13.034534] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:58.554 [2024-11-28 01:20:13.034562] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:58.554 [2024-11-28 01:20:13.034616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ee0d30 (9): Bad file descriptor 00:25:58.554 [2024-11-28 01:20:13.034643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2098c50 (9): Bad file descriptor 00:25:58.554 [2024-11-28 01:20:13.034660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:58.554 [2024-11-28 01:20:13.034674] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:58.554 [2024-11-28 01:20:13.034690] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:58.554 [2024-11-28 01:20:13.034710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:58.554 [2024-11-28 01:20:13.034724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:58.554 [2024-11-28 01:20:13.034737] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:58.554 [2024-11-28 01:20:13.036000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.036025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.036049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.036065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.036082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.036096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.554 [2024-11-28 01:20:13.036112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.554 [2024-11-28 01:20:13.036126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.036969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.036985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.037007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.037024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.037038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.037055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.037069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.037086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.037100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.037117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.037130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.037146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.037160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.037176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.037190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.037206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.037224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.037240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.037254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.037269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.037283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.037299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.555 [2024-11-28 01:20:13.037314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.555 [2024-11-28 01:20:13.037330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.037343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.037360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.037374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.037393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.037407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.037423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.037437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.037453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.037467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.037483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.037497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.037513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.037533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.037552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.037565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.037581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.037596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.037611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.037626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.037642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.037656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.037671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.037685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.037702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.037716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.037732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.037745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.037761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.037779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.037795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.037809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.037828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.037841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.037858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.037872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.037887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.037901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.037918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.047437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.047510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.047552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.047573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.047588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.047606] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebdb80 is same with the state(5) to be set 00:25:58.556 [2024-11-28 01:20:13.047713] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1ebdb80 was disconnected and freed. reset controller. 00:25:58.556 [2024-11-28 01:20:13.047820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.047851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.047879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.047896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.556 [2024-11-28 01:20:13.047912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.556 [2024-11-28 01:20:13.047926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.047942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.047956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.047986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.048973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.048986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.049003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.049017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.049032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.049046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.049061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.049075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.049091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.557 [2024-11-28 01:20:13.049113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.557 [2024-11-28 01:20:13.049129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.049826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.049841] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebf160 is same with the state(5) to be set 00:25:58.558 [2024-11-28 01:20:13.049911] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1ebf160 was disconnected and freed. reset controller. 00:25:58.558 [2024-11-28 01:20:13.050006] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:58.558 [2024-11-28 01:20:13.050068] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:58.558 [2024-11-28 01:20:13.050098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:58.558 [2024-11-28 01:20:13.050114] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:25:58.558 [2024-11-28 01:20:13.050316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.558 [2024-11-28 01:20:13.050435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.558 [2024-11-28 01:20:13.050460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ef5a30 with addr=10.0.0.2, port=4420 00:25:58.558 [2024-11-28 01:20:13.050477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ef5a30 is same with the state(5) to be set 00:25:58.558 [2024-11-28 01:20:13.050495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:58.558 [2024-11-28 01:20:13.050509] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:58.558 [2024-11-28 01:20:13.050534] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:58.558 [2024-11-28 01:20:13.050558] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:58.558 [2024-11-28 01:20:13.050572] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:58.558 [2024-11-28 01:20:13.050586] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:58.558 [2024-11-28 01:20:13.050613] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:58.558 [2024-11-28 01:20:13.050638] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:58.558 [2024-11-28 01:20:13.050698] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:58.558 [2024-11-28 01:20:13.050720] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:58.558 [2024-11-28 01:20:13.050762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ef5a30 (9): Bad file descriptor 00:25:58.558 [2024-11-28 01:20:13.053360] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:58.558 [2024-11-28 01:20:13.053387] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:58.558 [2024-11-28 01:20:13.053418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:58.558 [2024-11-28 01:20:13.053553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.558 [2024-11-28 01:20:13.053679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.558 [2024-11-28 01:20:13.053705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2084660 with addr=10.0.0.2, port=4420 00:25:58.558 [2024-11-28 01:20:13.053721] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2084660 is same with the state(5) to be set 00:25:58.558 [2024-11-28 01:20:13.054066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.054090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.054114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.054130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.054148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.054164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.054180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.054194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.054224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.558 [2024-11-28 01:20:13.054239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.558 [2024-11-28 01:20:13.054255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.054970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.054984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.055004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.055019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.055035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.055049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.055065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.055079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.055095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.055109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.055125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.055139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.055154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.055168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.055183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.055197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.055213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.055227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.055242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.055255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.055271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.055285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.055301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.055315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.055334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.055348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.055364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.055382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.055398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.055412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.055429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.055442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.559 [2024-11-28 01:20:13.055459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.559 [2024-11-28 01:20:13.055473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.560 [2024-11-28 01:20:13.055498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.560 [2024-11-28 01:20:13.055513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.560 [2024-11-28 01:20:13.055543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.560 [2024-11-28 01:20:13.055561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.560 [2024-11-28 01:20:13.055578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.560 [2024-11-28 01:20:13.055592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.560 [2024-11-28 01:20:13.055608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.560 [2024-11-28 01:20:13.055623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.560 [2024-11-28 01:20:13.055639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.560 [2024-11-28 01:20:13.055653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.560 [2024-11-28 01:20:13.055668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.560 [2024-11-28 01:20:13.055682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.560 [2024-11-28 01:20:13.055699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.560 [2024-11-28 01:20:13.055713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.560 [2024-11-28 01:20:13.055728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.560 [2024-11-28 01:20:13.055743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.560 [2024-11-28 01:20:13.055760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.560 [2024-11-28 01:20:13.055773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.560 [2024-11-28 01:20:13.055794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.560 [2024-11-28 01:20:13.055808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.560 [2024-11-28 01:20:13.055824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.560 [2024-11-28 01:20:13.055838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.560 [2024-11-28 01:20:13.055854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.560 [2024-11-28 01:20:13.055869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.560 [2024-11-28 01:20:13.055884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.560 [2024-11-28 01:20:13.055899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.560 [2024-11-28 01:20:13.055915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.560 [2024-11-28 01:20:13.055929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.560 [2024-11-28 01:20:13.055945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.560 [2024-11-28 01:20:13.055959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.560 [2024-11-28 01:20:13.055975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.560 [2024-11-28 01:20:13.055989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.560 [2024-11-28 01:20:13.056004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.560 [2024-11-28 01:20:13.056019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.560 [2024-11-28 01:20:13.056034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.560 [2024-11-28 01:20:13.056049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.560 [2024-11-28 01:20:13.056065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:58.560 [2024-11-28 01:20:13.056078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.560 [2024-11-28 01:20:13.056102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ec0740 is same with the state(5) to be set 00:25:58.560 [2024-11-28 01:20:13.057729] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:58.560 [2024-11-28 01:20:13.057761] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:58.560 [2024-11-28 01:20:13.057781] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:58.560 [2024-11-28 01:20:13.057800] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:58.560 task offset: 34816 on job bdev=Nvme1n1 fails 00:25:58.560 00:25:58.560 Latency(us) 00:25:58.560 [2024-11-28T00:20:13.163Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:58.560 [2024-11-28T00:20:13.163Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:58.560 [2024-11-28T00:20:13.163Z] Job: Nvme1n1 ended in about 0.82 seconds with error 00:25:58.560 Verification LBA range: start 0x0 length 0x400 00:25:58.560 Nvme1n1 : 0.82 306.59 19.16 78.17 0.00 165331.03 100197.26 145247.19 00:25:58.560 [2024-11-28T00:20:13.163Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:58.560 [2024-11-28T00:20:13.163Z] Job: Nvme2n1 ended in about 0.85 seconds with error 00:25:58.560 Verification LBA range: start 0x0 length 0x400 00:25:58.560 Nvme2n1 : 0.85 342.34 21.40 75.29 0.00 150982.36 81944.27 125052.40 00:25:58.560 [2024-11-28T00:20:13.163Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:58.560 [2024-11-28T00:20:13.163Z] Job: Nvme3n1 ended in about 0.83 seconds with error 00:25:58.560 Verification LBA range: start 0x0 length 0x400 00:25:58.560 Nvme3n1 : 0.83 351.08 21.94 77.21 0.00 145834.66 52428.80 118838.61 00:25:58.560 [2024-11-28T00:20:13.163Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:58.560 [2024-11-28T00:20:13.163Z] Job: Nvme4n1 ended in about 0.86 seconds with error 00:25:58.560 Verification LBA range: start 0x0 length 0x400 00:25:58.560 Nvme4n1 : 0.86 338.14 21.13 74.37 0.00 150229.16 74177.04 118061.89 00:25:58.560 [2024-11-28T00:20:13.163Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:58.560 [2024-11-28T00:20:13.163Z] Job: Nvme5n1 ended in about 0.83 seconds with error 00:25:58.560 Verification LBA range: start 0x0 length 0x400 00:25:58.560 Nvme5n1 : 0.83 315.67 19.73 66.27 0.00 160365.19 8689.59 130489.46 00:25:58.560 [2024-11-28T00:20:13.163Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:58.560 [2024-11-28T00:20:13.163Z] Job: Nvme6n1 ended in about 0.86 seconds with error 00:25:58.560 Verification LBA range: start 0x0 length 0x400 00:25:58.560 Nvme6n1 : 0.86 336.56 21.03 74.02 0.00 148347.52 67574.90 118838.61 00:25:58.560 [2024-11-28T00:20:13.163Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:58.560 [2024-11-28T00:20:13.163Z] Job: Nvme7n1 ended in about 0.88 seconds with error 00:25:58.560 Verification LBA range: start 0x0 length 0x400 00:25:58.560 Nvme7n1 : 0.88 330.36 20.65 72.66 0.00 149925.04 76118.85 118061.89 00:25:58.560 [2024-11-28T00:20:13.163Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:58.560 [2024-11-28T00:20:13.163Z] Job: Nvme8n1 ended in about 0.88 seconds with error 00:25:58.560 Verification LBA range: start 0x0 length 0x400 00:25:58.560 Nvme8n1 : 0.88 329.95 20.62 72.57 0.00 148744.09 67186.54 119615.34 00:25:58.560 [2024-11-28T00:20:13.163Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:58.560 [2024-11-28T00:20:13.163Z] Job: Nvme9n1 ended in about 0.89 seconds with error 00:25:58.560 Verification LBA range: start 0x0 length 0x400 00:25:58.560 Nvme9n1 : 0.89 283.35 17.71 72.25 0.00 167027.49 100197.26 137479.96 00:25:58.560 [2024-11-28T00:20:13.163Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:58.560 [2024-11-28T00:20:13.163Z] Job: Nvme10n1 ended in about 0.85 seconds with error 00:25:58.560 Verification LBA range: start 0x0 length 0x400 00:25:58.560 Nvme10n1 : 0.85 294.02 18.38 74.97 0.00 159102.45 100197.26 125052.40 00:25:58.560 [2024-11-28T00:20:13.163Z] =================================================================================================================== 00:25:58.560 [2024-11-28T00:20:13.163Z] Total : 3228.06 201.75 737.77 0.00 154197.61 8689.59 145247.19 00:25:58.560 [2024-11-28 01:20:13.083003] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:25:58.560 [2024-11-28 01:20:13.083082] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:25:58.560 [2024-11-28 01:20:13.083357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.560 [2024-11-28 01:20:13.083473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.560 [2024-11-28 01:20:13.083501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2089700 with addr=10.0.0.2, port=4420 00:25:58.560 [2024-11-28 01:20:13.083521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2089700 is same with the state(5) to be set 00:25:58.560 [2024-11-28 01:20:13.083561] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2084660 (9): Bad file descriptor 00:25:58.561 [2024-11-28 01:20:13.083596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:58.561 [2024-11-28 01:20:13.083612] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:58.561 [2024-11-28 01:20:13.083629] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:58.561 [2024-11-28 01:20:13.084299] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:58.561 [2024-11-28 01:20:13.084442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.561 [2024-11-28 01:20:13.084548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.561 [2024-11-28 01:20:13.084575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f28070 with addr=10.0.0.2, port=4420 00:25:58.561 [2024-11-28 01:20:13.084592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f28070 is same with the state(5) to be set 00:25:58.561 [2024-11-28 01:20:13.084688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.561 [2024-11-28 01:20:13.084781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.561 [2024-11-28 01:20:13.084807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ed36b0 with addr=10.0.0.2, port=4420 00:25:58.561 [2024-11-28 01:20:13.084823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed36b0 is same with the state(5) to be set 00:25:58.561 [2024-11-28 01:20:13.084933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.561 [2024-11-28 01:20:13.085039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.561 [2024-11-28 01:20:13.085064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2074c80 with addr=10.0.0.2, port=4420 00:25:58.561 [2024-11-28 01:20:13.085080] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2074c80 is same with the state(5) to be set 00:25:58.561 [2024-11-28 01:20:13.085181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.561 [2024-11-28 01:20:13.085326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.561 [2024-11-28 01:20:13.085351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x209a100 with addr=10.0.0.2, port=4420 00:25:58.561 [2024-11-28 01:20:13.085367] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x209a100 is same with the state(5) to be set 00:25:58.561 [2024-11-28 01:20:13.085495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.561 [2024-11-28 01:20:13.085600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.561 [2024-11-28 01:20:13.085626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f2a650 with addr=10.0.0.2, port=4420 00:25:58.561 [2024-11-28 01:20:13.085642] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f2a650 is same with the state(5) to be set 00:25:58.561 [2024-11-28 01:20:13.085661] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2089700 (9): Bad file descriptor 00:25:58.561 [2024-11-28 01:20:13.085678] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:25:58.561 [2024-11-28 01:20:13.085692] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:25:58.561 [2024-11-28 01:20:13.085705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:25:58.561 [2024-11-28 01:20:13.085754] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:58.561 [2024-11-28 01:20:13.085793] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:58.561 [2024-11-28 01:20:13.086121] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:58.561 [2024-11-28 01:20:13.086166] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f28070 (9): Bad file descriptor 00:25:58.561 [2024-11-28 01:20:13.086190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ed36b0 (9): Bad file descriptor 00:25:58.561 [2024-11-28 01:20:13.086208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2074c80 (9): Bad file descriptor 00:25:58.561 [2024-11-28 01:20:13.086227] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x209a100 (9): Bad file descriptor 00:25:58.561 [2024-11-28 01:20:13.086244] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f2a650 (9): Bad file descriptor 00:25:58.561 [2024-11-28 01:20:13.086260] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:58.561 [2024-11-28 01:20:13.086273] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:58.561 [2024-11-28 01:20:13.086286] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:58.561 [2024-11-28 01:20:13.086353] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:58.561 [2024-11-28 01:20:13.086378] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:58.561 [2024-11-28 01:20:13.086394] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:58.561 [2024-11-28 01:20:13.086409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:58.561 [2024-11-28 01:20:13.086443] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:58.561 [2024-11-28 01:20:13.086458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:58.561 [2024-11-28 01:20:13.086472] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:58.561 [2024-11-28 01:20:13.086489] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:58.561 [2024-11-28 01:20:13.086503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:58.561 [2024-11-28 01:20:13.086516] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:58.561 [2024-11-28 01:20:13.086540] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:58.561 [2024-11-28 01:20:13.086556] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:58.561 [2024-11-28 01:20:13.086569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:58.561 [2024-11-28 01:20:13.086584] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:58.561 [2024-11-28 01:20:13.086598] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:58.561 [2024-11-28 01:20:13.086611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:58.561 [2024-11-28 01:20:13.086626] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:25:58.561 [2024-11-28 01:20:13.086639] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:25:58.561 [2024-11-28 01:20:13.086652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:25:58.561 [2024-11-28 01:20:13.086698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:58.561 [2024-11-28 01:20:13.086717] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:58.561 [2024-11-28 01:20:13.086729] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:58.561 [2024-11-28 01:20:13.086745] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:58.561 [2024-11-28 01:20:13.086758] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:58.561 [2024-11-28 01:20:13.086864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.561 [2024-11-28 01:20:13.086959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.561 [2024-11-28 01:20:13.086983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2098c50 with addr=10.0.0.2, port=4420 00:25:58.561 [2024-11-28 01:20:13.087000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2098c50 is same with the state(5) to be set 00:25:58.561 [2024-11-28 01:20:13.087085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.561 [2024-11-28 01:20:13.087183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.561 [2024-11-28 01:20:13.087207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ee0d30 with addr=10.0.0.2, port=4420 00:25:58.561 [2024-11-28 01:20:13.087222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ee0d30 is same with the state(5) to be set 00:25:58.561 [2024-11-28 01:20:13.087309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.561 [2024-11-28 01:20:13.087399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:58.561 [2024-11-28 01:20:13.087422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ef5a30 with addr=10.0.0.2, port=4420 00:25:58.561 [2024-11-28 01:20:13.087437] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ef5a30 is same with the state(5) to be set 00:25:58.561 [2024-11-28 01:20:13.087480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2098c50 (9): Bad file descriptor 00:25:58.561 [2024-11-28 01:20:13.087505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ee0d30 (9): Bad file descriptor 00:25:58.561 [2024-11-28 01:20:13.087523] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ef5a30 (9): Bad file descriptor 00:25:58.561 [2024-11-28 01:20:13.087572] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:58.561 [2024-11-28 01:20:13.087591] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:58.561 [2024-11-28 01:20:13.087604] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:58.562 [2024-11-28 01:20:13.087621] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:58.562 [2024-11-28 01:20:13.087634] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:58.562 [2024-11-28 01:20:13.087648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:58.562 [2024-11-28 01:20:13.087664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:58.562 [2024-11-28 01:20:13.087677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:58.562 [2024-11-28 01:20:13.087689] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:58.562 [2024-11-28 01:20:13.087724] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:58.562 [2024-11-28 01:20:13.087741] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:58.562 [2024-11-28 01:20:13.087754] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:59.129 01:20:13 -- target/shutdown.sh@135 -- # nvmfpid= 00:25:59.129 01:20:13 -- target/shutdown.sh@138 -- # sleep 1 00:26:00.065 01:20:14 -- target/shutdown.sh@141 -- # kill -9 2112746 00:26:00.065 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (2112746) - No such process 00:26:00.065 01:20:14 -- target/shutdown.sh@141 -- # true 00:26:00.065 01:20:14 -- target/shutdown.sh@143 -- # stoptarget 00:26:00.065 01:20:14 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:26:00.065 01:20:14 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:26:00.065 01:20:14 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:00.065 01:20:14 -- target/shutdown.sh@45 -- # nvmftestfini 00:26:00.065 01:20:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:00.065 01:20:14 -- nvmf/common.sh@116 -- # sync 00:26:00.065 01:20:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:00.065 01:20:14 -- nvmf/common.sh@119 -- # set +e 00:26:00.065 01:20:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:00.065 01:20:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:00.065 rmmod nvme_tcp 00:26:00.065 rmmod nvme_fabrics 00:26:00.065 rmmod nvme_keyring 00:26:00.065 01:20:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:00.065 01:20:14 -- nvmf/common.sh@123 -- # set -e 00:26:00.065 01:20:14 -- nvmf/common.sh@124 -- # return 0 00:26:00.065 01:20:14 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:26:00.065 01:20:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:00.065 01:20:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:00.065 01:20:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:00.065 01:20:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:00.065 01:20:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:00.065 01:20:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:00.065 01:20:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:00.065 01:20:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:02.593 01:20:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:02.593 00:26:02.593 real 0m8.170s 00:26:02.593 user 0m21.125s 00:26:02.593 sys 0m1.554s 00:26:02.593 01:20:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:02.593 01:20:16 -- common/autotest_common.sh@10 -- # set +x 00:26:02.593 ************************************ 00:26:02.593 END TEST nvmf_shutdown_tc3 00:26:02.593 ************************************ 00:26:02.593 01:20:16 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:26:02.593 00:26:02.593 real 0m28.325s 00:26:02.593 user 1m19.955s 00:26:02.593 sys 0m6.410s 00:26:02.593 01:20:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:02.593 01:20:16 -- common/autotest_common.sh@10 -- # set +x 00:26:02.593 ************************************ 00:26:02.593 END TEST nvmf_shutdown 00:26:02.593 ************************************ 00:26:02.593 01:20:16 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:26:02.593 01:20:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:02.593 01:20:16 -- common/autotest_common.sh@10 -- # set +x 00:26:02.593 01:20:16 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:26:02.593 01:20:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:02.593 01:20:16 -- common/autotest_common.sh@10 -- # set +x 00:26:02.593 01:20:16 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:26:02.593 01:20:16 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:26:02.593 01:20:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:02.593 01:20:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:02.593 01:20:16 -- common/autotest_common.sh@10 -- # set +x 00:26:02.593 ************************************ 00:26:02.593 START TEST nvmf_multicontroller 00:26:02.593 ************************************ 00:26:02.593 01:20:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:26:02.593 * Looking for test storage... 00:26:02.593 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:02.593 01:20:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:02.593 01:20:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:02.593 01:20:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:02.593 01:20:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:02.593 01:20:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:02.593 01:20:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:02.593 01:20:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:02.593 01:20:16 -- scripts/common.sh@335 -- # IFS=.-: 00:26:02.593 01:20:16 -- scripts/common.sh@335 -- # read -ra ver1 00:26:02.593 01:20:16 -- scripts/common.sh@336 -- # IFS=.-: 00:26:02.593 01:20:16 -- scripts/common.sh@336 -- # read -ra ver2 00:26:02.593 01:20:16 -- scripts/common.sh@337 -- # local 'op=<' 00:26:02.593 01:20:16 -- scripts/common.sh@339 -- # ver1_l=2 00:26:02.593 01:20:16 -- scripts/common.sh@340 -- # ver2_l=1 00:26:02.593 01:20:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:02.593 01:20:16 -- scripts/common.sh@343 -- # case "$op" in 00:26:02.593 01:20:16 -- scripts/common.sh@344 -- # : 1 00:26:02.593 01:20:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:02.593 01:20:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:02.593 01:20:16 -- scripts/common.sh@364 -- # decimal 1 00:26:02.593 01:20:16 -- scripts/common.sh@352 -- # local d=1 00:26:02.593 01:20:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:02.593 01:20:16 -- scripts/common.sh@354 -- # echo 1 00:26:02.593 01:20:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:02.593 01:20:16 -- scripts/common.sh@365 -- # decimal 2 00:26:02.593 01:20:16 -- scripts/common.sh@352 -- # local d=2 00:26:02.593 01:20:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:02.593 01:20:16 -- scripts/common.sh@354 -- # echo 2 00:26:02.594 01:20:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:02.594 01:20:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:02.594 01:20:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:02.594 01:20:16 -- scripts/common.sh@367 -- # return 0 00:26:02.594 01:20:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:02.594 01:20:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:02.594 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:02.594 --rc genhtml_branch_coverage=1 00:26:02.594 --rc genhtml_function_coverage=1 00:26:02.594 --rc genhtml_legend=1 00:26:02.594 --rc geninfo_all_blocks=1 00:26:02.594 --rc geninfo_unexecuted_blocks=1 00:26:02.594 00:26:02.594 ' 00:26:02.594 01:20:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:02.594 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:02.594 --rc genhtml_branch_coverage=1 00:26:02.594 --rc genhtml_function_coverage=1 00:26:02.594 --rc genhtml_legend=1 00:26:02.594 --rc geninfo_all_blocks=1 00:26:02.594 --rc geninfo_unexecuted_blocks=1 00:26:02.594 00:26:02.594 ' 00:26:02.594 01:20:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:02.594 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:02.594 --rc genhtml_branch_coverage=1 00:26:02.594 --rc genhtml_function_coverage=1 00:26:02.594 --rc genhtml_legend=1 00:26:02.594 --rc geninfo_all_blocks=1 00:26:02.594 --rc geninfo_unexecuted_blocks=1 00:26:02.594 00:26:02.594 ' 00:26:02.594 01:20:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:02.594 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:02.594 --rc genhtml_branch_coverage=1 00:26:02.594 --rc genhtml_function_coverage=1 00:26:02.594 --rc genhtml_legend=1 00:26:02.594 --rc geninfo_all_blocks=1 00:26:02.594 --rc geninfo_unexecuted_blocks=1 00:26:02.594 00:26:02.594 ' 00:26:02.594 01:20:16 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:02.594 01:20:16 -- nvmf/common.sh@7 -- # uname -s 00:26:02.594 01:20:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:02.594 01:20:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:02.594 01:20:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:02.594 01:20:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:02.594 01:20:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:02.594 01:20:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:02.594 01:20:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:02.594 01:20:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:02.594 01:20:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:02.594 01:20:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:02.594 01:20:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:02.594 01:20:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:02.594 01:20:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:02.594 01:20:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:02.594 01:20:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:02.594 01:20:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:02.594 01:20:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:02.594 01:20:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:02.594 01:20:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:02.594 01:20:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:02.594 01:20:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:02.594 01:20:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:02.594 01:20:16 -- paths/export.sh@5 -- # export PATH 00:26:02.594 01:20:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:02.594 01:20:16 -- nvmf/common.sh@46 -- # : 0 00:26:02.594 01:20:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:02.594 01:20:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:02.594 01:20:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:02.594 01:20:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:02.594 01:20:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:02.594 01:20:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:02.594 01:20:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:02.594 01:20:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:02.594 01:20:16 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:02.594 01:20:16 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:02.594 01:20:16 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:26:02.594 01:20:16 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:26:02.594 01:20:16 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:26:02.594 01:20:16 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:26:02.594 01:20:16 -- host/multicontroller.sh@23 -- # nvmftestinit 00:26:02.594 01:20:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:02.594 01:20:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:02.594 01:20:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:02.594 01:20:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:02.594 01:20:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:02.594 01:20:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:02.594 01:20:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:02.594 01:20:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:02.594 01:20:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:02.594 01:20:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:02.594 01:20:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:02.594 01:20:16 -- common/autotest_common.sh@10 -- # set +x 00:26:04.496 01:20:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:04.496 01:20:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:04.496 01:20:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:04.496 01:20:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:04.496 01:20:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:04.496 01:20:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:04.496 01:20:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:04.496 01:20:18 -- nvmf/common.sh@294 -- # net_devs=() 00:26:04.496 01:20:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:04.496 01:20:18 -- nvmf/common.sh@295 -- # e810=() 00:26:04.496 01:20:18 -- nvmf/common.sh@295 -- # local -ga e810 00:26:04.496 01:20:18 -- nvmf/common.sh@296 -- # x722=() 00:26:04.496 01:20:18 -- nvmf/common.sh@296 -- # local -ga x722 00:26:04.496 01:20:18 -- nvmf/common.sh@297 -- # mlx=() 00:26:04.496 01:20:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:04.496 01:20:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:04.496 01:20:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:04.496 01:20:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:04.496 01:20:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:04.496 01:20:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:04.496 01:20:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:04.496 01:20:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:04.496 01:20:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:04.496 01:20:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:04.496 01:20:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:04.496 01:20:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:04.496 01:20:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:04.496 01:20:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:04.496 01:20:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:04.496 01:20:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:04.496 01:20:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:04.496 01:20:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:04.496 01:20:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:04.496 01:20:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:04.496 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:04.496 01:20:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:04.496 01:20:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:04.496 01:20:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:04.496 01:20:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:04.496 01:20:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:04.496 01:20:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:04.496 01:20:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:04.496 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:04.496 01:20:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:04.496 01:20:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:04.496 01:20:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:04.496 01:20:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:04.496 01:20:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:04.496 01:20:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:04.496 01:20:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:04.496 01:20:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:04.496 01:20:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:04.496 01:20:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:04.496 01:20:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:04.496 01:20:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:04.497 01:20:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:04.497 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:04.497 01:20:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:04.497 01:20:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:04.497 01:20:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:04.497 01:20:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:04.497 01:20:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:04.497 01:20:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:04.497 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:04.497 01:20:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:04.497 01:20:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:04.497 01:20:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:04.497 01:20:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:04.497 01:20:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:04.497 01:20:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:04.497 01:20:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:04.497 01:20:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:04.497 01:20:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:04.497 01:20:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:04.497 01:20:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:04.497 01:20:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:04.497 01:20:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:04.497 01:20:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:04.497 01:20:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:04.497 01:20:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:04.497 01:20:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:04.497 01:20:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:04.497 01:20:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:04.497 01:20:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:04.497 01:20:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:04.497 01:20:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:04.497 01:20:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:04.497 01:20:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:04.497 01:20:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:04.497 01:20:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:04.497 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:04.497 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.352 ms 00:26:04.497 00:26:04.497 --- 10.0.0.2 ping statistics --- 00:26:04.497 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:04.497 rtt min/avg/max/mdev = 0.352/0.352/0.352/0.000 ms 00:26:04.497 01:20:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:04.497 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:04.497 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.132 ms 00:26:04.497 00:26:04.497 --- 10.0.0.1 ping statistics --- 00:26:04.497 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:04.497 rtt min/avg/max/mdev = 0.132/0.132/0.132/0.000 ms 00:26:04.497 01:20:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:04.497 01:20:18 -- nvmf/common.sh@410 -- # return 0 00:26:04.497 01:20:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:04.497 01:20:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:04.497 01:20:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:04.497 01:20:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:04.497 01:20:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:04.497 01:20:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:04.497 01:20:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:04.497 01:20:18 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:26:04.497 01:20:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:04.497 01:20:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:04.497 01:20:18 -- common/autotest_common.sh@10 -- # set +x 00:26:04.497 01:20:18 -- nvmf/common.sh@469 -- # nvmfpid=2115302 00:26:04.497 01:20:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:26:04.497 01:20:18 -- nvmf/common.sh@470 -- # waitforlisten 2115302 00:26:04.497 01:20:18 -- common/autotest_common.sh@829 -- # '[' -z 2115302 ']' 00:26:04.497 01:20:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:04.497 01:20:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:04.497 01:20:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:04.497 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:04.497 01:20:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:04.497 01:20:18 -- common/autotest_common.sh@10 -- # set +x 00:26:04.497 [2024-11-28 01:20:19.036727] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:04.497 [2024-11-28 01:20:19.036803] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:04.497 EAL: No free 2048 kB hugepages reported on node 1 00:26:04.755 [2024-11-28 01:20:19.111175] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:26:04.756 [2024-11-28 01:20:19.199404] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:04.756 [2024-11-28 01:20:19.199578] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:04.756 [2024-11-28 01:20:19.199599] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:04.756 [2024-11-28 01:20:19.199613] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:04.756 [2024-11-28 01:20:19.199684] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:04.756 [2024-11-28 01:20:19.199731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:04.756 [2024-11-28 01:20:19.199734] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:05.690 01:20:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:05.690 01:20:20 -- common/autotest_common.sh@862 -- # return 0 00:26:05.690 01:20:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:05.690 01:20:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:05.690 01:20:20 -- common/autotest_common.sh@10 -- # set +x 00:26:05.690 01:20:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:05.690 01:20:20 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:05.690 01:20:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.690 01:20:20 -- common/autotest_common.sh@10 -- # set +x 00:26:05.690 [2024-11-28 01:20:20.044055] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:05.690 01:20:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.690 01:20:20 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:05.690 01:20:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.690 01:20:20 -- common/autotest_common.sh@10 -- # set +x 00:26:05.690 Malloc0 00:26:05.690 01:20:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.690 01:20:20 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:05.690 01:20:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.690 01:20:20 -- common/autotest_common.sh@10 -- # set +x 00:26:05.690 01:20:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.690 01:20:20 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:05.690 01:20:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.690 01:20:20 -- common/autotest_common.sh@10 -- # set +x 00:26:05.690 01:20:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.690 01:20:20 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:05.690 01:20:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.690 01:20:20 -- common/autotest_common.sh@10 -- # set +x 00:26:05.690 [2024-11-28 01:20:20.111896] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:05.690 01:20:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.690 01:20:20 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:26:05.690 01:20:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.690 01:20:20 -- common/autotest_common.sh@10 -- # set +x 00:26:05.690 [2024-11-28 01:20:20.119755] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:05.690 01:20:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.690 01:20:20 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:26:05.690 01:20:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.690 01:20:20 -- common/autotest_common.sh@10 -- # set +x 00:26:05.690 Malloc1 00:26:05.690 01:20:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.690 01:20:20 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:26:05.690 01:20:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.690 01:20:20 -- common/autotest_common.sh@10 -- # set +x 00:26:05.690 01:20:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.690 01:20:20 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:26:05.690 01:20:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.690 01:20:20 -- common/autotest_common.sh@10 -- # set +x 00:26:05.690 01:20:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.690 01:20:20 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:26:05.690 01:20:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.690 01:20:20 -- common/autotest_common.sh@10 -- # set +x 00:26:05.690 01:20:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.691 01:20:20 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:26:05.691 01:20:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.691 01:20:20 -- common/autotest_common.sh@10 -- # set +x 00:26:05.691 01:20:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.691 01:20:20 -- host/multicontroller.sh@44 -- # bdevperf_pid=2115461 00:26:05.691 01:20:20 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:26:05.691 01:20:20 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:05.691 01:20:20 -- host/multicontroller.sh@47 -- # waitforlisten 2115461 /var/tmp/bdevperf.sock 00:26:05.691 01:20:20 -- common/autotest_common.sh@829 -- # '[' -z 2115461 ']' 00:26:05.691 01:20:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:05.691 01:20:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:05.691 01:20:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:05.691 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:05.691 01:20:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:05.691 01:20:20 -- common/autotest_common.sh@10 -- # set +x 00:26:06.625 01:20:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:06.625 01:20:21 -- common/autotest_common.sh@862 -- # return 0 00:26:06.625 01:20:21 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:26:06.625 01:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.625 01:20:21 -- common/autotest_common.sh@10 -- # set +x 00:26:06.884 NVMe0n1 00:26:06.884 01:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.884 01:20:21 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:06.884 01:20:21 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:26:06.884 01:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.884 01:20:21 -- common/autotest_common.sh@10 -- # set +x 00:26:06.884 01:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.884 1 00:26:06.884 01:20:21 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:26:06.884 01:20:21 -- common/autotest_common.sh@650 -- # local es=0 00:26:06.884 01:20:21 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:26:06.884 01:20:21 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:06.884 01:20:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:06.884 01:20:21 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:06.884 01:20:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:06.884 01:20:21 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:26:06.884 01:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.884 01:20:21 -- common/autotest_common.sh@10 -- # set +x 00:26:06.884 request: 00:26:06.884 { 00:26:06.884 "name": "NVMe0", 00:26:06.884 "trtype": "tcp", 00:26:06.884 "traddr": "10.0.0.2", 00:26:06.884 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:26:06.884 "hostaddr": "10.0.0.2", 00:26:06.884 "hostsvcid": "60000", 00:26:06.884 "adrfam": "ipv4", 00:26:06.884 "trsvcid": "4420", 00:26:06.884 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:06.884 "method": "bdev_nvme_attach_controller", 00:26:06.884 "req_id": 1 00:26:06.884 } 00:26:06.884 Got JSON-RPC error response 00:26:06.884 response: 00:26:06.884 { 00:26:06.884 "code": -114, 00:26:06.884 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:26:06.884 } 00:26:06.884 01:20:21 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:06.884 01:20:21 -- common/autotest_common.sh@653 -- # es=1 00:26:06.884 01:20:21 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:06.884 01:20:21 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:06.884 01:20:21 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:06.884 01:20:21 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:26:06.884 01:20:21 -- common/autotest_common.sh@650 -- # local es=0 00:26:06.884 01:20:21 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:26:06.885 01:20:21 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:06.885 01:20:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:06.885 01:20:21 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:06.885 01:20:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:06.885 01:20:21 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:26:06.885 01:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.885 01:20:21 -- common/autotest_common.sh@10 -- # set +x 00:26:06.885 request: 00:26:06.885 { 00:26:06.885 "name": "NVMe0", 00:26:06.885 "trtype": "tcp", 00:26:06.885 "traddr": "10.0.0.2", 00:26:06.885 "hostaddr": "10.0.0.2", 00:26:06.885 "hostsvcid": "60000", 00:26:06.885 "adrfam": "ipv4", 00:26:06.885 "trsvcid": "4420", 00:26:06.885 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:06.885 "method": "bdev_nvme_attach_controller", 00:26:06.885 "req_id": 1 00:26:06.885 } 00:26:06.885 Got JSON-RPC error response 00:26:06.885 response: 00:26:06.885 { 00:26:06.885 "code": -114, 00:26:06.885 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:26:06.885 } 00:26:06.885 01:20:21 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:06.885 01:20:21 -- common/autotest_common.sh@653 -- # es=1 00:26:06.885 01:20:21 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:06.885 01:20:21 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:06.885 01:20:21 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:06.885 01:20:21 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:26:06.885 01:20:21 -- common/autotest_common.sh@650 -- # local es=0 00:26:06.885 01:20:21 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:26:06.885 01:20:21 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:06.885 01:20:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:06.885 01:20:21 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:06.885 01:20:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:06.885 01:20:21 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:26:06.885 01:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.885 01:20:21 -- common/autotest_common.sh@10 -- # set +x 00:26:06.885 request: 00:26:06.885 { 00:26:06.885 "name": "NVMe0", 00:26:06.885 "trtype": "tcp", 00:26:06.885 "traddr": "10.0.0.2", 00:26:06.885 "hostaddr": "10.0.0.2", 00:26:06.885 "hostsvcid": "60000", 00:26:06.885 "adrfam": "ipv4", 00:26:06.885 "trsvcid": "4420", 00:26:06.885 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:06.885 "multipath": "disable", 00:26:06.885 "method": "bdev_nvme_attach_controller", 00:26:06.885 "req_id": 1 00:26:06.885 } 00:26:06.885 Got JSON-RPC error response 00:26:06.885 response: 00:26:06.885 { 00:26:06.885 "code": -114, 00:26:06.885 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:26:06.885 } 00:26:06.885 01:20:21 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:06.885 01:20:21 -- common/autotest_common.sh@653 -- # es=1 00:26:06.885 01:20:21 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:06.885 01:20:21 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:06.885 01:20:21 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:06.885 01:20:21 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:26:06.885 01:20:21 -- common/autotest_common.sh@650 -- # local es=0 00:26:06.885 01:20:21 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:26:06.885 01:20:21 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:06.885 01:20:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:06.885 01:20:21 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:06.885 01:20:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:06.885 01:20:21 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:26:06.885 01:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.885 01:20:21 -- common/autotest_common.sh@10 -- # set +x 00:26:06.885 request: 00:26:06.885 { 00:26:06.885 "name": "NVMe0", 00:26:06.885 "trtype": "tcp", 00:26:06.885 "traddr": "10.0.0.2", 00:26:06.885 "hostaddr": "10.0.0.2", 00:26:06.885 "hostsvcid": "60000", 00:26:06.885 "adrfam": "ipv4", 00:26:06.885 "trsvcid": "4420", 00:26:06.885 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:06.885 "multipath": "failover", 00:26:06.885 "method": "bdev_nvme_attach_controller", 00:26:06.885 "req_id": 1 00:26:06.885 } 00:26:06.885 Got JSON-RPC error response 00:26:06.885 response: 00:26:06.885 { 00:26:06.885 "code": -114, 00:26:06.885 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:26:06.885 } 00:26:06.885 01:20:21 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:06.885 01:20:21 -- common/autotest_common.sh@653 -- # es=1 00:26:06.885 01:20:21 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:06.885 01:20:21 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:06.885 01:20:21 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:06.885 01:20:21 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:06.885 01:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.885 01:20:21 -- common/autotest_common.sh@10 -- # set +x 00:26:06.885 00:26:06.885 01:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.885 01:20:21 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:06.885 01:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.885 01:20:21 -- common/autotest_common.sh@10 -- # set +x 00:26:06.885 01:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.885 01:20:21 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:26:06.885 01:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.885 01:20:21 -- common/autotest_common.sh@10 -- # set +x 00:26:07.143 00:26:07.143 01:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.143 01:20:21 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:07.143 01:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.144 01:20:21 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:26:07.144 01:20:21 -- common/autotest_common.sh@10 -- # set +x 00:26:07.144 01:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.144 01:20:21 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:26:07.144 01:20:21 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:26:08.518 0 00:26:08.518 01:20:22 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:26:08.519 01:20:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.519 01:20:22 -- common/autotest_common.sh@10 -- # set +x 00:26:08.519 01:20:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.519 01:20:22 -- host/multicontroller.sh@100 -- # killprocess 2115461 00:26:08.519 01:20:22 -- common/autotest_common.sh@936 -- # '[' -z 2115461 ']' 00:26:08.519 01:20:22 -- common/autotest_common.sh@940 -- # kill -0 2115461 00:26:08.519 01:20:22 -- common/autotest_common.sh@941 -- # uname 00:26:08.519 01:20:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:08.519 01:20:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2115461 00:26:08.519 01:20:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:08.519 01:20:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:08.519 01:20:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2115461' 00:26:08.519 killing process with pid 2115461 00:26:08.519 01:20:22 -- common/autotest_common.sh@955 -- # kill 2115461 00:26:08.519 01:20:22 -- common/autotest_common.sh@960 -- # wait 2115461 00:26:08.519 01:20:23 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:08.519 01:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.519 01:20:23 -- common/autotest_common.sh@10 -- # set +x 00:26:08.519 01:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.519 01:20:23 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:26:08.519 01:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.519 01:20:23 -- common/autotest_common.sh@10 -- # set +x 00:26:08.519 01:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.519 01:20:23 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:26:08.519 01:20:23 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:08.519 01:20:23 -- common/autotest_common.sh@1607 -- # read -r file 00:26:08.519 01:20:23 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:26:08.519 01:20:23 -- common/autotest_common.sh@1606 -- # sort -u 00:26:08.519 01:20:23 -- common/autotest_common.sh@1608 -- # cat 00:26:08.519 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:26:08.519 [2024-11-28 01:20:20.215659] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:08.519 [2024-11-28 01:20:20.215746] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2115461 ] 00:26:08.519 EAL: No free 2048 kB hugepages reported on node 1 00:26:08.519 [2024-11-28 01:20:20.277835] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:08.519 [2024-11-28 01:20:20.363751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:08.519 [2024-11-28 01:20:21.640407] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 73d800c4-5415-4ce8-b59e-47ed58da9067 already exists 00:26:08.519 [2024-11-28 01:20:21.640447] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:73d800c4-5415-4ce8-b59e-47ed58da9067 alias for bdev NVMe1n1 00:26:08.519 [2024-11-28 01:20:21.640464] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:26:08.519 Running I/O for 1 seconds... 00:26:08.519 00:26:08.519 Latency(us) 00:26:08.519 [2024-11-28T00:20:23.122Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:08.519 [2024-11-28T00:20:23.122Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:26:08.519 NVMe0n1 : 1.01 18841.28 73.60 0.00 0.00 6784.28 2997.67 12087.75 00:26:08.519 [2024-11-28T00:20:23.122Z] =================================================================================================================== 00:26:08.519 [2024-11-28T00:20:23.122Z] Total : 18841.28 73.60 0.00 0.00 6784.28 2997.67 12087.75 00:26:08.519 Received shutdown signal, test time was about 1.000000 seconds 00:26:08.519 00:26:08.519 Latency(us) 00:26:08.519 [2024-11-28T00:20:23.122Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:08.519 [2024-11-28T00:20:23.122Z] =================================================================================================================== 00:26:08.519 [2024-11-28T00:20:23.122Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:08.519 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:26:08.519 01:20:23 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:08.519 01:20:23 -- common/autotest_common.sh@1607 -- # read -r file 00:26:08.519 01:20:23 -- host/multicontroller.sh@108 -- # nvmftestfini 00:26:08.519 01:20:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:08.519 01:20:23 -- nvmf/common.sh@116 -- # sync 00:26:08.519 01:20:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:08.519 01:20:23 -- nvmf/common.sh@119 -- # set +e 00:26:08.519 01:20:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:08.519 01:20:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:08.519 rmmod nvme_tcp 00:26:08.519 rmmod nvme_fabrics 00:26:08.519 rmmod nvme_keyring 00:26:08.777 01:20:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:08.777 01:20:23 -- nvmf/common.sh@123 -- # set -e 00:26:08.777 01:20:23 -- nvmf/common.sh@124 -- # return 0 00:26:08.777 01:20:23 -- nvmf/common.sh@477 -- # '[' -n 2115302 ']' 00:26:08.777 01:20:23 -- nvmf/common.sh@478 -- # killprocess 2115302 00:26:08.777 01:20:23 -- common/autotest_common.sh@936 -- # '[' -z 2115302 ']' 00:26:08.777 01:20:23 -- common/autotest_common.sh@940 -- # kill -0 2115302 00:26:08.777 01:20:23 -- common/autotest_common.sh@941 -- # uname 00:26:08.777 01:20:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:08.777 01:20:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2115302 00:26:08.777 01:20:23 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:08.777 01:20:23 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:08.777 01:20:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2115302' 00:26:08.777 killing process with pid 2115302 00:26:08.777 01:20:23 -- common/autotest_common.sh@955 -- # kill 2115302 00:26:08.777 01:20:23 -- common/autotest_common.sh@960 -- # wait 2115302 00:26:09.035 01:20:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:09.035 01:20:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:09.035 01:20:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:09.035 01:20:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:09.035 01:20:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:09.035 01:20:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:09.035 01:20:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:09.035 01:20:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:10.940 01:20:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:10.940 00:26:10.940 real 0m8.816s 00:26:10.940 user 0m16.827s 00:26:10.940 sys 0m2.338s 00:26:10.940 01:20:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:10.940 01:20:25 -- common/autotest_common.sh@10 -- # set +x 00:26:10.940 ************************************ 00:26:10.940 END TEST nvmf_multicontroller 00:26:10.940 ************************************ 00:26:10.940 01:20:25 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:26:10.940 01:20:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:10.940 01:20:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:10.940 01:20:25 -- common/autotest_common.sh@10 -- # set +x 00:26:10.940 ************************************ 00:26:10.940 START TEST nvmf_aer 00:26:10.940 ************************************ 00:26:10.940 01:20:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:26:11.199 * Looking for test storage... 00:26:11.199 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:11.199 01:20:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:11.199 01:20:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:11.199 01:20:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:11.199 01:20:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:11.199 01:20:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:11.199 01:20:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:11.199 01:20:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:11.199 01:20:25 -- scripts/common.sh@335 -- # IFS=.-: 00:26:11.199 01:20:25 -- scripts/common.sh@335 -- # read -ra ver1 00:26:11.199 01:20:25 -- scripts/common.sh@336 -- # IFS=.-: 00:26:11.199 01:20:25 -- scripts/common.sh@336 -- # read -ra ver2 00:26:11.199 01:20:25 -- scripts/common.sh@337 -- # local 'op=<' 00:26:11.199 01:20:25 -- scripts/common.sh@339 -- # ver1_l=2 00:26:11.199 01:20:25 -- scripts/common.sh@340 -- # ver2_l=1 00:26:11.199 01:20:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:11.199 01:20:25 -- scripts/common.sh@343 -- # case "$op" in 00:26:11.199 01:20:25 -- scripts/common.sh@344 -- # : 1 00:26:11.199 01:20:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:11.199 01:20:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:11.199 01:20:25 -- scripts/common.sh@364 -- # decimal 1 00:26:11.199 01:20:25 -- scripts/common.sh@352 -- # local d=1 00:26:11.199 01:20:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:11.199 01:20:25 -- scripts/common.sh@354 -- # echo 1 00:26:11.199 01:20:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:11.199 01:20:25 -- scripts/common.sh@365 -- # decimal 2 00:26:11.199 01:20:25 -- scripts/common.sh@352 -- # local d=2 00:26:11.199 01:20:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:11.199 01:20:25 -- scripts/common.sh@354 -- # echo 2 00:26:11.199 01:20:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:11.199 01:20:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:11.199 01:20:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:11.199 01:20:25 -- scripts/common.sh@367 -- # return 0 00:26:11.199 01:20:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:11.199 01:20:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:11.199 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:11.199 --rc genhtml_branch_coverage=1 00:26:11.199 --rc genhtml_function_coverage=1 00:26:11.199 --rc genhtml_legend=1 00:26:11.199 --rc geninfo_all_blocks=1 00:26:11.199 --rc geninfo_unexecuted_blocks=1 00:26:11.199 00:26:11.199 ' 00:26:11.199 01:20:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:11.199 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:11.199 --rc genhtml_branch_coverage=1 00:26:11.199 --rc genhtml_function_coverage=1 00:26:11.199 --rc genhtml_legend=1 00:26:11.199 --rc geninfo_all_blocks=1 00:26:11.199 --rc geninfo_unexecuted_blocks=1 00:26:11.199 00:26:11.199 ' 00:26:11.199 01:20:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:11.199 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:11.199 --rc genhtml_branch_coverage=1 00:26:11.199 --rc genhtml_function_coverage=1 00:26:11.199 --rc genhtml_legend=1 00:26:11.199 --rc geninfo_all_blocks=1 00:26:11.199 --rc geninfo_unexecuted_blocks=1 00:26:11.199 00:26:11.199 ' 00:26:11.199 01:20:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:11.199 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:11.199 --rc genhtml_branch_coverage=1 00:26:11.199 --rc genhtml_function_coverage=1 00:26:11.199 --rc genhtml_legend=1 00:26:11.199 --rc geninfo_all_blocks=1 00:26:11.199 --rc geninfo_unexecuted_blocks=1 00:26:11.199 00:26:11.199 ' 00:26:11.199 01:20:25 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:11.199 01:20:25 -- nvmf/common.sh@7 -- # uname -s 00:26:11.199 01:20:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:11.199 01:20:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:11.199 01:20:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:11.199 01:20:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:11.199 01:20:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:11.199 01:20:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:11.199 01:20:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:11.199 01:20:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:11.200 01:20:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:11.200 01:20:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:11.200 01:20:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:11.200 01:20:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:11.200 01:20:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:11.200 01:20:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:11.200 01:20:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:11.200 01:20:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:11.200 01:20:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:11.200 01:20:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:11.200 01:20:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:11.200 01:20:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:11.200 01:20:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:11.200 01:20:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:11.200 01:20:25 -- paths/export.sh@5 -- # export PATH 00:26:11.200 01:20:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:11.200 01:20:25 -- nvmf/common.sh@46 -- # : 0 00:26:11.200 01:20:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:11.200 01:20:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:11.200 01:20:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:11.200 01:20:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:11.200 01:20:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:11.200 01:20:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:11.200 01:20:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:11.200 01:20:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:11.200 01:20:25 -- host/aer.sh@11 -- # nvmftestinit 00:26:11.200 01:20:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:11.200 01:20:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:11.200 01:20:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:11.200 01:20:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:11.200 01:20:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:11.200 01:20:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:11.200 01:20:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:11.200 01:20:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:11.200 01:20:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:11.200 01:20:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:11.200 01:20:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:11.200 01:20:25 -- common/autotest_common.sh@10 -- # set +x 00:26:13.731 01:20:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:13.731 01:20:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:13.731 01:20:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:13.731 01:20:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:13.731 01:20:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:13.731 01:20:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:13.731 01:20:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:13.731 01:20:27 -- nvmf/common.sh@294 -- # net_devs=() 00:26:13.731 01:20:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:13.731 01:20:27 -- nvmf/common.sh@295 -- # e810=() 00:26:13.731 01:20:27 -- nvmf/common.sh@295 -- # local -ga e810 00:26:13.731 01:20:27 -- nvmf/common.sh@296 -- # x722=() 00:26:13.731 01:20:27 -- nvmf/common.sh@296 -- # local -ga x722 00:26:13.731 01:20:27 -- nvmf/common.sh@297 -- # mlx=() 00:26:13.731 01:20:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:13.731 01:20:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:13.731 01:20:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:13.731 01:20:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:13.731 01:20:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:13.731 01:20:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:13.731 01:20:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:13.731 01:20:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:13.731 01:20:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:13.731 01:20:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:13.731 01:20:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:13.731 01:20:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:13.731 01:20:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:13.731 01:20:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:13.731 01:20:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:13.731 01:20:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:13.731 01:20:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:13.731 01:20:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:13.731 01:20:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:13.731 01:20:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:13.731 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:13.731 01:20:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:13.731 01:20:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:13.731 01:20:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:13.731 01:20:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:13.731 01:20:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:13.731 01:20:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:13.731 01:20:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:13.731 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:13.731 01:20:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:13.731 01:20:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:13.731 01:20:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:13.731 01:20:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:13.731 01:20:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:13.731 01:20:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:13.731 01:20:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:13.731 01:20:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:13.731 01:20:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:13.731 01:20:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:13.731 01:20:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:13.731 01:20:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:13.731 01:20:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:13.731 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:13.731 01:20:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:13.731 01:20:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:13.731 01:20:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:13.731 01:20:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:13.731 01:20:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:13.731 01:20:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:13.731 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:13.731 01:20:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:13.731 01:20:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:13.731 01:20:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:13.731 01:20:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:13.731 01:20:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:13.731 01:20:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:13.731 01:20:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:13.731 01:20:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:13.731 01:20:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:13.731 01:20:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:13.731 01:20:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:13.731 01:20:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:13.731 01:20:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:13.731 01:20:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:13.731 01:20:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:13.731 01:20:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:13.731 01:20:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:13.731 01:20:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:13.731 01:20:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:13.731 01:20:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:13.731 01:20:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:13.732 01:20:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:13.732 01:20:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:13.732 01:20:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:13.732 01:20:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:13.732 01:20:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:13.732 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:13.732 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.154 ms 00:26:13.732 00:26:13.732 --- 10.0.0.2 ping statistics --- 00:26:13.732 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:13.732 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:26:13.732 01:20:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:13.732 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:13.732 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:26:13.732 00:26:13.732 --- 10.0.0.1 ping statistics --- 00:26:13.732 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:13.732 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:26:13.732 01:20:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:13.732 01:20:27 -- nvmf/common.sh@410 -- # return 0 00:26:13.732 01:20:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:13.732 01:20:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:13.732 01:20:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:13.732 01:20:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:13.732 01:20:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:13.732 01:20:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:13.732 01:20:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:13.732 01:20:27 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:26:13.732 01:20:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:13.732 01:20:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:13.732 01:20:27 -- common/autotest_common.sh@10 -- # set +x 00:26:13.732 01:20:27 -- nvmf/common.sh@469 -- # nvmfpid=2117803 00:26:13.732 01:20:27 -- nvmf/common.sh@470 -- # waitforlisten 2117803 00:26:13.732 01:20:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:13.732 01:20:27 -- common/autotest_common.sh@829 -- # '[' -z 2117803 ']' 00:26:13.732 01:20:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:13.732 01:20:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:13.732 01:20:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:13.732 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:13.732 01:20:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:13.732 01:20:27 -- common/autotest_common.sh@10 -- # set +x 00:26:13.732 [2024-11-28 01:20:28.012260] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:13.732 [2024-11-28 01:20:28.012344] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:13.732 EAL: No free 2048 kB hugepages reported on node 1 00:26:13.732 [2024-11-28 01:20:28.086016] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:13.732 [2024-11-28 01:20:28.173701] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:13.732 [2024-11-28 01:20:28.173870] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:13.732 [2024-11-28 01:20:28.173887] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:13.732 [2024-11-28 01:20:28.173900] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:13.732 [2024-11-28 01:20:28.173952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:13.732 [2024-11-28 01:20:28.174009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:13.732 [2024-11-28 01:20:28.174012] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:13.732 [2024-11-28 01:20:28.173979] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:14.666 01:20:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:14.666 01:20:28 -- common/autotest_common.sh@862 -- # return 0 00:26:14.666 01:20:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:14.666 01:20:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:14.666 01:20:28 -- common/autotest_common.sh@10 -- # set +x 00:26:14.666 01:20:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:14.666 01:20:29 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:14.666 01:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.666 01:20:29 -- common/autotest_common.sh@10 -- # set +x 00:26:14.666 [2024-11-28 01:20:29.011179] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:14.666 01:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.666 01:20:29 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:26:14.666 01:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.666 01:20:29 -- common/autotest_common.sh@10 -- # set +x 00:26:14.666 Malloc0 00:26:14.666 01:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.666 01:20:29 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:26:14.666 01:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.666 01:20:29 -- common/autotest_common.sh@10 -- # set +x 00:26:14.666 01:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.666 01:20:29 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:14.666 01:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.666 01:20:29 -- common/autotest_common.sh@10 -- # set +x 00:26:14.666 01:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.666 01:20:29 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:14.666 01:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.666 01:20:29 -- common/autotest_common.sh@10 -- # set +x 00:26:14.666 [2024-11-28 01:20:29.063121] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:14.666 01:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.666 01:20:29 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:26:14.666 01:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.666 01:20:29 -- common/autotest_common.sh@10 -- # set +x 00:26:14.666 [2024-11-28 01:20:29.070802] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:14.666 [ 00:26:14.666 { 00:26:14.666 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:14.666 "subtype": "Discovery", 00:26:14.666 "listen_addresses": [], 00:26:14.666 "allow_any_host": true, 00:26:14.666 "hosts": [] 00:26:14.666 }, 00:26:14.666 { 00:26:14.666 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:14.666 "subtype": "NVMe", 00:26:14.666 "listen_addresses": [ 00:26:14.666 { 00:26:14.666 "transport": "TCP", 00:26:14.666 "trtype": "TCP", 00:26:14.666 "adrfam": "IPv4", 00:26:14.666 "traddr": "10.0.0.2", 00:26:14.666 "trsvcid": "4420" 00:26:14.666 } 00:26:14.666 ], 00:26:14.666 "allow_any_host": true, 00:26:14.666 "hosts": [], 00:26:14.666 "serial_number": "SPDK00000000000001", 00:26:14.666 "model_number": "SPDK bdev Controller", 00:26:14.666 "max_namespaces": 2, 00:26:14.666 "min_cntlid": 1, 00:26:14.666 "max_cntlid": 65519, 00:26:14.666 "namespaces": [ 00:26:14.666 { 00:26:14.666 "nsid": 1, 00:26:14.666 "bdev_name": "Malloc0", 00:26:14.666 "name": "Malloc0", 00:26:14.666 "nguid": "72083B86BAA0471690228AD2A717BF8E", 00:26:14.666 "uuid": "72083b86-baa0-4716-9022-8ad2a717bf8e" 00:26:14.666 } 00:26:14.666 ] 00:26:14.666 } 00:26:14.666 ] 00:26:14.666 01:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.666 01:20:29 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:26:14.666 01:20:29 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:26:14.666 01:20:29 -- host/aer.sh@33 -- # aerpid=2117961 00:26:14.666 01:20:29 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:26:14.666 01:20:29 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:26:14.666 01:20:29 -- common/autotest_common.sh@1254 -- # local i=0 00:26:14.666 01:20:29 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:14.666 01:20:29 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:26:14.666 01:20:29 -- common/autotest_common.sh@1257 -- # i=1 00:26:14.666 01:20:29 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:26:14.666 EAL: No free 2048 kB hugepages reported on node 1 00:26:14.666 01:20:29 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:14.666 01:20:29 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:26:14.666 01:20:29 -- common/autotest_common.sh@1257 -- # i=2 00:26:14.666 01:20:29 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:26:14.924 01:20:29 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:14.924 01:20:29 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:14.924 01:20:29 -- common/autotest_common.sh@1265 -- # return 0 00:26:14.924 01:20:29 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:26:14.924 01:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.924 01:20:29 -- common/autotest_common.sh@10 -- # set +x 00:26:14.924 Malloc1 00:26:14.924 01:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.924 01:20:29 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:26:14.924 01:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.924 01:20:29 -- common/autotest_common.sh@10 -- # set +x 00:26:14.924 01:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.924 01:20:29 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:26:14.924 01:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.924 01:20:29 -- common/autotest_common.sh@10 -- # set +x 00:26:14.924 Asynchronous Event Request test 00:26:14.924 Attaching to 10.0.0.2 00:26:14.924 Attached to 10.0.0.2 00:26:14.924 Registering asynchronous event callbacks... 00:26:14.924 Starting namespace attribute notice tests for all controllers... 00:26:14.924 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:26:14.924 aer_cb - Changed Namespace 00:26:14.924 Cleaning up... 00:26:14.924 [ 00:26:14.924 { 00:26:14.924 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:14.924 "subtype": "Discovery", 00:26:14.924 "listen_addresses": [], 00:26:14.924 "allow_any_host": true, 00:26:14.924 "hosts": [] 00:26:14.925 }, 00:26:14.925 { 00:26:14.925 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:14.925 "subtype": "NVMe", 00:26:14.925 "listen_addresses": [ 00:26:14.925 { 00:26:14.925 "transport": "TCP", 00:26:14.925 "trtype": "TCP", 00:26:14.925 "adrfam": "IPv4", 00:26:14.925 "traddr": "10.0.0.2", 00:26:14.925 "trsvcid": "4420" 00:26:14.925 } 00:26:14.925 ], 00:26:14.925 "allow_any_host": true, 00:26:14.925 "hosts": [], 00:26:14.925 "serial_number": "SPDK00000000000001", 00:26:14.925 "model_number": "SPDK bdev Controller", 00:26:14.925 "max_namespaces": 2, 00:26:14.925 "min_cntlid": 1, 00:26:14.925 "max_cntlid": 65519, 00:26:14.925 "namespaces": [ 00:26:14.925 { 00:26:14.925 "nsid": 1, 00:26:14.925 "bdev_name": "Malloc0", 00:26:14.925 "name": "Malloc0", 00:26:14.925 "nguid": "72083B86BAA0471690228AD2A717BF8E", 00:26:14.925 "uuid": "72083b86-baa0-4716-9022-8ad2a717bf8e" 00:26:14.925 }, 00:26:14.925 { 00:26:14.925 "nsid": 2, 00:26:14.925 "bdev_name": "Malloc1", 00:26:14.925 "name": "Malloc1", 00:26:14.925 "nguid": "1FA0D9E8AA6A471C92D94C091F0E4022", 00:26:14.925 "uuid": "1fa0d9e8-aa6a-471c-92d9-4c091f0e4022" 00:26:14.925 } 00:26:14.925 ] 00:26:14.925 } 00:26:14.925 ] 00:26:14.925 01:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.925 01:20:29 -- host/aer.sh@43 -- # wait 2117961 00:26:14.925 01:20:29 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:26:14.925 01:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.925 01:20:29 -- common/autotest_common.sh@10 -- # set +x 00:26:14.925 01:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.925 01:20:29 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:26:14.925 01:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.925 01:20:29 -- common/autotest_common.sh@10 -- # set +x 00:26:14.925 01:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.925 01:20:29 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:14.925 01:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.925 01:20:29 -- common/autotest_common.sh@10 -- # set +x 00:26:14.925 01:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.925 01:20:29 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:26:14.925 01:20:29 -- host/aer.sh@51 -- # nvmftestfini 00:26:14.925 01:20:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:14.925 01:20:29 -- nvmf/common.sh@116 -- # sync 00:26:14.925 01:20:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:14.925 01:20:29 -- nvmf/common.sh@119 -- # set +e 00:26:14.925 01:20:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:14.925 01:20:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:14.925 rmmod nvme_tcp 00:26:14.925 rmmod nvme_fabrics 00:26:14.925 rmmod nvme_keyring 00:26:14.925 01:20:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:14.925 01:20:29 -- nvmf/common.sh@123 -- # set -e 00:26:14.925 01:20:29 -- nvmf/common.sh@124 -- # return 0 00:26:14.925 01:20:29 -- nvmf/common.sh@477 -- # '[' -n 2117803 ']' 00:26:14.925 01:20:29 -- nvmf/common.sh@478 -- # killprocess 2117803 00:26:14.925 01:20:29 -- common/autotest_common.sh@936 -- # '[' -z 2117803 ']' 00:26:14.925 01:20:29 -- common/autotest_common.sh@940 -- # kill -0 2117803 00:26:14.925 01:20:29 -- common/autotest_common.sh@941 -- # uname 00:26:14.925 01:20:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:14.925 01:20:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2117803 00:26:15.184 01:20:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:15.184 01:20:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:15.184 01:20:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2117803' 00:26:15.184 killing process with pid 2117803 00:26:15.184 01:20:29 -- common/autotest_common.sh@955 -- # kill 2117803 00:26:15.184 [2024-11-28 01:20:29.535384] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:15.184 01:20:29 -- common/autotest_common.sh@960 -- # wait 2117803 00:26:15.184 01:20:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:15.184 01:20:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:15.184 01:20:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:15.184 01:20:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:15.184 01:20:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:15.184 01:20:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:15.184 01:20:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:15.184 01:20:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:17.718 01:20:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:17.718 00:26:17.718 real 0m6.298s 00:26:17.718 user 0m7.323s 00:26:17.718 sys 0m2.062s 00:26:17.718 01:20:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:17.718 01:20:31 -- common/autotest_common.sh@10 -- # set +x 00:26:17.718 ************************************ 00:26:17.718 END TEST nvmf_aer 00:26:17.718 ************************************ 00:26:17.718 01:20:31 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:26:17.718 01:20:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:17.718 01:20:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:17.718 01:20:31 -- common/autotest_common.sh@10 -- # set +x 00:26:17.718 ************************************ 00:26:17.718 START TEST nvmf_async_init 00:26:17.718 ************************************ 00:26:17.718 01:20:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:26:17.718 * Looking for test storage... 00:26:17.718 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:17.718 01:20:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:17.718 01:20:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:17.718 01:20:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:17.718 01:20:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:17.718 01:20:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:17.718 01:20:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:17.718 01:20:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:17.718 01:20:31 -- scripts/common.sh@335 -- # IFS=.-: 00:26:17.718 01:20:31 -- scripts/common.sh@335 -- # read -ra ver1 00:26:17.718 01:20:31 -- scripts/common.sh@336 -- # IFS=.-: 00:26:17.718 01:20:31 -- scripts/common.sh@336 -- # read -ra ver2 00:26:17.718 01:20:31 -- scripts/common.sh@337 -- # local 'op=<' 00:26:17.718 01:20:31 -- scripts/common.sh@339 -- # ver1_l=2 00:26:17.718 01:20:31 -- scripts/common.sh@340 -- # ver2_l=1 00:26:17.718 01:20:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:17.718 01:20:31 -- scripts/common.sh@343 -- # case "$op" in 00:26:17.718 01:20:31 -- scripts/common.sh@344 -- # : 1 00:26:17.718 01:20:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:17.718 01:20:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:17.718 01:20:31 -- scripts/common.sh@364 -- # decimal 1 00:26:17.718 01:20:31 -- scripts/common.sh@352 -- # local d=1 00:26:17.718 01:20:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:17.718 01:20:31 -- scripts/common.sh@354 -- # echo 1 00:26:17.718 01:20:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:17.718 01:20:31 -- scripts/common.sh@365 -- # decimal 2 00:26:17.718 01:20:31 -- scripts/common.sh@352 -- # local d=2 00:26:17.718 01:20:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:17.718 01:20:31 -- scripts/common.sh@354 -- # echo 2 00:26:17.718 01:20:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:17.718 01:20:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:17.718 01:20:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:17.718 01:20:31 -- scripts/common.sh@367 -- # return 0 00:26:17.718 01:20:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:17.718 01:20:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:17.718 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:17.718 --rc genhtml_branch_coverage=1 00:26:17.718 --rc genhtml_function_coverage=1 00:26:17.718 --rc genhtml_legend=1 00:26:17.718 --rc geninfo_all_blocks=1 00:26:17.718 --rc geninfo_unexecuted_blocks=1 00:26:17.718 00:26:17.718 ' 00:26:17.719 01:20:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:17.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:17.719 --rc genhtml_branch_coverage=1 00:26:17.719 --rc genhtml_function_coverage=1 00:26:17.719 --rc genhtml_legend=1 00:26:17.719 --rc geninfo_all_blocks=1 00:26:17.719 --rc geninfo_unexecuted_blocks=1 00:26:17.719 00:26:17.719 ' 00:26:17.719 01:20:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:17.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:17.719 --rc genhtml_branch_coverage=1 00:26:17.719 --rc genhtml_function_coverage=1 00:26:17.719 --rc genhtml_legend=1 00:26:17.719 --rc geninfo_all_blocks=1 00:26:17.719 --rc geninfo_unexecuted_blocks=1 00:26:17.719 00:26:17.719 ' 00:26:17.719 01:20:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:17.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:17.719 --rc genhtml_branch_coverage=1 00:26:17.719 --rc genhtml_function_coverage=1 00:26:17.719 --rc genhtml_legend=1 00:26:17.719 --rc geninfo_all_blocks=1 00:26:17.719 --rc geninfo_unexecuted_blocks=1 00:26:17.719 00:26:17.719 ' 00:26:17.719 01:20:31 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:17.719 01:20:31 -- nvmf/common.sh@7 -- # uname -s 00:26:17.719 01:20:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:17.719 01:20:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:17.719 01:20:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:17.719 01:20:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:17.719 01:20:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:17.719 01:20:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:17.719 01:20:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:17.719 01:20:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:17.719 01:20:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:17.719 01:20:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:17.719 01:20:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:17.719 01:20:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:17.719 01:20:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:17.719 01:20:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:17.719 01:20:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:17.719 01:20:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:17.719 01:20:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:17.719 01:20:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:17.719 01:20:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:17.719 01:20:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:17.719 01:20:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:17.719 01:20:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:17.719 01:20:31 -- paths/export.sh@5 -- # export PATH 00:26:17.719 01:20:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:17.719 01:20:31 -- nvmf/common.sh@46 -- # : 0 00:26:17.719 01:20:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:17.719 01:20:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:17.719 01:20:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:17.719 01:20:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:17.719 01:20:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:17.719 01:20:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:17.719 01:20:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:17.719 01:20:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:17.719 01:20:31 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:26:17.719 01:20:31 -- host/async_init.sh@14 -- # null_block_size=512 00:26:17.719 01:20:31 -- host/async_init.sh@15 -- # null_bdev=null0 00:26:17.719 01:20:31 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:26:17.719 01:20:31 -- host/async_init.sh@20 -- # uuidgen 00:26:17.719 01:20:31 -- host/async_init.sh@20 -- # tr -d - 00:26:17.719 01:20:32 -- host/async_init.sh@20 -- # nguid=5dd89dccb0f74ff58fec8a905460ff08 00:26:17.719 01:20:32 -- host/async_init.sh@22 -- # nvmftestinit 00:26:17.719 01:20:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:17.719 01:20:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:17.719 01:20:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:17.719 01:20:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:17.719 01:20:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:17.719 01:20:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:17.719 01:20:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:17.719 01:20:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:17.719 01:20:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:17.719 01:20:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:17.719 01:20:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:17.719 01:20:32 -- common/autotest_common.sh@10 -- # set +x 00:26:19.620 01:20:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:19.620 01:20:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:19.620 01:20:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:19.620 01:20:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:19.620 01:20:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:19.620 01:20:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:19.620 01:20:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:19.620 01:20:33 -- nvmf/common.sh@294 -- # net_devs=() 00:26:19.620 01:20:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:19.620 01:20:33 -- nvmf/common.sh@295 -- # e810=() 00:26:19.620 01:20:33 -- nvmf/common.sh@295 -- # local -ga e810 00:26:19.620 01:20:33 -- nvmf/common.sh@296 -- # x722=() 00:26:19.620 01:20:33 -- nvmf/common.sh@296 -- # local -ga x722 00:26:19.620 01:20:33 -- nvmf/common.sh@297 -- # mlx=() 00:26:19.620 01:20:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:19.620 01:20:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:19.620 01:20:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:19.620 01:20:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:19.620 01:20:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:19.620 01:20:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:19.620 01:20:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:19.620 01:20:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:19.620 01:20:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:19.620 01:20:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:19.620 01:20:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:19.620 01:20:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:19.620 01:20:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:19.620 01:20:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:19.620 01:20:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:19.620 01:20:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:19.620 01:20:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:19.620 01:20:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:19.620 01:20:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:19.620 01:20:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:19.620 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:19.620 01:20:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:19.620 01:20:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:19.620 01:20:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:19.620 01:20:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:19.620 01:20:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:19.620 01:20:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:19.620 01:20:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:19.620 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:19.620 01:20:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:19.620 01:20:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:19.620 01:20:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:19.620 01:20:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:19.620 01:20:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:19.620 01:20:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:19.620 01:20:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:19.620 01:20:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:19.620 01:20:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:19.620 01:20:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:19.620 01:20:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:19.620 01:20:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:19.620 01:20:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:19.620 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:19.620 01:20:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:19.620 01:20:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:19.620 01:20:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:19.620 01:20:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:19.620 01:20:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:19.620 01:20:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:19.620 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:19.620 01:20:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:19.620 01:20:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:19.620 01:20:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:19.620 01:20:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:19.620 01:20:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:19.620 01:20:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:19.620 01:20:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:19.620 01:20:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:19.620 01:20:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:19.620 01:20:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:19.620 01:20:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:19.620 01:20:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:19.620 01:20:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:19.620 01:20:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:19.620 01:20:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:19.620 01:20:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:19.620 01:20:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:19.620 01:20:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:19.620 01:20:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:19.620 01:20:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:19.620 01:20:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:19.620 01:20:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:19.620 01:20:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:19.620 01:20:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:19.620 01:20:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:19.620 01:20:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:19.620 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:19.620 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.270 ms 00:26:19.620 00:26:19.620 --- 10.0.0.2 ping statistics --- 00:26:19.620 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:19.620 rtt min/avg/max/mdev = 0.270/0.270/0.270/0.000 ms 00:26:19.620 01:20:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:19.620 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:19.620 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.076 ms 00:26:19.620 00:26:19.620 --- 10.0.0.1 ping statistics --- 00:26:19.620 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:19.620 rtt min/avg/max/mdev = 0.076/0.076/0.076/0.000 ms 00:26:19.620 01:20:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:19.620 01:20:34 -- nvmf/common.sh@410 -- # return 0 00:26:19.620 01:20:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:19.620 01:20:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:19.620 01:20:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:19.620 01:20:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:19.620 01:20:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:19.620 01:20:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:19.620 01:20:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:19.620 01:20:34 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:26:19.620 01:20:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:19.620 01:20:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:19.620 01:20:34 -- common/autotest_common.sh@10 -- # set +x 00:26:19.620 01:20:34 -- nvmf/common.sh@469 -- # nvmfpid=2119944 00:26:19.620 01:20:34 -- nvmf/common.sh@470 -- # waitforlisten 2119944 00:26:19.620 01:20:34 -- common/autotest_common.sh@829 -- # '[' -z 2119944 ']' 00:26:19.620 01:20:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:26:19.620 01:20:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:19.620 01:20:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:19.621 01:20:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:19.621 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:19.621 01:20:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:19.621 01:20:34 -- common/autotest_common.sh@10 -- # set +x 00:26:19.621 [2024-11-28 01:20:34.200621] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:19.621 [2024-11-28 01:20:34.200701] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:19.879 EAL: No free 2048 kB hugepages reported on node 1 00:26:19.879 [2024-11-28 01:20:34.275325] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:19.879 [2024-11-28 01:20:34.363459] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:19.879 [2024-11-28 01:20:34.363656] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:19.879 [2024-11-28 01:20:34.363679] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:19.879 [2024-11-28 01:20:34.363694] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:19.879 [2024-11-28 01:20:34.363732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:20.812 01:20:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:20.812 01:20:35 -- common/autotest_common.sh@862 -- # return 0 00:26:20.812 01:20:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:20.812 01:20:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:20.812 01:20:35 -- common/autotest_common.sh@10 -- # set +x 00:26:20.812 01:20:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:20.812 01:20:35 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:26:20.812 01:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.812 01:20:35 -- common/autotest_common.sh@10 -- # set +x 00:26:20.812 [2024-11-28 01:20:35.189851] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:20.812 01:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.812 01:20:35 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:26:20.812 01:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.812 01:20:35 -- common/autotest_common.sh@10 -- # set +x 00:26:20.812 null0 00:26:20.812 01:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.812 01:20:35 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:26:20.812 01:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.812 01:20:35 -- common/autotest_common.sh@10 -- # set +x 00:26:20.812 01:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.812 01:20:35 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:26:20.812 01:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.812 01:20:35 -- common/autotest_common.sh@10 -- # set +x 00:26:20.812 01:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.812 01:20:35 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 5dd89dccb0f74ff58fec8a905460ff08 00:26:20.812 01:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.812 01:20:35 -- common/autotest_common.sh@10 -- # set +x 00:26:20.812 01:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.812 01:20:35 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:20.812 01:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.812 01:20:35 -- common/autotest_common.sh@10 -- # set +x 00:26:20.812 [2024-11-28 01:20:35.230123] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:20.812 01:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.812 01:20:35 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:26:20.812 01:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.812 01:20:35 -- common/autotest_common.sh@10 -- # set +x 00:26:21.070 nvme0n1 00:26:21.070 01:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.070 01:20:35 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:21.070 01:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.070 01:20:35 -- common/autotest_common.sh@10 -- # set +x 00:26:21.070 [ 00:26:21.070 { 00:26:21.070 "name": "nvme0n1", 00:26:21.070 "aliases": [ 00:26:21.070 "5dd89dcc-b0f7-4ff5-8fec-8a905460ff08" 00:26:21.070 ], 00:26:21.070 "product_name": "NVMe disk", 00:26:21.070 "block_size": 512, 00:26:21.070 "num_blocks": 2097152, 00:26:21.070 "uuid": "5dd89dcc-b0f7-4ff5-8fec-8a905460ff08", 00:26:21.070 "assigned_rate_limits": { 00:26:21.070 "rw_ios_per_sec": 0, 00:26:21.070 "rw_mbytes_per_sec": 0, 00:26:21.070 "r_mbytes_per_sec": 0, 00:26:21.070 "w_mbytes_per_sec": 0 00:26:21.070 }, 00:26:21.070 "claimed": false, 00:26:21.070 "zoned": false, 00:26:21.070 "supported_io_types": { 00:26:21.070 "read": true, 00:26:21.070 "write": true, 00:26:21.070 "unmap": false, 00:26:21.070 "write_zeroes": true, 00:26:21.070 "flush": true, 00:26:21.070 "reset": true, 00:26:21.070 "compare": true, 00:26:21.070 "compare_and_write": true, 00:26:21.070 "abort": true, 00:26:21.070 "nvme_admin": true, 00:26:21.070 "nvme_io": true 00:26:21.070 }, 00:26:21.070 "driver_specific": { 00:26:21.070 "nvme": [ 00:26:21.070 { 00:26:21.070 "trid": { 00:26:21.070 "trtype": "TCP", 00:26:21.070 "adrfam": "IPv4", 00:26:21.070 "traddr": "10.0.0.2", 00:26:21.070 "trsvcid": "4420", 00:26:21.070 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:21.070 }, 00:26:21.070 "ctrlr_data": { 00:26:21.070 "cntlid": 1, 00:26:21.070 "vendor_id": "0x8086", 00:26:21.070 "model_number": "SPDK bdev Controller", 00:26:21.070 "serial_number": "00000000000000000000", 00:26:21.070 "firmware_revision": "24.01.1", 00:26:21.070 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:21.070 "oacs": { 00:26:21.070 "security": 0, 00:26:21.070 "format": 0, 00:26:21.070 "firmware": 0, 00:26:21.070 "ns_manage": 0 00:26:21.070 }, 00:26:21.070 "multi_ctrlr": true, 00:26:21.070 "ana_reporting": false 00:26:21.070 }, 00:26:21.070 "vs": { 00:26:21.070 "nvme_version": "1.3" 00:26:21.070 }, 00:26:21.070 "ns_data": { 00:26:21.070 "id": 1, 00:26:21.070 "can_share": true 00:26:21.070 } 00:26:21.070 } 00:26:21.070 ], 00:26:21.070 "mp_policy": "active_passive" 00:26:21.070 } 00:26:21.070 } 00:26:21.070 ] 00:26:21.070 01:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.070 01:20:35 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:26:21.070 01:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.070 01:20:35 -- common/autotest_common.sh@10 -- # set +x 00:26:21.070 [2024-11-28 01:20:35.478711] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:21.070 [2024-11-28 01:20:35.478825] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x202c3f0 (9): Bad file descriptor 00:26:21.070 [2024-11-28 01:20:35.610686] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:21.070 01:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.070 01:20:35 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:21.070 01:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.070 01:20:35 -- common/autotest_common.sh@10 -- # set +x 00:26:21.070 [ 00:26:21.070 { 00:26:21.070 "name": "nvme0n1", 00:26:21.070 "aliases": [ 00:26:21.070 "5dd89dcc-b0f7-4ff5-8fec-8a905460ff08" 00:26:21.070 ], 00:26:21.070 "product_name": "NVMe disk", 00:26:21.070 "block_size": 512, 00:26:21.070 "num_blocks": 2097152, 00:26:21.070 "uuid": "5dd89dcc-b0f7-4ff5-8fec-8a905460ff08", 00:26:21.070 "assigned_rate_limits": { 00:26:21.070 "rw_ios_per_sec": 0, 00:26:21.070 "rw_mbytes_per_sec": 0, 00:26:21.070 "r_mbytes_per_sec": 0, 00:26:21.070 "w_mbytes_per_sec": 0 00:26:21.070 }, 00:26:21.070 "claimed": false, 00:26:21.070 "zoned": false, 00:26:21.070 "supported_io_types": { 00:26:21.070 "read": true, 00:26:21.070 "write": true, 00:26:21.070 "unmap": false, 00:26:21.070 "write_zeroes": true, 00:26:21.070 "flush": true, 00:26:21.070 "reset": true, 00:26:21.070 "compare": true, 00:26:21.070 "compare_and_write": true, 00:26:21.070 "abort": true, 00:26:21.070 "nvme_admin": true, 00:26:21.070 "nvme_io": true 00:26:21.070 }, 00:26:21.070 "driver_specific": { 00:26:21.070 "nvme": [ 00:26:21.070 { 00:26:21.070 "trid": { 00:26:21.070 "trtype": "TCP", 00:26:21.070 "adrfam": "IPv4", 00:26:21.070 "traddr": "10.0.0.2", 00:26:21.070 "trsvcid": "4420", 00:26:21.070 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:21.070 }, 00:26:21.070 "ctrlr_data": { 00:26:21.070 "cntlid": 2, 00:26:21.070 "vendor_id": "0x8086", 00:26:21.070 "model_number": "SPDK bdev Controller", 00:26:21.070 "serial_number": "00000000000000000000", 00:26:21.070 "firmware_revision": "24.01.1", 00:26:21.070 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:21.070 "oacs": { 00:26:21.070 "security": 0, 00:26:21.070 "format": 0, 00:26:21.070 "firmware": 0, 00:26:21.070 "ns_manage": 0 00:26:21.070 }, 00:26:21.070 "multi_ctrlr": true, 00:26:21.070 "ana_reporting": false 00:26:21.070 }, 00:26:21.070 "vs": { 00:26:21.070 "nvme_version": "1.3" 00:26:21.070 }, 00:26:21.070 "ns_data": { 00:26:21.070 "id": 1, 00:26:21.070 "can_share": true 00:26:21.070 } 00:26:21.070 } 00:26:21.070 ], 00:26:21.070 "mp_policy": "active_passive" 00:26:21.070 } 00:26:21.070 } 00:26:21.070 ] 00:26:21.070 01:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.070 01:20:35 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:26:21.070 01:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.070 01:20:35 -- common/autotest_common.sh@10 -- # set +x 00:26:21.070 01:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.070 01:20:35 -- host/async_init.sh@53 -- # mktemp 00:26:21.070 01:20:35 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.i9OKF86F7X 00:26:21.070 01:20:35 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:26:21.070 01:20:35 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.i9OKF86F7X 00:26:21.070 01:20:35 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:26:21.070 01:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.070 01:20:35 -- common/autotest_common.sh@10 -- # set +x 00:26:21.071 01:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.071 01:20:35 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:26:21.071 01:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.071 01:20:35 -- common/autotest_common.sh@10 -- # set +x 00:26:21.071 [2024-11-28 01:20:35.655319] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:26:21.071 [2024-11-28 01:20:35.655485] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:21.071 01:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.071 01:20:35 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.i9OKF86F7X 00:26:21.071 01:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.071 01:20:35 -- common/autotest_common.sh@10 -- # set +x 00:26:21.071 01:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.071 01:20:35 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.i9OKF86F7X 00:26:21.071 01:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.071 01:20:35 -- common/autotest_common.sh@10 -- # set +x 00:26:21.071 [2024-11-28 01:20:35.671356] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:26:21.365 nvme0n1 00:26:21.365 01:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.365 01:20:35 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:21.365 01:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.365 01:20:35 -- common/autotest_common.sh@10 -- # set +x 00:26:21.365 [ 00:26:21.365 { 00:26:21.365 "name": "nvme0n1", 00:26:21.365 "aliases": [ 00:26:21.365 "5dd89dcc-b0f7-4ff5-8fec-8a905460ff08" 00:26:21.365 ], 00:26:21.365 "product_name": "NVMe disk", 00:26:21.365 "block_size": 512, 00:26:21.366 "num_blocks": 2097152, 00:26:21.366 "uuid": "5dd89dcc-b0f7-4ff5-8fec-8a905460ff08", 00:26:21.366 "assigned_rate_limits": { 00:26:21.366 "rw_ios_per_sec": 0, 00:26:21.366 "rw_mbytes_per_sec": 0, 00:26:21.366 "r_mbytes_per_sec": 0, 00:26:21.366 "w_mbytes_per_sec": 0 00:26:21.366 }, 00:26:21.366 "claimed": false, 00:26:21.366 "zoned": false, 00:26:21.366 "supported_io_types": { 00:26:21.366 "read": true, 00:26:21.366 "write": true, 00:26:21.366 "unmap": false, 00:26:21.366 "write_zeroes": true, 00:26:21.366 "flush": true, 00:26:21.366 "reset": true, 00:26:21.366 "compare": true, 00:26:21.366 "compare_and_write": true, 00:26:21.366 "abort": true, 00:26:21.366 "nvme_admin": true, 00:26:21.366 "nvme_io": true 00:26:21.366 }, 00:26:21.366 "driver_specific": { 00:26:21.366 "nvme": [ 00:26:21.366 { 00:26:21.366 "trid": { 00:26:21.366 "trtype": "TCP", 00:26:21.366 "adrfam": "IPv4", 00:26:21.366 "traddr": "10.0.0.2", 00:26:21.366 "trsvcid": "4421", 00:26:21.366 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:21.366 }, 00:26:21.366 "ctrlr_data": { 00:26:21.366 "cntlid": 3, 00:26:21.366 "vendor_id": "0x8086", 00:26:21.366 "model_number": "SPDK bdev Controller", 00:26:21.366 "serial_number": "00000000000000000000", 00:26:21.366 "firmware_revision": "24.01.1", 00:26:21.366 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:21.366 "oacs": { 00:26:21.366 "security": 0, 00:26:21.366 "format": 0, 00:26:21.366 "firmware": 0, 00:26:21.366 "ns_manage": 0 00:26:21.366 }, 00:26:21.366 "multi_ctrlr": true, 00:26:21.366 "ana_reporting": false 00:26:21.366 }, 00:26:21.366 "vs": { 00:26:21.366 "nvme_version": "1.3" 00:26:21.366 }, 00:26:21.366 "ns_data": { 00:26:21.366 "id": 1, 00:26:21.366 "can_share": true 00:26:21.366 } 00:26:21.366 } 00:26:21.366 ], 00:26:21.366 "mp_policy": "active_passive" 00:26:21.366 } 00:26:21.366 } 00:26:21.366 ] 00:26:21.366 01:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.366 01:20:35 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:26:21.366 01:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.366 01:20:35 -- common/autotest_common.sh@10 -- # set +x 00:26:21.366 01:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.366 01:20:35 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.i9OKF86F7X 00:26:21.366 01:20:35 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:26:21.366 01:20:35 -- host/async_init.sh@78 -- # nvmftestfini 00:26:21.366 01:20:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:21.366 01:20:35 -- nvmf/common.sh@116 -- # sync 00:26:21.366 01:20:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:21.366 01:20:35 -- nvmf/common.sh@119 -- # set +e 00:26:21.366 01:20:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:21.366 01:20:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:21.366 rmmod nvme_tcp 00:26:21.366 rmmod nvme_fabrics 00:26:21.366 rmmod nvme_keyring 00:26:21.366 01:20:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:21.366 01:20:35 -- nvmf/common.sh@123 -- # set -e 00:26:21.366 01:20:35 -- nvmf/common.sh@124 -- # return 0 00:26:21.366 01:20:35 -- nvmf/common.sh@477 -- # '[' -n 2119944 ']' 00:26:21.366 01:20:35 -- nvmf/common.sh@478 -- # killprocess 2119944 00:26:21.366 01:20:35 -- common/autotest_common.sh@936 -- # '[' -z 2119944 ']' 00:26:21.366 01:20:35 -- common/autotest_common.sh@940 -- # kill -0 2119944 00:26:21.366 01:20:35 -- common/autotest_common.sh@941 -- # uname 00:26:21.366 01:20:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:21.366 01:20:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2119944 00:26:21.366 01:20:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:21.366 01:20:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:21.366 01:20:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2119944' 00:26:21.366 killing process with pid 2119944 00:26:21.366 01:20:35 -- common/autotest_common.sh@955 -- # kill 2119944 00:26:21.366 01:20:35 -- common/autotest_common.sh@960 -- # wait 2119944 00:26:21.649 01:20:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:21.650 01:20:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:21.650 01:20:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:21.650 01:20:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:21.650 01:20:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:21.650 01:20:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:21.650 01:20:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:21.650 01:20:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:23.555 01:20:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:23.555 00:26:23.555 real 0m6.250s 00:26:23.555 user 0m2.998s 00:26:23.555 sys 0m1.870s 00:26:23.555 01:20:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:23.555 01:20:38 -- common/autotest_common.sh@10 -- # set +x 00:26:23.555 ************************************ 00:26:23.555 END TEST nvmf_async_init 00:26:23.555 ************************************ 00:26:23.555 01:20:38 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:26:23.555 01:20:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:23.555 01:20:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:23.555 01:20:38 -- common/autotest_common.sh@10 -- # set +x 00:26:23.555 ************************************ 00:26:23.555 START TEST dma 00:26:23.555 ************************************ 00:26:23.555 01:20:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:26:23.814 * Looking for test storage... 00:26:23.814 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:23.814 01:20:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:23.814 01:20:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:23.814 01:20:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:23.814 01:20:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:23.814 01:20:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:23.814 01:20:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:23.814 01:20:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:23.814 01:20:38 -- scripts/common.sh@335 -- # IFS=.-: 00:26:23.814 01:20:38 -- scripts/common.sh@335 -- # read -ra ver1 00:26:23.814 01:20:38 -- scripts/common.sh@336 -- # IFS=.-: 00:26:23.814 01:20:38 -- scripts/common.sh@336 -- # read -ra ver2 00:26:23.814 01:20:38 -- scripts/common.sh@337 -- # local 'op=<' 00:26:23.814 01:20:38 -- scripts/common.sh@339 -- # ver1_l=2 00:26:23.814 01:20:38 -- scripts/common.sh@340 -- # ver2_l=1 00:26:23.814 01:20:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:23.814 01:20:38 -- scripts/common.sh@343 -- # case "$op" in 00:26:23.814 01:20:38 -- scripts/common.sh@344 -- # : 1 00:26:23.814 01:20:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:23.814 01:20:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:23.814 01:20:38 -- scripts/common.sh@364 -- # decimal 1 00:26:23.814 01:20:38 -- scripts/common.sh@352 -- # local d=1 00:26:23.814 01:20:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:23.814 01:20:38 -- scripts/common.sh@354 -- # echo 1 00:26:23.814 01:20:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:23.814 01:20:38 -- scripts/common.sh@365 -- # decimal 2 00:26:23.814 01:20:38 -- scripts/common.sh@352 -- # local d=2 00:26:23.814 01:20:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:23.814 01:20:38 -- scripts/common.sh@354 -- # echo 2 00:26:23.814 01:20:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:23.814 01:20:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:23.814 01:20:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:23.814 01:20:38 -- scripts/common.sh@367 -- # return 0 00:26:23.814 01:20:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:23.814 01:20:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:23.814 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:23.814 --rc genhtml_branch_coverage=1 00:26:23.814 --rc genhtml_function_coverage=1 00:26:23.814 --rc genhtml_legend=1 00:26:23.814 --rc geninfo_all_blocks=1 00:26:23.814 --rc geninfo_unexecuted_blocks=1 00:26:23.814 00:26:23.814 ' 00:26:23.814 01:20:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:23.814 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:23.814 --rc genhtml_branch_coverage=1 00:26:23.814 --rc genhtml_function_coverage=1 00:26:23.814 --rc genhtml_legend=1 00:26:23.814 --rc geninfo_all_blocks=1 00:26:23.814 --rc geninfo_unexecuted_blocks=1 00:26:23.814 00:26:23.814 ' 00:26:23.814 01:20:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:23.814 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:23.814 --rc genhtml_branch_coverage=1 00:26:23.814 --rc genhtml_function_coverage=1 00:26:23.814 --rc genhtml_legend=1 00:26:23.814 --rc geninfo_all_blocks=1 00:26:23.814 --rc geninfo_unexecuted_blocks=1 00:26:23.814 00:26:23.814 ' 00:26:23.814 01:20:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:23.814 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:23.814 --rc genhtml_branch_coverage=1 00:26:23.814 --rc genhtml_function_coverage=1 00:26:23.814 --rc genhtml_legend=1 00:26:23.814 --rc geninfo_all_blocks=1 00:26:23.814 --rc geninfo_unexecuted_blocks=1 00:26:23.814 00:26:23.814 ' 00:26:23.814 01:20:38 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:23.814 01:20:38 -- nvmf/common.sh@7 -- # uname -s 00:26:23.814 01:20:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:23.814 01:20:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:23.814 01:20:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:23.814 01:20:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:23.814 01:20:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:23.814 01:20:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:23.814 01:20:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:23.814 01:20:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:23.814 01:20:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:23.814 01:20:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:23.814 01:20:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:23.814 01:20:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:23.814 01:20:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:23.814 01:20:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:23.814 01:20:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:23.814 01:20:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:23.814 01:20:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:23.814 01:20:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:23.814 01:20:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:23.814 01:20:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:23.815 01:20:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:23.815 01:20:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:23.815 01:20:38 -- paths/export.sh@5 -- # export PATH 00:26:23.815 01:20:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:23.815 01:20:38 -- nvmf/common.sh@46 -- # : 0 00:26:23.815 01:20:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:23.815 01:20:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:23.815 01:20:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:23.815 01:20:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:23.815 01:20:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:23.815 01:20:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:23.815 01:20:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:23.815 01:20:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:23.815 01:20:38 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:26:23.815 01:20:38 -- host/dma.sh@13 -- # exit 0 00:26:23.815 00:26:23.815 real 0m0.167s 00:26:23.815 user 0m0.113s 00:26:23.815 sys 0m0.063s 00:26:23.815 01:20:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:23.815 01:20:38 -- common/autotest_common.sh@10 -- # set +x 00:26:23.815 ************************************ 00:26:23.815 END TEST dma 00:26:23.815 ************************************ 00:26:23.815 01:20:38 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:26:23.815 01:20:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:23.815 01:20:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:23.815 01:20:38 -- common/autotest_common.sh@10 -- # set +x 00:26:23.815 ************************************ 00:26:23.815 START TEST nvmf_identify 00:26:23.815 ************************************ 00:26:23.815 01:20:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:26:23.815 * Looking for test storage... 00:26:23.815 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:23.815 01:20:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:23.815 01:20:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:23.815 01:20:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:24.073 01:20:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:24.073 01:20:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:24.073 01:20:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:24.073 01:20:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:24.073 01:20:38 -- scripts/common.sh@335 -- # IFS=.-: 00:26:24.073 01:20:38 -- scripts/common.sh@335 -- # read -ra ver1 00:26:24.073 01:20:38 -- scripts/common.sh@336 -- # IFS=.-: 00:26:24.073 01:20:38 -- scripts/common.sh@336 -- # read -ra ver2 00:26:24.073 01:20:38 -- scripts/common.sh@337 -- # local 'op=<' 00:26:24.073 01:20:38 -- scripts/common.sh@339 -- # ver1_l=2 00:26:24.073 01:20:38 -- scripts/common.sh@340 -- # ver2_l=1 00:26:24.073 01:20:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:24.073 01:20:38 -- scripts/common.sh@343 -- # case "$op" in 00:26:24.073 01:20:38 -- scripts/common.sh@344 -- # : 1 00:26:24.073 01:20:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:24.073 01:20:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:24.073 01:20:38 -- scripts/common.sh@364 -- # decimal 1 00:26:24.073 01:20:38 -- scripts/common.sh@352 -- # local d=1 00:26:24.073 01:20:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:24.074 01:20:38 -- scripts/common.sh@354 -- # echo 1 00:26:24.074 01:20:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:24.074 01:20:38 -- scripts/common.sh@365 -- # decimal 2 00:26:24.074 01:20:38 -- scripts/common.sh@352 -- # local d=2 00:26:24.074 01:20:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:24.074 01:20:38 -- scripts/common.sh@354 -- # echo 2 00:26:24.074 01:20:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:24.074 01:20:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:24.074 01:20:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:24.074 01:20:38 -- scripts/common.sh@367 -- # return 0 00:26:24.074 01:20:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:24.074 01:20:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:24.074 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:24.074 --rc genhtml_branch_coverage=1 00:26:24.074 --rc genhtml_function_coverage=1 00:26:24.074 --rc genhtml_legend=1 00:26:24.074 --rc geninfo_all_blocks=1 00:26:24.074 --rc geninfo_unexecuted_blocks=1 00:26:24.074 00:26:24.074 ' 00:26:24.074 01:20:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:24.074 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:24.074 --rc genhtml_branch_coverage=1 00:26:24.074 --rc genhtml_function_coverage=1 00:26:24.074 --rc genhtml_legend=1 00:26:24.074 --rc geninfo_all_blocks=1 00:26:24.074 --rc geninfo_unexecuted_blocks=1 00:26:24.074 00:26:24.074 ' 00:26:24.074 01:20:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:24.074 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:24.074 --rc genhtml_branch_coverage=1 00:26:24.074 --rc genhtml_function_coverage=1 00:26:24.074 --rc genhtml_legend=1 00:26:24.074 --rc geninfo_all_blocks=1 00:26:24.074 --rc geninfo_unexecuted_blocks=1 00:26:24.074 00:26:24.074 ' 00:26:24.074 01:20:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:24.074 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:24.074 --rc genhtml_branch_coverage=1 00:26:24.074 --rc genhtml_function_coverage=1 00:26:24.074 --rc genhtml_legend=1 00:26:24.074 --rc geninfo_all_blocks=1 00:26:24.074 --rc geninfo_unexecuted_blocks=1 00:26:24.074 00:26:24.074 ' 00:26:24.074 01:20:38 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:24.074 01:20:38 -- nvmf/common.sh@7 -- # uname -s 00:26:24.074 01:20:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:24.074 01:20:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:24.074 01:20:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:24.074 01:20:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:24.074 01:20:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:24.074 01:20:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:24.074 01:20:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:24.074 01:20:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:24.074 01:20:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:24.074 01:20:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:24.074 01:20:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:24.074 01:20:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:24.074 01:20:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:24.074 01:20:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:24.074 01:20:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:24.074 01:20:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:24.074 01:20:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:24.074 01:20:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:24.074 01:20:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:24.074 01:20:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:24.074 01:20:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:24.074 01:20:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:24.074 01:20:38 -- paths/export.sh@5 -- # export PATH 00:26:24.074 01:20:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:24.074 01:20:38 -- nvmf/common.sh@46 -- # : 0 00:26:24.074 01:20:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:24.074 01:20:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:24.074 01:20:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:24.074 01:20:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:24.074 01:20:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:24.074 01:20:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:24.074 01:20:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:24.074 01:20:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:24.074 01:20:38 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:24.074 01:20:38 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:24.074 01:20:38 -- host/identify.sh@14 -- # nvmftestinit 00:26:24.074 01:20:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:24.074 01:20:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:24.074 01:20:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:24.074 01:20:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:24.074 01:20:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:24.074 01:20:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:24.074 01:20:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:24.074 01:20:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:24.074 01:20:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:24.074 01:20:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:24.074 01:20:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:24.074 01:20:38 -- common/autotest_common.sh@10 -- # set +x 00:26:25.978 01:20:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:25.978 01:20:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:25.978 01:20:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:25.978 01:20:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:25.978 01:20:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:25.978 01:20:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:25.978 01:20:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:25.978 01:20:40 -- nvmf/common.sh@294 -- # net_devs=() 00:26:25.978 01:20:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:25.978 01:20:40 -- nvmf/common.sh@295 -- # e810=() 00:26:25.978 01:20:40 -- nvmf/common.sh@295 -- # local -ga e810 00:26:25.978 01:20:40 -- nvmf/common.sh@296 -- # x722=() 00:26:25.978 01:20:40 -- nvmf/common.sh@296 -- # local -ga x722 00:26:25.978 01:20:40 -- nvmf/common.sh@297 -- # mlx=() 00:26:25.978 01:20:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:25.978 01:20:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:25.978 01:20:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:25.978 01:20:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:25.978 01:20:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:25.978 01:20:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:25.978 01:20:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:25.978 01:20:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:25.978 01:20:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:25.978 01:20:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:25.978 01:20:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:25.978 01:20:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:25.978 01:20:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:25.978 01:20:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:25.978 01:20:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:25.978 01:20:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:25.978 01:20:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:25.978 01:20:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:25.978 01:20:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:25.978 01:20:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:25.978 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:25.978 01:20:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:25.978 01:20:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:25.978 01:20:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:25.978 01:20:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:25.978 01:20:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:25.978 01:20:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:25.978 01:20:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:25.978 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:25.978 01:20:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:25.978 01:20:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:25.978 01:20:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:25.978 01:20:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:25.978 01:20:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:25.978 01:20:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:25.978 01:20:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:25.978 01:20:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:25.978 01:20:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:25.978 01:20:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:25.978 01:20:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:25.978 01:20:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:25.978 01:20:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:25.978 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:25.978 01:20:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:25.978 01:20:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:25.978 01:20:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:25.978 01:20:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:25.978 01:20:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:25.978 01:20:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:25.978 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:25.978 01:20:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:25.978 01:20:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:25.978 01:20:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:25.978 01:20:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:25.978 01:20:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:25.978 01:20:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:25.978 01:20:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:25.978 01:20:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:25.978 01:20:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:25.978 01:20:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:25.978 01:20:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:25.978 01:20:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:25.978 01:20:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:25.978 01:20:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:25.978 01:20:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:25.978 01:20:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:25.978 01:20:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:25.978 01:20:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:25.978 01:20:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:26.237 01:20:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:26.237 01:20:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:26.238 01:20:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:26.238 01:20:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:26.238 01:20:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:26.238 01:20:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:26.238 01:20:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:26.238 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:26.238 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.336 ms 00:26:26.238 00:26:26.238 --- 10.0.0.2 ping statistics --- 00:26:26.238 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:26.238 rtt min/avg/max/mdev = 0.336/0.336/0.336/0.000 ms 00:26:26.238 01:20:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:26.238 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:26.238 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.130 ms 00:26:26.238 00:26:26.238 --- 10.0.0.1 ping statistics --- 00:26:26.238 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:26.238 rtt min/avg/max/mdev = 0.130/0.130/0.130/0.000 ms 00:26:26.238 01:20:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:26.238 01:20:40 -- nvmf/common.sh@410 -- # return 0 00:26:26.238 01:20:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:26.238 01:20:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:26.238 01:20:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:26.238 01:20:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:26.238 01:20:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:26.238 01:20:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:26.238 01:20:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:26.238 01:20:40 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:26:26.238 01:20:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:26.238 01:20:40 -- common/autotest_common.sh@10 -- # set +x 00:26:26.238 01:20:40 -- host/identify.sh@19 -- # nvmfpid=2122233 00:26:26.238 01:20:40 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:26.238 01:20:40 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:26.238 01:20:40 -- host/identify.sh@23 -- # waitforlisten 2122233 00:26:26.238 01:20:40 -- common/autotest_common.sh@829 -- # '[' -z 2122233 ']' 00:26:26.238 01:20:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:26.238 01:20:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:26.238 01:20:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:26.238 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:26.238 01:20:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:26.238 01:20:40 -- common/autotest_common.sh@10 -- # set +x 00:26:26.238 [2024-11-28 01:20:40.774376] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:26.238 [2024-11-28 01:20:40.774466] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:26.238 EAL: No free 2048 kB hugepages reported on node 1 00:26:26.496 [2024-11-28 01:20:40.842248] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:26.496 [2024-11-28 01:20:40.929785] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:26.496 [2024-11-28 01:20:40.929949] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:26.496 [2024-11-28 01:20:40.929967] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:26.496 [2024-11-28 01:20:40.929980] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:26.496 [2024-11-28 01:20:40.930029] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:26.496 [2024-11-28 01:20:40.930059] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:26.496 [2024-11-28 01:20:40.930116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:26.496 [2024-11-28 01:20:40.930118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:27.432 01:20:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:27.432 01:20:41 -- common/autotest_common.sh@862 -- # return 0 00:26:27.432 01:20:41 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:27.432 01:20:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.432 01:20:41 -- common/autotest_common.sh@10 -- # set +x 00:26:27.432 [2024-11-28 01:20:41.759133] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:27.432 01:20:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.432 01:20:41 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:26:27.432 01:20:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:27.432 01:20:41 -- common/autotest_common.sh@10 -- # set +x 00:26:27.432 01:20:41 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:27.432 01:20:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.432 01:20:41 -- common/autotest_common.sh@10 -- # set +x 00:26:27.432 Malloc0 00:26:27.432 01:20:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.432 01:20:41 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:27.432 01:20:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.432 01:20:41 -- common/autotest_common.sh@10 -- # set +x 00:26:27.432 01:20:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.432 01:20:41 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:26:27.432 01:20:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.432 01:20:41 -- common/autotest_common.sh@10 -- # set +x 00:26:27.432 01:20:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.432 01:20:41 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:27.432 01:20:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.432 01:20:41 -- common/autotest_common.sh@10 -- # set +x 00:26:27.432 [2024-11-28 01:20:41.836244] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:27.432 01:20:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.432 01:20:41 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:27.432 01:20:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.432 01:20:41 -- common/autotest_common.sh@10 -- # set +x 00:26:27.432 01:20:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.432 01:20:41 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:26:27.432 01:20:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.432 01:20:41 -- common/autotest_common.sh@10 -- # set +x 00:26:27.432 [2024-11-28 01:20:41.851988] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:27.432 [ 00:26:27.432 { 00:26:27.432 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:27.432 "subtype": "Discovery", 00:26:27.432 "listen_addresses": [ 00:26:27.432 { 00:26:27.432 "transport": "TCP", 00:26:27.432 "trtype": "TCP", 00:26:27.432 "adrfam": "IPv4", 00:26:27.432 "traddr": "10.0.0.2", 00:26:27.432 "trsvcid": "4420" 00:26:27.432 } 00:26:27.432 ], 00:26:27.432 "allow_any_host": true, 00:26:27.432 "hosts": [] 00:26:27.432 }, 00:26:27.432 { 00:26:27.432 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:27.432 "subtype": "NVMe", 00:26:27.432 "listen_addresses": [ 00:26:27.432 { 00:26:27.432 "transport": "TCP", 00:26:27.432 "trtype": "TCP", 00:26:27.432 "adrfam": "IPv4", 00:26:27.432 "traddr": "10.0.0.2", 00:26:27.432 "trsvcid": "4420" 00:26:27.432 } 00:26:27.432 ], 00:26:27.432 "allow_any_host": true, 00:26:27.432 "hosts": [], 00:26:27.432 "serial_number": "SPDK00000000000001", 00:26:27.432 "model_number": "SPDK bdev Controller", 00:26:27.432 "max_namespaces": 32, 00:26:27.432 "min_cntlid": 1, 00:26:27.432 "max_cntlid": 65519, 00:26:27.432 "namespaces": [ 00:26:27.432 { 00:26:27.432 "nsid": 1, 00:26:27.432 "bdev_name": "Malloc0", 00:26:27.432 "name": "Malloc0", 00:26:27.432 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:26:27.432 "eui64": "ABCDEF0123456789", 00:26:27.432 "uuid": "ffe29761-dd2c-45b8-8e65-63188a088f74" 00:26:27.432 } 00:26:27.432 ] 00:26:27.432 } 00:26:27.432 ] 00:26:27.432 01:20:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.432 01:20:41 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:26:27.432 [2024-11-28 01:20:41.877325] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:27.432 [2024-11-28 01:20:41.877365] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2122393 ] 00:26:27.432 EAL: No free 2048 kB hugepages reported on node 1 00:26:27.432 [2024-11-28 01:20:41.908787] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:26:27.432 [2024-11-28 01:20:41.908875] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:27.432 [2024-11-28 01:20:41.908886] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:27.432 [2024-11-28 01:20:41.908903] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:27.432 [2024-11-28 01:20:41.908916] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:27.432 [2024-11-28 01:20:41.912578] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:26:27.432 [2024-11-28 01:20:41.912645] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1404420 0 00:26:27.432 [2024-11-28 01:20:41.920544] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:27.432 [2024-11-28 01:20:41.920566] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:27.432 [2024-11-28 01:20:41.920575] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:27.432 [2024-11-28 01:20:41.920581] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:27.432 [2024-11-28 01:20:41.920636] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.432 [2024-11-28 01:20:41.920650] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.432 [2024-11-28 01:20:41.920658] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1404420) 00:26:27.432 [2024-11-28 01:20:41.920677] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:27.432 [2024-11-28 01:20:41.920709] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469b00, cid 0, qid 0 00:26:27.432 [2024-11-28 01:20:41.928536] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.432 [2024-11-28 01:20:41.928554] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.432 [2024-11-28 01:20:41.928562] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.432 [2024-11-28 01:20:41.928570] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1469b00) on tqpair=0x1404420 00:26:27.432 [2024-11-28 01:20:41.928592] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:27.432 [2024-11-28 01:20:41.928603] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:26:27.432 [2024-11-28 01:20:41.928612] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:26:27.432 [2024-11-28 01:20:41.928632] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.432 [2024-11-28 01:20:41.928640] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.432 [2024-11-28 01:20:41.928647] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1404420) 00:26:27.432 [2024-11-28 01:20:41.928657] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.432 [2024-11-28 01:20:41.928681] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469b00, cid 0, qid 0 00:26:27.432 [2024-11-28 01:20:41.928842] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.432 [2024-11-28 01:20:41.928857] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.432 [2024-11-28 01:20:41.928864] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.432 [2024-11-28 01:20:41.928870] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1469b00) on tqpair=0x1404420 00:26:27.432 [2024-11-28 01:20:41.928881] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:26:27.433 [2024-11-28 01:20:41.928894] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:26:27.433 [2024-11-28 01:20:41.928906] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.928914] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.928920] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1404420) 00:26:27.433 [2024-11-28 01:20:41.928930] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.433 [2024-11-28 01:20:41.928952] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469b00, cid 0, qid 0 00:26:27.433 [2024-11-28 01:20:41.929049] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.433 [2024-11-28 01:20:41.929064] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.433 [2024-11-28 01:20:41.929070] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.929077] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1469b00) on tqpair=0x1404420 00:26:27.433 [2024-11-28 01:20:41.929087] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:26:27.433 [2024-11-28 01:20:41.929102] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:26:27.433 [2024-11-28 01:20:41.929115] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.929122] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.929128] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1404420) 00:26:27.433 [2024-11-28 01:20:41.929139] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.433 [2024-11-28 01:20:41.929164] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469b00, cid 0, qid 0 00:26:27.433 [2024-11-28 01:20:41.929263] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.433 [2024-11-28 01:20:41.929278] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.433 [2024-11-28 01:20:41.929284] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.929291] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1469b00) on tqpair=0x1404420 00:26:27.433 [2024-11-28 01:20:41.929301] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:27.433 [2024-11-28 01:20:41.929318] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.929326] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.929333] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1404420) 00:26:27.433 [2024-11-28 01:20:41.929343] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.433 [2024-11-28 01:20:41.929364] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469b00, cid 0, qid 0 00:26:27.433 [2024-11-28 01:20:41.929460] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.433 [2024-11-28 01:20:41.929475] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.433 [2024-11-28 01:20:41.929481] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.929488] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1469b00) on tqpair=0x1404420 00:26:27.433 [2024-11-28 01:20:41.929497] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:26:27.433 [2024-11-28 01:20:41.929506] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:26:27.433 [2024-11-28 01:20:41.929519] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:27.433 [2024-11-28 01:20:41.929637] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:26:27.433 [2024-11-28 01:20:41.929646] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:27.433 [2024-11-28 01:20:41.929662] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.929669] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.929675] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1404420) 00:26:27.433 [2024-11-28 01:20:41.929686] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.433 [2024-11-28 01:20:41.929721] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469b00, cid 0, qid 0 00:26:27.433 [2024-11-28 01:20:41.929914] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.433 [2024-11-28 01:20:41.929926] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.433 [2024-11-28 01:20:41.929933] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.929939] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1469b00) on tqpair=0x1404420 00:26:27.433 [2024-11-28 01:20:41.929949] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:27.433 [2024-11-28 01:20:41.929965] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.929974] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.929980] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1404420) 00:26:27.433 [2024-11-28 01:20:41.929994] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.433 [2024-11-28 01:20:41.930016] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469b00, cid 0, qid 0 00:26:27.433 [2024-11-28 01:20:41.930126] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.433 [2024-11-28 01:20:41.930140] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.433 [2024-11-28 01:20:41.930147] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.930153] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1469b00) on tqpair=0x1404420 00:26:27.433 [2024-11-28 01:20:41.930162] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:27.433 [2024-11-28 01:20:41.930170] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:26:27.433 [2024-11-28 01:20:41.930183] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:26:27.433 [2024-11-28 01:20:41.930204] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:26:27.433 [2024-11-28 01:20:41.930220] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.930227] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.930233] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1404420) 00:26:27.433 [2024-11-28 01:20:41.930244] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.433 [2024-11-28 01:20:41.930265] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469b00, cid 0, qid 0 00:26:27.433 [2024-11-28 01:20:41.930423] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:27.433 [2024-11-28 01:20:41.930438] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:27.433 [2024-11-28 01:20:41.930445] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.930451] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1404420): datao=0, datal=4096, cccid=0 00:26:27.433 [2024-11-28 01:20:41.930459] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1469b00) on tqpair(0x1404420): expected_datao=0, payload_size=4096 00:26:27.433 [2024-11-28 01:20:41.930471] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.930480] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.930492] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.433 [2024-11-28 01:20:41.930501] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.433 [2024-11-28 01:20:41.930508] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.930514] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1469b00) on tqpair=0x1404420 00:26:27.433 [2024-11-28 01:20:41.930537] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:26:27.433 [2024-11-28 01:20:41.930549] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:26:27.433 [2024-11-28 01:20:41.930556] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:26:27.433 [2024-11-28 01:20:41.930565] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:26:27.433 [2024-11-28 01:20:41.930572] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:26:27.433 [2024-11-28 01:20:41.930579] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:26:27.433 [2024-11-28 01:20:41.930603] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:26:27.433 [2024-11-28 01:20:41.930617] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.930625] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.930631] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1404420) 00:26:27.433 [2024-11-28 01:20:41.930642] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:27.433 [2024-11-28 01:20:41.930663] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469b00, cid 0, qid 0 00:26:27.433 [2024-11-28 01:20:41.930774] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.433 [2024-11-28 01:20:41.930789] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.433 [2024-11-28 01:20:41.930796] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.930802] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1469b00) on tqpair=0x1404420 00:26:27.433 [2024-11-28 01:20:41.930817] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.930824] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.930831] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1404420) 00:26:27.433 [2024-11-28 01:20:41.930840] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:27.433 [2024-11-28 01:20:41.930850] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.930856] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.433 [2024-11-28 01:20:41.930862] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1404420) 00:26:27.434 [2024-11-28 01:20:41.930871] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:27.434 [2024-11-28 01:20:41.930880] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.930887] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.930893] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1404420) 00:26:27.434 [2024-11-28 01:20:41.930902] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:27.434 [2024-11-28 01:20:41.930911] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.930917] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.930923] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404420) 00:26:27.434 [2024-11-28 01:20:41.930932] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:27.434 [2024-11-28 01:20:41.930955] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:26:27.434 [2024-11-28 01:20:41.930975] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:27.434 [2024-11-28 01:20:41.930987] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.930994] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.931000] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1404420) 00:26:27.434 [2024-11-28 01:20:41.931010] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.434 [2024-11-28 01:20:41.931032] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469b00, cid 0, qid 0 00:26:27.434 [2024-11-28 01:20:41.931061] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469c60, cid 1, qid 0 00:26:27.434 [2024-11-28 01:20:41.931070] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469dc0, cid 2, qid 0 00:26:27.434 [2024-11-28 01:20:41.931077] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469f20, cid 3, qid 0 00:26:27.434 [2024-11-28 01:20:41.931085] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x146a080, cid 4, qid 0 00:26:27.434 [2024-11-28 01:20:41.931238] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.434 [2024-11-28 01:20:41.931253] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.434 [2024-11-28 01:20:41.931260] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.931266] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x146a080) on tqpair=0x1404420 00:26:27.434 [2024-11-28 01:20:41.931277] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:26:27.434 [2024-11-28 01:20:41.931286] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:26:27.434 [2024-11-28 01:20:41.931303] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.931312] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.931318] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1404420) 00:26:27.434 [2024-11-28 01:20:41.931328] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.434 [2024-11-28 01:20:41.931363] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x146a080, cid 4, qid 0 00:26:27.434 [2024-11-28 01:20:41.931574] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:27.434 [2024-11-28 01:20:41.931588] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:27.434 [2024-11-28 01:20:41.931595] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.931601] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1404420): datao=0, datal=4096, cccid=4 00:26:27.434 [2024-11-28 01:20:41.931608] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x146a080) on tqpair(0x1404420): expected_datao=0, payload_size=4096 00:26:27.434 [2024-11-28 01:20:41.931625] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.931633] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.974535] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.434 [2024-11-28 01:20:41.974554] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.434 [2024-11-28 01:20:41.974561] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.974568] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x146a080) on tqpair=0x1404420 00:26:27.434 [2024-11-28 01:20:41.974590] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:26:27.434 [2024-11-28 01:20:41.974631] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.974641] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.974647] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1404420) 00:26:27.434 [2024-11-28 01:20:41.974658] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.434 [2024-11-28 01:20:41.974670] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.974677] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.974683] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1404420) 00:26:27.434 [2024-11-28 01:20:41.974691] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:27.434 [2024-11-28 01:20:41.974723] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x146a080, cid 4, qid 0 00:26:27.434 [2024-11-28 01:20:41.974751] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x146a1e0, cid 5, qid 0 00:26:27.434 [2024-11-28 01:20:41.974956] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:27.434 [2024-11-28 01:20:41.974971] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:27.434 [2024-11-28 01:20:41.974978] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.974984] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1404420): datao=0, datal=1024, cccid=4 00:26:27.434 [2024-11-28 01:20:41.974991] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x146a080) on tqpair(0x1404420): expected_datao=0, payload_size=1024 00:26:27.434 [2024-11-28 01:20:41.975002] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.975009] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.975017] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.434 [2024-11-28 01:20:41.975026] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.434 [2024-11-28 01:20:41.975032] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:41.975054] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x146a1e0) on tqpair=0x1404420 00:26:27.434 [2024-11-28 01:20:42.019542] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.434 [2024-11-28 01:20:42.019560] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.434 [2024-11-28 01:20:42.019568] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:42.019575] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x146a080) on tqpair=0x1404420 00:26:27.434 [2024-11-28 01:20:42.019595] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:42.019603] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:42.019609] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1404420) 00:26:27.434 [2024-11-28 01:20:42.019620] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.434 [2024-11-28 01:20:42.019649] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x146a080, cid 4, qid 0 00:26:27.434 [2024-11-28 01:20:42.019809] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:27.434 [2024-11-28 01:20:42.019824] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:27.434 [2024-11-28 01:20:42.019831] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:42.019838] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1404420): datao=0, datal=3072, cccid=4 00:26:27.434 [2024-11-28 01:20:42.019845] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x146a080) on tqpair(0x1404420): expected_datao=0, payload_size=3072 00:26:27.434 [2024-11-28 01:20:42.019856] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:42.019863] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:42.019875] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.434 [2024-11-28 01:20:42.019885] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.434 [2024-11-28 01:20:42.019891] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:42.019897] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x146a080) on tqpair=0x1404420 00:26:27.434 [2024-11-28 01:20:42.019913] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:42.019922] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:42.019928] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1404420) 00:26:27.434 [2024-11-28 01:20:42.019939] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.434 [2024-11-28 01:20:42.019972] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x146a080, cid 4, qid 0 00:26:27.434 [2024-11-28 01:20:42.020092] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:27.434 [2024-11-28 01:20:42.020107] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:27.434 [2024-11-28 01:20:42.020114] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:42.020120] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1404420): datao=0, datal=8, cccid=4 00:26:27.434 [2024-11-28 01:20:42.020128] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x146a080) on tqpair(0x1404420): expected_datao=0, payload_size=8 00:26:27.434 [2024-11-28 01:20:42.020138] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:27.434 [2024-11-28 01:20:42.020145] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:27.696 [2024-11-28 01:20:42.060671] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.696 [2024-11-28 01:20:42.060690] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.696 [2024-11-28 01:20:42.060697] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.696 [2024-11-28 01:20:42.060704] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x146a080) on tqpair=0x1404420 00:26:27.696 ===================================================== 00:26:27.696 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:26:27.696 ===================================================== 00:26:27.696 Controller Capabilities/Features 00:26:27.696 ================================ 00:26:27.696 Vendor ID: 0000 00:26:27.696 Subsystem Vendor ID: 0000 00:26:27.696 Serial Number: .................... 00:26:27.696 Model Number: ........................................ 00:26:27.696 Firmware Version: 24.01.1 00:26:27.696 Recommended Arb Burst: 0 00:26:27.696 IEEE OUI Identifier: 00 00 00 00:26:27.696 Multi-path I/O 00:26:27.696 May have multiple subsystem ports: No 00:26:27.696 May have multiple controllers: No 00:26:27.696 Associated with SR-IOV VF: No 00:26:27.696 Max Data Transfer Size: 131072 00:26:27.696 Max Number of Namespaces: 0 00:26:27.696 Max Number of I/O Queues: 1024 00:26:27.696 NVMe Specification Version (VS): 1.3 00:26:27.696 NVMe Specification Version (Identify): 1.3 00:26:27.696 Maximum Queue Entries: 128 00:26:27.696 Contiguous Queues Required: Yes 00:26:27.696 Arbitration Mechanisms Supported 00:26:27.696 Weighted Round Robin: Not Supported 00:26:27.696 Vendor Specific: Not Supported 00:26:27.696 Reset Timeout: 15000 ms 00:26:27.696 Doorbell Stride: 4 bytes 00:26:27.696 NVM Subsystem Reset: Not Supported 00:26:27.696 Command Sets Supported 00:26:27.697 NVM Command Set: Supported 00:26:27.697 Boot Partition: Not Supported 00:26:27.697 Memory Page Size Minimum: 4096 bytes 00:26:27.697 Memory Page Size Maximum: 4096 bytes 00:26:27.697 Persistent Memory Region: Not Supported 00:26:27.697 Optional Asynchronous Events Supported 00:26:27.697 Namespace Attribute Notices: Not Supported 00:26:27.697 Firmware Activation Notices: Not Supported 00:26:27.697 ANA Change Notices: Not Supported 00:26:27.697 PLE Aggregate Log Change Notices: Not Supported 00:26:27.697 LBA Status Info Alert Notices: Not Supported 00:26:27.697 EGE Aggregate Log Change Notices: Not Supported 00:26:27.697 Normal NVM Subsystem Shutdown event: Not Supported 00:26:27.697 Zone Descriptor Change Notices: Not Supported 00:26:27.697 Discovery Log Change Notices: Supported 00:26:27.697 Controller Attributes 00:26:27.697 128-bit Host Identifier: Not Supported 00:26:27.697 Non-Operational Permissive Mode: Not Supported 00:26:27.697 NVM Sets: Not Supported 00:26:27.697 Read Recovery Levels: Not Supported 00:26:27.697 Endurance Groups: Not Supported 00:26:27.697 Predictable Latency Mode: Not Supported 00:26:27.697 Traffic Based Keep ALive: Not Supported 00:26:27.697 Namespace Granularity: Not Supported 00:26:27.697 SQ Associations: Not Supported 00:26:27.697 UUID List: Not Supported 00:26:27.697 Multi-Domain Subsystem: Not Supported 00:26:27.697 Fixed Capacity Management: Not Supported 00:26:27.697 Variable Capacity Management: Not Supported 00:26:27.697 Delete Endurance Group: Not Supported 00:26:27.697 Delete NVM Set: Not Supported 00:26:27.697 Extended LBA Formats Supported: Not Supported 00:26:27.697 Flexible Data Placement Supported: Not Supported 00:26:27.697 00:26:27.697 Controller Memory Buffer Support 00:26:27.697 ================================ 00:26:27.697 Supported: No 00:26:27.697 00:26:27.697 Persistent Memory Region Support 00:26:27.697 ================================ 00:26:27.697 Supported: No 00:26:27.697 00:26:27.697 Admin Command Set Attributes 00:26:27.697 ============================ 00:26:27.697 Security Send/Receive: Not Supported 00:26:27.697 Format NVM: Not Supported 00:26:27.697 Firmware Activate/Download: Not Supported 00:26:27.697 Namespace Management: Not Supported 00:26:27.697 Device Self-Test: Not Supported 00:26:27.697 Directives: Not Supported 00:26:27.697 NVMe-MI: Not Supported 00:26:27.697 Virtualization Management: Not Supported 00:26:27.697 Doorbell Buffer Config: Not Supported 00:26:27.697 Get LBA Status Capability: Not Supported 00:26:27.697 Command & Feature Lockdown Capability: Not Supported 00:26:27.697 Abort Command Limit: 1 00:26:27.697 Async Event Request Limit: 4 00:26:27.697 Number of Firmware Slots: N/A 00:26:27.697 Firmware Slot 1 Read-Only: N/A 00:26:27.697 Firmware Activation Without Reset: N/A 00:26:27.697 Multiple Update Detection Support: N/A 00:26:27.697 Firmware Update Granularity: No Information Provided 00:26:27.697 Per-Namespace SMART Log: No 00:26:27.697 Asymmetric Namespace Access Log Page: Not Supported 00:26:27.697 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:26:27.697 Command Effects Log Page: Not Supported 00:26:27.697 Get Log Page Extended Data: Supported 00:26:27.697 Telemetry Log Pages: Not Supported 00:26:27.697 Persistent Event Log Pages: Not Supported 00:26:27.697 Supported Log Pages Log Page: May Support 00:26:27.697 Commands Supported & Effects Log Page: Not Supported 00:26:27.697 Feature Identifiers & Effects Log Page:May Support 00:26:27.697 NVMe-MI Commands & Effects Log Page: May Support 00:26:27.697 Data Area 4 for Telemetry Log: Not Supported 00:26:27.697 Error Log Page Entries Supported: 128 00:26:27.697 Keep Alive: Not Supported 00:26:27.697 00:26:27.697 NVM Command Set Attributes 00:26:27.697 ========================== 00:26:27.697 Submission Queue Entry Size 00:26:27.697 Max: 1 00:26:27.697 Min: 1 00:26:27.697 Completion Queue Entry Size 00:26:27.697 Max: 1 00:26:27.697 Min: 1 00:26:27.697 Number of Namespaces: 0 00:26:27.697 Compare Command: Not Supported 00:26:27.697 Write Uncorrectable Command: Not Supported 00:26:27.697 Dataset Management Command: Not Supported 00:26:27.697 Write Zeroes Command: Not Supported 00:26:27.697 Set Features Save Field: Not Supported 00:26:27.697 Reservations: Not Supported 00:26:27.697 Timestamp: Not Supported 00:26:27.697 Copy: Not Supported 00:26:27.697 Volatile Write Cache: Not Present 00:26:27.697 Atomic Write Unit (Normal): 1 00:26:27.697 Atomic Write Unit (PFail): 1 00:26:27.697 Atomic Compare & Write Unit: 1 00:26:27.697 Fused Compare & Write: Supported 00:26:27.697 Scatter-Gather List 00:26:27.697 SGL Command Set: Supported 00:26:27.697 SGL Keyed: Supported 00:26:27.697 SGL Bit Bucket Descriptor: Not Supported 00:26:27.697 SGL Metadata Pointer: Not Supported 00:26:27.697 Oversized SGL: Not Supported 00:26:27.697 SGL Metadata Address: Not Supported 00:26:27.697 SGL Offset: Supported 00:26:27.697 Transport SGL Data Block: Not Supported 00:26:27.697 Replay Protected Memory Block: Not Supported 00:26:27.697 00:26:27.697 Firmware Slot Information 00:26:27.697 ========================= 00:26:27.697 Active slot: 0 00:26:27.697 00:26:27.697 00:26:27.697 Error Log 00:26:27.697 ========= 00:26:27.697 00:26:27.697 Active Namespaces 00:26:27.697 ================= 00:26:27.697 Discovery Log Page 00:26:27.697 ================== 00:26:27.697 Generation Counter: 2 00:26:27.697 Number of Records: 2 00:26:27.697 Record Format: 0 00:26:27.697 00:26:27.697 Discovery Log Entry 0 00:26:27.697 ---------------------- 00:26:27.697 Transport Type: 3 (TCP) 00:26:27.697 Address Family: 1 (IPv4) 00:26:27.697 Subsystem Type: 3 (Current Discovery Subsystem) 00:26:27.697 Entry Flags: 00:26:27.697 Duplicate Returned Information: 1 00:26:27.697 Explicit Persistent Connection Support for Discovery: 1 00:26:27.697 Transport Requirements: 00:26:27.697 Secure Channel: Not Required 00:26:27.697 Port ID: 0 (0x0000) 00:26:27.697 Controller ID: 65535 (0xffff) 00:26:27.697 Admin Max SQ Size: 128 00:26:27.697 Transport Service Identifier: 4420 00:26:27.697 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:26:27.697 Transport Address: 10.0.0.2 00:26:27.697 Discovery Log Entry 1 00:26:27.697 ---------------------- 00:26:27.697 Transport Type: 3 (TCP) 00:26:27.697 Address Family: 1 (IPv4) 00:26:27.697 Subsystem Type: 2 (NVM Subsystem) 00:26:27.697 Entry Flags: 00:26:27.697 Duplicate Returned Information: 0 00:26:27.697 Explicit Persistent Connection Support for Discovery: 0 00:26:27.697 Transport Requirements: 00:26:27.697 Secure Channel: Not Required 00:26:27.697 Port ID: 0 (0x0000) 00:26:27.697 Controller ID: 65535 (0xffff) 00:26:27.697 Admin Max SQ Size: 128 00:26:27.697 Transport Service Identifier: 4420 00:26:27.697 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:26:27.697 Transport Address: 10.0.0.2 [2024-11-28 01:20:42.060830] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:26:27.697 [2024-11-28 01:20:42.060857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:27.697 [2024-11-28 01:20:42.060870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:27.697 [2024-11-28 01:20:42.060880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:27.697 [2024-11-28 01:20:42.060889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:27.697 [2024-11-28 01:20:42.060904] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.697 [2024-11-28 01:20:42.060912] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.697 [2024-11-28 01:20:42.060918] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404420) 00:26:27.697 [2024-11-28 01:20:42.060929] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.697 [2024-11-28 01:20:42.060973] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469f20, cid 3, qid 0 00:26:27.697 [2024-11-28 01:20:42.061143] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.697 [2024-11-28 01:20:42.061158] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.697 [2024-11-28 01:20:42.061165] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.697 [2024-11-28 01:20:42.061172] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1469f20) on tqpair=0x1404420 00:26:27.697 [2024-11-28 01:20:42.061186] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.697 [2024-11-28 01:20:42.061194] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.697 [2024-11-28 01:20:42.061200] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404420) 00:26:27.698 [2024-11-28 01:20:42.061210] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.698 [2024-11-28 01:20:42.061237] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469f20, cid 3, qid 0 00:26:27.698 [2024-11-28 01:20:42.061377] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.698 [2024-11-28 01:20:42.061389] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.698 [2024-11-28 01:20:42.061396] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.061402] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1469f20) on tqpair=0x1404420 00:26:27.698 [2024-11-28 01:20:42.061417] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:26:27.698 [2024-11-28 01:20:42.061426] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:26:27.698 [2024-11-28 01:20:42.061442] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.061451] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.061457] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404420) 00:26:27.698 [2024-11-28 01:20:42.061468] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.698 [2024-11-28 01:20:42.061488] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469f20, cid 3, qid 0 00:26:27.698 [2024-11-28 01:20:42.061599] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.698 [2024-11-28 01:20:42.061614] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.698 [2024-11-28 01:20:42.061621] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.061628] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1469f20) on tqpair=0x1404420 00:26:27.698 [2024-11-28 01:20:42.061647] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.061657] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.061663] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404420) 00:26:27.698 [2024-11-28 01:20:42.061674] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.698 [2024-11-28 01:20:42.061694] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469f20, cid 3, qid 0 00:26:27.698 [2024-11-28 01:20:42.061797] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.698 [2024-11-28 01:20:42.061809] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.698 [2024-11-28 01:20:42.061815] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.061822] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1469f20) on tqpair=0x1404420 00:26:27.698 [2024-11-28 01:20:42.061838] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.061848] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.061854] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404420) 00:26:27.698 [2024-11-28 01:20:42.061864] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.698 [2024-11-28 01:20:42.061885] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469f20, cid 3, qid 0 00:26:27.698 [2024-11-28 01:20:42.061983] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.698 [2024-11-28 01:20:42.061998] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.698 [2024-11-28 01:20:42.062005] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.062011] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1469f20) on tqpair=0x1404420 00:26:27.698 [2024-11-28 01:20:42.062028] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.062038] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.062044] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404420) 00:26:27.698 [2024-11-28 01:20:42.062055] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.698 [2024-11-28 01:20:42.062075] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469f20, cid 3, qid 0 00:26:27.698 [2024-11-28 01:20:42.062181] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.698 [2024-11-28 01:20:42.062197] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.698 [2024-11-28 01:20:42.062205] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.062211] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1469f20) on tqpair=0x1404420 00:26:27.698 [2024-11-28 01:20:42.062229] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.062238] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.062245] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404420) 00:26:27.698 [2024-11-28 01:20:42.062255] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.698 [2024-11-28 01:20:42.062275] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469f20, cid 3, qid 0 00:26:27.698 [2024-11-28 01:20:42.065535] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.698 [2024-11-28 01:20:42.065552] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.698 [2024-11-28 01:20:42.065560] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.065566] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1469f20) on tqpair=0x1404420 00:26:27.698 [2024-11-28 01:20:42.065585] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.065594] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.065600] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404420) 00:26:27.698 [2024-11-28 01:20:42.065611] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.698 [2024-11-28 01:20:42.065633] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1469f20, cid 3, qid 0 00:26:27.698 [2024-11-28 01:20:42.065772] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.698 [2024-11-28 01:20:42.065787] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.698 [2024-11-28 01:20:42.065794] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.065801] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1469f20) on tqpair=0x1404420 00:26:27.698 [2024-11-28 01:20:42.065816] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 4 milliseconds 00:26:27.698 00:26:27.698 01:20:42 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:26:27.698 [2024-11-28 01:20:42.095188] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:27.698 [2024-11-28 01:20:42.095230] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2122395 ] 00:26:27.698 EAL: No free 2048 kB hugepages reported on node 1 00:26:27.698 [2024-11-28 01:20:42.127074] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:26:27.698 [2024-11-28 01:20:42.127120] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:27.698 [2024-11-28 01:20:42.127130] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:27.698 [2024-11-28 01:20:42.127145] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:27.698 [2024-11-28 01:20:42.127157] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:27.698 [2024-11-28 01:20:42.130589] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:26:27.698 [2024-11-28 01:20:42.130650] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0xaab420 0 00:26:27.698 [2024-11-28 01:20:42.138542] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:27.698 [2024-11-28 01:20:42.138562] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:27.698 [2024-11-28 01:20:42.138570] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:27.698 [2024-11-28 01:20:42.138576] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:27.698 [2024-11-28 01:20:42.138615] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.138628] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.138635] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xaab420) 00:26:27.698 [2024-11-28 01:20:42.138648] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:27.698 [2024-11-28 01:20:42.138674] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb10b00, cid 0, qid 0 00:26:27.698 [2024-11-28 01:20:42.146539] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.698 [2024-11-28 01:20:42.146558] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.698 [2024-11-28 01:20:42.146565] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.146572] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb10b00) on tqpair=0xaab420 00:26:27.698 [2024-11-28 01:20:42.146586] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:27.698 [2024-11-28 01:20:42.146600] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:26:27.698 [2024-11-28 01:20:42.146610] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:26:27.698 [2024-11-28 01:20:42.146626] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.146635] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.146641] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xaab420) 00:26:27.698 [2024-11-28 01:20:42.146653] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.698 [2024-11-28 01:20:42.146677] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb10b00, cid 0, qid 0 00:26:27.698 [2024-11-28 01:20:42.146822] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.698 [2024-11-28 01:20:42.146838] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.698 [2024-11-28 01:20:42.146847] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.698 [2024-11-28 01:20:42.146856] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb10b00) on tqpair=0xaab420 00:26:27.698 [2024-11-28 01:20:42.146865] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:26:27.698 [2024-11-28 01:20:42.146879] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:26:27.699 [2024-11-28 01:20:42.146892] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.146903] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.146910] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xaab420) 00:26:27.699 [2024-11-28 01:20:42.146921] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.699 [2024-11-28 01:20:42.146944] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb10b00, cid 0, qid 0 00:26:27.699 [2024-11-28 01:20:42.147043] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.699 [2024-11-28 01:20:42.147059] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.699 [2024-11-28 01:20:42.147066] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.147080] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb10b00) on tqpair=0xaab420 00:26:27.699 [2024-11-28 01:20:42.147090] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:26:27.699 [2024-11-28 01:20:42.147106] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:26:27.699 [2024-11-28 01:20:42.147119] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.147130] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.147137] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xaab420) 00:26:27.699 [2024-11-28 01:20:42.147147] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.699 [2024-11-28 01:20:42.147170] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb10b00, cid 0, qid 0 00:26:27.699 [2024-11-28 01:20:42.147271] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.699 [2024-11-28 01:20:42.147288] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.699 [2024-11-28 01:20:42.147298] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.147304] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb10b00) on tqpair=0xaab420 00:26:27.699 [2024-11-28 01:20:42.147313] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:27.699 [2024-11-28 01:20:42.147331] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.147343] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.147351] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xaab420) 00:26:27.699 [2024-11-28 01:20:42.147362] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.699 [2024-11-28 01:20:42.147384] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb10b00, cid 0, qid 0 00:26:27.699 [2024-11-28 01:20:42.147475] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.699 [2024-11-28 01:20:42.147490] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.699 [2024-11-28 01:20:42.147498] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.147507] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb10b00) on tqpair=0xaab420 00:26:27.699 [2024-11-28 01:20:42.147516] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:26:27.699 [2024-11-28 01:20:42.147530] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:26:27.699 [2024-11-28 01:20:42.147546] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:27.699 [2024-11-28 01:20:42.147660] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:26:27.699 [2024-11-28 01:20:42.147668] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:27.699 [2024-11-28 01:20:42.147680] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.147688] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.147695] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xaab420) 00:26:27.699 [2024-11-28 01:20:42.147705] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.699 [2024-11-28 01:20:42.147742] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb10b00, cid 0, qid 0 00:26:27.699 [2024-11-28 01:20:42.147912] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.699 [2024-11-28 01:20:42.147932] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.699 [2024-11-28 01:20:42.147943] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.147951] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb10b00) on tqpair=0xaab420 00:26:27.699 [2024-11-28 01:20:42.147959] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:27.699 [2024-11-28 01:20:42.147977] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.147987] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.147997] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xaab420) 00:26:27.699 [2024-11-28 01:20:42.148008] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.699 [2024-11-28 01:20:42.148029] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb10b00, cid 0, qid 0 00:26:27.699 [2024-11-28 01:20:42.148121] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.699 [2024-11-28 01:20:42.148136] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.699 [2024-11-28 01:20:42.148143] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.148153] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb10b00) on tqpair=0xaab420 00:26:27.699 [2024-11-28 01:20:42.148161] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:27.699 [2024-11-28 01:20:42.148170] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:26:27.699 [2024-11-28 01:20:42.148184] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:26:27.699 [2024-11-28 01:20:42.148201] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:26:27.699 [2024-11-28 01:20:42.148216] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.148224] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.148230] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xaab420) 00:26:27.699 [2024-11-28 01:20:42.148241] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.699 [2024-11-28 01:20:42.148263] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb10b00, cid 0, qid 0 00:26:27.699 [2024-11-28 01:20:42.148422] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:27.699 [2024-11-28 01:20:42.148442] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:27.699 [2024-11-28 01:20:42.148455] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.148462] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xaab420): datao=0, datal=4096, cccid=0 00:26:27.699 [2024-11-28 01:20:42.148470] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xb10b00) on tqpair(0xaab420): expected_datao=0, payload_size=4096 00:26:27.699 [2024-11-28 01:20:42.148489] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.148498] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.188686] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.699 [2024-11-28 01:20:42.188708] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.699 [2024-11-28 01:20:42.188717] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.188724] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb10b00) on tqpair=0xaab420 00:26:27.699 [2024-11-28 01:20:42.188736] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:26:27.699 [2024-11-28 01:20:42.188749] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:26:27.699 [2024-11-28 01:20:42.188758] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:26:27.699 [2024-11-28 01:20:42.188764] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:26:27.699 [2024-11-28 01:20:42.188772] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:26:27.699 [2024-11-28 01:20:42.188780] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:26:27.699 [2024-11-28 01:20:42.188802] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:26:27.699 [2024-11-28 01:20:42.188818] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.188825] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.188832] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xaab420) 00:26:27.699 [2024-11-28 01:20:42.188843] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:27.699 [2024-11-28 01:20:42.188868] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb10b00, cid 0, qid 0 00:26:27.699 [2024-11-28 01:20:42.188982] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.699 [2024-11-28 01:20:42.188998] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.699 [2024-11-28 01:20:42.189005] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.189011] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb10b00) on tqpair=0xaab420 00:26:27.699 [2024-11-28 01:20:42.189022] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.189030] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.189036] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xaab420) 00:26:27.699 [2024-11-28 01:20:42.189047] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:27.699 [2024-11-28 01:20:42.189057] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.189064] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.189070] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0xaab420) 00:26:27.699 [2024-11-28 01:20:42.189079] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:27.699 [2024-11-28 01:20:42.189088] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.699 [2024-11-28 01:20:42.189095] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.189102] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0xaab420) 00:26:27.700 [2024-11-28 01:20:42.189110] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:27.700 [2024-11-28 01:20:42.189120] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.189127] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.189133] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xaab420) 00:26:27.700 [2024-11-28 01:20:42.189141] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:27.700 [2024-11-28 01:20:42.189151] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:26:27.700 [2024-11-28 01:20:42.189185] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:27.700 [2024-11-28 01:20:42.189203] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.189210] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.189217] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xaab420) 00:26:27.700 [2024-11-28 01:20:42.189227] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.700 [2024-11-28 01:20:42.189265] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb10b00, cid 0, qid 0 00:26:27.700 [2024-11-28 01:20:42.189276] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb10c60, cid 1, qid 0 00:26:27.700 [2024-11-28 01:20:42.189283] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb10dc0, cid 2, qid 0 00:26:27.700 [2024-11-28 01:20:42.189290] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb10f20, cid 3, qid 0 00:26:27.700 [2024-11-28 01:20:42.189313] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb11080, cid 4, qid 0 00:26:27.700 [2024-11-28 01:20:42.192536] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.700 [2024-11-28 01:20:42.192553] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.700 [2024-11-28 01:20:42.192560] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.192567] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb11080) on tqpair=0xaab420 00:26:27.700 [2024-11-28 01:20:42.192575] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:26:27.700 [2024-11-28 01:20:42.192584] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:26:27.700 [2024-11-28 01:20:42.192601] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:26:27.700 [2024-11-28 01:20:42.192621] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:26:27.700 [2024-11-28 01:20:42.192634] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.192641] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.192647] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xaab420) 00:26:27.700 [2024-11-28 01:20:42.192658] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:27.700 [2024-11-28 01:20:42.192680] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb11080, cid 4, qid 0 00:26:27.700 [2024-11-28 01:20:42.192831] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.700 [2024-11-28 01:20:42.192847] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.700 [2024-11-28 01:20:42.192855] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.192865] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb11080) on tqpair=0xaab420 00:26:27.700 [2024-11-28 01:20:42.192932] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:26:27.700 [2024-11-28 01:20:42.192954] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:26:27.700 [2024-11-28 01:20:42.192971] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.192979] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.192985] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xaab420) 00:26:27.700 [2024-11-28 01:20:42.192996] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.700 [2024-11-28 01:20:42.193036] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb11080, cid 4, qid 0 00:26:27.700 [2024-11-28 01:20:42.193227] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:27.700 [2024-11-28 01:20:42.193243] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:27.700 [2024-11-28 01:20:42.193250] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.193257] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xaab420): datao=0, datal=4096, cccid=4 00:26:27.700 [2024-11-28 01:20:42.193269] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xb11080) on tqpair(0xaab420): expected_datao=0, payload_size=4096 00:26:27.700 [2024-11-28 01:20:42.193287] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.193299] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.193312] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.700 [2024-11-28 01:20:42.193322] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.700 [2024-11-28 01:20:42.193329] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.193335] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb11080) on tqpair=0xaab420 00:26:27.700 [2024-11-28 01:20:42.193358] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:26:27.700 [2024-11-28 01:20:42.193380] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:26:27.700 [2024-11-28 01:20:42.193401] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:26:27.700 [2024-11-28 01:20:42.193416] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.193424] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.193430] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xaab420) 00:26:27.700 [2024-11-28 01:20:42.193441] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.700 [2024-11-28 01:20:42.193463] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb11080, cid 4, qid 0 00:26:27.700 [2024-11-28 01:20:42.193609] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:27.700 [2024-11-28 01:20:42.193625] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:27.700 [2024-11-28 01:20:42.193632] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.193639] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xaab420): datao=0, datal=4096, cccid=4 00:26:27.700 [2024-11-28 01:20:42.193649] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xb11080) on tqpair(0xaab420): expected_datao=0, payload_size=4096 00:26:27.700 [2024-11-28 01:20:42.193664] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.193677] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.193695] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.700 [2024-11-28 01:20:42.193707] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.700 [2024-11-28 01:20:42.193714] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.193720] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb11080) on tqpair=0xaab420 00:26:27.700 [2024-11-28 01:20:42.193748] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:26:27.700 [2024-11-28 01:20:42.193770] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:26:27.700 [2024-11-28 01:20:42.193786] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.193794] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.193804] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xaab420) 00:26:27.700 [2024-11-28 01:20:42.193816] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.700 [2024-11-28 01:20:42.193839] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb11080, cid 4, qid 0 00:26:27.700 [2024-11-28 01:20:42.193952] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:27.700 [2024-11-28 01:20:42.193968] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:27.700 [2024-11-28 01:20:42.193978] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.193985] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xaab420): datao=0, datal=4096, cccid=4 00:26:27.700 [2024-11-28 01:20:42.193996] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xb11080) on tqpair(0xaab420): expected_datao=0, payload_size=4096 00:26:27.700 [2024-11-28 01:20:42.194013] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.194027] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.194041] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.700 [2024-11-28 01:20:42.194051] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.700 [2024-11-28 01:20:42.194057] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.700 [2024-11-28 01:20:42.194064] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb11080) on tqpair=0xaab420 00:26:27.700 [2024-11-28 01:20:42.194078] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:26:27.700 [2024-11-28 01:20:42.194095] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:26:27.700 [2024-11-28 01:20:42.194115] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:26:27.700 [2024-11-28 01:20:42.194127] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:26:27.700 [2024-11-28 01:20:42.194136] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:26:27.700 [2024-11-28 01:20:42.194145] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:26:27.700 [2024-11-28 01:20:42.194153] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:26:27.700 [2024-11-28 01:20:42.194162] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:26:27.700 [2024-11-28 01:20:42.194181] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.194190] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.194196] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xaab420) 00:26:27.701 [2024-11-28 01:20:42.194207] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.701 [2024-11-28 01:20:42.194218] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.194240] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.194246] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xaab420) 00:26:27.701 [2024-11-28 01:20:42.194255] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:27.701 [2024-11-28 01:20:42.194280] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb11080, cid 4, qid 0 00:26:27.701 [2024-11-28 01:20:42.194308] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb111e0, cid 5, qid 0 00:26:27.701 [2024-11-28 01:20:42.194455] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.701 [2024-11-28 01:20:42.194471] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.701 [2024-11-28 01:20:42.194481] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.194488] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb11080) on tqpair=0xaab420 00:26:27.701 [2024-11-28 01:20:42.194500] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.701 [2024-11-28 01:20:42.194509] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.701 [2024-11-28 01:20:42.194516] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.194522] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb111e0) on tqpair=0xaab420 00:26:27.701 [2024-11-28 01:20:42.194548] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.194559] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.194566] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xaab420) 00:26:27.701 [2024-11-28 01:20:42.194576] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.701 [2024-11-28 01:20:42.194598] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb111e0, cid 5, qid 0 00:26:27.701 [2024-11-28 01:20:42.194739] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.701 [2024-11-28 01:20:42.194754] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.701 [2024-11-28 01:20:42.194762] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.194768] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb111e0) on tqpair=0xaab420 00:26:27.701 [2024-11-28 01:20:42.194786] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.194797] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.194804] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xaab420) 00:26:27.701 [2024-11-28 01:20:42.194814] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.701 [2024-11-28 01:20:42.194836] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb111e0, cid 5, qid 0 00:26:27.701 [2024-11-28 01:20:42.194937] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.701 [2024-11-28 01:20:42.194953] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.701 [2024-11-28 01:20:42.194959] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.194966] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb111e0) on tqpair=0xaab420 00:26:27.701 [2024-11-28 01:20:42.194985] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.194996] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.195003] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xaab420) 00:26:27.701 [2024-11-28 01:20:42.195013] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.701 [2024-11-28 01:20:42.195037] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb111e0, cid 5, qid 0 00:26:27.701 [2024-11-28 01:20:42.195135] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.701 [2024-11-28 01:20:42.195151] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.701 [2024-11-28 01:20:42.195161] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.195168] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb111e0) on tqpair=0xaab420 00:26:27.701 [2024-11-28 01:20:42.195189] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.195199] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.195213] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xaab420) 00:26:27.701 [2024-11-28 01:20:42.195225] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.701 [2024-11-28 01:20:42.195238] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.195246] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.195252] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xaab420) 00:26:27.701 [2024-11-28 01:20:42.195262] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.701 [2024-11-28 01:20:42.195273] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.195280] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.195286] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0xaab420) 00:26:27.701 [2024-11-28 01:20:42.195296] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.701 [2024-11-28 01:20:42.195307] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.195329] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.195336] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0xaab420) 00:26:27.701 [2024-11-28 01:20:42.195345] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.701 [2024-11-28 01:20:42.195367] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb111e0, cid 5, qid 0 00:26:27.701 [2024-11-28 01:20:42.195378] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb11080, cid 4, qid 0 00:26:27.701 [2024-11-28 01:20:42.195401] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb11340, cid 6, qid 0 00:26:27.701 [2024-11-28 01:20:42.195409] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb114a0, cid 7, qid 0 00:26:27.701 [2024-11-28 01:20:42.195627] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:27.701 [2024-11-28 01:20:42.195648] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:27.701 [2024-11-28 01:20:42.195662] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.195673] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xaab420): datao=0, datal=8192, cccid=5 00:26:27.701 [2024-11-28 01:20:42.195686] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xb111e0) on tqpair(0xaab420): expected_datao=0, payload_size=8192 00:26:27.701 [2024-11-28 01:20:42.195716] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.195732] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.195747] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:27.701 [2024-11-28 01:20:42.195758] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:27.701 [2024-11-28 01:20:42.195764] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.195770] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xaab420): datao=0, datal=512, cccid=4 00:26:27.701 [2024-11-28 01:20:42.195782] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xb11080) on tqpair(0xaab420): expected_datao=0, payload_size=512 00:26:27.701 [2024-11-28 01:20:42.195798] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.195811] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.195821] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:27.701 [2024-11-28 01:20:42.195830] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:27.701 [2024-11-28 01:20:42.195836] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.195846] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xaab420): datao=0, datal=512, cccid=6 00:26:27.701 [2024-11-28 01:20:42.195855] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xb11340) on tqpair(0xaab420): expected_datao=0, payload_size=512 00:26:27.701 [2024-11-28 01:20:42.195865] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.195872] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:27.701 [2024-11-28 01:20:42.195880] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:27.701 [2024-11-28 01:20:42.195889] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:27.701 [2024-11-28 01:20:42.195895] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:27.702 [2024-11-28 01:20:42.195901] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xaab420): datao=0, datal=4096, cccid=7 00:26:27.702 [2024-11-28 01:20:42.195909] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xb114a0) on tqpair(0xaab420): expected_datao=0, payload_size=4096 00:26:27.702 [2024-11-28 01:20:42.195919] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:27.702 [2024-11-28 01:20:42.195926] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:27.702 [2024-11-28 01:20:42.195938] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.702 [2024-11-28 01:20:42.195947] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.702 [2024-11-28 01:20:42.195954] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.702 [2024-11-28 01:20:42.195960] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb111e0) on tqpair=0xaab420 00:26:27.702 [2024-11-28 01:20:42.195980] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.702 [2024-11-28 01:20:42.195992] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.702 [2024-11-28 01:20:42.195999] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.702 [2024-11-28 01:20:42.196020] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb11080) on tqpair=0xaab420 00:26:27.702 [2024-11-28 01:20:42.196034] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.702 [2024-11-28 01:20:42.196044] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.702 [2024-11-28 01:20:42.196051] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.702 [2024-11-28 01:20:42.196057] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb11340) on tqpair=0xaab420 00:26:27.702 [2024-11-28 01:20:42.196082] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.702 [2024-11-28 01:20:42.196091] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.702 [2024-11-28 01:20:42.196098] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.702 [2024-11-28 01:20:42.196104] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb114a0) on tqpair=0xaab420 00:26:27.702 ===================================================== 00:26:27.702 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:27.702 ===================================================== 00:26:27.702 Controller Capabilities/Features 00:26:27.702 ================================ 00:26:27.702 Vendor ID: 8086 00:26:27.702 Subsystem Vendor ID: 8086 00:26:27.702 Serial Number: SPDK00000000000001 00:26:27.702 Model Number: SPDK bdev Controller 00:26:27.702 Firmware Version: 24.01.1 00:26:27.702 Recommended Arb Burst: 6 00:26:27.702 IEEE OUI Identifier: e4 d2 5c 00:26:27.702 Multi-path I/O 00:26:27.702 May have multiple subsystem ports: Yes 00:26:27.702 May have multiple controllers: Yes 00:26:27.702 Associated with SR-IOV VF: No 00:26:27.702 Max Data Transfer Size: 131072 00:26:27.702 Max Number of Namespaces: 32 00:26:27.702 Max Number of I/O Queues: 127 00:26:27.702 NVMe Specification Version (VS): 1.3 00:26:27.702 NVMe Specification Version (Identify): 1.3 00:26:27.702 Maximum Queue Entries: 128 00:26:27.702 Contiguous Queues Required: Yes 00:26:27.702 Arbitration Mechanisms Supported 00:26:27.702 Weighted Round Robin: Not Supported 00:26:27.702 Vendor Specific: Not Supported 00:26:27.702 Reset Timeout: 15000 ms 00:26:27.702 Doorbell Stride: 4 bytes 00:26:27.702 NVM Subsystem Reset: Not Supported 00:26:27.702 Command Sets Supported 00:26:27.702 NVM Command Set: Supported 00:26:27.702 Boot Partition: Not Supported 00:26:27.702 Memory Page Size Minimum: 4096 bytes 00:26:27.702 Memory Page Size Maximum: 4096 bytes 00:26:27.702 Persistent Memory Region: Not Supported 00:26:27.702 Optional Asynchronous Events Supported 00:26:27.702 Namespace Attribute Notices: Supported 00:26:27.702 Firmware Activation Notices: Not Supported 00:26:27.702 ANA Change Notices: Not Supported 00:26:27.702 PLE Aggregate Log Change Notices: Not Supported 00:26:27.702 LBA Status Info Alert Notices: Not Supported 00:26:27.702 EGE Aggregate Log Change Notices: Not Supported 00:26:27.702 Normal NVM Subsystem Shutdown event: Not Supported 00:26:27.702 Zone Descriptor Change Notices: Not Supported 00:26:27.702 Discovery Log Change Notices: Not Supported 00:26:27.702 Controller Attributes 00:26:27.702 128-bit Host Identifier: Supported 00:26:27.702 Non-Operational Permissive Mode: Not Supported 00:26:27.702 NVM Sets: Not Supported 00:26:27.702 Read Recovery Levels: Not Supported 00:26:27.702 Endurance Groups: Not Supported 00:26:27.702 Predictable Latency Mode: Not Supported 00:26:27.702 Traffic Based Keep ALive: Not Supported 00:26:27.702 Namespace Granularity: Not Supported 00:26:27.702 SQ Associations: Not Supported 00:26:27.702 UUID List: Not Supported 00:26:27.702 Multi-Domain Subsystem: Not Supported 00:26:27.702 Fixed Capacity Management: Not Supported 00:26:27.702 Variable Capacity Management: Not Supported 00:26:27.702 Delete Endurance Group: Not Supported 00:26:27.702 Delete NVM Set: Not Supported 00:26:27.702 Extended LBA Formats Supported: Not Supported 00:26:27.702 Flexible Data Placement Supported: Not Supported 00:26:27.702 00:26:27.702 Controller Memory Buffer Support 00:26:27.702 ================================ 00:26:27.702 Supported: No 00:26:27.702 00:26:27.702 Persistent Memory Region Support 00:26:27.702 ================================ 00:26:27.702 Supported: No 00:26:27.702 00:26:27.702 Admin Command Set Attributes 00:26:27.702 ============================ 00:26:27.702 Security Send/Receive: Not Supported 00:26:27.702 Format NVM: Not Supported 00:26:27.702 Firmware Activate/Download: Not Supported 00:26:27.702 Namespace Management: Not Supported 00:26:27.702 Device Self-Test: Not Supported 00:26:27.702 Directives: Not Supported 00:26:27.702 NVMe-MI: Not Supported 00:26:27.702 Virtualization Management: Not Supported 00:26:27.702 Doorbell Buffer Config: Not Supported 00:26:27.702 Get LBA Status Capability: Not Supported 00:26:27.702 Command & Feature Lockdown Capability: Not Supported 00:26:27.702 Abort Command Limit: 4 00:26:27.702 Async Event Request Limit: 4 00:26:27.702 Number of Firmware Slots: N/A 00:26:27.702 Firmware Slot 1 Read-Only: N/A 00:26:27.702 Firmware Activation Without Reset: N/A 00:26:27.702 Multiple Update Detection Support: N/A 00:26:27.702 Firmware Update Granularity: No Information Provided 00:26:27.702 Per-Namespace SMART Log: No 00:26:27.702 Asymmetric Namespace Access Log Page: Not Supported 00:26:27.702 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:26:27.702 Command Effects Log Page: Supported 00:26:27.702 Get Log Page Extended Data: Supported 00:26:27.702 Telemetry Log Pages: Not Supported 00:26:27.702 Persistent Event Log Pages: Not Supported 00:26:27.702 Supported Log Pages Log Page: May Support 00:26:27.702 Commands Supported & Effects Log Page: Not Supported 00:26:27.702 Feature Identifiers & Effects Log Page:May Support 00:26:27.702 NVMe-MI Commands & Effects Log Page: May Support 00:26:27.702 Data Area 4 for Telemetry Log: Not Supported 00:26:27.702 Error Log Page Entries Supported: 128 00:26:27.702 Keep Alive: Supported 00:26:27.702 Keep Alive Granularity: 10000 ms 00:26:27.702 00:26:27.702 NVM Command Set Attributes 00:26:27.702 ========================== 00:26:27.702 Submission Queue Entry Size 00:26:27.702 Max: 64 00:26:27.702 Min: 64 00:26:27.702 Completion Queue Entry Size 00:26:27.702 Max: 16 00:26:27.702 Min: 16 00:26:27.702 Number of Namespaces: 32 00:26:27.702 Compare Command: Supported 00:26:27.702 Write Uncorrectable Command: Not Supported 00:26:27.702 Dataset Management Command: Supported 00:26:27.702 Write Zeroes Command: Supported 00:26:27.702 Set Features Save Field: Not Supported 00:26:27.702 Reservations: Supported 00:26:27.702 Timestamp: Not Supported 00:26:27.702 Copy: Supported 00:26:27.702 Volatile Write Cache: Present 00:26:27.702 Atomic Write Unit (Normal): 1 00:26:27.702 Atomic Write Unit (PFail): 1 00:26:27.702 Atomic Compare & Write Unit: 1 00:26:27.702 Fused Compare & Write: Supported 00:26:27.702 Scatter-Gather List 00:26:27.702 SGL Command Set: Supported 00:26:27.702 SGL Keyed: Supported 00:26:27.702 SGL Bit Bucket Descriptor: Not Supported 00:26:27.702 SGL Metadata Pointer: Not Supported 00:26:27.702 Oversized SGL: Not Supported 00:26:27.702 SGL Metadata Address: Not Supported 00:26:27.702 SGL Offset: Supported 00:26:27.702 Transport SGL Data Block: Not Supported 00:26:27.702 Replay Protected Memory Block: Not Supported 00:26:27.702 00:26:27.702 Firmware Slot Information 00:26:27.702 ========================= 00:26:27.702 Active slot: 1 00:26:27.702 Slot 1 Firmware Revision: 24.01.1 00:26:27.702 00:26:27.702 00:26:27.702 Commands Supported and Effects 00:26:27.702 ============================== 00:26:27.702 Admin Commands 00:26:27.702 -------------- 00:26:27.702 Get Log Page (02h): Supported 00:26:27.702 Identify (06h): Supported 00:26:27.702 Abort (08h): Supported 00:26:27.702 Set Features (09h): Supported 00:26:27.702 Get Features (0Ah): Supported 00:26:27.702 Asynchronous Event Request (0Ch): Supported 00:26:27.702 Keep Alive (18h): Supported 00:26:27.702 I/O Commands 00:26:27.702 ------------ 00:26:27.702 Flush (00h): Supported LBA-Change 00:26:27.703 Write (01h): Supported LBA-Change 00:26:27.703 Read (02h): Supported 00:26:27.703 Compare (05h): Supported 00:26:27.703 Write Zeroes (08h): Supported LBA-Change 00:26:27.703 Dataset Management (09h): Supported LBA-Change 00:26:27.703 Copy (19h): Supported LBA-Change 00:26:27.703 Unknown (79h): Supported LBA-Change 00:26:27.703 Unknown (7Ah): Supported 00:26:27.703 00:26:27.703 Error Log 00:26:27.703 ========= 00:26:27.703 00:26:27.703 Arbitration 00:26:27.703 =========== 00:26:27.703 Arbitration Burst: 1 00:26:27.703 00:26:27.703 Power Management 00:26:27.703 ================ 00:26:27.703 Number of Power States: 1 00:26:27.703 Current Power State: Power State #0 00:26:27.703 Power State #0: 00:26:27.703 Max Power: 0.00 W 00:26:27.703 Non-Operational State: Operational 00:26:27.703 Entry Latency: Not Reported 00:26:27.703 Exit Latency: Not Reported 00:26:27.703 Relative Read Throughput: 0 00:26:27.703 Relative Read Latency: 0 00:26:27.703 Relative Write Throughput: 0 00:26:27.703 Relative Write Latency: 0 00:26:27.703 Idle Power: Not Reported 00:26:27.703 Active Power: Not Reported 00:26:27.703 Non-Operational Permissive Mode: Not Supported 00:26:27.703 00:26:27.703 Health Information 00:26:27.703 ================== 00:26:27.703 Critical Warnings: 00:26:27.703 Available Spare Space: OK 00:26:27.703 Temperature: OK 00:26:27.703 Device Reliability: OK 00:26:27.703 Read Only: No 00:26:27.703 Volatile Memory Backup: OK 00:26:27.703 Current Temperature: 0 Kelvin (-273 Celsius) 00:26:27.703 Temperature Threshold: [2024-11-28 01:20:42.196225] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.703 [2024-11-28 01:20:42.196237] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.703 [2024-11-28 01:20:42.196243] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0xaab420) 00:26:27.703 [2024-11-28 01:20:42.196253] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.703 [2024-11-28 01:20:42.196275] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb114a0, cid 7, qid 0 00:26:27.703 [2024-11-28 01:20:42.196430] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.703 [2024-11-28 01:20:42.196446] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.703 [2024-11-28 01:20:42.196453] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.703 [2024-11-28 01:20:42.196459] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb114a0) on tqpair=0xaab420 00:26:27.703 [2024-11-28 01:20:42.196503] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:26:27.703 [2024-11-28 01:20:42.196538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:27.703 [2024-11-28 01:20:42.196554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:27.703 [2024-11-28 01:20:42.196564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:27.703 [2024-11-28 01:20:42.196574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:27.703 [2024-11-28 01:20:42.196587] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.703 [2024-11-28 01:20:42.196595] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.703 [2024-11-28 01:20:42.196602] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xaab420) 00:26:27.703 [2024-11-28 01:20:42.196612] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.703 [2024-11-28 01:20:42.196635] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb10f20, cid 3, qid 0 00:26:27.703 [2024-11-28 01:20:42.196772] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.703 [2024-11-28 01:20:42.196789] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.703 [2024-11-28 01:20:42.196800] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.703 [2024-11-28 01:20:42.196807] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb10f20) on tqpair=0xaab420 00:26:27.703 [2024-11-28 01:20:42.196818] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.703 [2024-11-28 01:20:42.196826] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.703 [2024-11-28 01:20:42.196833] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xaab420) 00:26:27.703 [2024-11-28 01:20:42.196843] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.703 [2024-11-28 01:20:42.196873] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb10f20, cid 3, qid 0 00:26:27.703 [2024-11-28 01:20:42.196985] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.703 [2024-11-28 01:20:42.197000] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.703 [2024-11-28 01:20:42.197007] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.703 [2024-11-28 01:20:42.197014] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb10f20) on tqpair=0xaab420 00:26:27.703 [2024-11-28 01:20:42.197022] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:26:27.703 [2024-11-28 01:20:42.197030] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:26:27.703 [2024-11-28 01:20:42.197048] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.703 [2024-11-28 01:20:42.197058] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.703 [2024-11-28 01:20:42.197065] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xaab420) 00:26:27.703 [2024-11-28 01:20:42.197076] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.703 [2024-11-28 01:20:42.197098] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb10f20, cid 3, qid 0 00:26:27.703 [2024-11-28 01:20:42.200538] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.703 [2024-11-28 01:20:42.200555] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.703 [2024-11-28 01:20:42.200562] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.703 [2024-11-28 01:20:42.200569] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb10f20) on tqpair=0xaab420 00:26:27.703 [2024-11-28 01:20:42.200589] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:27.703 [2024-11-28 01:20:42.200600] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:27.703 [2024-11-28 01:20:42.200611] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xaab420) 00:26:27.703 [2024-11-28 01:20:42.200622] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.703 [2024-11-28 01:20:42.200644] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb10f20, cid 3, qid 0 00:26:27.703 [2024-11-28 01:20:42.200806] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:27.703 [2024-11-28 01:20:42.200822] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:27.703 [2024-11-28 01:20:42.200831] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:27.703 [2024-11-28 01:20:42.200839] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb10f20) on tqpair=0xaab420 00:26:27.703 [2024-11-28 01:20:42.200854] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 3 milliseconds 00:26:27.703 0 Kelvin (-273 Celsius) 00:26:27.703 Available Spare: 0% 00:26:27.703 Available Spare Threshold: 0% 00:26:27.703 Life Percentage Used: 0% 00:26:27.703 Data Units Read: 0 00:26:27.703 Data Units Written: 0 00:26:27.703 Host Read Commands: 0 00:26:27.703 Host Write Commands: 0 00:26:27.703 Controller Busy Time: 0 minutes 00:26:27.703 Power Cycles: 0 00:26:27.703 Power On Hours: 0 hours 00:26:27.703 Unsafe Shutdowns: 0 00:26:27.703 Unrecoverable Media Errors: 0 00:26:27.703 Lifetime Error Log Entries: 0 00:26:27.703 Warning Temperature Time: 0 minutes 00:26:27.703 Critical Temperature Time: 0 minutes 00:26:27.703 00:26:27.703 Number of Queues 00:26:27.703 ================ 00:26:27.703 Number of I/O Submission Queues: 127 00:26:27.703 Number of I/O Completion Queues: 127 00:26:27.703 00:26:27.703 Active Namespaces 00:26:27.703 ================= 00:26:27.703 Namespace ID:1 00:26:27.703 Error Recovery Timeout: Unlimited 00:26:27.703 Command Set Identifier: NVM (00h) 00:26:27.703 Deallocate: Supported 00:26:27.703 Deallocated/Unwritten Error: Not Supported 00:26:27.703 Deallocated Read Value: Unknown 00:26:27.703 Deallocate in Write Zeroes: Not Supported 00:26:27.703 Deallocated Guard Field: 0xFFFF 00:26:27.703 Flush: Supported 00:26:27.703 Reservation: Supported 00:26:27.703 Namespace Sharing Capabilities: Multiple Controllers 00:26:27.703 Size (in LBAs): 131072 (0GiB) 00:26:27.703 Capacity (in LBAs): 131072 (0GiB) 00:26:27.703 Utilization (in LBAs): 131072 (0GiB) 00:26:27.703 NGUID: ABCDEF0123456789ABCDEF0123456789 00:26:27.703 EUI64: ABCDEF0123456789 00:26:27.703 UUID: ffe29761-dd2c-45b8-8e65-63188a088f74 00:26:27.703 Thin Provisioning: Not Supported 00:26:27.703 Per-NS Atomic Units: Yes 00:26:27.703 Atomic Boundary Size (Normal): 0 00:26:27.703 Atomic Boundary Size (PFail): 0 00:26:27.703 Atomic Boundary Offset: 0 00:26:27.703 Maximum Single Source Range Length: 65535 00:26:27.703 Maximum Copy Length: 65535 00:26:27.703 Maximum Source Range Count: 1 00:26:27.703 NGUID/EUI64 Never Reused: No 00:26:27.703 Namespace Write Protected: No 00:26:27.703 Number of LBA Formats: 1 00:26:27.703 Current LBA Format: LBA Format #00 00:26:27.703 LBA Format #00: Data Size: 512 Metadata Size: 0 00:26:27.703 00:26:27.703 01:20:42 -- host/identify.sh@51 -- # sync 00:26:27.703 01:20:42 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:27.703 01:20:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.703 01:20:42 -- common/autotest_common.sh@10 -- # set +x 00:26:27.704 01:20:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.704 01:20:42 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:26:27.704 01:20:42 -- host/identify.sh@56 -- # nvmftestfini 00:26:27.704 01:20:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:27.704 01:20:42 -- nvmf/common.sh@116 -- # sync 00:26:27.704 01:20:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:27.704 01:20:42 -- nvmf/common.sh@119 -- # set +e 00:26:27.704 01:20:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:27.704 01:20:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:27.704 rmmod nvme_tcp 00:26:27.704 rmmod nvme_fabrics 00:26:27.704 rmmod nvme_keyring 00:26:27.704 01:20:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:27.704 01:20:42 -- nvmf/common.sh@123 -- # set -e 00:26:27.704 01:20:42 -- nvmf/common.sh@124 -- # return 0 00:26:27.704 01:20:42 -- nvmf/common.sh@477 -- # '[' -n 2122233 ']' 00:26:27.704 01:20:42 -- nvmf/common.sh@478 -- # killprocess 2122233 00:26:27.704 01:20:42 -- common/autotest_common.sh@936 -- # '[' -z 2122233 ']' 00:26:27.704 01:20:42 -- common/autotest_common.sh@940 -- # kill -0 2122233 00:26:27.704 01:20:42 -- common/autotest_common.sh@941 -- # uname 00:26:27.704 01:20:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:27.704 01:20:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2122233 00:26:27.962 01:20:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:27.962 01:20:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:27.962 01:20:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2122233' 00:26:27.962 killing process with pid 2122233 00:26:27.962 01:20:42 -- common/autotest_common.sh@955 -- # kill 2122233 00:26:27.962 [2024-11-28 01:20:42.331826] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:27.962 01:20:42 -- common/autotest_common.sh@960 -- # wait 2122233 00:26:28.223 01:20:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:28.223 01:20:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:28.223 01:20:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:28.223 01:20:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:28.223 01:20:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:28.223 01:20:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:28.223 01:20:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:28.223 01:20:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:30.130 01:20:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:30.130 00:26:30.130 real 0m6.317s 00:26:30.130 user 0m7.520s 00:26:30.130 sys 0m1.951s 00:26:30.130 01:20:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:30.130 01:20:44 -- common/autotest_common.sh@10 -- # set +x 00:26:30.130 ************************************ 00:26:30.130 END TEST nvmf_identify 00:26:30.130 ************************************ 00:26:30.130 01:20:44 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:30.130 01:20:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:30.130 01:20:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:30.130 01:20:44 -- common/autotest_common.sh@10 -- # set +x 00:26:30.130 ************************************ 00:26:30.130 START TEST nvmf_perf 00:26:30.130 ************************************ 00:26:30.130 01:20:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:30.130 * Looking for test storage... 00:26:30.130 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:30.130 01:20:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:30.130 01:20:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:30.130 01:20:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:30.389 01:20:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:30.389 01:20:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:30.389 01:20:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:30.389 01:20:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:30.389 01:20:44 -- scripts/common.sh@335 -- # IFS=.-: 00:26:30.389 01:20:44 -- scripts/common.sh@335 -- # read -ra ver1 00:26:30.389 01:20:44 -- scripts/common.sh@336 -- # IFS=.-: 00:26:30.389 01:20:44 -- scripts/common.sh@336 -- # read -ra ver2 00:26:30.389 01:20:44 -- scripts/common.sh@337 -- # local 'op=<' 00:26:30.389 01:20:44 -- scripts/common.sh@339 -- # ver1_l=2 00:26:30.389 01:20:44 -- scripts/common.sh@340 -- # ver2_l=1 00:26:30.389 01:20:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:30.389 01:20:44 -- scripts/common.sh@343 -- # case "$op" in 00:26:30.389 01:20:44 -- scripts/common.sh@344 -- # : 1 00:26:30.389 01:20:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:30.389 01:20:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:30.389 01:20:44 -- scripts/common.sh@364 -- # decimal 1 00:26:30.389 01:20:44 -- scripts/common.sh@352 -- # local d=1 00:26:30.389 01:20:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:30.389 01:20:44 -- scripts/common.sh@354 -- # echo 1 00:26:30.389 01:20:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:30.389 01:20:44 -- scripts/common.sh@365 -- # decimal 2 00:26:30.389 01:20:44 -- scripts/common.sh@352 -- # local d=2 00:26:30.389 01:20:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:30.389 01:20:44 -- scripts/common.sh@354 -- # echo 2 00:26:30.389 01:20:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:30.389 01:20:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:30.389 01:20:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:30.390 01:20:44 -- scripts/common.sh@367 -- # return 0 00:26:30.390 01:20:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:30.390 01:20:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:30.390 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:30.390 --rc genhtml_branch_coverage=1 00:26:30.390 --rc genhtml_function_coverage=1 00:26:30.390 --rc genhtml_legend=1 00:26:30.390 --rc geninfo_all_blocks=1 00:26:30.390 --rc geninfo_unexecuted_blocks=1 00:26:30.390 00:26:30.390 ' 00:26:30.390 01:20:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:30.390 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:30.390 --rc genhtml_branch_coverage=1 00:26:30.390 --rc genhtml_function_coverage=1 00:26:30.390 --rc genhtml_legend=1 00:26:30.390 --rc geninfo_all_blocks=1 00:26:30.390 --rc geninfo_unexecuted_blocks=1 00:26:30.390 00:26:30.390 ' 00:26:30.390 01:20:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:30.390 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:30.390 --rc genhtml_branch_coverage=1 00:26:30.390 --rc genhtml_function_coverage=1 00:26:30.390 --rc genhtml_legend=1 00:26:30.390 --rc geninfo_all_blocks=1 00:26:30.390 --rc geninfo_unexecuted_blocks=1 00:26:30.390 00:26:30.390 ' 00:26:30.390 01:20:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:30.390 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:30.390 --rc genhtml_branch_coverage=1 00:26:30.390 --rc genhtml_function_coverage=1 00:26:30.390 --rc genhtml_legend=1 00:26:30.390 --rc geninfo_all_blocks=1 00:26:30.390 --rc geninfo_unexecuted_blocks=1 00:26:30.390 00:26:30.390 ' 00:26:30.390 01:20:44 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:30.390 01:20:44 -- nvmf/common.sh@7 -- # uname -s 00:26:30.390 01:20:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:30.390 01:20:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:30.390 01:20:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:30.390 01:20:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:30.390 01:20:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:30.390 01:20:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:30.390 01:20:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:30.390 01:20:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:30.390 01:20:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:30.390 01:20:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:30.390 01:20:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:30.390 01:20:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:30.390 01:20:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:30.390 01:20:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:30.390 01:20:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:30.390 01:20:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:30.390 01:20:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:30.390 01:20:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:30.390 01:20:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:30.390 01:20:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:30.390 01:20:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:30.390 01:20:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:30.390 01:20:44 -- paths/export.sh@5 -- # export PATH 00:26:30.390 01:20:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:30.390 01:20:44 -- nvmf/common.sh@46 -- # : 0 00:26:30.390 01:20:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:30.390 01:20:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:30.390 01:20:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:30.390 01:20:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:30.390 01:20:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:30.390 01:20:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:30.390 01:20:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:30.390 01:20:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:30.390 01:20:44 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:26:30.390 01:20:44 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:26:30.390 01:20:44 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:26:30.390 01:20:44 -- host/perf.sh@17 -- # nvmftestinit 00:26:30.390 01:20:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:30.390 01:20:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:30.390 01:20:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:30.390 01:20:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:30.390 01:20:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:30.390 01:20:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:30.390 01:20:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:30.390 01:20:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:30.390 01:20:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:30.390 01:20:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:30.390 01:20:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:30.390 01:20:44 -- common/autotest_common.sh@10 -- # set +x 00:26:32.293 01:20:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:32.293 01:20:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:32.293 01:20:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:32.293 01:20:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:32.293 01:20:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:32.293 01:20:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:32.293 01:20:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:32.293 01:20:46 -- nvmf/common.sh@294 -- # net_devs=() 00:26:32.293 01:20:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:32.293 01:20:46 -- nvmf/common.sh@295 -- # e810=() 00:26:32.293 01:20:46 -- nvmf/common.sh@295 -- # local -ga e810 00:26:32.293 01:20:46 -- nvmf/common.sh@296 -- # x722=() 00:26:32.293 01:20:46 -- nvmf/common.sh@296 -- # local -ga x722 00:26:32.293 01:20:46 -- nvmf/common.sh@297 -- # mlx=() 00:26:32.293 01:20:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:32.293 01:20:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:32.293 01:20:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:32.293 01:20:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:32.293 01:20:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:32.293 01:20:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:32.293 01:20:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:32.293 01:20:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:32.293 01:20:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:32.293 01:20:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:32.293 01:20:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:32.293 01:20:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:32.293 01:20:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:32.293 01:20:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:32.293 01:20:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:32.293 01:20:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:32.293 01:20:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:32.294 01:20:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:32.294 01:20:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:32.294 01:20:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:32.294 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:32.294 01:20:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:32.294 01:20:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:32.294 01:20:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:32.294 01:20:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:32.294 01:20:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:32.294 01:20:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:32.294 01:20:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:32.294 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:32.294 01:20:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:32.294 01:20:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:32.294 01:20:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:32.294 01:20:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:32.294 01:20:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:32.294 01:20:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:32.294 01:20:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:32.294 01:20:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:32.294 01:20:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:32.294 01:20:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:32.294 01:20:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:32.294 01:20:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:32.294 01:20:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:32.294 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:32.294 01:20:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:32.294 01:20:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:32.294 01:20:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:32.294 01:20:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:32.294 01:20:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:32.294 01:20:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:32.294 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:32.294 01:20:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:32.294 01:20:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:32.294 01:20:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:32.294 01:20:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:32.294 01:20:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:32.294 01:20:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:32.294 01:20:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:32.294 01:20:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:32.294 01:20:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:32.294 01:20:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:32.294 01:20:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:32.294 01:20:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:32.294 01:20:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:32.294 01:20:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:32.294 01:20:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:32.294 01:20:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:32.294 01:20:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:32.294 01:20:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:32.294 01:20:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:32.294 01:20:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:32.294 01:20:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:32.294 01:20:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:32.294 01:20:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:32.553 01:20:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:32.553 01:20:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:32.553 01:20:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:32.553 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:32.553 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.165 ms 00:26:32.553 00:26:32.553 --- 10.0.0.2 ping statistics --- 00:26:32.553 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:32.553 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:26:32.553 01:20:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:32.553 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:32.553 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:26:32.553 00:26:32.553 --- 10.0.0.1 ping statistics --- 00:26:32.553 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:32.553 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:26:32.553 01:20:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:32.553 01:20:46 -- nvmf/common.sh@410 -- # return 0 00:26:32.553 01:20:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:32.553 01:20:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:32.553 01:20:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:32.553 01:20:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:32.553 01:20:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:32.553 01:20:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:32.553 01:20:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:32.553 01:20:46 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:26:32.553 01:20:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:32.553 01:20:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:32.553 01:20:46 -- common/autotest_common.sh@10 -- # set +x 00:26:32.553 01:20:46 -- nvmf/common.sh@469 -- # nvmfpid=2124344 00:26:32.553 01:20:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:32.553 01:20:46 -- nvmf/common.sh@470 -- # waitforlisten 2124344 00:26:32.553 01:20:46 -- common/autotest_common.sh@829 -- # '[' -z 2124344 ']' 00:26:32.553 01:20:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:32.553 01:20:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:32.553 01:20:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:32.553 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:32.553 01:20:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:32.553 01:20:46 -- common/autotest_common.sh@10 -- # set +x 00:26:32.553 [2024-11-28 01:20:46.987814] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:32.553 [2024-11-28 01:20:46.987899] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:32.553 EAL: No free 2048 kB hugepages reported on node 1 00:26:32.553 [2024-11-28 01:20:47.061212] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:32.553 [2024-11-28 01:20:47.149637] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:32.553 [2024-11-28 01:20:47.149810] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:32.553 [2024-11-28 01:20:47.149838] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:32.553 [2024-11-28 01:20:47.149851] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:32.553 [2024-11-28 01:20:47.149904] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:32.553 [2024-11-28 01:20:47.149934] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:32.553 [2024-11-28 01:20:47.149960] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:32.553 [2024-11-28 01:20:47.149963] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:33.487 01:20:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:33.487 01:20:48 -- common/autotest_common.sh@862 -- # return 0 00:26:33.487 01:20:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:33.487 01:20:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:33.487 01:20:48 -- common/autotest_common.sh@10 -- # set +x 00:26:33.487 01:20:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:33.487 01:20:48 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:26:33.487 01:20:48 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:26:36.769 01:20:51 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:26:36.769 01:20:51 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:26:37.027 01:20:51 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:26:37.027 01:20:51 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:26:37.285 01:20:51 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:26:37.285 01:20:51 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:26:37.285 01:20:51 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:26:37.285 01:20:51 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:26:37.285 01:20:51 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:26:37.543 [2024-11-28 01:20:51.989627] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:37.543 01:20:52 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:37.801 01:20:52 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:37.801 01:20:52 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:38.059 01:20:52 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:38.059 01:20:52 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:26:38.316 01:20:52 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:38.573 [2024-11-28 01:20:52.997559] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:38.573 01:20:53 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:38.830 01:20:53 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:26:38.830 01:20:53 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:38.830 01:20:53 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:26:38.830 01:20:53 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:40.200 Initializing NVMe Controllers 00:26:40.200 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:26:40.200 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:26:40.200 Initialization complete. Launching workers. 00:26:40.200 ======================================================== 00:26:40.200 Latency(us) 00:26:40.200 Device Information : IOPS MiB/s Average min max 00:26:40.200 PCIE (0000:88:00.0) NSID 1 from core 0: 86845.00 339.24 367.90 37.25 6254.56 00:26:40.201 ======================================================== 00:26:40.201 Total : 86845.00 339.24 367.90 37.25 6254.56 00:26:40.201 00:26:40.201 01:20:54 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:40.201 EAL: No free 2048 kB hugepages reported on node 1 00:26:41.131 Initializing NVMe Controllers 00:26:41.131 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:41.131 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:41.131 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:41.131 Initialization complete. Launching workers. 00:26:41.131 ======================================================== 00:26:41.131 Latency(us) 00:26:41.131 Device Information : IOPS MiB/s Average min max 00:26:41.131 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 112.00 0.44 9066.60 154.62 48793.06 00:26:41.131 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 55.00 0.21 18317.95 3981.23 51868.37 00:26:41.131 ======================================================== 00:26:41.131 Total : 167.00 0.65 12113.45 154.62 51868.37 00:26:41.131 00:26:41.131 01:20:55 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:41.131 EAL: No free 2048 kB hugepages reported on node 1 00:26:42.507 Initializing NVMe Controllers 00:26:42.507 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:42.507 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:42.508 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:42.508 Initialization complete. Launching workers. 00:26:42.508 ======================================================== 00:26:42.508 Latency(us) 00:26:42.508 Device Information : IOPS MiB/s Average min max 00:26:42.508 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8140.50 31.80 3931.74 673.12 11868.91 00:26:42.508 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3905.80 15.26 8249.75 4222.71 16042.26 00:26:42.508 ======================================================== 00:26:42.508 Total : 12046.30 47.06 5331.78 673.12 16042.26 00:26:42.508 00:26:42.508 01:20:57 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:26:42.508 01:20:57 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:26:42.508 01:20:57 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:42.508 EAL: No free 2048 kB hugepages reported on node 1 00:26:45.041 Initializing NVMe Controllers 00:26:45.041 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:45.041 Controller IO queue size 128, less than required. 00:26:45.041 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:45.041 Controller IO queue size 128, less than required. 00:26:45.041 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:45.041 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:45.041 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:45.041 Initialization complete. Launching workers. 00:26:45.041 ======================================================== 00:26:45.041 Latency(us) 00:26:45.041 Device Information : IOPS MiB/s Average min max 00:26:45.041 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1602.13 400.53 81563.00 56617.45 131298.32 00:26:45.041 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 575.33 143.83 231476.93 82398.51 337267.70 00:26:45.041 ======================================================== 00:26:45.041 Total : 2177.46 544.37 121173.29 56617.45 337267.70 00:26:45.041 00:26:45.041 01:20:59 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:26:45.041 EAL: No free 2048 kB hugepages reported on node 1 00:26:45.300 No valid NVMe controllers or AIO or URING devices found 00:26:45.300 Initializing NVMe Controllers 00:26:45.300 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:45.300 Controller IO queue size 128, less than required. 00:26:45.300 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:45.300 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:26:45.300 Controller IO queue size 128, less than required. 00:26:45.300 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:45.300 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:26:45.300 WARNING: Some requested NVMe devices were skipped 00:26:45.300 01:20:59 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:26:45.300 EAL: No free 2048 kB hugepages reported on node 1 00:26:47.831 Initializing NVMe Controllers 00:26:47.831 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:47.831 Controller IO queue size 128, less than required. 00:26:47.831 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:47.831 Controller IO queue size 128, less than required. 00:26:47.831 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:47.831 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:47.831 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:47.831 Initialization complete. Launching workers. 00:26:47.831 00:26:47.831 ==================== 00:26:47.831 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:26:47.831 TCP transport: 00:26:47.831 polls: 9119 00:26:47.831 idle_polls: 5953 00:26:47.831 sock_completions: 3166 00:26:47.831 nvme_completions: 5820 00:26:47.831 submitted_requests: 8881 00:26:47.831 queued_requests: 1 00:26:47.831 00:26:47.831 ==================== 00:26:47.831 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:26:47.831 TCP transport: 00:26:47.831 polls: 8952 00:26:47.831 idle_polls: 5364 00:26:47.831 sock_completions: 3588 00:26:47.831 nvme_completions: 5862 00:26:47.831 submitted_requests: 8928 00:26:47.831 queued_requests: 1 00:26:47.831 ======================================================== 00:26:47.831 Latency(us) 00:26:47.831 Device Information : IOPS MiB/s Average min max 00:26:47.831 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1518.08 379.52 87088.82 49014.96 142809.16 00:26:47.831 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1528.58 382.14 83617.21 39910.66 118856.89 00:26:47.831 ======================================================== 00:26:47.831 Total : 3046.65 761.66 85347.04 39910.66 142809.16 00:26:47.831 00:26:47.831 01:21:02 -- host/perf.sh@66 -- # sync 00:26:47.831 01:21:02 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:48.089 01:21:02 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:26:48.089 01:21:02 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:26:48.089 01:21:02 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:26:51.370 01:21:05 -- host/perf.sh@72 -- # ls_guid=ff058998-a4b6-4eb1-ac3e-65e9f0ee693c 00:26:51.370 01:21:05 -- host/perf.sh@73 -- # get_lvs_free_mb ff058998-a4b6-4eb1-ac3e-65e9f0ee693c 00:26:51.370 01:21:05 -- common/autotest_common.sh@1353 -- # local lvs_uuid=ff058998-a4b6-4eb1-ac3e-65e9f0ee693c 00:26:51.370 01:21:05 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:51.370 01:21:05 -- common/autotest_common.sh@1355 -- # local fc 00:26:51.370 01:21:05 -- common/autotest_common.sh@1356 -- # local cs 00:26:51.370 01:21:05 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:51.628 01:21:06 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:51.628 { 00:26:51.628 "uuid": "ff058998-a4b6-4eb1-ac3e-65e9f0ee693c", 00:26:51.628 "name": "lvs_0", 00:26:51.628 "base_bdev": "Nvme0n1", 00:26:51.628 "total_data_clusters": 238234, 00:26:51.628 "free_clusters": 238234, 00:26:51.628 "block_size": 512, 00:26:51.628 "cluster_size": 4194304 00:26:51.628 } 00:26:51.628 ]' 00:26:51.628 01:21:06 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="ff058998-a4b6-4eb1-ac3e-65e9f0ee693c") .free_clusters' 00:26:51.628 01:21:06 -- common/autotest_common.sh@1358 -- # fc=238234 00:26:51.628 01:21:06 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="ff058998-a4b6-4eb1-ac3e-65e9f0ee693c") .cluster_size' 00:26:51.628 01:21:06 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:51.628 01:21:06 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:26:51.628 01:21:06 -- common/autotest_common.sh@1363 -- # echo 952936 00:26:51.628 952936 00:26:51.628 01:21:06 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:26:51.628 01:21:06 -- host/perf.sh@78 -- # free_mb=20480 00:26:51.628 01:21:06 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u ff058998-a4b6-4eb1-ac3e-65e9f0ee693c lbd_0 20480 00:26:52.193 01:21:06 -- host/perf.sh@80 -- # lb_guid=73c01cd7-6b32-41d2-912a-3f079c0eae8a 00:26:52.193 01:21:06 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 73c01cd7-6b32-41d2-912a-3f079c0eae8a lvs_n_0 00:26:53.127 01:21:07 -- host/perf.sh@83 -- # ls_nested_guid=dcab7ba8-fd61-44c0-a84c-21d207956eac 00:26:53.127 01:21:07 -- host/perf.sh@84 -- # get_lvs_free_mb dcab7ba8-fd61-44c0-a84c-21d207956eac 00:26:53.127 01:21:07 -- common/autotest_common.sh@1353 -- # local lvs_uuid=dcab7ba8-fd61-44c0-a84c-21d207956eac 00:26:53.127 01:21:07 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:53.127 01:21:07 -- common/autotest_common.sh@1355 -- # local fc 00:26:53.127 01:21:07 -- common/autotest_common.sh@1356 -- # local cs 00:26:53.127 01:21:07 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:53.127 01:21:07 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:53.127 { 00:26:53.127 "uuid": "ff058998-a4b6-4eb1-ac3e-65e9f0ee693c", 00:26:53.127 "name": "lvs_0", 00:26:53.127 "base_bdev": "Nvme0n1", 00:26:53.127 "total_data_clusters": 238234, 00:26:53.127 "free_clusters": 233114, 00:26:53.127 "block_size": 512, 00:26:53.127 "cluster_size": 4194304 00:26:53.127 }, 00:26:53.127 { 00:26:53.127 "uuid": "dcab7ba8-fd61-44c0-a84c-21d207956eac", 00:26:53.127 "name": "lvs_n_0", 00:26:53.127 "base_bdev": "73c01cd7-6b32-41d2-912a-3f079c0eae8a", 00:26:53.127 "total_data_clusters": 5114, 00:26:53.127 "free_clusters": 5114, 00:26:53.127 "block_size": 512, 00:26:53.127 "cluster_size": 4194304 00:26:53.127 } 00:26:53.127 ]' 00:26:53.127 01:21:07 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="dcab7ba8-fd61-44c0-a84c-21d207956eac") .free_clusters' 00:26:53.384 01:21:07 -- common/autotest_common.sh@1358 -- # fc=5114 00:26:53.384 01:21:07 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="dcab7ba8-fd61-44c0-a84c-21d207956eac") .cluster_size' 00:26:53.384 01:21:07 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:53.384 01:21:07 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:26:53.384 01:21:07 -- common/autotest_common.sh@1363 -- # echo 20456 00:26:53.384 20456 00:26:53.384 01:21:07 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:26:53.385 01:21:07 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u dcab7ba8-fd61-44c0-a84c-21d207956eac lbd_nest_0 20456 00:26:53.642 01:21:08 -- host/perf.sh@88 -- # lb_nested_guid=6ca233f3-466a-46f5-b5e5-98f72dfff0cf 00:26:53.642 01:21:08 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:53.899 01:21:08 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:26:53.900 01:21:08 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 6ca233f3-466a-46f5-b5e5-98f72dfff0cf 00:26:54.186 01:21:08 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:54.469 01:21:08 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:26:54.469 01:21:08 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:26:54.469 01:21:08 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:54.469 01:21:08 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:54.469 01:21:08 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:54.469 EAL: No free 2048 kB hugepages reported on node 1 00:27:06.661 Initializing NVMe Controllers 00:27:06.661 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:06.661 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:06.661 Initialization complete. Launching workers. 00:27:06.661 ======================================================== 00:27:06.661 Latency(us) 00:27:06.661 Device Information : IOPS MiB/s Average min max 00:27:06.661 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 44.59 0.02 22485.08 181.49 46886.22 00:27:06.661 ======================================================== 00:27:06.661 Total : 44.59 0.02 22485.08 181.49 46886.22 00:27:06.661 00:27:06.661 01:21:19 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:06.661 01:21:19 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:06.661 EAL: No free 2048 kB hugepages reported on node 1 00:27:16.627 Initializing NVMe Controllers 00:27:16.627 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:16.627 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:16.627 Initialization complete. Launching workers. 00:27:16.627 ======================================================== 00:27:16.627 Latency(us) 00:27:16.627 Device Information : IOPS MiB/s Average min max 00:27:16.627 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 73.30 9.16 13659.07 5010.03 50878.51 00:27:16.627 ======================================================== 00:27:16.627 Total : 73.30 9.16 13659.07 5010.03 50878.51 00:27:16.627 00:27:16.627 01:21:29 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:16.627 01:21:29 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:16.628 01:21:29 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:16.628 EAL: No free 2048 kB hugepages reported on node 1 00:27:26.587 Initializing NVMe Controllers 00:27:26.587 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:26.587 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:26.587 Initialization complete. Launching workers. 00:27:26.587 ======================================================== 00:27:26.587 Latency(us) 00:27:26.587 Device Information : IOPS MiB/s Average min max 00:27:26.587 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7864.69 3.84 4069.47 273.78 10015.43 00:27:26.587 ======================================================== 00:27:26.587 Total : 7864.69 3.84 4069.47 273.78 10015.43 00:27:26.587 00:27:26.587 01:21:39 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:26.587 01:21:39 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:26.587 EAL: No free 2048 kB hugepages reported on node 1 00:27:36.552 Initializing NVMe Controllers 00:27:36.552 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:36.552 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:36.552 Initialization complete. Launching workers. 00:27:36.552 ======================================================== 00:27:36.552 Latency(us) 00:27:36.552 Device Information : IOPS MiB/s Average min max 00:27:36.552 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 2951.50 368.94 10848.82 671.21 25231.01 00:27:36.552 ======================================================== 00:27:36.552 Total : 2951.50 368.94 10848.82 671.21 25231.01 00:27:36.552 00:27:36.552 01:21:50 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:36.552 01:21:50 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:36.552 01:21:50 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:36.552 EAL: No free 2048 kB hugepages reported on node 1 00:27:46.527 Initializing NVMe Controllers 00:27:46.527 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:46.527 Controller IO queue size 128, less than required. 00:27:46.527 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:46.527 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:46.527 Initialization complete. Launching workers. 00:27:46.528 ======================================================== 00:27:46.528 Latency(us) 00:27:46.528 Device Information : IOPS MiB/s Average min max 00:27:46.528 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12036.34 5.88 10635.64 1733.20 31003.13 00:27:46.528 ======================================================== 00:27:46.528 Total : 12036.34 5.88 10635.64 1733.20 31003.13 00:27:46.528 00:27:46.528 01:22:00 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:46.528 01:22:00 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:46.528 EAL: No free 2048 kB hugepages reported on node 1 00:27:58.718 Initializing NVMe Controllers 00:27:58.718 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:58.718 Controller IO queue size 128, less than required. 00:27:58.718 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:58.718 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:58.718 Initialization complete. Launching workers. 00:27:58.718 ======================================================== 00:27:58.718 Latency(us) 00:27:58.718 Device Information : IOPS MiB/s Average min max 00:27:58.718 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1198.60 149.82 107101.44 15861.69 260939.97 00:27:58.718 ======================================================== 00:27:58.718 Total : 1198.60 149.82 107101.44 15861.69 260939.97 00:27:58.718 00:27:58.718 01:22:11 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:58.718 01:22:11 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 6ca233f3-466a-46f5-b5e5-98f72dfff0cf 00:27:58.718 01:22:12 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:58.718 01:22:12 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 73c01cd7-6b32-41d2-912a-3f079c0eae8a 00:27:58.718 01:22:12 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:58.718 01:22:12 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:27:58.718 01:22:12 -- host/perf.sh@114 -- # nvmftestfini 00:27:58.718 01:22:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:58.718 01:22:12 -- nvmf/common.sh@116 -- # sync 00:27:58.718 01:22:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:58.718 01:22:12 -- nvmf/common.sh@119 -- # set +e 00:27:58.718 01:22:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:58.718 01:22:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:58.718 rmmod nvme_tcp 00:27:58.718 rmmod nvme_fabrics 00:27:58.718 rmmod nvme_keyring 00:27:58.718 01:22:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:58.718 01:22:13 -- nvmf/common.sh@123 -- # set -e 00:27:58.718 01:22:13 -- nvmf/common.sh@124 -- # return 0 00:27:58.718 01:22:13 -- nvmf/common.sh@477 -- # '[' -n 2124344 ']' 00:27:58.718 01:22:13 -- nvmf/common.sh@478 -- # killprocess 2124344 00:27:58.718 01:22:13 -- common/autotest_common.sh@936 -- # '[' -z 2124344 ']' 00:27:58.718 01:22:13 -- common/autotest_common.sh@940 -- # kill -0 2124344 00:27:58.718 01:22:13 -- common/autotest_common.sh@941 -- # uname 00:27:58.718 01:22:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:58.718 01:22:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2124344 00:27:58.718 01:22:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:58.718 01:22:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:58.718 01:22:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2124344' 00:27:58.718 killing process with pid 2124344 00:27:58.718 01:22:13 -- common/autotest_common.sh@955 -- # kill 2124344 00:27:58.718 01:22:13 -- common/autotest_common.sh@960 -- # wait 2124344 00:28:00.092 01:22:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:00.092 01:22:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:00.092 01:22:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:00.092 01:22:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:00.092 01:22:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:00.092 01:22:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:00.092 01:22:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:00.092 01:22:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:02.629 01:22:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:02.629 00:28:02.629 real 1m32.050s 00:28:02.629 user 5m41.498s 00:28:02.629 sys 0m15.411s 00:28:02.629 01:22:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:02.629 01:22:16 -- common/autotest_common.sh@10 -- # set +x 00:28:02.629 ************************************ 00:28:02.629 END TEST nvmf_perf 00:28:02.629 ************************************ 00:28:02.629 01:22:16 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:28:02.629 01:22:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:02.629 01:22:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:02.629 01:22:16 -- common/autotest_common.sh@10 -- # set +x 00:28:02.629 ************************************ 00:28:02.629 START TEST nvmf_fio_host 00:28:02.629 ************************************ 00:28:02.629 01:22:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:28:02.629 * Looking for test storage... 00:28:02.629 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:02.629 01:22:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:02.629 01:22:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:02.629 01:22:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:02.629 01:22:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:02.629 01:22:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:02.629 01:22:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:02.629 01:22:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:02.629 01:22:16 -- scripts/common.sh@335 -- # IFS=.-: 00:28:02.629 01:22:16 -- scripts/common.sh@335 -- # read -ra ver1 00:28:02.629 01:22:16 -- scripts/common.sh@336 -- # IFS=.-: 00:28:02.629 01:22:16 -- scripts/common.sh@336 -- # read -ra ver2 00:28:02.629 01:22:16 -- scripts/common.sh@337 -- # local 'op=<' 00:28:02.629 01:22:16 -- scripts/common.sh@339 -- # ver1_l=2 00:28:02.629 01:22:16 -- scripts/common.sh@340 -- # ver2_l=1 00:28:02.629 01:22:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:02.629 01:22:16 -- scripts/common.sh@343 -- # case "$op" in 00:28:02.629 01:22:16 -- scripts/common.sh@344 -- # : 1 00:28:02.629 01:22:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:02.629 01:22:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:02.629 01:22:16 -- scripts/common.sh@364 -- # decimal 1 00:28:02.629 01:22:16 -- scripts/common.sh@352 -- # local d=1 00:28:02.629 01:22:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:02.629 01:22:16 -- scripts/common.sh@354 -- # echo 1 00:28:02.629 01:22:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:02.629 01:22:16 -- scripts/common.sh@365 -- # decimal 2 00:28:02.629 01:22:16 -- scripts/common.sh@352 -- # local d=2 00:28:02.629 01:22:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:02.629 01:22:16 -- scripts/common.sh@354 -- # echo 2 00:28:02.629 01:22:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:02.629 01:22:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:02.629 01:22:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:02.629 01:22:16 -- scripts/common.sh@367 -- # return 0 00:28:02.629 01:22:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:02.629 01:22:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:02.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:02.629 --rc genhtml_branch_coverage=1 00:28:02.629 --rc genhtml_function_coverage=1 00:28:02.629 --rc genhtml_legend=1 00:28:02.629 --rc geninfo_all_blocks=1 00:28:02.629 --rc geninfo_unexecuted_blocks=1 00:28:02.629 00:28:02.629 ' 00:28:02.629 01:22:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:02.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:02.629 --rc genhtml_branch_coverage=1 00:28:02.629 --rc genhtml_function_coverage=1 00:28:02.629 --rc genhtml_legend=1 00:28:02.629 --rc geninfo_all_blocks=1 00:28:02.629 --rc geninfo_unexecuted_blocks=1 00:28:02.629 00:28:02.629 ' 00:28:02.629 01:22:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:02.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:02.629 --rc genhtml_branch_coverage=1 00:28:02.629 --rc genhtml_function_coverage=1 00:28:02.629 --rc genhtml_legend=1 00:28:02.629 --rc geninfo_all_blocks=1 00:28:02.629 --rc geninfo_unexecuted_blocks=1 00:28:02.629 00:28:02.629 ' 00:28:02.629 01:22:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:02.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:02.629 --rc genhtml_branch_coverage=1 00:28:02.629 --rc genhtml_function_coverage=1 00:28:02.629 --rc genhtml_legend=1 00:28:02.629 --rc geninfo_all_blocks=1 00:28:02.629 --rc geninfo_unexecuted_blocks=1 00:28:02.629 00:28:02.629 ' 00:28:02.629 01:22:16 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:02.629 01:22:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:02.629 01:22:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:02.629 01:22:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:02.629 01:22:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.629 01:22:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.629 01:22:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.629 01:22:16 -- paths/export.sh@5 -- # export PATH 00:28:02.629 01:22:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.629 01:22:16 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:02.629 01:22:16 -- nvmf/common.sh@7 -- # uname -s 00:28:02.629 01:22:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:02.629 01:22:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:02.629 01:22:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:02.629 01:22:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:02.629 01:22:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:02.629 01:22:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:02.629 01:22:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:02.629 01:22:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:02.629 01:22:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:02.629 01:22:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:02.629 01:22:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:02.629 01:22:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:02.629 01:22:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:02.629 01:22:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:02.629 01:22:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:02.629 01:22:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:02.629 01:22:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:02.629 01:22:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:02.629 01:22:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:02.629 01:22:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.629 01:22:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.630 01:22:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.630 01:22:16 -- paths/export.sh@5 -- # export PATH 00:28:02.630 01:22:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.630 01:22:16 -- nvmf/common.sh@46 -- # : 0 00:28:02.630 01:22:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:02.630 01:22:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:02.630 01:22:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:02.630 01:22:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:02.630 01:22:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:02.630 01:22:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:02.630 01:22:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:02.630 01:22:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:02.630 01:22:16 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:28:02.630 01:22:16 -- host/fio.sh@14 -- # nvmftestinit 00:28:02.630 01:22:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:02.630 01:22:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:02.630 01:22:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:02.630 01:22:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:02.630 01:22:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:02.630 01:22:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:02.630 01:22:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:02.630 01:22:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:02.630 01:22:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:02.630 01:22:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:02.630 01:22:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:02.630 01:22:16 -- common/autotest_common.sh@10 -- # set +x 00:28:04.592 01:22:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:04.592 01:22:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:04.592 01:22:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:04.592 01:22:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:04.592 01:22:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:04.592 01:22:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:04.592 01:22:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:04.592 01:22:18 -- nvmf/common.sh@294 -- # net_devs=() 00:28:04.592 01:22:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:04.592 01:22:18 -- nvmf/common.sh@295 -- # e810=() 00:28:04.592 01:22:18 -- nvmf/common.sh@295 -- # local -ga e810 00:28:04.592 01:22:18 -- nvmf/common.sh@296 -- # x722=() 00:28:04.592 01:22:18 -- nvmf/common.sh@296 -- # local -ga x722 00:28:04.592 01:22:18 -- nvmf/common.sh@297 -- # mlx=() 00:28:04.592 01:22:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:04.592 01:22:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:04.592 01:22:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:04.592 01:22:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:04.592 01:22:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:04.592 01:22:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:04.592 01:22:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:04.592 01:22:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:04.592 01:22:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:04.592 01:22:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:04.592 01:22:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:04.592 01:22:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:04.592 01:22:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:04.592 01:22:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:04.592 01:22:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:04.592 01:22:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:04.592 01:22:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:04.592 01:22:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:04.592 01:22:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:04.592 01:22:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:04.592 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:04.592 01:22:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:04.592 01:22:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:04.592 01:22:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:04.592 01:22:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:04.592 01:22:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:04.592 01:22:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:04.592 01:22:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:04.592 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:04.592 01:22:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:04.592 01:22:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:04.592 01:22:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:04.592 01:22:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:04.592 01:22:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:04.592 01:22:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:04.592 01:22:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:04.592 01:22:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:04.592 01:22:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:04.592 01:22:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:04.592 01:22:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:04.592 01:22:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:04.592 01:22:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:04.592 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:04.592 01:22:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:04.592 01:22:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:04.592 01:22:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:04.592 01:22:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:04.592 01:22:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:04.592 01:22:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:04.592 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:04.592 01:22:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:04.592 01:22:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:04.592 01:22:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:04.592 01:22:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:04.592 01:22:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:04.592 01:22:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:04.592 01:22:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:04.592 01:22:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:04.592 01:22:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:04.592 01:22:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:04.592 01:22:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:04.592 01:22:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:04.592 01:22:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:04.592 01:22:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:04.592 01:22:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:04.592 01:22:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:04.592 01:22:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:04.592 01:22:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:04.592 01:22:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:04.592 01:22:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:04.592 01:22:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:04.592 01:22:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:04.592 01:22:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:04.592 01:22:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:04.592 01:22:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:04.592 01:22:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:04.592 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:04.592 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.191 ms 00:28:04.592 00:28:04.592 --- 10.0.0.2 ping statistics --- 00:28:04.592 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:04.592 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:28:04.592 01:22:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:04.592 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:04.592 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.071 ms 00:28:04.592 00:28:04.592 --- 10.0.0.1 ping statistics --- 00:28:04.592 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:04.592 rtt min/avg/max/mdev = 0.071/0.071/0.071/0.000 ms 00:28:04.592 01:22:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:04.592 01:22:19 -- nvmf/common.sh@410 -- # return 0 00:28:04.592 01:22:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:04.592 01:22:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:04.592 01:22:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:04.592 01:22:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:04.592 01:22:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:04.592 01:22:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:04.592 01:22:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:04.592 01:22:19 -- host/fio.sh@16 -- # [[ y != y ]] 00:28:04.592 01:22:19 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:28:04.592 01:22:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:04.592 01:22:19 -- common/autotest_common.sh@10 -- # set +x 00:28:04.592 01:22:19 -- host/fio.sh@24 -- # nvmfpid=2137559 00:28:04.592 01:22:19 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:04.592 01:22:19 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:28:04.592 01:22:19 -- host/fio.sh@28 -- # waitforlisten 2137559 00:28:04.592 01:22:19 -- common/autotest_common.sh@829 -- # '[' -z 2137559 ']' 00:28:04.592 01:22:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:04.593 01:22:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:04.593 01:22:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:04.593 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:04.593 01:22:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:04.593 01:22:19 -- common/autotest_common.sh@10 -- # set +x 00:28:04.593 [2024-11-28 01:22:19.107911] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:04.593 [2024-11-28 01:22:19.108009] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:04.593 EAL: No free 2048 kB hugepages reported on node 1 00:28:04.593 [2024-11-28 01:22:19.177635] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:04.850 [2024-11-28 01:22:19.268081] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:04.850 [2024-11-28 01:22:19.268260] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:04.850 [2024-11-28 01:22:19.268278] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:04.850 [2024-11-28 01:22:19.268307] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:04.850 [2024-11-28 01:22:19.268413] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:04.850 [2024-11-28 01:22:19.268482] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:04.850 [2024-11-28 01:22:19.268568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:04.850 [2024-11-28 01:22:19.268571] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:05.785 01:22:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:05.785 01:22:20 -- common/autotest_common.sh@862 -- # return 0 00:28:05.785 01:22:20 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:28:05.785 [2024-11-28 01:22:20.321017] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:05.785 01:22:20 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:28:05.785 01:22:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:05.785 01:22:20 -- common/autotest_common.sh@10 -- # set +x 00:28:05.785 01:22:20 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:28:06.042 Malloc1 00:28:06.300 01:22:20 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:06.300 01:22:20 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:28:06.558 01:22:21 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:06.815 [2024-11-28 01:22:21.387749] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:06.815 01:22:21 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:28:07.380 01:22:21 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:28:07.380 01:22:21 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:07.380 01:22:21 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:07.380 01:22:21 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:07.380 01:22:21 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:07.380 01:22:21 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:07.380 01:22:21 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:07.380 01:22:21 -- common/autotest_common.sh@1330 -- # shift 00:28:07.380 01:22:21 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:07.380 01:22:21 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:07.380 01:22:21 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:07.380 01:22:21 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:07.380 01:22:21 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:07.380 01:22:21 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:07.380 01:22:21 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:07.380 01:22:21 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:07.380 01:22:21 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:07.380 01:22:21 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:07.380 01:22:21 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:07.380 01:22:21 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:07.380 01:22:21 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:07.380 01:22:21 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:07.380 01:22:21 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:07.380 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:07.380 fio-3.35 00:28:07.380 Starting 1 thread 00:28:07.380 EAL: No free 2048 kB hugepages reported on node 1 00:28:09.909 00:28:09.910 test: (groupid=0, jobs=1): err= 0: pid=2138056: Thu Nov 28 01:22:24 2024 00:28:09.910 read: IOPS=8282, BW=32.4MiB/s (33.9MB/s)(64.9MiB/2006msec) 00:28:09.910 slat (nsec): min=1977, max=153722, avg=2583.00, stdev=1884.22 00:28:09.910 clat (usec): min=3777, max=13468, avg=8471.71, stdev=730.76 00:28:09.910 lat (usec): min=3795, max=13471, avg=8474.29, stdev=730.69 00:28:09.910 clat percentiles (usec): 00:28:09.910 | 1.00th=[ 6849], 5.00th=[ 7308], 10.00th=[ 7570], 20.00th=[ 7898], 00:28:09.910 | 30.00th=[ 8094], 40.00th=[ 8291], 50.00th=[ 8455], 60.00th=[ 8586], 00:28:09.910 | 70.00th=[ 8848], 80.00th=[ 8979], 90.00th=[ 9372], 95.00th=[ 9634], 00:28:09.910 | 99.00th=[10290], 99.50th=[10552], 99.90th=[11994], 99.95th=[12125], 00:28:09.910 | 99.99th=[13435] 00:28:09.910 bw ( KiB/s): min=32192, max=33992, per=99.81%, avg=33068.00, stdev=742.31, samples=4 00:28:09.910 iops : min= 8048, max= 8498, avg=8267.00, stdev=185.58, samples=4 00:28:09.910 write: IOPS=8281, BW=32.3MiB/s (33.9MB/s)(64.9MiB/2006msec); 0 zone resets 00:28:09.910 slat (nsec): min=2072, max=91013, avg=2672.36, stdev=1418.30 00:28:09.910 clat (usec): min=1919, max=11417, avg=6920.35, stdev=598.25 00:28:09.910 lat (usec): min=1925, max=11419, avg=6923.02, stdev=598.23 00:28:09.910 clat percentiles (usec): 00:28:09.910 | 1.00th=[ 5604], 5.00th=[ 5997], 10.00th=[ 6194], 20.00th=[ 6456], 00:28:09.910 | 30.00th=[ 6652], 40.00th=[ 6783], 50.00th=[ 6915], 60.00th=[ 7046], 00:28:09.910 | 70.00th=[ 7242], 80.00th=[ 7373], 90.00th=[ 7635], 95.00th=[ 7832], 00:28:09.910 | 99.00th=[ 8291], 99.50th=[ 8455], 99.90th=[10421], 99.95th=[11207], 00:28:09.910 | 99.99th=[11338] 00:28:09.910 bw ( KiB/s): min=32896, max=33336, per=100.00%, avg=33134.00, stdev=212.20, samples=4 00:28:09.910 iops : min= 8224, max= 8334, avg=8283.50, stdev=53.05, samples=4 00:28:09.910 lat (msec) : 2=0.01%, 4=0.08%, 10=98.92%, 20=0.98% 00:28:09.910 cpu : usr=63.84%, sys=33.22%, ctx=79, majf=0, minf=41 00:28:09.910 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:28:09.910 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:09.910 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:09.910 issued rwts: total=16615,16613,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:09.910 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:09.910 00:28:09.910 Run status group 0 (all jobs): 00:28:09.910 READ: bw=32.4MiB/s (33.9MB/s), 32.4MiB/s-32.4MiB/s (33.9MB/s-33.9MB/s), io=64.9MiB (68.1MB), run=2006-2006msec 00:28:09.910 WRITE: bw=32.3MiB/s (33.9MB/s), 32.3MiB/s-32.3MiB/s (33.9MB/s-33.9MB/s), io=64.9MiB (68.0MB), run=2006-2006msec 00:28:09.910 01:22:24 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:28:09.910 01:22:24 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:28:09.910 01:22:24 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:09.910 01:22:24 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:09.910 01:22:24 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:09.910 01:22:24 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:09.910 01:22:24 -- common/autotest_common.sh@1330 -- # shift 00:28:09.910 01:22:24 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:09.910 01:22:24 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:09.910 01:22:24 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:09.910 01:22:24 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:09.910 01:22:24 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:09.910 01:22:24 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:09.910 01:22:24 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:09.910 01:22:24 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:09.910 01:22:24 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:09.910 01:22:24 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:09.910 01:22:24 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:09.910 01:22:24 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:09.910 01:22:24 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:09.910 01:22:24 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:09.910 01:22:24 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:28:09.910 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:28:09.910 fio-3.35 00:28:09.910 Starting 1 thread 00:28:09.910 EAL: No free 2048 kB hugepages reported on node 1 00:28:12.434 00:28:12.434 test: (groupid=0, jobs=1): err= 0: pid=2138398: Thu Nov 28 01:22:26 2024 00:28:12.434 read: IOPS=8449, BW=132MiB/s (138MB/s)(265MiB/2005msec) 00:28:12.434 slat (usec): min=2, max=104, avg= 3.84, stdev= 2.15 00:28:12.434 clat (usec): min=2021, max=19461, avg=8794.41, stdev=2162.54 00:28:12.434 lat (usec): min=2025, max=19464, avg=8798.25, stdev=2162.59 00:28:12.434 clat percentiles (usec): 00:28:12.434 | 1.00th=[ 4752], 5.00th=[ 5538], 10.00th=[ 6063], 20.00th=[ 6849], 00:28:12.434 | 30.00th=[ 7504], 40.00th=[ 8094], 50.00th=[ 8717], 60.00th=[ 9372], 00:28:12.434 | 70.00th=[ 9896], 80.00th=[10552], 90.00th=[11600], 95.00th=[12518], 00:28:12.434 | 99.00th=[14484], 99.50th=[15008], 99.90th=[16712], 99.95th=[16909], 00:28:12.434 | 99.99th=[18220] 00:28:12.434 bw ( KiB/s): min=64800, max=80640, per=51.71%, avg=69912.00, stdev=7263.43, samples=4 00:28:12.434 iops : min= 4050, max= 5040, avg=4369.50, stdev=453.96, samples=4 00:28:12.434 write: IOPS=4932, BW=77.1MiB/s (80.8MB/s)(143MiB/1853msec); 0 zone resets 00:28:12.434 slat (usec): min=30, max=202, avg=35.55, stdev= 6.85 00:28:12.434 clat (usec): min=3789, max=19845, avg=11156.73, stdev=1997.39 00:28:12.434 lat (usec): min=3826, max=19881, avg=11192.28, stdev=1997.64 00:28:12.434 clat percentiles (usec): 00:28:12.434 | 1.00th=[ 7504], 5.00th=[ 8291], 10.00th=[ 8848], 20.00th=[ 9503], 00:28:12.434 | 30.00th=[ 9896], 40.00th=[10421], 50.00th=[10945], 60.00th=[11469], 00:28:12.434 | 70.00th=[12125], 80.00th=[12780], 90.00th=[13960], 95.00th=[14877], 00:28:12.434 | 99.00th=[16188], 99.50th=[16450], 99.90th=[17171], 99.95th=[19530], 00:28:12.434 | 99.99th=[19792] 00:28:12.434 bw ( KiB/s): min=65984, max=82784, per=91.94%, avg=72552.00, stdev=7217.28, samples=4 00:28:12.434 iops : min= 4124, max= 5174, avg=4534.50, stdev=451.08, samples=4 00:28:12.434 lat (msec) : 4=0.23%, 10=57.52%, 20=42.24% 00:28:12.434 cpu : usr=76.35%, sys=21.41%, ctx=26, majf=0, minf=59 00:28:12.434 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:28:12.434 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:12.434 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:12.434 issued rwts: total=16941,9139,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:12.434 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:12.434 00:28:12.434 Run status group 0 (all jobs): 00:28:12.434 READ: bw=132MiB/s (138MB/s), 132MiB/s-132MiB/s (138MB/s-138MB/s), io=265MiB (278MB), run=2005-2005msec 00:28:12.434 WRITE: bw=77.1MiB/s (80.8MB/s), 77.1MiB/s-77.1MiB/s (80.8MB/s-80.8MB/s), io=143MiB (150MB), run=1853-1853msec 00:28:12.434 01:22:26 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:12.434 01:22:26 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:28:12.434 01:22:26 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:28:12.434 01:22:26 -- host/fio.sh@51 -- # get_nvme_bdfs 00:28:12.434 01:22:26 -- common/autotest_common.sh@1508 -- # bdfs=() 00:28:12.434 01:22:26 -- common/autotest_common.sh@1508 -- # local bdfs 00:28:12.434 01:22:26 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:12.434 01:22:26 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:12.434 01:22:26 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:28:12.434 01:22:27 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:28:12.435 01:22:27 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:28:12.435 01:22:27 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:28:15.714 Nvme0n1 00:28:15.714 01:22:30 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:28:18.993 01:22:33 -- host/fio.sh@53 -- # ls_guid=54ec5902-efb0-490b-9140-4c5c6ca9ef3b 00:28:18.993 01:22:33 -- host/fio.sh@54 -- # get_lvs_free_mb 54ec5902-efb0-490b-9140-4c5c6ca9ef3b 00:28:18.994 01:22:33 -- common/autotest_common.sh@1353 -- # local lvs_uuid=54ec5902-efb0-490b-9140-4c5c6ca9ef3b 00:28:18.994 01:22:33 -- common/autotest_common.sh@1354 -- # local lvs_info 00:28:18.994 01:22:33 -- common/autotest_common.sh@1355 -- # local fc 00:28:18.994 01:22:33 -- common/autotest_common.sh@1356 -- # local cs 00:28:18.994 01:22:33 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:28:18.994 01:22:33 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:28:18.994 { 00:28:18.994 "uuid": "54ec5902-efb0-490b-9140-4c5c6ca9ef3b", 00:28:18.994 "name": "lvs_0", 00:28:18.994 "base_bdev": "Nvme0n1", 00:28:18.994 "total_data_clusters": 930, 00:28:18.994 "free_clusters": 930, 00:28:18.994 "block_size": 512, 00:28:18.994 "cluster_size": 1073741824 00:28:18.994 } 00:28:18.994 ]' 00:28:18.994 01:22:33 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="54ec5902-efb0-490b-9140-4c5c6ca9ef3b") .free_clusters' 00:28:18.994 01:22:33 -- common/autotest_common.sh@1358 -- # fc=930 00:28:18.994 01:22:33 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="54ec5902-efb0-490b-9140-4c5c6ca9ef3b") .cluster_size' 00:28:18.994 01:22:33 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:28:18.994 01:22:33 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:28:18.994 01:22:33 -- common/autotest_common.sh@1363 -- # echo 952320 00:28:18.994 952320 00:28:18.994 01:22:33 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:28:19.251 d44c8ef1-0a93-4e8d-b23d-35c9cc497dd1 00:28:19.251 01:22:33 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:28:19.509 01:22:34 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:28:19.767 01:22:34 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:28:20.025 01:22:34 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:20.025 01:22:34 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:20.025 01:22:34 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:20.025 01:22:34 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:20.025 01:22:34 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:20.025 01:22:34 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:20.025 01:22:34 -- common/autotest_common.sh@1330 -- # shift 00:28:20.025 01:22:34 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:20.025 01:22:34 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:20.025 01:22:34 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:20.025 01:22:34 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:20.025 01:22:34 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:20.025 01:22:34 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:20.025 01:22:34 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:20.025 01:22:34 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:20.025 01:22:34 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:20.025 01:22:34 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:20.025 01:22:34 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:20.025 01:22:34 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:20.025 01:22:34 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:20.025 01:22:34 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:20.025 01:22:34 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:20.283 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:20.284 fio-3.35 00:28:20.284 Starting 1 thread 00:28:20.284 EAL: No free 2048 kB hugepages reported on node 1 00:28:22.811 00:28:22.811 test: (groupid=0, jobs=1): err= 0: pid=2140023: Thu Nov 28 01:22:37 2024 00:28:22.811 read: IOPS=6013, BW=23.5MiB/s (24.6MB/s)(47.2MiB/2008msec) 00:28:22.811 slat (nsec): min=1847, max=225440, avg=2511.57, stdev=2998.44 00:28:22.811 clat (usec): min=844, max=171022, avg=11664.28, stdev=11576.39 00:28:22.811 lat (usec): min=849, max=171066, avg=11666.79, stdev=11576.96 00:28:22.811 clat percentiles (msec): 00:28:22.811 | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 10], 20.00th=[ 11], 00:28:22.811 | 30.00th=[ 11], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 12], 00:28:22.811 | 70.00th=[ 12], 80.00th=[ 12], 90.00th=[ 12], 95.00th=[ 13], 00:28:22.811 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:28:22.811 | 99.99th=[ 171] 00:28:22.811 bw ( KiB/s): min=16928, max=26504, per=99.92%, avg=24036.00, stdev=4739.21, samples=4 00:28:22.811 iops : min= 4232, max= 6626, avg=6009.00, stdev=1184.80, samples=4 00:28:22.811 write: IOPS=6002, BW=23.4MiB/s (24.6MB/s)(47.1MiB/2008msec); 0 zone resets 00:28:22.811 slat (nsec): min=1952, max=208487, avg=2585.39, stdev=2271.83 00:28:22.811 clat (usec): min=426, max=168745, avg=9464.52, stdev=10876.53 00:28:22.811 lat (usec): min=430, max=168756, avg=9467.10, stdev=10877.16 00:28:22.811 clat percentiles (msec): 00:28:22.811 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9], 00:28:22.811 | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:28:22.811 | 70.00th=[ 10], 80.00th=[ 10], 90.00th=[ 10], 95.00th=[ 10], 00:28:22.811 | 99.00th=[ 11], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:28:22.811 | 99.99th=[ 169] 00:28:22.811 bw ( KiB/s): min=17840, max=26184, per=99.83%, avg=23968.00, stdev=4087.64, samples=4 00:28:22.811 iops : min= 4460, max= 6546, avg=5992.00, stdev=1021.91, samples=4 00:28:22.811 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:28:22.811 lat (msec) : 2=0.03%, 4=0.14%, 10=56.56%, 20=42.72%, 250=0.53% 00:28:22.811 cpu : usr=61.43%, sys=36.22%, ctx=115, majf=0, minf=41 00:28:22.811 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:28:22.811 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:22.811 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:22.811 issued rwts: total=12076,12053,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:22.811 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:22.811 00:28:22.811 Run status group 0 (all jobs): 00:28:22.811 READ: bw=23.5MiB/s (24.6MB/s), 23.5MiB/s-23.5MiB/s (24.6MB/s-24.6MB/s), io=47.2MiB (49.5MB), run=2008-2008msec 00:28:22.811 WRITE: bw=23.4MiB/s (24.6MB/s), 23.4MiB/s-23.4MiB/s (24.6MB/s-24.6MB/s), io=47.1MiB (49.4MB), run=2008-2008msec 00:28:22.811 01:22:37 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:28:23.069 01:22:37 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:28:24.003 01:22:38 -- host/fio.sh@64 -- # ls_nested_guid=a2d19aff-8937-41f5-98f3-46a11edf4402 00:28:24.003 01:22:38 -- host/fio.sh@65 -- # get_lvs_free_mb a2d19aff-8937-41f5-98f3-46a11edf4402 00:28:24.003 01:22:38 -- common/autotest_common.sh@1353 -- # local lvs_uuid=a2d19aff-8937-41f5-98f3-46a11edf4402 00:28:24.003 01:22:38 -- common/autotest_common.sh@1354 -- # local lvs_info 00:28:24.003 01:22:38 -- common/autotest_common.sh@1355 -- # local fc 00:28:24.003 01:22:38 -- common/autotest_common.sh@1356 -- # local cs 00:28:24.003 01:22:38 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:28:24.261 01:22:38 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:28:24.261 { 00:28:24.261 "uuid": "54ec5902-efb0-490b-9140-4c5c6ca9ef3b", 00:28:24.261 "name": "lvs_0", 00:28:24.261 "base_bdev": "Nvme0n1", 00:28:24.261 "total_data_clusters": 930, 00:28:24.261 "free_clusters": 0, 00:28:24.261 "block_size": 512, 00:28:24.261 "cluster_size": 1073741824 00:28:24.261 }, 00:28:24.261 { 00:28:24.261 "uuid": "a2d19aff-8937-41f5-98f3-46a11edf4402", 00:28:24.261 "name": "lvs_n_0", 00:28:24.261 "base_bdev": "d44c8ef1-0a93-4e8d-b23d-35c9cc497dd1", 00:28:24.261 "total_data_clusters": 237847, 00:28:24.261 "free_clusters": 237847, 00:28:24.261 "block_size": 512, 00:28:24.261 "cluster_size": 4194304 00:28:24.261 } 00:28:24.261 ]' 00:28:24.261 01:22:38 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="a2d19aff-8937-41f5-98f3-46a11edf4402") .free_clusters' 00:28:24.261 01:22:38 -- common/autotest_common.sh@1358 -- # fc=237847 00:28:24.261 01:22:38 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="a2d19aff-8937-41f5-98f3-46a11edf4402") .cluster_size' 00:28:24.519 01:22:38 -- common/autotest_common.sh@1359 -- # cs=4194304 00:28:24.519 01:22:38 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:28:24.519 01:22:38 -- common/autotest_common.sh@1363 -- # echo 951388 00:28:24.519 951388 00:28:24.519 01:22:38 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:28:25.084 0e9414de-f795-40ae-887e-a733cf535aed 00:28:25.084 01:22:39 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:28:25.341 01:22:39 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:28:25.598 01:22:40 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:28:25.856 01:22:40 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:25.856 01:22:40 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:25.856 01:22:40 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:25.856 01:22:40 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:25.856 01:22:40 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:25.856 01:22:40 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:25.856 01:22:40 -- common/autotest_common.sh@1330 -- # shift 00:28:25.857 01:22:40 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:25.857 01:22:40 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:25.857 01:22:40 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:25.857 01:22:40 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:25.857 01:22:40 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:25.857 01:22:40 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:25.857 01:22:40 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:25.857 01:22:40 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:25.857 01:22:40 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:25.857 01:22:40 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:25.857 01:22:40 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:25.857 01:22:40 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:25.857 01:22:40 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:25.857 01:22:40 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:25.857 01:22:40 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:26.115 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:26.115 fio-3.35 00:28:26.115 Starting 1 thread 00:28:26.115 EAL: No free 2048 kB hugepages reported on node 1 00:28:28.640 00:28:28.640 test: (groupid=0, jobs=1): err= 0: pid=2140850: Thu Nov 28 01:22:42 2024 00:28:28.640 read: IOPS=6211, BW=24.3MiB/s (25.4MB/s)(48.7MiB/2009msec) 00:28:28.640 slat (usec): min=2, max=262, avg= 2.77, stdev= 3.53 00:28:28.640 clat (usec): min=4646, max=18463, avg=11378.35, stdev=916.59 00:28:28.640 lat (usec): min=4683, max=18466, avg=11381.12, stdev=916.39 00:28:28.640 clat percentiles (usec): 00:28:28.640 | 1.00th=[ 9241], 5.00th=[ 9896], 10.00th=[10290], 20.00th=[10683], 00:28:28.640 | 30.00th=[10945], 40.00th=[11207], 50.00th=[11338], 60.00th=[11600], 00:28:28.640 | 70.00th=[11863], 80.00th=[12125], 90.00th=[12518], 95.00th=[12780], 00:28:28.640 | 99.00th=[13435], 99.50th=[13566], 99.90th=[16450], 99.95th=[17695], 00:28:28.640 | 99.99th=[18482] 00:28:28.640 bw ( KiB/s): min=23584, max=25344, per=99.98%, avg=24838.00, stdev=838.83, samples=4 00:28:28.640 iops : min= 5896, max= 6336, avg=6209.50, stdev=209.71, samples=4 00:28:28.640 write: IOPS=6206, BW=24.2MiB/s (25.4MB/s)(48.7MiB/2009msec); 0 zone resets 00:28:28.641 slat (usec): min=2, max=207, avg= 2.82, stdev= 2.22 00:28:28.641 clat (usec): min=2500, max=17643, avg=9094.51, stdev=842.74 00:28:28.641 lat (usec): min=2515, max=17646, avg=9097.33, stdev=842.70 00:28:28.641 clat percentiles (usec): 00:28:28.641 | 1.00th=[ 7177], 5.00th=[ 7832], 10.00th=[ 8160], 20.00th=[ 8455], 00:28:28.641 | 30.00th=[ 8717], 40.00th=[ 8848], 50.00th=[ 9110], 60.00th=[ 9241], 00:28:28.641 | 70.00th=[ 9503], 80.00th=[ 9765], 90.00th=[10028], 95.00th=[10290], 00:28:28.641 | 99.00th=[10945], 99.50th=[11207], 99.90th=[16319], 99.95th=[16581], 00:28:28.641 | 99.99th=[17695] 00:28:28.641 bw ( KiB/s): min=24648, max=24904, per=99.90%, avg=24802.00, stdev=116.73, samples=4 00:28:28.641 iops : min= 6162, max= 6226, avg=6200.50, stdev=29.18, samples=4 00:28:28.641 lat (msec) : 4=0.04%, 10=47.27%, 20=52.69% 00:28:28.641 cpu : usr=61.70%, sys=35.96%, ctx=100, majf=0, minf=41 00:28:28.641 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:28:28.641 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:28.641 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:28.641 issued rwts: total=12478,12469,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:28.641 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:28.641 00:28:28.641 Run status group 0 (all jobs): 00:28:28.641 READ: bw=24.3MiB/s (25.4MB/s), 24.3MiB/s-24.3MiB/s (25.4MB/s-25.4MB/s), io=48.7MiB (51.1MB), run=2009-2009msec 00:28:28.641 WRITE: bw=24.2MiB/s (25.4MB/s), 24.2MiB/s-24.2MiB/s (25.4MB/s-25.4MB/s), io=48.7MiB (51.1MB), run=2009-2009msec 00:28:28.641 01:22:42 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:28:28.641 01:22:43 -- host/fio.sh@74 -- # sync 00:28:28.641 01:22:43 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:28:32.819 01:22:47 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:28:32.819 01:22:47 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:28:36.097 01:22:50 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:28:36.097 01:22:50 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:28:37.995 01:22:52 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:28:37.995 01:22:52 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:28:37.995 01:22:52 -- host/fio.sh@86 -- # nvmftestfini 00:28:37.995 01:22:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:37.995 01:22:52 -- nvmf/common.sh@116 -- # sync 00:28:37.995 01:22:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:37.995 01:22:52 -- nvmf/common.sh@119 -- # set +e 00:28:37.995 01:22:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:37.995 01:22:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:37.995 rmmod nvme_tcp 00:28:37.995 rmmod nvme_fabrics 00:28:37.995 rmmod nvme_keyring 00:28:37.995 01:22:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:37.995 01:22:52 -- nvmf/common.sh@123 -- # set -e 00:28:37.995 01:22:52 -- nvmf/common.sh@124 -- # return 0 00:28:37.995 01:22:52 -- nvmf/common.sh@477 -- # '[' -n 2137559 ']' 00:28:37.995 01:22:52 -- nvmf/common.sh@478 -- # killprocess 2137559 00:28:37.995 01:22:52 -- common/autotest_common.sh@936 -- # '[' -z 2137559 ']' 00:28:37.995 01:22:52 -- common/autotest_common.sh@940 -- # kill -0 2137559 00:28:37.995 01:22:52 -- common/autotest_common.sh@941 -- # uname 00:28:37.995 01:22:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:37.995 01:22:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2137559 00:28:37.995 01:22:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:37.996 01:22:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:37.996 01:22:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2137559' 00:28:37.996 killing process with pid 2137559 00:28:37.996 01:22:52 -- common/autotest_common.sh@955 -- # kill 2137559 00:28:37.996 01:22:52 -- common/autotest_common.sh@960 -- # wait 2137559 00:28:38.261 01:22:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:38.261 01:22:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:38.261 01:22:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:38.261 01:22:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:38.261 01:22:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:38.261 01:22:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:38.261 01:22:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:38.261 01:22:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:40.850 01:22:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:40.850 00:28:40.850 real 0m38.123s 00:28:40.850 user 2m26.096s 00:28:40.850 sys 0m7.109s 00:28:40.850 01:22:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:40.850 01:22:54 -- common/autotest_common.sh@10 -- # set +x 00:28:40.850 ************************************ 00:28:40.850 END TEST nvmf_fio_host 00:28:40.850 ************************************ 00:28:40.850 01:22:54 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:40.850 01:22:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:40.850 01:22:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:40.850 01:22:54 -- common/autotest_common.sh@10 -- # set +x 00:28:40.850 ************************************ 00:28:40.850 START TEST nvmf_failover 00:28:40.850 ************************************ 00:28:40.850 01:22:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:40.850 * Looking for test storage... 00:28:40.850 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:40.850 01:22:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:40.850 01:22:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:40.850 01:22:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:40.850 01:22:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:40.850 01:22:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:40.850 01:22:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:40.850 01:22:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:40.850 01:22:55 -- scripts/common.sh@335 -- # IFS=.-: 00:28:40.850 01:22:55 -- scripts/common.sh@335 -- # read -ra ver1 00:28:40.850 01:22:55 -- scripts/common.sh@336 -- # IFS=.-: 00:28:40.850 01:22:55 -- scripts/common.sh@336 -- # read -ra ver2 00:28:40.850 01:22:55 -- scripts/common.sh@337 -- # local 'op=<' 00:28:40.850 01:22:55 -- scripts/common.sh@339 -- # ver1_l=2 00:28:40.850 01:22:55 -- scripts/common.sh@340 -- # ver2_l=1 00:28:40.850 01:22:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:40.850 01:22:55 -- scripts/common.sh@343 -- # case "$op" in 00:28:40.850 01:22:55 -- scripts/common.sh@344 -- # : 1 00:28:40.850 01:22:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:40.850 01:22:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:40.850 01:22:55 -- scripts/common.sh@364 -- # decimal 1 00:28:40.850 01:22:55 -- scripts/common.sh@352 -- # local d=1 00:28:40.850 01:22:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:40.850 01:22:55 -- scripts/common.sh@354 -- # echo 1 00:28:40.850 01:22:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:40.850 01:22:55 -- scripts/common.sh@365 -- # decimal 2 00:28:40.850 01:22:55 -- scripts/common.sh@352 -- # local d=2 00:28:40.850 01:22:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:40.850 01:22:55 -- scripts/common.sh@354 -- # echo 2 00:28:40.850 01:22:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:40.850 01:22:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:40.850 01:22:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:40.850 01:22:55 -- scripts/common.sh@367 -- # return 0 00:28:40.850 01:22:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:40.850 01:22:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:40.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:40.850 --rc genhtml_branch_coverage=1 00:28:40.850 --rc genhtml_function_coverage=1 00:28:40.850 --rc genhtml_legend=1 00:28:40.850 --rc geninfo_all_blocks=1 00:28:40.850 --rc geninfo_unexecuted_blocks=1 00:28:40.850 00:28:40.850 ' 00:28:40.850 01:22:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:40.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:40.850 --rc genhtml_branch_coverage=1 00:28:40.850 --rc genhtml_function_coverage=1 00:28:40.850 --rc genhtml_legend=1 00:28:40.850 --rc geninfo_all_blocks=1 00:28:40.850 --rc geninfo_unexecuted_blocks=1 00:28:40.850 00:28:40.850 ' 00:28:40.850 01:22:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:40.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:40.850 --rc genhtml_branch_coverage=1 00:28:40.850 --rc genhtml_function_coverage=1 00:28:40.850 --rc genhtml_legend=1 00:28:40.850 --rc geninfo_all_blocks=1 00:28:40.850 --rc geninfo_unexecuted_blocks=1 00:28:40.850 00:28:40.850 ' 00:28:40.850 01:22:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:40.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:40.850 --rc genhtml_branch_coverage=1 00:28:40.850 --rc genhtml_function_coverage=1 00:28:40.850 --rc genhtml_legend=1 00:28:40.850 --rc geninfo_all_blocks=1 00:28:40.850 --rc geninfo_unexecuted_blocks=1 00:28:40.850 00:28:40.850 ' 00:28:40.850 01:22:55 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:40.850 01:22:55 -- nvmf/common.sh@7 -- # uname -s 00:28:40.850 01:22:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:40.850 01:22:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:40.850 01:22:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:40.850 01:22:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:40.850 01:22:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:40.850 01:22:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:40.850 01:22:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:40.850 01:22:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:40.850 01:22:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:40.850 01:22:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:40.850 01:22:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:40.850 01:22:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:40.850 01:22:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:40.850 01:22:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:40.850 01:22:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:40.850 01:22:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:40.850 01:22:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:40.850 01:22:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:40.850 01:22:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:40.850 01:22:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:40.850 01:22:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:40.850 01:22:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:40.850 01:22:55 -- paths/export.sh@5 -- # export PATH 00:28:40.850 01:22:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:40.850 01:22:55 -- nvmf/common.sh@46 -- # : 0 00:28:40.850 01:22:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:40.850 01:22:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:40.850 01:22:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:40.850 01:22:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:40.850 01:22:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:40.850 01:22:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:40.850 01:22:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:40.850 01:22:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:40.850 01:22:55 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:28:40.850 01:22:55 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:28:40.850 01:22:55 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:28:40.850 01:22:55 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:28:40.850 01:22:55 -- host/failover.sh@18 -- # nvmftestinit 00:28:40.850 01:22:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:40.850 01:22:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:40.850 01:22:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:40.850 01:22:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:40.850 01:22:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:40.850 01:22:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:40.850 01:22:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:40.850 01:22:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:40.850 01:22:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:40.850 01:22:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:40.850 01:22:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:40.850 01:22:55 -- common/autotest_common.sh@10 -- # set +x 00:28:42.753 01:22:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:42.753 01:22:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:42.753 01:22:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:42.753 01:22:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:42.753 01:22:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:42.753 01:22:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:42.753 01:22:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:42.753 01:22:57 -- nvmf/common.sh@294 -- # net_devs=() 00:28:42.753 01:22:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:42.753 01:22:57 -- nvmf/common.sh@295 -- # e810=() 00:28:42.753 01:22:57 -- nvmf/common.sh@295 -- # local -ga e810 00:28:42.753 01:22:57 -- nvmf/common.sh@296 -- # x722=() 00:28:42.753 01:22:57 -- nvmf/common.sh@296 -- # local -ga x722 00:28:42.753 01:22:57 -- nvmf/common.sh@297 -- # mlx=() 00:28:42.753 01:22:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:42.753 01:22:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:42.753 01:22:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:42.753 01:22:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:42.753 01:22:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:42.753 01:22:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:42.753 01:22:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:42.753 01:22:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:42.753 01:22:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:42.753 01:22:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:42.753 01:22:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:42.753 01:22:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:42.753 01:22:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:42.753 01:22:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:42.753 01:22:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:42.753 01:22:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:42.753 01:22:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:42.753 01:22:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:42.753 01:22:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:42.753 01:22:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:42.753 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:42.753 01:22:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:42.753 01:22:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:42.753 01:22:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:42.753 01:22:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:42.753 01:22:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:42.753 01:22:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:42.753 01:22:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:42.753 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:42.753 01:22:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:42.753 01:22:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:42.753 01:22:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:42.753 01:22:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:42.753 01:22:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:42.753 01:22:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:42.753 01:22:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:42.753 01:22:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:42.753 01:22:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:42.753 01:22:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:42.753 01:22:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:42.753 01:22:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:42.753 01:22:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:42.753 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:42.753 01:22:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:42.753 01:22:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:42.753 01:22:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:42.753 01:22:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:42.753 01:22:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:42.753 01:22:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:42.753 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:42.753 01:22:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:42.753 01:22:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:42.753 01:22:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:42.753 01:22:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:42.753 01:22:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:42.753 01:22:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:42.753 01:22:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:42.753 01:22:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:42.753 01:22:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:42.753 01:22:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:42.753 01:22:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:42.753 01:22:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:42.753 01:22:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:42.753 01:22:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:42.753 01:22:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:42.753 01:22:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:42.753 01:22:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:42.753 01:22:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:42.753 01:22:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:42.753 01:22:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:42.753 01:22:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:42.753 01:22:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:42.753 01:22:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:42.753 01:22:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:42.753 01:22:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:42.753 01:22:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:42.753 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:42.753 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.341 ms 00:28:42.753 00:28:42.753 --- 10.0.0.2 ping statistics --- 00:28:42.753 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:42.753 rtt min/avg/max/mdev = 0.341/0.341/0.341/0.000 ms 00:28:42.753 01:22:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:42.753 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:42.753 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.126 ms 00:28:42.753 00:28:42.753 --- 10.0.0.1 ping statistics --- 00:28:42.753 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:42.754 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:28:42.754 01:22:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:42.754 01:22:57 -- nvmf/common.sh@410 -- # return 0 00:28:42.754 01:22:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:42.754 01:22:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:42.754 01:22:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:42.754 01:22:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:42.754 01:22:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:42.754 01:22:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:42.754 01:22:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:42.754 01:22:57 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:28:42.754 01:22:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:42.754 01:22:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:42.754 01:22:57 -- common/autotest_common.sh@10 -- # set +x 00:28:42.754 01:22:57 -- nvmf/common.sh@469 -- # nvmfpid=2144159 00:28:42.754 01:22:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:28:42.754 01:22:57 -- nvmf/common.sh@470 -- # waitforlisten 2144159 00:28:42.754 01:22:57 -- common/autotest_common.sh@829 -- # '[' -z 2144159 ']' 00:28:42.754 01:22:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:42.754 01:22:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:42.754 01:22:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:42.754 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:42.754 01:22:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:42.754 01:22:57 -- common/autotest_common.sh@10 -- # set +x 00:28:42.754 [2024-11-28 01:22:57.275961] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:42.754 [2024-11-28 01:22:57.276034] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:42.754 EAL: No free 2048 kB hugepages reported on node 1 00:28:42.754 [2024-11-28 01:22:57.341210] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:28:43.012 [2024-11-28 01:22:57.425041] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:43.012 [2024-11-28 01:22:57.425188] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:43.012 [2024-11-28 01:22:57.425205] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:43.012 [2024-11-28 01:22:57.425217] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:43.012 [2024-11-28 01:22:57.425314] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:43.012 [2024-11-28 01:22:57.425376] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:43.012 [2024-11-28 01:22:57.425379] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:43.947 01:22:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:43.947 01:22:58 -- common/autotest_common.sh@862 -- # return 0 00:28:43.947 01:22:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:43.947 01:22:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:43.947 01:22:58 -- common/autotest_common.sh@10 -- # set +x 00:28:43.947 01:22:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:43.947 01:22:58 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:28:44.205 [2024-11-28 01:22:58.597486] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:44.205 01:22:58 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:28:44.463 Malloc0 00:28:44.463 01:22:58 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:44.721 01:22:59 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:44.979 01:22:59 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:45.237 [2024-11-28 01:22:59.652003] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:45.237 01:22:59 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:45.494 [2024-11-28 01:22:59.920798] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:45.494 01:22:59 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:45.751 [2024-11-28 01:23:00.181764] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:45.751 01:23:00 -- host/failover.sh@31 -- # bdevperf_pid=2144588 00:28:45.751 01:23:00 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:28:45.751 01:23:00 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:45.751 01:23:00 -- host/failover.sh@34 -- # waitforlisten 2144588 /var/tmp/bdevperf.sock 00:28:45.751 01:23:00 -- common/autotest_common.sh@829 -- # '[' -z 2144588 ']' 00:28:45.751 01:23:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:45.751 01:23:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:45.751 01:23:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:45.751 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:45.751 01:23:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:45.751 01:23:00 -- common/autotest_common.sh@10 -- # set +x 00:28:46.683 01:23:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:46.683 01:23:01 -- common/autotest_common.sh@862 -- # return 0 00:28:46.683 01:23:01 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:47.248 NVMe0n1 00:28:47.248 01:23:01 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:47.505 00:28:47.505 01:23:01 -- host/failover.sh@39 -- # run_test_pid=2144749 00:28:47.505 01:23:01 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:47.505 01:23:01 -- host/failover.sh@41 -- # sleep 1 00:28:48.438 01:23:02 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:48.697 [2024-11-28 01:23:03.243176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243281] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243317] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243340] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243664] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243701] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243729] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243829] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243906] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 [2024-11-28 01:23:03.243928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ed930 is same with the state(5) to be set 00:28:48.697 01:23:03 -- host/failover.sh@45 -- # sleep 3 00:28:51.979 01:23:06 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:52.237 00:28:52.237 01:23:06 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:52.495 [2024-11-28 01:23:06.954553] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954646] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954717] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954729] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954835] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954847] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954937] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954949] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954961] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954973] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.954999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.955010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.955021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.955033] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.955044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.955055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.955066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.955082] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.955094] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.955105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 [2024-11-28 01:23:06.955116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ee7c0 is same with the state(5) to be set 00:28:52.495 01:23:06 -- host/failover.sh@50 -- # sleep 3 00:28:55.776 01:23:09 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:55.776 [2024-11-28 01:23:10.238256] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:55.776 01:23:10 -- host/failover.sh@55 -- # sleep 1 00:28:56.707 01:23:11 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:56.965 [2024-11-28 01:23:11.512971] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513189] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513201] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513213] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513365] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513377] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513390] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513402] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513414] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 [2024-11-28 01:23:11.513494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ef310 is same with the state(5) to be set 00:28:56.965 01:23:11 -- host/failover.sh@59 -- # wait 2144749 00:29:03.526 0 00:29:03.526 01:23:17 -- host/failover.sh@61 -- # killprocess 2144588 00:29:03.526 01:23:17 -- common/autotest_common.sh@936 -- # '[' -z 2144588 ']' 00:29:03.526 01:23:17 -- common/autotest_common.sh@940 -- # kill -0 2144588 00:29:03.526 01:23:17 -- common/autotest_common.sh@941 -- # uname 00:29:03.526 01:23:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:03.526 01:23:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2144588 00:29:03.526 01:23:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:03.526 01:23:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:03.526 01:23:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2144588' 00:29:03.526 killing process with pid 2144588 00:29:03.526 01:23:17 -- common/autotest_common.sh@955 -- # kill 2144588 00:29:03.526 01:23:17 -- common/autotest_common.sh@960 -- # wait 2144588 00:29:03.526 01:23:17 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:29:03.526 [2024-11-28 01:23:00.243546] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:03.526 [2024-11-28 01:23:00.243659] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2144588 ] 00:29:03.526 EAL: No free 2048 kB hugepages reported on node 1 00:29:03.526 [2024-11-28 01:23:00.305012] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:03.526 [2024-11-28 01:23:00.389493] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:03.526 Running I/O for 15 seconds... 00:29:03.526 [2024-11-28 01:23:03.244249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:116752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.526 [2024-11-28 01:23:03.244293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.526 [2024-11-28 01:23:03.244323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:116760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.526 [2024-11-28 01:23:03.244340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.526 [2024-11-28 01:23:03.244357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:116784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.526 [2024-11-28 01:23:03.244371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.526 [2024-11-28 01:23:03.244387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:116792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.526 [2024-11-28 01:23:03.244401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.526 [2024-11-28 01:23:03.244417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:116800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.526 [2024-11-28 01:23:03.244430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.526 [2024-11-28 01:23:03.244446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:116816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.526 [2024-11-28 01:23:03.244459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.526 [2024-11-28 01:23:03.244475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:116856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.526 [2024-11-28 01:23:03.244489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.526 [2024-11-28 01:23:03.244504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:116864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.526 [2024-11-28 01:23:03.244517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.526 [2024-11-28 01:23:03.244542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:116888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.526 [2024-11-28 01:23:03.244558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.526 [2024-11-28 01:23:03.244583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:116936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.526 [2024-11-28 01:23:03.244597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.526 [2024-11-28 01:23:03.244613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:116968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.526 [2024-11-28 01:23:03.244627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.526 [2024-11-28 01:23:03.244650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:116976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.526 [2024-11-28 01:23:03.244665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.526 [2024-11-28 01:23:03.244680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:116992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.526 [2024-11-28 01:23:03.244694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.526 [2024-11-28 01:23:03.244709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:117000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.526 [2024-11-28 01:23:03.244723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.526 [2024-11-28 01:23:03.244738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:117440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.526 [2024-11-28 01:23:03.244767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.244782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:117520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.244795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.244820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:117536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.244848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.244862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:117544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.244875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.244889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:117552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.244902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.244916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:117560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.244929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.244943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:117568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.244955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.244969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:117584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.244983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.244997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:117600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:117608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:117624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:117640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:117656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:117672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:117680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:117688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.527 [2024-11-28 01:23:03.245201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:117696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:117704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:117712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.527 [2024-11-28 01:23:03.245283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:117720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:117728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:117736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.527 [2024-11-28 01:23:03.245362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:117744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:117752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:117760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.527 [2024-11-28 01:23:03.245446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:117768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.527 [2024-11-28 01:23:03.245472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:117776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.527 [2024-11-28 01:23:03.245498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:117016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:117024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:117040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:117072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:117080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:117096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:117112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:117128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:117144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:117176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:117216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:117224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.527 [2024-11-28 01:23:03.245911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:117232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.527 [2024-11-28 01:23:03.245925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.245940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:117264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.528 [2024-11-28 01:23:03.245954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.245968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:117272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.528 [2024-11-28 01:23:03.245981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.245996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:117280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.528 [2024-11-28 01:23:03.246008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:117784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.528 [2024-11-28 01:23:03.246035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:117792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.528 [2024-11-28 01:23:03.246062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:117800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.528 [2024-11-28 01:23:03.246089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:117808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.528 [2024-11-28 01:23:03.246116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:117816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:117824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:117832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:117840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.528 [2024-11-28 01:23:03.246229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:117848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:117856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:117864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:117872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:117880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:117888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:117896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:117904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:117912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:117920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:117928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.528 [2024-11-28 01:23:03.246554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:117936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:117944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:117952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.528 [2024-11-28 01:23:03.246644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:117960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:117968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:117976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:117984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:117992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.528 [2024-11-28 01:23:03.246787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:118000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.528 [2024-11-28 01:23:03.246815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:118008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.528 [2024-11-28 01:23:03.246859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:118016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:118024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.528 [2024-11-28 01:23:03.246918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:118032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:118040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.528 [2024-11-28 01:23:03.246972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.246985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:118048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.528 [2024-11-28 01:23:03.246998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.247013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:118056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.528 [2024-11-28 01:23:03.247025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.247040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:118064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.528 [2024-11-28 01:23:03.247052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.528 [2024-11-28 01:23:03.247066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:118072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.529 [2024-11-28 01:23:03.247079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:118080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:117320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:117336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:117352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:117360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:117368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:117376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:117384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:117392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:118088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.529 [2024-11-28 01:23:03.247369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:118096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:118104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:118112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:118120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:118128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.529 [2024-11-28 01:23:03.247503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:118136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.529 [2024-11-28 01:23:03.247554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:118144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.529 [2024-11-28 01:23:03.247597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:118152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.529 [2024-11-28 01:23:03.247631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:117448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:117456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:117464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:117472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:117480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:117488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:117496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:117504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:117512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:117528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:117576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.247979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:117592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.247991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.248010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:117616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.248023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.248038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:117632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.248050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.248065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:117648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.529 [2024-11-28 01:23:03.248079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.248093] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x884c60 is same with the state(5) to be set 00:29:03.529 [2024-11-28 01:23:03.248109] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:29:03.529 [2024-11-28 01:23:03.248119] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:29:03.529 [2024-11-28 01:23:03.248135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:117664 len:8 PRP1 0x0 PRP2 0x0 00:29:03.529 [2024-11-28 01:23:03.248148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.248209] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x884c60 was disconnected and freed. reset controller. 00:29:03.529 [2024-11-28 01:23:03.248232] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:29:03.529 [2024-11-28 01:23:03.248267] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:03.529 [2024-11-28 01:23:03.248301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.248316] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:03.529 [2024-11-28 01:23:03.248330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.529 [2024-11-28 01:23:03.248344] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:03.529 [2024-11-28 01:23:03.248357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:03.248371] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:03.530 [2024-11-28 01:23:03.248384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:03.248397] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:03.530 [2024-11-28 01:23:03.250763] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:03.530 [2024-11-28 01:23:03.250813] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x866000 (9): Bad file descriptor 00:29:03.530 [2024-11-28 01:23:03.362642] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:29:03.530 [2024-11-28 01:23:06.955258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:16456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:16464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:16496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:16504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:16512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:16520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:16544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:16568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:17056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:16576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:16584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:16592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:16632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:16656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:16680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:16696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:16704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:17112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:17120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:17136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.955980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.955995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:17184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.530 [2024-11-28 01:23:06.956007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.956021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:17192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.530 [2024-11-28 01:23:06.956034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.956048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:17200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.530 [2024-11-28 01:23:06.956060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.956074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:17208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.530 [2024-11-28 01:23:06.956086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.956100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:17216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.956117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.956131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:17224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.530 [2024-11-28 01:23:06.956144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.956158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:17232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.530 [2024-11-28 01:23:06.956171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.956185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:17240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.956197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.956211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:17248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.530 [2024-11-28 01:23:06.956223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.530 [2024-11-28 01:23:06.956238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:17256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.531 [2024-11-28 01:23:06.956250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:17264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.956277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:17272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.956304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:17280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.956331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:17288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.531 [2024-11-28 01:23:06.956357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:17296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.531 [2024-11-28 01:23:06.956384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:17304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.531 [2024-11-28 01:23:06.956411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:17312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.956437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:17320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.531 [2024-11-28 01:23:06.956468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:17328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.956494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:17336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.531 [2024-11-28 01:23:06.956521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.956575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:16720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.956603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:16728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.956631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:16744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.956659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:16760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.956686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:16768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.956713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:16784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.956742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:16800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.956771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:17344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.531 [2024-11-28 01:23:06.956801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:17352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.956835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:17360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.956864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:17368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.531 [2024-11-28 01:23:06.956895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:17376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.956924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:17384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.531 [2024-11-28 01:23:06.956955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.956971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:17392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.531 [2024-11-28 01:23:06.956985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.957000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:17400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.531 [2024-11-28 01:23:06.957013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.957028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:17408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.531 [2024-11-28 01:23:06.957042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.957056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:16808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.957069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.957083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:16824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.957096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.957111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:16840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.957124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.957138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:16856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.957151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.957165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:16888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.957178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.957198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:16896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.957212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.957226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:16912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.957240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.957254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:16920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.531 [2024-11-28 01:23:06.957267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.957281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:17416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.531 [2024-11-28 01:23:06.957295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.957310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:17424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.531 [2024-11-28 01:23:06.957323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.531 [2024-11-28 01:23:06.957337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:17432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.531 [2024-11-28 01:23:06.957350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:17440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.957377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:17448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.532 [2024-11-28 01:23:06.957405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:17456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.957432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:17464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.532 [2024-11-28 01:23:06.957459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:17472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.532 [2024-11-28 01:23:06.957487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:17480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.957516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:17488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.532 [2024-11-28 01:23:06.957573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:17496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.532 [2024-11-28 01:23:06.957603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:17504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.957632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:16936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.957660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:16952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.957690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:16960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.957719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:16968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.957747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:16976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.957776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.957804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:16992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.957833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:17000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.957876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:17512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.957904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:17520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.532 [2024-11-28 01:23:06.957932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:17528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.957963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.957979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:17536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.957993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.958007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.958020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.958034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:17552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.958047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.958062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.958075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.958089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:17568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.532 [2024-11-28 01:23:06.958102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.958117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:17576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.958130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.958153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:17584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.958167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.958181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:17592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.532 [2024-11-28 01:23:06.958195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.958209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:17600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.532 [2024-11-28 01:23:06.958222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.958237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.958250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.958265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:17616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.958278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.958292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:17624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.532 [2024-11-28 01:23:06.958305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.958324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:17632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.532 [2024-11-28 01:23:06.958338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.958353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:17008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.958365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.958380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:17016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.958393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.958408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:17032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.958421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.958435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.958448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.958462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:17048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.958476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.958491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:17064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.958504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.532 [2024-11-28 01:23:06.958518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:17072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.532 [2024-11-28 01:23:06.958554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.958572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:17080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:06.958587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.958602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:17640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:06.958616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.958636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:06.958651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.958666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:17656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:06.958680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.958695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:06.958712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.958728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:06.958743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.958757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:17680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.533 [2024-11-28 01:23:06.958771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.958786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:17688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.533 [2024-11-28 01:23:06.958800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.958815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:17696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:06.958828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.958859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:17704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.533 [2024-11-28 01:23:06.958872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.958887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:17096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:06.958900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.958914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:17104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:06.958928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.958942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:17128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:06.958956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.958970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:17144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:06.958984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.958998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:17152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:06.959012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.959026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:06.959039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.959054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:17168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:06.959067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.959086] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8724b0 is same with the state(5) to be set 00:29:03.533 [2024-11-28 01:23:06.959104] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:29:03.533 [2024-11-28 01:23:06.959120] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:29:03.533 [2024-11-28 01:23:06.959134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17176 len:8 PRP1 0x0 PRP2 0x0 00:29:03.533 [2024-11-28 01:23:06.959147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.959214] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x8724b0 was disconnected and freed. reset controller. 00:29:03.533 [2024-11-28 01:23:06.959233] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:29:03.533 [2024-11-28 01:23:06.959282] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:03.533 [2024-11-28 01:23:06.959302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.959318] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:03.533 [2024-11-28 01:23:06.959330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.959344] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:03.533 [2024-11-28 01:23:06.959358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.959371] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:03.533 [2024-11-28 01:23:06.959385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:06.959398] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:03.533 [2024-11-28 01:23:06.959452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x866000 (9): Bad file descriptor 00:29:03.533 [2024-11-28 01:23:06.961629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:03.533 [2024-11-28 01:23:07.109562] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:29:03.533 [2024-11-28 01:23:11.513243] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:03.533 [2024-11-28 01:23:11.513286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:11.513305] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:03.533 [2024-11-28 01:23:11.513319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:11.513333] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:03.533 [2024-11-28 01:23:11.513347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:11.513362] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:03.533 [2024-11-28 01:23:11.513375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:11.513389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x866000 is same with the state(5) to be set 00:29:03.533 [2024-11-28 01:23:11.513655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:11.513680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:11.513704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:19384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:11.513720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:11.513736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:19392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:11.513750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:11.513765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:19408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:11.513779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:11.513795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:18872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:11.513809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:11.513824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:18888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:11.513837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:11.513852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:11.513866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:11.513881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:18936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:11.513895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.533 [2024-11-28 01:23:11.513910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:18968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.533 [2024-11-28 01:23:11.513923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.513954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.513967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.513993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:19016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.514006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:19056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.514034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:19432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.514087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.514116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:19472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.514144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:19488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.514170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:19496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.534 [2024-11-28 01:23:11.514198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:19504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.534 [2024-11-28 01:23:11.514224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:19512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.514251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:19520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.534 [2024-11-28 01:23:11.514278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:19528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.514314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:19536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.514341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:19544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.514367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:19552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.514394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:19560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.514421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.514453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:19576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.534 [2024-11-28 01:23:11.514482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:19584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.514532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:19592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.534 [2024-11-28 01:23:11.514567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:19600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.534 [2024-11-28 01:23:11.514597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:19608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.534 [2024-11-28 01:23:11.514628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:19616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.534 [2024-11-28 01:23:11.514656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:19624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.514685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:19632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.534 [2024-11-28 01:23:11.514713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:19640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.514740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:19648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.534 [2024-11-28 01:23:11.514768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:19656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.534 [2024-11-28 01:23:11.514806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:19664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.514853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:19672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.534 [2024-11-28 01:23:11.514881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:19680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.534 [2024-11-28 01:23:11.514908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:19688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.534 [2024-11-28 01:23:11.514935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:19696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.514962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.514976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.534 [2024-11-28 01:23:11.514989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.515003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:19712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.534 [2024-11-28 01:23:11.515016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.515030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:19720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.515043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.515057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:19728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.534 [2024-11-28 01:23:11.515070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.515084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:19736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.515096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.515110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:19744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.534 [2024-11-28 01:23:11.515123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.534 [2024-11-28 01:23:11.515137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:19064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:19112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:19136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:19152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:19168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:19240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:19776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:19784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:19792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.535 [2024-11-28 01:23:11.515536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:19800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.535 [2024-11-28 01:23:11.515567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:19808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.535 [2024-11-28 01:23:11.515599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:19816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:19824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.535 [2024-11-28 01:23:11.515654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:19832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:19840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.535 [2024-11-28 01:23:11.515708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:19848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.535 [2024-11-28 01:23:11.515735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:19856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:19864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.535 [2024-11-28 01:23:11.515788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:19872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:19880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:19888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:19904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.535 [2024-11-28 01:23:11.515942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:19912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.515973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.515987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:19920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.516000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.516014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:19928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.535 [2024-11-28 01:23:11.516026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.516041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:19936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.516053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.516067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:19944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.516080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.516095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.516108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.516122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:19960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.535 [2024-11-28 01:23:11.516134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.535 [2024-11-28 01:23:11.516149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:19968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.536 [2024-11-28 01:23:11.516161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:19976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.516188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:19984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.516214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:19992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.536 [2024-11-28 01:23:11.516240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:20000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.536 [2024-11-28 01:23:11.516267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:20008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.516298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:20016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.516325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:20024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.536 [2024-11-28 01:23:11.516351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:20032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.516378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:20040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.536 [2024-11-28 01:23:11.516405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:20048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.516432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:20056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.516459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:20064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.516486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:20072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.536 [2024-11-28 01:23:11.516512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:20080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.536 [2024-11-28 01:23:11.516562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.516591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:20096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.536 [2024-11-28 01:23:11.516618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.516649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:19280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.516678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:19288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.516707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:19296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.516734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:19312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.516762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.516790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:19336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.516817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:19344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.516866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:19352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.516895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.516921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:20120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.516948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:20128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.536 [2024-11-28 01:23:11.516975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.516989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.517001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.517016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:20144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.536 [2024-11-28 01:23:11.517032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.517047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:20152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.517060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.517073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:20160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.536 [2024-11-28 01:23:11.517086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.517100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.517113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.517127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:20176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.536 [2024-11-28 01:23:11.517139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.517154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:20184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:03.536 [2024-11-28 01:23:11.517167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.517182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:20192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.517194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.517209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:19368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.517221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.517235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.517248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.536 [2024-11-28 01:23:11.517262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:19416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.536 [2024-11-28 01:23:11.517274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.537 [2024-11-28 01:23:11.517289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.537 [2024-11-28 01:23:11.517303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.537 [2024-11-28 01:23:11.517317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:19440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.537 [2024-11-28 01:23:11.517330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.537 [2024-11-28 01:23:11.517345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:19448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.537 [2024-11-28 01:23:11.517357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.537 [2024-11-28 01:23:11.517375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:19456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:03.537 [2024-11-28 01:23:11.517389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.537 [2024-11-28 01:23:11.517403] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x886c10 is same with the state(5) to be set 00:29:03.537 [2024-11-28 01:23:11.517419] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:29:03.537 [2024-11-28 01:23:11.517430] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:29:03.537 [2024-11-28 01:23:11.517441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19480 len:8 PRP1 0x0 PRP2 0x0 00:29:03.537 [2024-11-28 01:23:11.517453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.537 [2024-11-28 01:23:11.517531] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x886c10 was disconnected and freed. reset controller. 00:29:03.537 [2024-11-28 01:23:11.517562] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:29:03.537 [2024-11-28 01:23:11.517577] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:03.537 [2024-11-28 01:23:11.519556] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:03.537 [2024-11-28 01:23:11.519596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x866000 (9): Bad file descriptor 00:29:03.537 [2024-11-28 01:23:11.626963] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:29:03.537 00:29:03.537 Latency(us) 00:29:03.537 [2024-11-28T00:23:18.140Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:03.537 [2024-11-28T00:23:18.140Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:29:03.537 Verification LBA range: start 0x0 length 0x4000 00:29:03.537 NVMe0n1 : 15.01 12646.78 49.40 1464.15 0.00 9054.76 618.95 14563.56 00:29:03.537 [2024-11-28T00:23:18.140Z] =================================================================================================================== 00:29:03.537 [2024-11-28T00:23:18.140Z] Total : 12646.78 49.40 1464.15 0.00 9054.76 618.95 14563.56 00:29:03.537 Received shutdown signal, test time was about 15.000000 seconds 00:29:03.537 00:29:03.537 Latency(us) 00:29:03.537 [2024-11-28T00:23:18.140Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:03.537 [2024-11-28T00:23:18.140Z] =================================================================================================================== 00:29:03.537 [2024-11-28T00:23:18.140Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:03.537 01:23:17 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:29:03.537 01:23:17 -- host/failover.sh@65 -- # count=3 00:29:03.537 01:23:17 -- host/failover.sh@67 -- # (( count != 3 )) 00:29:03.537 01:23:17 -- host/failover.sh@73 -- # bdevperf_pid=2146637 00:29:03.537 01:23:17 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:29:03.537 01:23:17 -- host/failover.sh@75 -- # waitforlisten 2146637 /var/tmp/bdevperf.sock 00:29:03.537 01:23:17 -- common/autotest_common.sh@829 -- # '[' -z 2146637 ']' 00:29:03.537 01:23:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:29:03.537 01:23:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:03.537 01:23:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:29:03.537 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:29:03.537 01:23:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:03.537 01:23:17 -- common/autotest_common.sh@10 -- # set +x 00:29:04.103 01:23:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:04.103 01:23:18 -- common/autotest_common.sh@862 -- # return 0 00:29:04.103 01:23:18 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:29:04.103 [2024-11-28 01:23:18.633065] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:29:04.103 01:23:18 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:29:04.360 [2024-11-28 01:23:18.901793] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:29:04.361 01:23:18 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:04.926 NVMe0n1 00:29:04.926 01:23:19 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:05.183 00:29:05.183 01:23:19 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:05.747 00:29:05.747 01:23:20 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:05.747 01:23:20 -- host/failover.sh@82 -- # grep -q NVMe0 00:29:06.004 01:23:20 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:06.260 01:23:20 -- host/failover.sh@87 -- # sleep 3 00:29:09.536 01:23:23 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:09.536 01:23:23 -- host/failover.sh@88 -- # grep -q NVMe0 00:29:09.536 01:23:23 -- host/failover.sh@90 -- # run_test_pid=2147453 00:29:09.536 01:23:23 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:29:09.536 01:23:23 -- host/failover.sh@92 -- # wait 2147453 00:29:10.908 0 00:29:10.908 01:23:25 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:29:10.908 [2024-11-28 01:23:17.439599] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:10.908 [2024-11-28 01:23:17.439688] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2146637 ] 00:29:10.908 EAL: No free 2048 kB hugepages reported on node 1 00:29:10.908 [2024-11-28 01:23:17.500773] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:10.908 [2024-11-28 01:23:17.581614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:10.908 [2024-11-28 01:23:20.687826] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:29:10.908 [2024-11-28 01:23:20.687919] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:10.908 [2024-11-28 01:23:20.687957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:10.908 [2024-11-28 01:23:20.687976] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:10.908 [2024-11-28 01:23:20.687989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:10.908 [2024-11-28 01:23:20.688004] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:10.908 [2024-11-28 01:23:20.688019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:10.908 [2024-11-28 01:23:20.688033] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:10.908 [2024-11-28 01:23:20.688047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:10.908 [2024-11-28 01:23:20.688062] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:10.908 [2024-11-28 01:23:20.688103] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:10.908 [2024-11-28 01:23:20.688135] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf87000 (9): Bad file descriptor 00:29:10.908 [2024-11-28 01:23:20.699246] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:29:10.908 Running I/O for 1 seconds... 00:29:10.908 00:29:10.908 Latency(us) 00:29:10.908 [2024-11-28T00:23:25.511Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:10.908 [2024-11-28T00:23:25.511Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:29:10.908 Verification LBA range: start 0x0 length 0x4000 00:29:10.908 NVMe0n1 : 1.01 12900.34 50.39 0.00 0.00 9878.89 1371.40 14660.65 00:29:10.908 [2024-11-28T00:23:25.511Z] =================================================================================================================== 00:29:10.908 [2024-11-28T00:23:25.511Z] Total : 12900.34 50.39 0.00 0.00 9878.89 1371.40 14660.65 00:29:10.908 01:23:25 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:10.908 01:23:25 -- host/failover.sh@95 -- # grep -q NVMe0 00:29:10.908 01:23:25 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:11.166 01:23:25 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:11.166 01:23:25 -- host/failover.sh@99 -- # grep -q NVMe0 00:29:11.424 01:23:26 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:12.005 01:23:26 -- host/failover.sh@101 -- # sleep 3 00:29:15.284 01:23:29 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:15.284 01:23:29 -- host/failover.sh@103 -- # grep -q NVMe0 00:29:15.284 01:23:29 -- host/failover.sh@108 -- # killprocess 2146637 00:29:15.284 01:23:29 -- common/autotest_common.sh@936 -- # '[' -z 2146637 ']' 00:29:15.284 01:23:29 -- common/autotest_common.sh@940 -- # kill -0 2146637 00:29:15.284 01:23:29 -- common/autotest_common.sh@941 -- # uname 00:29:15.284 01:23:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:15.284 01:23:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2146637 00:29:15.284 01:23:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:15.284 01:23:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:15.284 01:23:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2146637' 00:29:15.284 killing process with pid 2146637 00:29:15.284 01:23:29 -- common/autotest_common.sh@955 -- # kill 2146637 00:29:15.284 01:23:29 -- common/autotest_common.sh@960 -- # wait 2146637 00:29:15.284 01:23:29 -- host/failover.sh@110 -- # sync 00:29:15.284 01:23:29 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:15.542 01:23:30 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:29:15.542 01:23:30 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:29:15.542 01:23:30 -- host/failover.sh@116 -- # nvmftestfini 00:29:15.542 01:23:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:15.542 01:23:30 -- nvmf/common.sh@116 -- # sync 00:29:15.542 01:23:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:15.542 01:23:30 -- nvmf/common.sh@119 -- # set +e 00:29:15.542 01:23:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:15.542 01:23:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:15.542 rmmod nvme_tcp 00:29:15.542 rmmod nvme_fabrics 00:29:15.542 rmmod nvme_keyring 00:29:15.542 01:23:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:15.542 01:23:30 -- nvmf/common.sh@123 -- # set -e 00:29:15.542 01:23:30 -- nvmf/common.sh@124 -- # return 0 00:29:15.542 01:23:30 -- nvmf/common.sh@477 -- # '[' -n 2144159 ']' 00:29:15.542 01:23:30 -- nvmf/common.sh@478 -- # killprocess 2144159 00:29:15.542 01:23:30 -- common/autotest_common.sh@936 -- # '[' -z 2144159 ']' 00:29:15.542 01:23:30 -- common/autotest_common.sh@940 -- # kill -0 2144159 00:29:15.542 01:23:30 -- common/autotest_common.sh@941 -- # uname 00:29:15.801 01:23:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:15.801 01:23:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2144159 00:29:15.801 01:23:30 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:15.801 01:23:30 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:15.801 01:23:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2144159' 00:29:15.801 killing process with pid 2144159 00:29:15.801 01:23:30 -- common/autotest_common.sh@955 -- # kill 2144159 00:29:15.801 01:23:30 -- common/autotest_common.sh@960 -- # wait 2144159 00:29:16.060 01:23:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:16.060 01:23:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:16.060 01:23:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:16.060 01:23:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:16.060 01:23:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:16.060 01:23:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:16.060 01:23:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:16.060 01:23:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:17.966 01:23:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:17.966 00:29:17.966 real 0m37.563s 00:29:17.966 user 2m13.392s 00:29:17.966 sys 0m5.972s 00:29:17.966 01:23:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:17.966 01:23:32 -- common/autotest_common.sh@10 -- # set +x 00:29:17.966 ************************************ 00:29:17.966 END TEST nvmf_failover 00:29:17.966 ************************************ 00:29:17.966 01:23:32 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:29:17.966 01:23:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:17.966 01:23:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:17.966 01:23:32 -- common/autotest_common.sh@10 -- # set +x 00:29:17.966 ************************************ 00:29:17.966 START TEST nvmf_discovery 00:29:17.966 ************************************ 00:29:17.966 01:23:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:29:17.966 * Looking for test storage... 00:29:17.966 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:17.966 01:23:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:17.966 01:23:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:17.966 01:23:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:18.226 01:23:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:18.226 01:23:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:18.226 01:23:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:18.226 01:23:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:18.226 01:23:32 -- scripts/common.sh@335 -- # IFS=.-: 00:29:18.226 01:23:32 -- scripts/common.sh@335 -- # read -ra ver1 00:29:18.226 01:23:32 -- scripts/common.sh@336 -- # IFS=.-: 00:29:18.226 01:23:32 -- scripts/common.sh@336 -- # read -ra ver2 00:29:18.226 01:23:32 -- scripts/common.sh@337 -- # local 'op=<' 00:29:18.226 01:23:32 -- scripts/common.sh@339 -- # ver1_l=2 00:29:18.226 01:23:32 -- scripts/common.sh@340 -- # ver2_l=1 00:29:18.226 01:23:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:18.226 01:23:32 -- scripts/common.sh@343 -- # case "$op" in 00:29:18.226 01:23:32 -- scripts/common.sh@344 -- # : 1 00:29:18.226 01:23:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:18.226 01:23:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:18.226 01:23:32 -- scripts/common.sh@364 -- # decimal 1 00:29:18.226 01:23:32 -- scripts/common.sh@352 -- # local d=1 00:29:18.226 01:23:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:18.226 01:23:32 -- scripts/common.sh@354 -- # echo 1 00:29:18.226 01:23:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:18.226 01:23:32 -- scripts/common.sh@365 -- # decimal 2 00:29:18.226 01:23:32 -- scripts/common.sh@352 -- # local d=2 00:29:18.226 01:23:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:18.226 01:23:32 -- scripts/common.sh@354 -- # echo 2 00:29:18.226 01:23:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:18.226 01:23:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:18.226 01:23:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:18.226 01:23:32 -- scripts/common.sh@367 -- # return 0 00:29:18.226 01:23:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:18.226 01:23:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:18.226 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:18.226 --rc genhtml_branch_coverage=1 00:29:18.226 --rc genhtml_function_coverage=1 00:29:18.226 --rc genhtml_legend=1 00:29:18.226 --rc geninfo_all_blocks=1 00:29:18.226 --rc geninfo_unexecuted_blocks=1 00:29:18.226 00:29:18.226 ' 00:29:18.226 01:23:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:18.226 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:18.226 --rc genhtml_branch_coverage=1 00:29:18.226 --rc genhtml_function_coverage=1 00:29:18.226 --rc genhtml_legend=1 00:29:18.226 --rc geninfo_all_blocks=1 00:29:18.226 --rc geninfo_unexecuted_blocks=1 00:29:18.226 00:29:18.226 ' 00:29:18.226 01:23:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:18.226 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:18.226 --rc genhtml_branch_coverage=1 00:29:18.226 --rc genhtml_function_coverage=1 00:29:18.226 --rc genhtml_legend=1 00:29:18.226 --rc geninfo_all_blocks=1 00:29:18.226 --rc geninfo_unexecuted_blocks=1 00:29:18.226 00:29:18.226 ' 00:29:18.226 01:23:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:18.226 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:18.226 --rc genhtml_branch_coverage=1 00:29:18.226 --rc genhtml_function_coverage=1 00:29:18.226 --rc genhtml_legend=1 00:29:18.226 --rc geninfo_all_blocks=1 00:29:18.226 --rc geninfo_unexecuted_blocks=1 00:29:18.226 00:29:18.226 ' 00:29:18.226 01:23:32 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:18.226 01:23:32 -- nvmf/common.sh@7 -- # uname -s 00:29:18.226 01:23:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:18.226 01:23:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:18.226 01:23:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:18.226 01:23:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:18.226 01:23:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:18.226 01:23:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:18.226 01:23:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:18.226 01:23:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:18.226 01:23:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:18.226 01:23:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:18.226 01:23:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:18.226 01:23:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:18.226 01:23:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:18.226 01:23:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:18.226 01:23:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:18.226 01:23:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:18.226 01:23:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:18.226 01:23:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:18.226 01:23:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:18.226 01:23:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:18.226 01:23:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:18.226 01:23:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:18.226 01:23:32 -- paths/export.sh@5 -- # export PATH 00:29:18.226 01:23:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:18.226 01:23:32 -- nvmf/common.sh@46 -- # : 0 00:29:18.226 01:23:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:18.226 01:23:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:18.226 01:23:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:18.226 01:23:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:18.226 01:23:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:18.226 01:23:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:18.226 01:23:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:18.226 01:23:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:18.226 01:23:32 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:29:18.226 01:23:32 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:29:18.226 01:23:32 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:29:18.226 01:23:32 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:29:18.226 01:23:32 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:29:18.226 01:23:32 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:29:18.226 01:23:32 -- host/discovery.sh@25 -- # nvmftestinit 00:29:18.226 01:23:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:18.226 01:23:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:18.226 01:23:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:18.226 01:23:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:18.226 01:23:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:18.226 01:23:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:18.226 01:23:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:18.226 01:23:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:18.226 01:23:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:18.226 01:23:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:18.226 01:23:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:18.226 01:23:32 -- common/autotest_common.sh@10 -- # set +x 00:29:20.129 01:23:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:20.129 01:23:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:20.129 01:23:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:20.129 01:23:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:20.129 01:23:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:20.129 01:23:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:20.129 01:23:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:20.129 01:23:34 -- nvmf/common.sh@294 -- # net_devs=() 00:29:20.129 01:23:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:20.129 01:23:34 -- nvmf/common.sh@295 -- # e810=() 00:29:20.129 01:23:34 -- nvmf/common.sh@295 -- # local -ga e810 00:29:20.129 01:23:34 -- nvmf/common.sh@296 -- # x722=() 00:29:20.129 01:23:34 -- nvmf/common.sh@296 -- # local -ga x722 00:29:20.129 01:23:34 -- nvmf/common.sh@297 -- # mlx=() 00:29:20.129 01:23:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:20.129 01:23:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:20.129 01:23:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:20.129 01:23:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:20.129 01:23:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:20.129 01:23:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:20.129 01:23:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:20.129 01:23:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:20.129 01:23:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:20.129 01:23:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:20.129 01:23:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:20.129 01:23:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:20.129 01:23:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:20.129 01:23:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:20.129 01:23:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:20.129 01:23:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:20.129 01:23:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:20.129 01:23:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:20.129 01:23:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:20.129 01:23:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:20.129 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:20.129 01:23:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:20.129 01:23:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:20.129 01:23:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:20.129 01:23:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:20.129 01:23:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:20.129 01:23:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:20.129 01:23:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:20.129 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:20.129 01:23:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:20.129 01:23:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:20.129 01:23:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:20.129 01:23:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:20.129 01:23:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:20.129 01:23:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:20.129 01:23:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:20.129 01:23:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:20.129 01:23:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:20.129 01:23:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:20.129 01:23:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:20.129 01:23:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:20.129 01:23:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:20.129 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:20.129 01:23:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:20.129 01:23:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:20.129 01:23:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:20.129 01:23:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:20.129 01:23:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:20.129 01:23:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:20.129 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:20.129 01:23:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:20.129 01:23:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:20.129 01:23:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:20.129 01:23:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:20.129 01:23:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:20.129 01:23:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:20.129 01:23:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:20.129 01:23:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:20.129 01:23:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:20.129 01:23:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:20.129 01:23:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:20.129 01:23:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:20.129 01:23:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:20.129 01:23:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:20.129 01:23:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:20.129 01:23:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:20.129 01:23:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:20.129 01:23:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:20.129 01:23:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:20.129 01:23:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:20.129 01:23:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:20.129 01:23:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:20.129 01:23:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:20.388 01:23:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:20.388 01:23:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:20.388 01:23:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:20.388 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:20.388 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.209 ms 00:29:20.388 00:29:20.388 --- 10.0.0.2 ping statistics --- 00:29:20.388 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:20.388 rtt min/avg/max/mdev = 0.209/0.209/0.209/0.000 ms 00:29:20.388 01:23:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:20.388 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:20.388 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.052 ms 00:29:20.388 00:29:20.388 --- 10.0.0.1 ping statistics --- 00:29:20.388 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:20.388 rtt min/avg/max/mdev = 0.052/0.052/0.052/0.000 ms 00:29:20.388 01:23:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:20.388 01:23:34 -- nvmf/common.sh@410 -- # return 0 00:29:20.388 01:23:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:20.388 01:23:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:20.388 01:23:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:20.388 01:23:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:20.388 01:23:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:20.388 01:23:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:20.388 01:23:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:20.388 01:23:34 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:29:20.388 01:23:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:20.388 01:23:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:20.388 01:23:34 -- common/autotest_common.sh@10 -- # set +x 00:29:20.388 01:23:34 -- nvmf/common.sh@469 -- # nvmfpid=2150113 00:29:20.388 01:23:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:29:20.388 01:23:34 -- nvmf/common.sh@470 -- # waitforlisten 2150113 00:29:20.388 01:23:34 -- common/autotest_common.sh@829 -- # '[' -z 2150113 ']' 00:29:20.388 01:23:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:20.388 01:23:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:20.388 01:23:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:20.388 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:20.388 01:23:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:20.388 01:23:34 -- common/autotest_common.sh@10 -- # set +x 00:29:20.388 [2024-11-28 01:23:34.858891] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:20.388 [2024-11-28 01:23:34.858969] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:20.388 EAL: No free 2048 kB hugepages reported on node 1 00:29:20.388 [2024-11-28 01:23:34.929133] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:20.645 [2024-11-28 01:23:35.020335] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:20.645 [2024-11-28 01:23:35.020509] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:20.645 [2024-11-28 01:23:35.020537] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:20.645 [2024-11-28 01:23:35.020554] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:20.645 [2024-11-28 01:23:35.020592] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:21.579 01:23:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:21.579 01:23:35 -- common/autotest_common.sh@862 -- # return 0 00:29:21.579 01:23:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:21.579 01:23:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:21.579 01:23:35 -- common/autotest_common.sh@10 -- # set +x 00:29:21.579 01:23:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:21.579 01:23:35 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:21.579 01:23:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.579 01:23:35 -- common/autotest_common.sh@10 -- # set +x 00:29:21.579 [2024-11-28 01:23:35.841376] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:21.579 01:23:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.579 01:23:35 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:29:21.579 01:23:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.579 01:23:35 -- common/autotest_common.sh@10 -- # set +x 00:29:21.579 [2024-11-28 01:23:35.849553] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:21.579 01:23:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.579 01:23:35 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:29:21.579 01:23:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.579 01:23:35 -- common/autotest_common.sh@10 -- # set +x 00:29:21.579 null0 00:29:21.579 01:23:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.579 01:23:35 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:29:21.579 01:23:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.579 01:23:35 -- common/autotest_common.sh@10 -- # set +x 00:29:21.579 null1 00:29:21.579 01:23:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.579 01:23:35 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:29:21.579 01:23:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.579 01:23:35 -- common/autotest_common.sh@10 -- # set +x 00:29:21.579 01:23:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.579 01:23:35 -- host/discovery.sh@45 -- # hostpid=2150270 00:29:21.579 01:23:35 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:29:21.579 01:23:35 -- host/discovery.sh@46 -- # waitforlisten 2150270 /tmp/host.sock 00:29:21.579 01:23:35 -- common/autotest_common.sh@829 -- # '[' -z 2150270 ']' 00:29:21.579 01:23:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:29:21.579 01:23:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:21.579 01:23:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:21.579 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:21.579 01:23:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:21.579 01:23:35 -- common/autotest_common.sh@10 -- # set +x 00:29:21.579 [2024-11-28 01:23:35.923984] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:21.579 [2024-11-28 01:23:35.924059] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2150270 ] 00:29:21.579 EAL: No free 2048 kB hugepages reported on node 1 00:29:21.579 [2024-11-28 01:23:35.992842] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:21.579 [2024-11-28 01:23:36.083388] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:21.579 [2024-11-28 01:23:36.083584] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:22.511 01:23:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:22.511 01:23:36 -- common/autotest_common.sh@862 -- # return 0 00:29:22.511 01:23:36 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:22.511 01:23:36 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:29:22.511 01:23:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.511 01:23:36 -- common/autotest_common.sh@10 -- # set +x 00:29:22.511 01:23:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.511 01:23:36 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:29:22.511 01:23:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.511 01:23:36 -- common/autotest_common.sh@10 -- # set +x 00:29:22.511 01:23:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.512 01:23:36 -- host/discovery.sh@72 -- # notify_id=0 00:29:22.512 01:23:36 -- host/discovery.sh@78 -- # get_subsystem_names 00:29:22.512 01:23:36 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:22.512 01:23:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.512 01:23:36 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:22.512 01:23:36 -- common/autotest_common.sh@10 -- # set +x 00:29:22.512 01:23:36 -- host/discovery.sh@59 -- # sort 00:29:22.512 01:23:36 -- host/discovery.sh@59 -- # xargs 00:29:22.512 01:23:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.512 01:23:36 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:29:22.512 01:23:36 -- host/discovery.sh@79 -- # get_bdev_list 00:29:22.512 01:23:36 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:22.512 01:23:36 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:22.512 01:23:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.512 01:23:36 -- common/autotest_common.sh@10 -- # set +x 00:29:22.512 01:23:36 -- host/discovery.sh@55 -- # sort 00:29:22.512 01:23:36 -- host/discovery.sh@55 -- # xargs 00:29:22.512 01:23:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.512 01:23:37 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:29:22.512 01:23:37 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:29:22.512 01:23:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.512 01:23:37 -- common/autotest_common.sh@10 -- # set +x 00:29:22.512 01:23:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.512 01:23:37 -- host/discovery.sh@82 -- # get_subsystem_names 00:29:22.512 01:23:37 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:22.512 01:23:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.512 01:23:37 -- common/autotest_common.sh@10 -- # set +x 00:29:22.512 01:23:37 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:22.512 01:23:37 -- host/discovery.sh@59 -- # sort 00:29:22.512 01:23:37 -- host/discovery.sh@59 -- # xargs 00:29:22.512 01:23:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.512 01:23:37 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:29:22.512 01:23:37 -- host/discovery.sh@83 -- # get_bdev_list 00:29:22.512 01:23:37 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:22.512 01:23:37 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:22.512 01:23:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.512 01:23:37 -- host/discovery.sh@55 -- # sort 00:29:22.512 01:23:37 -- common/autotest_common.sh@10 -- # set +x 00:29:22.512 01:23:37 -- host/discovery.sh@55 -- # xargs 00:29:22.512 01:23:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.769 01:23:37 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:29:22.769 01:23:37 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:29:22.769 01:23:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.769 01:23:37 -- common/autotest_common.sh@10 -- # set +x 00:29:22.769 01:23:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.769 01:23:37 -- host/discovery.sh@86 -- # get_subsystem_names 00:29:22.769 01:23:37 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:22.769 01:23:37 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:22.769 01:23:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.769 01:23:37 -- common/autotest_common.sh@10 -- # set +x 00:29:22.769 01:23:37 -- host/discovery.sh@59 -- # sort 00:29:22.769 01:23:37 -- host/discovery.sh@59 -- # xargs 00:29:22.769 01:23:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.769 01:23:37 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:29:22.769 01:23:37 -- host/discovery.sh@87 -- # get_bdev_list 00:29:22.769 01:23:37 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:22.769 01:23:37 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:22.769 01:23:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.769 01:23:37 -- common/autotest_common.sh@10 -- # set +x 00:29:22.769 01:23:37 -- host/discovery.sh@55 -- # sort 00:29:22.769 01:23:37 -- host/discovery.sh@55 -- # xargs 00:29:22.769 01:23:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.769 01:23:37 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:29:22.769 01:23:37 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:22.769 01:23:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.769 01:23:37 -- common/autotest_common.sh@10 -- # set +x 00:29:22.769 [2024-11-28 01:23:37.213348] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:22.769 01:23:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.769 01:23:37 -- host/discovery.sh@92 -- # get_subsystem_names 00:29:22.769 01:23:37 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:22.769 01:23:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.769 01:23:37 -- common/autotest_common.sh@10 -- # set +x 00:29:22.769 01:23:37 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:22.769 01:23:37 -- host/discovery.sh@59 -- # sort 00:29:22.770 01:23:37 -- host/discovery.sh@59 -- # xargs 00:29:22.770 01:23:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.770 01:23:37 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:29:22.770 01:23:37 -- host/discovery.sh@93 -- # get_bdev_list 00:29:22.770 01:23:37 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:22.770 01:23:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.770 01:23:37 -- common/autotest_common.sh@10 -- # set +x 00:29:22.770 01:23:37 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:22.770 01:23:37 -- host/discovery.sh@55 -- # sort 00:29:22.770 01:23:37 -- host/discovery.sh@55 -- # xargs 00:29:22.770 01:23:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.770 01:23:37 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:29:22.770 01:23:37 -- host/discovery.sh@94 -- # get_notification_count 00:29:22.770 01:23:37 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:29:22.770 01:23:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.770 01:23:37 -- host/discovery.sh@74 -- # jq '. | length' 00:29:22.770 01:23:37 -- common/autotest_common.sh@10 -- # set +x 00:29:22.770 01:23:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.770 01:23:37 -- host/discovery.sh@74 -- # notification_count=0 00:29:22.770 01:23:37 -- host/discovery.sh@75 -- # notify_id=0 00:29:22.770 01:23:37 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:29:22.770 01:23:37 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:29:22.770 01:23:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.770 01:23:37 -- common/autotest_common.sh@10 -- # set +x 00:29:22.770 01:23:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.770 01:23:37 -- host/discovery.sh@100 -- # sleep 1 00:29:23.703 [2024-11-28 01:23:38.001709] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:23.703 [2024-11-28 01:23:38.001738] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:23.703 [2024-11-28 01:23:38.001761] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:23.703 [2024-11-28 01:23:38.090071] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:23.703 [2024-11-28 01:23:38.273193] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:23.703 [2024-11-28 01:23:38.273220] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:23.961 01:23:38 -- host/discovery.sh@101 -- # get_subsystem_names 00:29:23.961 01:23:38 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:23.961 01:23:38 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:23.961 01:23:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:23.961 01:23:38 -- common/autotest_common.sh@10 -- # set +x 00:29:23.961 01:23:38 -- host/discovery.sh@59 -- # sort 00:29:23.961 01:23:38 -- host/discovery.sh@59 -- # xargs 00:29:23.961 01:23:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:23.961 01:23:38 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:23.961 01:23:38 -- host/discovery.sh@102 -- # get_bdev_list 00:29:23.961 01:23:38 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:23.961 01:23:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:23.961 01:23:38 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:23.961 01:23:38 -- common/autotest_common.sh@10 -- # set +x 00:29:23.961 01:23:38 -- host/discovery.sh@55 -- # sort 00:29:23.961 01:23:38 -- host/discovery.sh@55 -- # xargs 00:29:23.961 01:23:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:23.961 01:23:38 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:29:23.961 01:23:38 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:29:23.961 01:23:38 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:23.961 01:23:38 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:23.961 01:23:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:23.961 01:23:38 -- common/autotest_common.sh@10 -- # set +x 00:29:23.961 01:23:38 -- host/discovery.sh@63 -- # sort -n 00:29:23.961 01:23:38 -- host/discovery.sh@63 -- # xargs 00:29:23.961 01:23:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:23.961 01:23:38 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:29:23.961 01:23:38 -- host/discovery.sh@104 -- # get_notification_count 00:29:23.961 01:23:38 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:29:23.961 01:23:38 -- host/discovery.sh@74 -- # jq '. | length' 00:29:23.961 01:23:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:23.961 01:23:38 -- common/autotest_common.sh@10 -- # set +x 00:29:23.961 01:23:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:23.961 01:23:38 -- host/discovery.sh@74 -- # notification_count=1 00:29:23.961 01:23:38 -- host/discovery.sh@75 -- # notify_id=1 00:29:23.961 01:23:38 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:29:23.961 01:23:38 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:29:23.961 01:23:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:23.961 01:23:38 -- common/autotest_common.sh@10 -- # set +x 00:29:23.961 01:23:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:23.961 01:23:38 -- host/discovery.sh@109 -- # sleep 1 00:29:25.335 01:23:39 -- host/discovery.sh@110 -- # get_bdev_list 00:29:25.335 01:23:39 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:25.335 01:23:39 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:25.335 01:23:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.335 01:23:39 -- common/autotest_common.sh@10 -- # set +x 00:29:25.335 01:23:39 -- host/discovery.sh@55 -- # sort 00:29:25.335 01:23:39 -- host/discovery.sh@55 -- # xargs 00:29:25.335 01:23:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.335 01:23:39 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:25.335 01:23:39 -- host/discovery.sh@111 -- # get_notification_count 00:29:25.335 01:23:39 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:29:25.335 01:23:39 -- host/discovery.sh@74 -- # jq '. | length' 00:29:25.335 01:23:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.335 01:23:39 -- common/autotest_common.sh@10 -- # set +x 00:29:25.335 01:23:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.335 01:23:39 -- host/discovery.sh@74 -- # notification_count=1 00:29:25.335 01:23:39 -- host/discovery.sh@75 -- # notify_id=2 00:29:25.335 01:23:39 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:29:25.335 01:23:39 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:29:25.335 01:23:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.335 01:23:39 -- common/autotest_common.sh@10 -- # set +x 00:29:25.335 [2024-11-28 01:23:39.624564] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:29:25.335 [2024-11-28 01:23:39.625174] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:25.335 [2024-11-28 01:23:39.625231] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:25.335 01:23:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.335 01:23:39 -- host/discovery.sh@117 -- # sleep 1 00:29:25.335 [2024-11-28 01:23:39.711390] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:29:25.594 [2024-11-28 01:23:40.013857] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:25.594 [2024-11-28 01:23:40.013894] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:25.594 [2024-11-28 01:23:40.013911] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:26.159 01:23:40 -- host/discovery.sh@118 -- # get_subsystem_names 00:29:26.159 01:23:40 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:26.159 01:23:40 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:26.159 01:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.159 01:23:40 -- common/autotest_common.sh@10 -- # set +x 00:29:26.159 01:23:40 -- host/discovery.sh@59 -- # sort 00:29:26.159 01:23:40 -- host/discovery.sh@59 -- # xargs 00:29:26.159 01:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.159 01:23:40 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:26.159 01:23:40 -- host/discovery.sh@119 -- # get_bdev_list 00:29:26.159 01:23:40 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:26.159 01:23:40 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:26.159 01:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.159 01:23:40 -- host/discovery.sh@55 -- # sort 00:29:26.159 01:23:40 -- common/autotest_common.sh@10 -- # set +x 00:29:26.159 01:23:40 -- host/discovery.sh@55 -- # xargs 00:29:26.159 01:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.159 01:23:40 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:26.159 01:23:40 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:29:26.159 01:23:40 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:26.159 01:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.159 01:23:40 -- common/autotest_common.sh@10 -- # set +x 00:29:26.159 01:23:40 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:26.159 01:23:40 -- host/discovery.sh@63 -- # sort -n 00:29:26.159 01:23:40 -- host/discovery.sh@63 -- # xargs 00:29:26.159 01:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.159 01:23:40 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:29:26.159 01:23:40 -- host/discovery.sh@121 -- # get_notification_count 00:29:26.159 01:23:40 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:26.159 01:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.159 01:23:40 -- host/discovery.sh@74 -- # jq '. | length' 00:29:26.417 01:23:40 -- common/autotest_common.sh@10 -- # set +x 00:29:26.417 01:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.417 01:23:40 -- host/discovery.sh@74 -- # notification_count=0 00:29:26.417 01:23:40 -- host/discovery.sh@75 -- # notify_id=2 00:29:26.417 01:23:40 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:29:26.417 01:23:40 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:26.417 01:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.417 01:23:40 -- common/autotest_common.sh@10 -- # set +x 00:29:26.417 [2024-11-28 01:23:40.800891] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:26.417 [2024-11-28 01:23:40.800935] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:26.417 01:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.417 01:23:40 -- host/discovery.sh@127 -- # sleep 1 00:29:26.417 [2024-11-28 01:23:40.806626] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:26.417 [2024-11-28 01:23:40.806674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:26.417 [2024-11-28 01:23:40.806691] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:26.417 [2024-11-28 01:23:40.806704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:26.417 [2024-11-28 01:23:40.806717] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:26.417 [2024-11-28 01:23:40.806730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:26.417 [2024-11-28 01:23:40.806743] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:26.417 [2024-11-28 01:23:40.806756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:26.417 [2024-11-28 01:23:40.806769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x116b410 is same with the state(5) to be set 00:29:26.417 [2024-11-28 01:23:40.816633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x116b410 (9): Bad file descriptor 00:29:26.417 [2024-11-28 01:23:40.826680] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:26.417 [2024-11-28 01:23:40.826984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:26.417 [2024-11-28 01:23:40.827104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:26.417 [2024-11-28 01:23:40.827140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x116b410 with addr=10.0.0.2, port=4420 00:29:26.417 [2024-11-28 01:23:40.827157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x116b410 is same with the state(5) to be set 00:29:26.417 [2024-11-28 01:23:40.827180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x116b410 (9): Bad file descriptor 00:29:26.417 [2024-11-28 01:23:40.827234] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:26.417 [2024-11-28 01:23:40.827255] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:26.417 [2024-11-28 01:23:40.827273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:26.417 [2024-11-28 01:23:40.827295] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:26.417 [2024-11-28 01:23:40.836769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:26.417 [2024-11-28 01:23:40.836935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:26.417 [2024-11-28 01:23:40.837111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:26.417 [2024-11-28 01:23:40.837140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x116b410 with addr=10.0.0.2, port=4420 00:29:26.417 [2024-11-28 01:23:40.837157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x116b410 is same with the state(5) to be set 00:29:26.417 [2024-11-28 01:23:40.837181] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x116b410 (9): Bad file descriptor 00:29:26.417 [2024-11-28 01:23:40.837218] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:26.417 [2024-11-28 01:23:40.837237] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:26.417 [2024-11-28 01:23:40.837252] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:26.417 [2024-11-28 01:23:40.837287] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:26.417 [2024-11-28 01:23:40.846855] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:26.417 [2024-11-28 01:23:40.847065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:26.417 [2024-11-28 01:23:40.847173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:26.417 [2024-11-28 01:23:40.847199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x116b410 with addr=10.0.0.2, port=4420 00:29:26.417 [2024-11-28 01:23:40.847215] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x116b410 is same with the state(5) to be set 00:29:26.417 [2024-11-28 01:23:40.847236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x116b410 (9): Bad file descriptor 00:29:26.417 [2024-11-28 01:23:40.847256] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:26.417 [2024-11-28 01:23:40.847269] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:26.417 [2024-11-28 01:23:40.847282] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:26.418 [2024-11-28 01:23:40.847327] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:26.418 [2024-11-28 01:23:40.856935] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:26.418 [2024-11-28 01:23:40.857102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:26.418 [2024-11-28 01:23:40.857281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:26.418 [2024-11-28 01:23:40.857307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x116b410 with addr=10.0.0.2, port=4420 00:29:26.418 [2024-11-28 01:23:40.857328] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x116b410 is same with the state(5) to be set 00:29:26.418 [2024-11-28 01:23:40.857351] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x116b410 (9): Bad file descriptor 00:29:26.418 [2024-11-28 01:23:40.857395] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:26.418 [2024-11-28 01:23:40.857413] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:26.418 [2024-11-28 01:23:40.857427] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:26.418 [2024-11-28 01:23:40.857445] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:26.418 [2024-11-28 01:23:40.867011] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:26.418 [2024-11-28 01:23:40.867183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:26.418 [2024-11-28 01:23:40.867344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:26.418 [2024-11-28 01:23:40.867370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x116b410 with addr=10.0.0.2, port=4420 00:29:26.418 [2024-11-28 01:23:40.867385] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x116b410 is same with the state(5) to be set 00:29:26.418 [2024-11-28 01:23:40.867407] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x116b410 (9): Bad file descriptor 00:29:26.418 [2024-11-28 01:23:40.867440] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:26.418 [2024-11-28 01:23:40.867458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:26.418 [2024-11-28 01:23:40.867471] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:26.418 [2024-11-28 01:23:40.867490] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:26.418 [2024-11-28 01:23:40.877088] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:26.418 [2024-11-28 01:23:40.877260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:26.418 [2024-11-28 01:23:40.877434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:26.418 [2024-11-28 01:23:40.877460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x116b410 with addr=10.0.0.2, port=4420 00:29:26.418 [2024-11-28 01:23:40.877475] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x116b410 is same with the state(5) to be set 00:29:26.418 [2024-11-28 01:23:40.877496] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x116b410 (9): Bad file descriptor 00:29:26.418 [2024-11-28 01:23:40.877546] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:26.418 [2024-11-28 01:23:40.877566] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:26.418 [2024-11-28 01:23:40.877579] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:26.418 [2024-11-28 01:23:40.877597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:26.418 [2024-11-28 01:23:40.887162] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:26.418 [2024-11-28 01:23:40.887302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:26.418 [2024-11-28 01:23:40.887449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:26.418 [2024-11-28 01:23:40.887477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x116b410 with addr=10.0.0.2, port=4420 00:29:26.418 [2024-11-28 01:23:40.887493] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x116b410 is same with the state(5) to be set 00:29:26.418 [2024-11-28 01:23:40.887533] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x116b410 (9): Bad file descriptor 00:29:26.418 [2024-11-28 01:23:40.887574] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:26.418 [2024-11-28 01:23:40.887588] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:26.418 [2024-11-28 01:23:40.887600] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:26.418 [2024-11-28 01:23:40.887663] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:29:26.418 [2024-11-28 01:23:40.887689] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:26.418 [2024-11-28 01:23:40.887726] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:27.351 01:23:41 -- host/discovery.sh@128 -- # get_subsystem_names 00:29:27.351 01:23:41 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:27.351 01:23:41 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:27.351 01:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.351 01:23:41 -- common/autotest_common.sh@10 -- # set +x 00:29:27.351 01:23:41 -- host/discovery.sh@59 -- # sort 00:29:27.351 01:23:41 -- host/discovery.sh@59 -- # xargs 00:29:27.351 01:23:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.351 01:23:41 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:27.351 01:23:41 -- host/discovery.sh@129 -- # get_bdev_list 00:29:27.351 01:23:41 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:27.351 01:23:41 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:27.351 01:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.351 01:23:41 -- common/autotest_common.sh@10 -- # set +x 00:29:27.351 01:23:41 -- host/discovery.sh@55 -- # sort 00:29:27.351 01:23:41 -- host/discovery.sh@55 -- # xargs 00:29:27.351 01:23:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.351 01:23:41 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:27.351 01:23:41 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:29:27.351 01:23:41 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:27.351 01:23:41 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:27.351 01:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.351 01:23:41 -- common/autotest_common.sh@10 -- # set +x 00:29:27.351 01:23:41 -- host/discovery.sh@63 -- # sort -n 00:29:27.351 01:23:41 -- host/discovery.sh@63 -- # xargs 00:29:27.351 01:23:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.351 01:23:41 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:29:27.351 01:23:41 -- host/discovery.sh@131 -- # get_notification_count 00:29:27.351 01:23:41 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:27.351 01:23:41 -- host/discovery.sh@74 -- # jq '. | length' 00:29:27.351 01:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.351 01:23:41 -- common/autotest_common.sh@10 -- # set +x 00:29:27.351 01:23:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.609 01:23:41 -- host/discovery.sh@74 -- # notification_count=0 00:29:27.609 01:23:41 -- host/discovery.sh@75 -- # notify_id=2 00:29:27.609 01:23:41 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:29:27.609 01:23:41 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:29:27.609 01:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.609 01:23:41 -- common/autotest_common.sh@10 -- # set +x 00:29:27.609 01:23:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.609 01:23:41 -- host/discovery.sh@135 -- # sleep 1 00:29:28.542 01:23:42 -- host/discovery.sh@136 -- # get_subsystem_names 00:29:28.542 01:23:42 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:28.542 01:23:42 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:28.542 01:23:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.542 01:23:42 -- common/autotest_common.sh@10 -- # set +x 00:29:28.542 01:23:42 -- host/discovery.sh@59 -- # sort 00:29:28.542 01:23:42 -- host/discovery.sh@59 -- # xargs 00:29:28.542 01:23:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.542 01:23:43 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:29:28.542 01:23:43 -- host/discovery.sh@137 -- # get_bdev_list 00:29:28.542 01:23:43 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:28.542 01:23:43 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:28.542 01:23:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.542 01:23:43 -- common/autotest_common.sh@10 -- # set +x 00:29:28.542 01:23:43 -- host/discovery.sh@55 -- # sort 00:29:28.542 01:23:43 -- host/discovery.sh@55 -- # xargs 00:29:28.542 01:23:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.542 01:23:43 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:29:28.542 01:23:43 -- host/discovery.sh@138 -- # get_notification_count 00:29:28.542 01:23:43 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:28.542 01:23:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.542 01:23:43 -- host/discovery.sh@74 -- # jq '. | length' 00:29:28.542 01:23:43 -- common/autotest_common.sh@10 -- # set +x 00:29:28.542 01:23:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.542 01:23:43 -- host/discovery.sh@74 -- # notification_count=2 00:29:28.542 01:23:43 -- host/discovery.sh@75 -- # notify_id=4 00:29:28.542 01:23:43 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:29:28.542 01:23:43 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:28.542 01:23:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.542 01:23:43 -- common/autotest_common.sh@10 -- # set +x 00:29:29.917 [2024-11-28 01:23:44.157676] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:29.917 [2024-11-28 01:23:44.157711] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:29.917 [2024-11-28 01:23:44.157731] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:29.917 [2024-11-28 01:23:44.244043] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:29:29.917 [2024-11-28 01:23:44.512925] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:29.917 [2024-11-28 01:23:44.512966] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:29.917 01:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.917 01:23:44 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:29.917 01:23:44 -- common/autotest_common.sh@650 -- # local es=0 00:29:29.917 01:23:44 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:29.917 01:23:44 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:29.917 01:23:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:29.917 01:23:44 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:29.917 01:23:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:29.917 01:23:44 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:29.917 01:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.917 01:23:44 -- common/autotest_common.sh@10 -- # set +x 00:29:30.176 request: 00:29:30.176 { 00:29:30.176 "name": "nvme", 00:29:30.176 "trtype": "tcp", 00:29:30.176 "traddr": "10.0.0.2", 00:29:30.176 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:30.176 "adrfam": "ipv4", 00:29:30.176 "trsvcid": "8009", 00:29:30.176 "wait_for_attach": true, 00:29:30.176 "method": "bdev_nvme_start_discovery", 00:29:30.176 "req_id": 1 00:29:30.176 } 00:29:30.176 Got JSON-RPC error response 00:29:30.176 response: 00:29:30.176 { 00:29:30.176 "code": -17, 00:29:30.176 "message": "File exists" 00:29:30.176 } 00:29:30.176 01:23:44 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:30.176 01:23:44 -- common/autotest_common.sh@653 -- # es=1 00:29:30.176 01:23:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:30.176 01:23:44 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:30.176 01:23:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:30.176 01:23:44 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:29:30.176 01:23:44 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:30.176 01:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:30.176 01:23:44 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:30.176 01:23:44 -- common/autotest_common.sh@10 -- # set +x 00:29:30.176 01:23:44 -- host/discovery.sh@67 -- # sort 00:29:30.176 01:23:44 -- host/discovery.sh@67 -- # xargs 00:29:30.176 01:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:30.176 01:23:44 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:29:30.176 01:23:44 -- host/discovery.sh@147 -- # get_bdev_list 00:29:30.176 01:23:44 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:30.176 01:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:30.176 01:23:44 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:30.176 01:23:44 -- common/autotest_common.sh@10 -- # set +x 00:29:30.176 01:23:44 -- host/discovery.sh@55 -- # sort 00:29:30.176 01:23:44 -- host/discovery.sh@55 -- # xargs 00:29:30.176 01:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:30.176 01:23:44 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:30.176 01:23:44 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:30.176 01:23:44 -- common/autotest_common.sh@650 -- # local es=0 00:29:30.176 01:23:44 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:30.176 01:23:44 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:30.176 01:23:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:30.176 01:23:44 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:30.176 01:23:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:30.176 01:23:44 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:30.176 01:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:30.176 01:23:44 -- common/autotest_common.sh@10 -- # set +x 00:29:30.176 request: 00:29:30.176 { 00:29:30.176 "name": "nvme_second", 00:29:30.176 "trtype": "tcp", 00:29:30.176 "traddr": "10.0.0.2", 00:29:30.176 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:30.176 "adrfam": "ipv4", 00:29:30.176 "trsvcid": "8009", 00:29:30.176 "wait_for_attach": true, 00:29:30.176 "method": "bdev_nvme_start_discovery", 00:29:30.176 "req_id": 1 00:29:30.176 } 00:29:30.176 Got JSON-RPC error response 00:29:30.176 response: 00:29:30.176 { 00:29:30.176 "code": -17, 00:29:30.176 "message": "File exists" 00:29:30.176 } 00:29:30.176 01:23:44 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:30.176 01:23:44 -- common/autotest_common.sh@653 -- # es=1 00:29:30.176 01:23:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:30.176 01:23:44 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:30.176 01:23:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:30.176 01:23:44 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:29:30.176 01:23:44 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:30.176 01:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:30.176 01:23:44 -- common/autotest_common.sh@10 -- # set +x 00:29:30.176 01:23:44 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:30.176 01:23:44 -- host/discovery.sh@67 -- # sort 00:29:30.176 01:23:44 -- host/discovery.sh@67 -- # xargs 00:29:30.176 01:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:30.176 01:23:44 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:29:30.176 01:23:44 -- host/discovery.sh@153 -- # get_bdev_list 00:29:30.176 01:23:44 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:30.176 01:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:30.176 01:23:44 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:30.176 01:23:44 -- common/autotest_common.sh@10 -- # set +x 00:29:30.176 01:23:44 -- host/discovery.sh@55 -- # sort 00:29:30.176 01:23:44 -- host/discovery.sh@55 -- # xargs 00:29:30.176 01:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:30.176 01:23:44 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:30.176 01:23:44 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:30.176 01:23:44 -- common/autotest_common.sh@650 -- # local es=0 00:29:30.176 01:23:44 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:30.176 01:23:44 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:30.176 01:23:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:30.176 01:23:44 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:30.176 01:23:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:30.176 01:23:44 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:30.176 01:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:30.176 01:23:44 -- common/autotest_common.sh@10 -- # set +x 00:29:31.548 [2024-11-28 01:23:45.713032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:31.548 [2024-11-28 01:23:45.713155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:31.548 [2024-11-28 01:23:45.713182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10e22e0 with addr=10.0.0.2, port=8010 00:29:31.548 [2024-11-28 01:23:45.713212] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:31.548 [2024-11-28 01:23:45.713227] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:31.548 [2024-11-28 01:23:45.713240] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:32.114 [2024-11-28 01:23:46.715380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:32.114 [2024-11-28 01:23:46.715502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:32.114 [2024-11-28 01:23:46.715548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10e22e0 with addr=10.0.0.2, port=8010 00:29:32.114 [2024-11-28 01:23:46.715585] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:32.114 [2024-11-28 01:23:46.715598] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:32.114 [2024-11-28 01:23:46.715610] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:33.518 [2024-11-28 01:23:47.717667] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:29:33.518 request: 00:29:33.518 { 00:29:33.518 "name": "nvme_second", 00:29:33.518 "trtype": "tcp", 00:29:33.518 "traddr": "10.0.0.2", 00:29:33.518 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:33.518 "adrfam": "ipv4", 00:29:33.518 "trsvcid": "8010", 00:29:33.518 "attach_timeout_ms": 3000, 00:29:33.518 "method": "bdev_nvme_start_discovery", 00:29:33.518 "req_id": 1 00:29:33.518 } 00:29:33.518 Got JSON-RPC error response 00:29:33.518 response: 00:29:33.518 { 00:29:33.518 "code": -110, 00:29:33.518 "message": "Connection timed out" 00:29:33.518 } 00:29:33.518 01:23:47 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:33.518 01:23:47 -- common/autotest_common.sh@653 -- # es=1 00:29:33.518 01:23:47 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:33.518 01:23:47 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:33.518 01:23:47 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:33.518 01:23:47 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:29:33.518 01:23:47 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:33.518 01:23:47 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:33.518 01:23:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:33.518 01:23:47 -- common/autotest_common.sh@10 -- # set +x 00:29:33.518 01:23:47 -- host/discovery.sh@67 -- # sort 00:29:33.518 01:23:47 -- host/discovery.sh@67 -- # xargs 00:29:33.518 01:23:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:33.518 01:23:47 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:29:33.518 01:23:47 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:29:33.518 01:23:47 -- host/discovery.sh@162 -- # kill 2150270 00:29:33.518 01:23:47 -- host/discovery.sh@163 -- # nvmftestfini 00:29:33.518 01:23:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:33.518 01:23:47 -- nvmf/common.sh@116 -- # sync 00:29:33.518 01:23:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:33.518 01:23:47 -- nvmf/common.sh@119 -- # set +e 00:29:33.518 01:23:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:33.518 01:23:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:33.518 rmmod nvme_tcp 00:29:33.518 rmmod nvme_fabrics 00:29:33.518 rmmod nvme_keyring 00:29:33.518 01:23:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:33.518 01:23:47 -- nvmf/common.sh@123 -- # set -e 00:29:33.518 01:23:47 -- nvmf/common.sh@124 -- # return 0 00:29:33.518 01:23:47 -- nvmf/common.sh@477 -- # '[' -n 2150113 ']' 00:29:33.518 01:23:47 -- nvmf/common.sh@478 -- # killprocess 2150113 00:29:33.518 01:23:47 -- common/autotest_common.sh@936 -- # '[' -z 2150113 ']' 00:29:33.518 01:23:47 -- common/autotest_common.sh@940 -- # kill -0 2150113 00:29:33.518 01:23:47 -- common/autotest_common.sh@941 -- # uname 00:29:33.518 01:23:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:33.518 01:23:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2150113 00:29:33.518 01:23:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:33.518 01:23:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:33.518 01:23:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2150113' 00:29:33.518 killing process with pid 2150113 00:29:33.518 01:23:47 -- common/autotest_common.sh@955 -- # kill 2150113 00:29:33.518 01:23:47 -- common/autotest_common.sh@960 -- # wait 2150113 00:29:33.518 01:23:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:33.518 01:23:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:33.518 01:23:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:33.518 01:23:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:33.518 01:23:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:33.518 01:23:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:33.518 01:23:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:33.518 01:23:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:36.053 01:23:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:36.053 00:29:36.053 real 0m17.652s 00:29:36.053 user 0m27.477s 00:29:36.053 sys 0m2.891s 00:29:36.053 01:23:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:36.053 01:23:50 -- common/autotest_common.sh@10 -- # set +x 00:29:36.053 ************************************ 00:29:36.053 END TEST nvmf_discovery 00:29:36.053 ************************************ 00:29:36.053 01:23:50 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:36.053 01:23:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:36.053 01:23:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:36.053 01:23:50 -- common/autotest_common.sh@10 -- # set +x 00:29:36.053 ************************************ 00:29:36.053 START TEST nvmf_discovery_remove_ifc 00:29:36.053 ************************************ 00:29:36.053 01:23:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:36.053 * Looking for test storage... 00:29:36.053 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:36.053 01:23:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:36.053 01:23:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:36.053 01:23:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:36.053 01:23:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:36.053 01:23:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:36.053 01:23:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:36.053 01:23:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:36.053 01:23:50 -- scripts/common.sh@335 -- # IFS=.-: 00:29:36.053 01:23:50 -- scripts/common.sh@335 -- # read -ra ver1 00:29:36.053 01:23:50 -- scripts/common.sh@336 -- # IFS=.-: 00:29:36.053 01:23:50 -- scripts/common.sh@336 -- # read -ra ver2 00:29:36.053 01:23:50 -- scripts/common.sh@337 -- # local 'op=<' 00:29:36.053 01:23:50 -- scripts/common.sh@339 -- # ver1_l=2 00:29:36.053 01:23:50 -- scripts/common.sh@340 -- # ver2_l=1 00:29:36.053 01:23:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:36.053 01:23:50 -- scripts/common.sh@343 -- # case "$op" in 00:29:36.053 01:23:50 -- scripts/common.sh@344 -- # : 1 00:29:36.053 01:23:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:36.053 01:23:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:36.053 01:23:50 -- scripts/common.sh@364 -- # decimal 1 00:29:36.053 01:23:50 -- scripts/common.sh@352 -- # local d=1 00:29:36.053 01:23:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:36.053 01:23:50 -- scripts/common.sh@354 -- # echo 1 00:29:36.053 01:23:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:36.053 01:23:50 -- scripts/common.sh@365 -- # decimal 2 00:29:36.053 01:23:50 -- scripts/common.sh@352 -- # local d=2 00:29:36.053 01:23:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:36.053 01:23:50 -- scripts/common.sh@354 -- # echo 2 00:29:36.053 01:23:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:36.053 01:23:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:36.053 01:23:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:36.053 01:23:50 -- scripts/common.sh@367 -- # return 0 00:29:36.053 01:23:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:36.053 01:23:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:36.053 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:36.053 --rc genhtml_branch_coverage=1 00:29:36.053 --rc genhtml_function_coverage=1 00:29:36.053 --rc genhtml_legend=1 00:29:36.053 --rc geninfo_all_blocks=1 00:29:36.054 --rc geninfo_unexecuted_blocks=1 00:29:36.054 00:29:36.054 ' 00:29:36.054 01:23:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:36.054 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:36.054 --rc genhtml_branch_coverage=1 00:29:36.054 --rc genhtml_function_coverage=1 00:29:36.054 --rc genhtml_legend=1 00:29:36.054 --rc geninfo_all_blocks=1 00:29:36.054 --rc geninfo_unexecuted_blocks=1 00:29:36.054 00:29:36.054 ' 00:29:36.054 01:23:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:36.054 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:36.054 --rc genhtml_branch_coverage=1 00:29:36.054 --rc genhtml_function_coverage=1 00:29:36.054 --rc genhtml_legend=1 00:29:36.054 --rc geninfo_all_blocks=1 00:29:36.054 --rc geninfo_unexecuted_blocks=1 00:29:36.054 00:29:36.054 ' 00:29:36.054 01:23:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:36.054 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:36.054 --rc genhtml_branch_coverage=1 00:29:36.054 --rc genhtml_function_coverage=1 00:29:36.054 --rc genhtml_legend=1 00:29:36.054 --rc geninfo_all_blocks=1 00:29:36.054 --rc geninfo_unexecuted_blocks=1 00:29:36.054 00:29:36.054 ' 00:29:36.054 01:23:50 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:36.054 01:23:50 -- nvmf/common.sh@7 -- # uname -s 00:29:36.054 01:23:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:36.054 01:23:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:36.054 01:23:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:36.054 01:23:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:36.054 01:23:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:36.054 01:23:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:36.054 01:23:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:36.054 01:23:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:36.054 01:23:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:36.054 01:23:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:36.054 01:23:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:36.054 01:23:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:36.054 01:23:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:36.054 01:23:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:36.054 01:23:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:36.054 01:23:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:36.054 01:23:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:36.054 01:23:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:36.054 01:23:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:36.054 01:23:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:36.054 01:23:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:36.054 01:23:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:36.054 01:23:50 -- paths/export.sh@5 -- # export PATH 00:29:36.054 01:23:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:36.054 01:23:50 -- nvmf/common.sh@46 -- # : 0 00:29:36.054 01:23:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:36.054 01:23:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:36.054 01:23:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:36.054 01:23:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:36.054 01:23:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:36.054 01:23:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:36.054 01:23:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:36.054 01:23:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:36.054 01:23:50 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:29:36.054 01:23:50 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:29:36.054 01:23:50 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:29:36.054 01:23:50 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:29:36.054 01:23:50 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:29:36.054 01:23:50 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:29:36.054 01:23:50 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:29:36.054 01:23:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:36.054 01:23:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:36.054 01:23:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:36.054 01:23:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:36.054 01:23:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:36.054 01:23:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:36.054 01:23:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:36.054 01:23:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:36.054 01:23:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:36.054 01:23:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:36.054 01:23:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:36.054 01:23:50 -- common/autotest_common.sh@10 -- # set +x 00:29:37.956 01:23:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:37.956 01:23:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:37.956 01:23:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:37.956 01:23:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:37.956 01:23:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:37.956 01:23:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:37.956 01:23:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:37.956 01:23:52 -- nvmf/common.sh@294 -- # net_devs=() 00:29:37.956 01:23:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:37.956 01:23:52 -- nvmf/common.sh@295 -- # e810=() 00:29:37.956 01:23:52 -- nvmf/common.sh@295 -- # local -ga e810 00:29:37.956 01:23:52 -- nvmf/common.sh@296 -- # x722=() 00:29:37.956 01:23:52 -- nvmf/common.sh@296 -- # local -ga x722 00:29:37.956 01:23:52 -- nvmf/common.sh@297 -- # mlx=() 00:29:37.956 01:23:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:37.956 01:23:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:37.956 01:23:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:37.956 01:23:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:37.956 01:23:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:37.956 01:23:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:37.956 01:23:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:37.956 01:23:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:37.956 01:23:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:37.956 01:23:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:37.956 01:23:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:37.956 01:23:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:37.956 01:23:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:37.956 01:23:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:37.956 01:23:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:37.956 01:23:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:37.956 01:23:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:37.956 01:23:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:37.956 01:23:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:37.956 01:23:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:37.956 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:37.956 01:23:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:37.956 01:23:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:37.956 01:23:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:37.956 01:23:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:37.956 01:23:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:37.956 01:23:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:37.956 01:23:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:37.956 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:37.956 01:23:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:37.956 01:23:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:37.956 01:23:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:37.956 01:23:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:37.956 01:23:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:37.956 01:23:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:37.956 01:23:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:37.956 01:23:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:37.956 01:23:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:37.956 01:23:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:37.956 01:23:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:37.956 01:23:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:37.956 01:23:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:37.956 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:37.956 01:23:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:37.956 01:23:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:37.956 01:23:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:37.956 01:23:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:37.956 01:23:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:37.956 01:23:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:37.956 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:37.956 01:23:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:37.956 01:23:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:37.956 01:23:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:37.956 01:23:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:37.956 01:23:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:37.956 01:23:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:37.956 01:23:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:37.956 01:23:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:37.956 01:23:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:37.956 01:23:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:37.956 01:23:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:37.956 01:23:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:37.956 01:23:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:37.956 01:23:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:37.956 01:23:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:37.956 01:23:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:37.956 01:23:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:37.956 01:23:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:37.956 01:23:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:37.956 01:23:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:37.956 01:23:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:37.956 01:23:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:37.956 01:23:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:37.956 01:23:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:37.956 01:23:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:37.956 01:23:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:37.956 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:37.956 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.282 ms 00:29:37.956 00:29:37.956 --- 10.0.0.2 ping statistics --- 00:29:37.956 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:37.956 rtt min/avg/max/mdev = 0.282/0.282/0.282/0.000 ms 00:29:37.956 01:23:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:37.956 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:37.956 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:29:37.956 00:29:37.956 --- 10.0.0.1 ping statistics --- 00:29:37.956 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:37.956 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:29:37.956 01:23:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:37.957 01:23:52 -- nvmf/common.sh@410 -- # return 0 00:29:37.957 01:23:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:37.957 01:23:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:37.957 01:23:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:37.957 01:23:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:37.957 01:23:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:37.957 01:23:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:37.957 01:23:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:37.957 01:23:52 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:29:37.957 01:23:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:37.957 01:23:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:37.957 01:23:52 -- common/autotest_common.sh@10 -- # set +x 00:29:37.957 01:23:52 -- nvmf/common.sh@469 -- # nvmfpid=2153867 00:29:37.957 01:23:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:29:37.957 01:23:52 -- nvmf/common.sh@470 -- # waitforlisten 2153867 00:29:37.957 01:23:52 -- common/autotest_common.sh@829 -- # '[' -z 2153867 ']' 00:29:37.957 01:23:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:37.957 01:23:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:37.957 01:23:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:37.957 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:37.957 01:23:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:37.957 01:23:52 -- common/autotest_common.sh@10 -- # set +x 00:29:37.957 [2024-11-28 01:23:52.467848] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:37.957 [2024-11-28 01:23:52.467932] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:37.957 EAL: No free 2048 kB hugepages reported on node 1 00:29:37.957 [2024-11-28 01:23:52.540286] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:38.215 [2024-11-28 01:23:52.628834] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:38.215 [2024-11-28 01:23:52.629007] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:38.215 [2024-11-28 01:23:52.629026] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:38.215 [2024-11-28 01:23:52.629041] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:38.215 [2024-11-28 01:23:52.629072] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:39.148 01:23:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:39.148 01:23:53 -- common/autotest_common.sh@862 -- # return 0 00:29:39.148 01:23:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:39.148 01:23:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:39.148 01:23:53 -- common/autotest_common.sh@10 -- # set +x 00:29:39.148 01:23:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:39.148 01:23:53 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:29:39.148 01:23:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.148 01:23:53 -- common/autotest_common.sh@10 -- # set +x 00:29:39.148 [2024-11-28 01:23:53.510318] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:39.148 [2024-11-28 01:23:53.518485] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:39.148 null0 00:29:39.148 [2024-11-28 01:23:53.550465] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:39.148 01:23:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.148 01:23:53 -- host/discovery_remove_ifc.sh@59 -- # hostpid=2154020 00:29:39.148 01:23:53 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:29:39.148 01:23:53 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 2154020 /tmp/host.sock 00:29:39.148 01:23:53 -- common/autotest_common.sh@829 -- # '[' -z 2154020 ']' 00:29:39.148 01:23:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:29:39.148 01:23:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:39.148 01:23:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:39.148 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:39.148 01:23:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:39.148 01:23:53 -- common/autotest_common.sh@10 -- # set +x 00:29:39.148 [2024-11-28 01:23:53.613467] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:39.148 [2024-11-28 01:23:53.613564] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2154020 ] 00:29:39.148 EAL: No free 2048 kB hugepages reported on node 1 00:29:39.148 [2024-11-28 01:23:53.674256] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:39.406 [2024-11-28 01:23:53.760322] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:39.406 [2024-11-28 01:23:53.760485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:39.406 01:23:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:39.406 01:23:53 -- common/autotest_common.sh@862 -- # return 0 00:29:39.406 01:23:53 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:39.406 01:23:53 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:29:39.406 01:23:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.406 01:23:53 -- common/autotest_common.sh@10 -- # set +x 00:29:39.406 01:23:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.406 01:23:53 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:29:39.406 01:23:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.406 01:23:53 -- common/autotest_common.sh@10 -- # set +x 00:29:39.406 01:23:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.406 01:23:53 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:29:39.406 01:23:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.406 01:23:53 -- common/autotest_common.sh@10 -- # set +x 00:29:40.777 [2024-11-28 01:23:54.998336] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:40.777 [2024-11-28 01:23:54.998383] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:40.777 [2024-11-28 01:23:54.998410] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:40.777 [2024-11-28 01:23:55.125832] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:40.777 [2024-11-28 01:23:55.309978] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:40.777 [2024-11-28 01:23:55.310036] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:40.777 [2024-11-28 01:23:55.310079] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:40.777 [2024-11-28 01:23:55.310104] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:40.777 [2024-11-28 01:23:55.310145] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:40.777 01:23:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:40.777 01:23:55 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:29:40.777 01:23:55 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:40.777 01:23:55 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:40.777 01:23:55 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:40.777 01:23:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:40.777 01:23:55 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:40.777 01:23:55 -- common/autotest_common.sh@10 -- # set +x 00:29:40.777 01:23:55 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:40.777 [2024-11-28 01:23:55.316602] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xe40c50 was disconnected and freed. delete nvme_qpair. 00:29:40.777 01:23:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:40.777 01:23:55 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:29:40.777 01:23:55 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:29:40.777 01:23:55 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:29:41.034 01:23:55 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:29:41.034 01:23:55 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:41.034 01:23:55 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:41.034 01:23:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:41.034 01:23:55 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:41.034 01:23:55 -- common/autotest_common.sh@10 -- # set +x 00:29:41.034 01:23:55 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:41.034 01:23:55 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:41.034 01:23:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:41.034 01:23:55 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:41.034 01:23:55 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:41.989 01:23:56 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:41.989 01:23:56 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:41.989 01:23:56 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:41.989 01:23:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:41.989 01:23:56 -- common/autotest_common.sh@10 -- # set +x 00:29:41.989 01:23:56 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:41.989 01:23:56 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:41.989 01:23:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:41.989 01:23:56 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:41.989 01:23:56 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:42.958 01:23:57 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:42.958 01:23:57 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:42.958 01:23:57 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:42.958 01:23:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:42.958 01:23:57 -- common/autotest_common.sh@10 -- # set +x 00:29:42.958 01:23:57 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:42.958 01:23:57 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:42.958 01:23:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:42.958 01:23:57 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:42.958 01:23:57 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:44.329 01:23:58 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:44.329 01:23:58 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:44.329 01:23:58 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:44.329 01:23:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:44.329 01:23:58 -- common/autotest_common.sh@10 -- # set +x 00:29:44.329 01:23:58 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:44.329 01:23:58 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:44.329 01:23:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:44.329 01:23:58 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:44.329 01:23:58 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:45.261 01:23:59 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:45.261 01:23:59 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:45.261 01:23:59 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:45.261 01:23:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:45.261 01:23:59 -- common/autotest_common.sh@10 -- # set +x 00:29:45.261 01:23:59 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:45.261 01:23:59 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:45.261 01:23:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:45.261 01:23:59 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:45.261 01:23:59 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:46.194 01:24:00 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:46.194 01:24:00 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:46.194 01:24:00 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:46.194 01:24:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:46.194 01:24:00 -- common/autotest_common.sh@10 -- # set +x 00:29:46.194 01:24:00 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:46.194 01:24:00 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:46.194 01:24:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:46.194 01:24:00 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:46.194 01:24:00 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:46.194 [2024-11-28 01:24:00.751068] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:29:46.194 [2024-11-28 01:24:00.751136] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:46.194 [2024-11-28 01:24:00.751161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.194 [2024-11-28 01:24:00.751181] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:46.194 [2024-11-28 01:24:00.751196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.194 [2024-11-28 01:24:00.751212] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:46.194 [2024-11-28 01:24:00.751227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.194 [2024-11-28 01:24:00.751243] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:46.194 [2024-11-28 01:24:00.751258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.194 [2024-11-28 01:24:00.751274] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:46.194 [2024-11-28 01:24:00.751289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.194 [2024-11-28 01:24:00.751304] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe070b0 is same with the state(5) to be set 00:29:46.194 [2024-11-28 01:24:00.761086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe070b0 (9): Bad file descriptor 00:29:46.194 [2024-11-28 01:24:00.771141] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:47.127 01:24:01 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:47.127 01:24:01 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:47.127 01:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:47.127 01:24:01 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:47.127 01:24:01 -- common/autotest_common.sh@10 -- # set +x 00:29:47.127 01:24:01 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:47.127 01:24:01 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:47.384 [2024-11-28 01:24:01.812649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:48.318 [2024-11-28 01:24:02.836608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:48.318 [2024-11-28 01:24:02.836674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe070b0 with addr=10.0.0.2, port=4420 00:29:48.318 [2024-11-28 01:24:02.836703] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe070b0 is same with the state(5) to be set 00:29:48.318 [2024-11-28 01:24:02.836743] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:48.318 [2024-11-28 01:24:02.836763] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:48.318 [2024-11-28 01:24:02.836779] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:48.318 [2024-11-28 01:24:02.836797] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:29:48.318 [2024-11-28 01:24:02.837235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe070b0 (9): Bad file descriptor 00:29:48.318 [2024-11-28 01:24:02.837280] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.318 [2024-11-28 01:24:02.837321] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:29:48.318 [2024-11-28 01:24:02.837363] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:48.318 [2024-11-28 01:24:02.837389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.318 [2024-11-28 01:24:02.837410] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:48.318 [2024-11-28 01:24:02.837425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.318 [2024-11-28 01:24:02.837441] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:48.318 [2024-11-28 01:24:02.837456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.318 [2024-11-28 01:24:02.837471] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:48.318 [2024-11-28 01:24:02.837486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.318 [2024-11-28 01:24:02.837502] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:48.318 [2024-11-28 01:24:02.837516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.318 [2024-11-28 01:24:02.837548] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:29:48.318 [2024-11-28 01:24:02.837742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe074c0 (9): Bad file descriptor 00:29:48.318 [2024-11-28 01:24:02.838763] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:29:48.318 [2024-11-28 01:24:02.838786] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:29:48.318 01:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:48.318 01:24:02 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:48.318 01:24:02 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:49.252 01:24:03 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:49.252 01:24:03 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:49.252 01:24:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:49.252 01:24:03 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:49.252 01:24:03 -- common/autotest_common.sh@10 -- # set +x 00:29:49.510 01:24:03 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:49.510 01:24:03 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:49.510 01:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:49.510 01:24:03 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:29:49.510 01:24:03 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:49.510 01:24:03 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:49.510 01:24:03 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:29:49.510 01:24:03 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:49.510 01:24:03 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:49.510 01:24:03 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:49.510 01:24:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:49.510 01:24:03 -- common/autotest_common.sh@10 -- # set +x 00:29:49.510 01:24:03 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:49.510 01:24:03 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:49.510 01:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:49.510 01:24:03 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:49.510 01:24:03 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:50.444 [2024-11-28 01:24:04.895715] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:50.444 [2024-11-28 01:24:04.895739] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:50.444 [2024-11-28 01:24:04.895762] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:50.444 01:24:04 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:50.444 01:24:04 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:50.444 01:24:04 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:50.444 01:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:50.444 01:24:04 -- common/autotest_common.sh@10 -- # set +x 00:29:50.444 01:24:04 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:50.444 01:24:04 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:50.444 01:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:50.444 [2024-11-28 01:24:04.982080] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:29:50.444 01:24:05 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:50.444 01:24:05 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:50.706 [2024-11-28 01:24:05.207583] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:50.706 [2024-11-28 01:24:05.207646] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:50.706 [2024-11-28 01:24:05.207678] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:50.706 [2024-11-28 01:24:05.207698] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:29:50.706 [2024-11-28 01:24:05.207710] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:50.706 [2024-11-28 01:24:05.254169] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xe15ac0 was disconnected and freed. delete nvme_qpair. 00:29:51.638 01:24:06 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:51.638 01:24:06 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:51.638 01:24:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:51.638 01:24:06 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:51.638 01:24:06 -- common/autotest_common.sh@10 -- # set +x 00:29:51.638 01:24:06 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:51.638 01:24:06 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:51.638 01:24:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:51.638 01:24:06 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:29:51.638 01:24:06 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:29:51.638 01:24:06 -- host/discovery_remove_ifc.sh@90 -- # killprocess 2154020 00:29:51.638 01:24:06 -- common/autotest_common.sh@936 -- # '[' -z 2154020 ']' 00:29:51.638 01:24:06 -- common/autotest_common.sh@940 -- # kill -0 2154020 00:29:51.638 01:24:06 -- common/autotest_common.sh@941 -- # uname 00:29:51.638 01:24:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:51.638 01:24:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2154020 00:29:51.638 01:24:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:51.638 01:24:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:51.638 01:24:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2154020' 00:29:51.638 killing process with pid 2154020 00:29:51.638 01:24:06 -- common/autotest_common.sh@955 -- # kill 2154020 00:29:51.638 01:24:06 -- common/autotest_common.sh@960 -- # wait 2154020 00:29:51.895 01:24:06 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:29:51.895 01:24:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:51.895 01:24:06 -- nvmf/common.sh@116 -- # sync 00:29:51.895 01:24:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:51.895 01:24:06 -- nvmf/common.sh@119 -- # set +e 00:29:51.895 01:24:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:51.895 01:24:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:51.895 rmmod nvme_tcp 00:29:51.895 rmmod nvme_fabrics 00:29:51.895 rmmod nvme_keyring 00:29:51.895 01:24:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:51.895 01:24:06 -- nvmf/common.sh@123 -- # set -e 00:29:51.895 01:24:06 -- nvmf/common.sh@124 -- # return 0 00:29:51.895 01:24:06 -- nvmf/common.sh@477 -- # '[' -n 2153867 ']' 00:29:51.895 01:24:06 -- nvmf/common.sh@478 -- # killprocess 2153867 00:29:51.895 01:24:06 -- common/autotest_common.sh@936 -- # '[' -z 2153867 ']' 00:29:51.895 01:24:06 -- common/autotest_common.sh@940 -- # kill -0 2153867 00:29:51.895 01:24:06 -- common/autotest_common.sh@941 -- # uname 00:29:51.895 01:24:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:51.895 01:24:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2153867 00:29:51.895 01:24:06 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:51.895 01:24:06 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:51.895 01:24:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2153867' 00:29:51.895 killing process with pid 2153867 00:29:51.895 01:24:06 -- common/autotest_common.sh@955 -- # kill 2153867 00:29:51.895 01:24:06 -- common/autotest_common.sh@960 -- # wait 2153867 00:29:52.153 01:24:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:52.153 01:24:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:52.153 01:24:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:52.153 01:24:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:52.153 01:24:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:52.153 01:24:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:52.153 01:24:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:52.153 01:24:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:54.684 01:24:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:54.684 00:29:54.684 real 0m18.539s 00:29:54.684 user 0m25.856s 00:29:54.684 sys 0m2.913s 00:29:54.684 01:24:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:54.684 01:24:08 -- common/autotest_common.sh@10 -- # set +x 00:29:54.684 ************************************ 00:29:54.684 END TEST nvmf_discovery_remove_ifc 00:29:54.684 ************************************ 00:29:54.684 01:24:08 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:29:54.684 01:24:08 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:54.684 01:24:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:54.684 01:24:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:54.684 01:24:08 -- common/autotest_common.sh@10 -- # set +x 00:29:54.684 ************************************ 00:29:54.684 START TEST nvmf_digest 00:29:54.684 ************************************ 00:29:54.684 01:24:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:54.684 * Looking for test storage... 00:29:54.684 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:54.684 01:24:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:54.684 01:24:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:54.684 01:24:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:54.684 01:24:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:54.684 01:24:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:54.685 01:24:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:54.685 01:24:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:54.685 01:24:08 -- scripts/common.sh@335 -- # IFS=.-: 00:29:54.685 01:24:08 -- scripts/common.sh@335 -- # read -ra ver1 00:29:54.685 01:24:08 -- scripts/common.sh@336 -- # IFS=.-: 00:29:54.685 01:24:08 -- scripts/common.sh@336 -- # read -ra ver2 00:29:54.685 01:24:08 -- scripts/common.sh@337 -- # local 'op=<' 00:29:54.685 01:24:08 -- scripts/common.sh@339 -- # ver1_l=2 00:29:54.685 01:24:08 -- scripts/common.sh@340 -- # ver2_l=1 00:29:54.685 01:24:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:54.685 01:24:08 -- scripts/common.sh@343 -- # case "$op" in 00:29:54.685 01:24:08 -- scripts/common.sh@344 -- # : 1 00:29:54.685 01:24:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:54.685 01:24:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:54.685 01:24:08 -- scripts/common.sh@364 -- # decimal 1 00:29:54.685 01:24:08 -- scripts/common.sh@352 -- # local d=1 00:29:54.685 01:24:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:54.685 01:24:08 -- scripts/common.sh@354 -- # echo 1 00:29:54.685 01:24:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:54.685 01:24:08 -- scripts/common.sh@365 -- # decimal 2 00:29:54.685 01:24:08 -- scripts/common.sh@352 -- # local d=2 00:29:54.685 01:24:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:54.685 01:24:08 -- scripts/common.sh@354 -- # echo 2 00:29:54.685 01:24:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:54.685 01:24:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:54.685 01:24:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:54.685 01:24:08 -- scripts/common.sh@367 -- # return 0 00:29:54.685 01:24:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:54.685 01:24:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:54.685 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:54.685 --rc genhtml_branch_coverage=1 00:29:54.685 --rc genhtml_function_coverage=1 00:29:54.685 --rc genhtml_legend=1 00:29:54.685 --rc geninfo_all_blocks=1 00:29:54.685 --rc geninfo_unexecuted_blocks=1 00:29:54.685 00:29:54.685 ' 00:29:54.685 01:24:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:54.685 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:54.685 --rc genhtml_branch_coverage=1 00:29:54.685 --rc genhtml_function_coverage=1 00:29:54.685 --rc genhtml_legend=1 00:29:54.685 --rc geninfo_all_blocks=1 00:29:54.685 --rc geninfo_unexecuted_blocks=1 00:29:54.685 00:29:54.685 ' 00:29:54.685 01:24:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:54.685 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:54.685 --rc genhtml_branch_coverage=1 00:29:54.685 --rc genhtml_function_coverage=1 00:29:54.685 --rc genhtml_legend=1 00:29:54.685 --rc geninfo_all_blocks=1 00:29:54.685 --rc geninfo_unexecuted_blocks=1 00:29:54.685 00:29:54.685 ' 00:29:54.685 01:24:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:54.685 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:54.685 --rc genhtml_branch_coverage=1 00:29:54.685 --rc genhtml_function_coverage=1 00:29:54.685 --rc genhtml_legend=1 00:29:54.685 --rc geninfo_all_blocks=1 00:29:54.685 --rc geninfo_unexecuted_blocks=1 00:29:54.685 00:29:54.685 ' 00:29:54.685 01:24:08 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:54.685 01:24:08 -- nvmf/common.sh@7 -- # uname -s 00:29:54.685 01:24:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:54.685 01:24:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:54.685 01:24:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:54.685 01:24:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:54.685 01:24:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:54.685 01:24:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:54.685 01:24:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:54.685 01:24:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:54.685 01:24:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:54.685 01:24:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:54.685 01:24:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:54.685 01:24:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:54.685 01:24:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:54.685 01:24:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:54.685 01:24:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:54.685 01:24:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:54.685 01:24:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:54.685 01:24:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:54.685 01:24:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:54.685 01:24:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:54.685 01:24:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:54.685 01:24:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:54.685 01:24:08 -- paths/export.sh@5 -- # export PATH 00:29:54.685 01:24:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:54.685 01:24:08 -- nvmf/common.sh@46 -- # : 0 00:29:54.685 01:24:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:54.685 01:24:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:54.685 01:24:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:54.685 01:24:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:54.685 01:24:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:54.685 01:24:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:54.685 01:24:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:54.685 01:24:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:54.685 01:24:08 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:29:54.685 01:24:08 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:29:54.685 01:24:08 -- host/digest.sh@16 -- # runtime=2 00:29:54.685 01:24:08 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:29:54.685 01:24:08 -- host/digest.sh@132 -- # nvmftestinit 00:29:54.685 01:24:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:54.685 01:24:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:54.685 01:24:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:54.685 01:24:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:54.685 01:24:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:54.685 01:24:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:54.685 01:24:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:54.685 01:24:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:54.685 01:24:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:54.685 01:24:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:54.685 01:24:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:54.685 01:24:08 -- common/autotest_common.sh@10 -- # set +x 00:29:56.585 01:24:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:56.585 01:24:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:56.585 01:24:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:56.585 01:24:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:56.585 01:24:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:56.585 01:24:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:56.585 01:24:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:56.585 01:24:10 -- nvmf/common.sh@294 -- # net_devs=() 00:29:56.585 01:24:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:56.585 01:24:10 -- nvmf/common.sh@295 -- # e810=() 00:29:56.585 01:24:10 -- nvmf/common.sh@295 -- # local -ga e810 00:29:56.585 01:24:10 -- nvmf/common.sh@296 -- # x722=() 00:29:56.585 01:24:10 -- nvmf/common.sh@296 -- # local -ga x722 00:29:56.585 01:24:10 -- nvmf/common.sh@297 -- # mlx=() 00:29:56.585 01:24:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:56.585 01:24:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:56.585 01:24:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:56.585 01:24:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:56.585 01:24:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:56.585 01:24:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:56.585 01:24:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:56.585 01:24:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:56.585 01:24:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:56.585 01:24:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:56.585 01:24:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:56.585 01:24:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:56.585 01:24:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:56.585 01:24:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:56.585 01:24:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:56.585 01:24:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:56.585 01:24:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:56.585 01:24:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:56.585 01:24:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:56.585 01:24:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:56.585 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:56.585 01:24:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:56.585 01:24:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:56.585 01:24:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:56.585 01:24:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:56.585 01:24:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:56.586 01:24:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:56.586 01:24:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:56.586 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:56.586 01:24:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:56.586 01:24:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:56.586 01:24:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:56.586 01:24:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:56.586 01:24:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:56.586 01:24:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:56.586 01:24:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:56.586 01:24:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:56.586 01:24:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:56.586 01:24:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:56.586 01:24:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:56.586 01:24:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:56.586 01:24:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:56.586 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:56.586 01:24:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:56.586 01:24:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:56.586 01:24:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:56.586 01:24:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:56.586 01:24:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:56.586 01:24:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:56.586 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:56.586 01:24:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:56.586 01:24:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:56.586 01:24:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:56.586 01:24:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:56.586 01:24:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:56.586 01:24:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:56.586 01:24:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:56.586 01:24:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:56.586 01:24:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:56.586 01:24:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:56.586 01:24:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:56.586 01:24:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:56.586 01:24:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:56.586 01:24:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:56.586 01:24:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:56.586 01:24:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:56.586 01:24:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:56.586 01:24:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:56.586 01:24:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:56.586 01:24:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:56.586 01:24:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:56.586 01:24:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:56.586 01:24:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:56.586 01:24:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:56.586 01:24:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:56.586 01:24:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:56.586 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:56.586 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.152 ms 00:29:56.586 00:29:56.586 --- 10.0.0.2 ping statistics --- 00:29:56.586 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:56.586 rtt min/avg/max/mdev = 0.152/0.152/0.152/0.000 ms 00:29:56.586 01:24:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:56.586 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:56.586 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:29:56.586 00:29:56.586 --- 10.0.0.1 ping statistics --- 00:29:56.586 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:56.586 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:29:56.586 01:24:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:56.586 01:24:11 -- nvmf/common.sh@410 -- # return 0 00:29:56.586 01:24:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:56.586 01:24:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:56.586 01:24:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:56.586 01:24:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:56.586 01:24:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:56.586 01:24:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:56.586 01:24:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:56.586 01:24:11 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:29:56.586 01:24:11 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:29:56.586 01:24:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:56.586 01:24:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:56.586 01:24:11 -- common/autotest_common.sh@10 -- # set +x 00:29:56.586 ************************************ 00:29:56.586 START TEST nvmf_digest_clean 00:29:56.586 ************************************ 00:29:56.586 01:24:11 -- common/autotest_common.sh@1114 -- # run_digest 00:29:56.586 01:24:11 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:29:56.586 01:24:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:56.586 01:24:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:56.586 01:24:11 -- common/autotest_common.sh@10 -- # set +x 00:29:56.586 01:24:11 -- nvmf/common.sh@469 -- # nvmfpid=2158339 00:29:56.586 01:24:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:56.586 01:24:11 -- nvmf/common.sh@470 -- # waitforlisten 2158339 00:29:56.586 01:24:11 -- common/autotest_common.sh@829 -- # '[' -z 2158339 ']' 00:29:56.586 01:24:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:56.586 01:24:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:56.586 01:24:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:56.586 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:56.586 01:24:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:56.586 01:24:11 -- common/autotest_common.sh@10 -- # set +x 00:29:56.586 [2024-11-28 01:24:11.069022] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:56.586 [2024-11-28 01:24:11.069091] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:56.586 EAL: No free 2048 kB hugepages reported on node 1 00:29:56.586 [2024-11-28 01:24:11.131653] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:56.844 [2024-11-28 01:24:11.215746] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:56.844 [2024-11-28 01:24:11.215921] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:56.844 [2024-11-28 01:24:11.215939] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:56.844 [2024-11-28 01:24:11.215953] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:56.844 [2024-11-28 01:24:11.215987] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:56.844 01:24:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:56.844 01:24:11 -- common/autotest_common.sh@862 -- # return 0 00:29:56.844 01:24:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:56.844 01:24:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:56.844 01:24:11 -- common/autotest_common.sh@10 -- # set +x 00:29:56.844 01:24:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:56.844 01:24:11 -- host/digest.sh@120 -- # common_target_config 00:29:56.844 01:24:11 -- host/digest.sh@43 -- # rpc_cmd 00:29:56.844 01:24:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:56.844 01:24:11 -- common/autotest_common.sh@10 -- # set +x 00:29:56.844 null0 00:29:56.844 [2024-11-28 01:24:11.418318] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:56.844 [2024-11-28 01:24:11.442593] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:57.102 01:24:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:57.102 01:24:11 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:29:57.102 01:24:11 -- host/digest.sh@77 -- # local rw bs qd 00:29:57.102 01:24:11 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:57.102 01:24:11 -- host/digest.sh@80 -- # rw=randread 00:29:57.102 01:24:11 -- host/digest.sh@80 -- # bs=4096 00:29:57.102 01:24:11 -- host/digest.sh@80 -- # qd=128 00:29:57.102 01:24:11 -- host/digest.sh@82 -- # bperfpid=2158483 00:29:57.102 01:24:11 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:57.102 01:24:11 -- host/digest.sh@83 -- # waitforlisten 2158483 /var/tmp/bperf.sock 00:29:57.102 01:24:11 -- common/autotest_common.sh@829 -- # '[' -z 2158483 ']' 00:29:57.102 01:24:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:57.102 01:24:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:57.102 01:24:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:57.102 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:57.102 01:24:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:57.102 01:24:11 -- common/autotest_common.sh@10 -- # set +x 00:29:57.102 [2024-11-28 01:24:11.482973] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:57.102 [2024-11-28 01:24:11.483051] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2158483 ] 00:29:57.102 EAL: No free 2048 kB hugepages reported on node 1 00:29:57.102 [2024-11-28 01:24:11.546149] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:57.102 [2024-11-28 01:24:11.636273] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:57.360 01:24:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:57.360 01:24:11 -- common/autotest_common.sh@862 -- # return 0 00:29:57.360 01:24:11 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:57.360 01:24:11 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:57.360 01:24:11 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:57.618 01:24:12 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:57.618 01:24:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:57.875 nvme0n1 00:29:58.133 01:24:12 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:58.133 01:24:12 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:58.133 Running I/O for 2 seconds... 00:30:00.032 00:30:00.032 Latency(us) 00:30:00.032 [2024-11-28T00:24:14.635Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:00.032 [2024-11-28T00:24:14.635Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:30:00.032 nvme0n1 : 2.01 15989.73 62.46 0.00 0.00 7994.41 3737.98 21262.79 00:30:00.032 [2024-11-28T00:24:14.635Z] =================================================================================================================== 00:30:00.032 [2024-11-28T00:24:14.635Z] Total : 15989.73 62.46 0.00 0.00 7994.41 3737.98 21262.79 00:30:00.032 0 00:30:00.032 01:24:14 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:30:00.032 01:24:14 -- host/digest.sh@92 -- # get_accel_stats 00:30:00.032 01:24:14 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:30:00.032 01:24:14 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:30:00.032 | select(.opcode=="crc32c") 00:30:00.032 | "\(.module_name) \(.executed)"' 00:30:00.032 01:24:14 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:30:00.289 01:24:14 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:30:00.289 01:24:14 -- host/digest.sh@93 -- # exp_module=software 00:30:00.289 01:24:14 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:30:00.289 01:24:14 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:30:00.289 01:24:14 -- host/digest.sh@97 -- # killprocess 2158483 00:30:00.289 01:24:14 -- common/autotest_common.sh@936 -- # '[' -z 2158483 ']' 00:30:00.289 01:24:14 -- common/autotest_common.sh@940 -- # kill -0 2158483 00:30:00.289 01:24:14 -- common/autotest_common.sh@941 -- # uname 00:30:00.289 01:24:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:00.547 01:24:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2158483 00:30:00.547 01:24:14 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:00.547 01:24:14 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:00.547 01:24:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2158483' 00:30:00.547 killing process with pid 2158483 00:30:00.547 01:24:14 -- common/autotest_common.sh@955 -- # kill 2158483 00:30:00.547 Received shutdown signal, test time was about 2.000000 seconds 00:30:00.547 00:30:00.547 Latency(us) 00:30:00.547 [2024-11-28T00:24:15.150Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:00.547 [2024-11-28T00:24:15.150Z] =================================================================================================================== 00:30:00.547 [2024-11-28T00:24:15.150Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:00.547 01:24:14 -- common/autotest_common.sh@960 -- # wait 2158483 00:30:00.547 01:24:15 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:30:00.547 01:24:15 -- host/digest.sh@77 -- # local rw bs qd 00:30:00.547 01:24:15 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:30:00.547 01:24:15 -- host/digest.sh@80 -- # rw=randread 00:30:00.547 01:24:15 -- host/digest.sh@80 -- # bs=131072 00:30:00.547 01:24:15 -- host/digest.sh@80 -- # qd=16 00:30:00.547 01:24:15 -- host/digest.sh@82 -- # bperfpid=2158905 00:30:00.547 01:24:15 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:30:00.547 01:24:15 -- host/digest.sh@83 -- # waitforlisten 2158905 /var/tmp/bperf.sock 00:30:00.547 01:24:15 -- common/autotest_common.sh@829 -- # '[' -z 2158905 ']' 00:30:00.547 01:24:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:00.547 01:24:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:00.547 01:24:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:00.547 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:00.547 01:24:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:00.547 01:24:15 -- common/autotest_common.sh@10 -- # set +x 00:30:00.805 [2024-11-28 01:24:15.168781] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:00.805 [2024-11-28 01:24:15.168877] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2158905 ] 00:30:00.805 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:00.805 Zero copy mechanism will not be used. 00:30:00.805 EAL: No free 2048 kB hugepages reported on node 1 00:30:00.805 [2024-11-28 01:24:15.231688] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:00.805 [2024-11-28 01:24:15.321924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:01.062 01:24:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:01.062 01:24:15 -- common/autotest_common.sh@862 -- # return 0 00:30:01.062 01:24:15 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:30:01.062 01:24:15 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:30:01.062 01:24:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:30:01.320 01:24:15 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:01.320 01:24:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:01.577 nvme0n1 00:30:01.577 01:24:16 -- host/digest.sh@91 -- # bperf_py perform_tests 00:30:01.577 01:24:16 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:01.834 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:01.834 Zero copy mechanism will not be used. 00:30:01.834 Running I/O for 2 seconds... 00:30:03.732 00:30:03.732 Latency(us) 00:30:03.732 [2024-11-28T00:24:18.335Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:03.732 [2024-11-28T00:24:18.335Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:30:03.732 nvme0n1 : 2.00 5501.06 687.63 0.00 0.00 2904.80 628.05 6699.24 00:30:03.732 [2024-11-28T00:24:18.335Z] =================================================================================================================== 00:30:03.732 [2024-11-28T00:24:18.335Z] Total : 5501.06 687.63 0.00 0.00 2904.80 628.05 6699.24 00:30:03.732 0 00:30:03.732 01:24:18 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:30:03.732 01:24:18 -- host/digest.sh@92 -- # get_accel_stats 00:30:03.732 01:24:18 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:30:03.732 01:24:18 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:30:03.732 01:24:18 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:30:03.732 | select(.opcode=="crc32c") 00:30:03.732 | "\(.module_name) \(.executed)"' 00:30:03.990 01:24:18 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:30:03.990 01:24:18 -- host/digest.sh@93 -- # exp_module=software 00:30:03.990 01:24:18 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:30:03.990 01:24:18 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:30:03.990 01:24:18 -- host/digest.sh@97 -- # killprocess 2158905 00:30:03.990 01:24:18 -- common/autotest_common.sh@936 -- # '[' -z 2158905 ']' 00:30:03.990 01:24:18 -- common/autotest_common.sh@940 -- # kill -0 2158905 00:30:03.990 01:24:18 -- common/autotest_common.sh@941 -- # uname 00:30:03.990 01:24:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:03.990 01:24:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2158905 00:30:03.990 01:24:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:03.990 01:24:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:03.990 01:24:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2158905' 00:30:03.990 killing process with pid 2158905 00:30:03.990 01:24:18 -- common/autotest_common.sh@955 -- # kill 2158905 00:30:03.990 Received shutdown signal, test time was about 2.000000 seconds 00:30:03.990 00:30:03.990 Latency(us) 00:30:03.990 [2024-11-28T00:24:18.593Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:03.990 [2024-11-28T00:24:18.593Z] =================================================================================================================== 00:30:03.990 [2024-11-28T00:24:18.593Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:03.990 01:24:18 -- common/autotest_common.sh@960 -- # wait 2158905 00:30:04.247 01:24:18 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:30:04.247 01:24:18 -- host/digest.sh@77 -- # local rw bs qd 00:30:04.247 01:24:18 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:30:04.247 01:24:18 -- host/digest.sh@80 -- # rw=randwrite 00:30:04.247 01:24:18 -- host/digest.sh@80 -- # bs=4096 00:30:04.247 01:24:18 -- host/digest.sh@80 -- # qd=128 00:30:04.248 01:24:18 -- host/digest.sh@82 -- # bperfpid=2159323 00:30:04.248 01:24:18 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:30:04.248 01:24:18 -- host/digest.sh@83 -- # waitforlisten 2159323 /var/tmp/bperf.sock 00:30:04.248 01:24:18 -- common/autotest_common.sh@829 -- # '[' -z 2159323 ']' 00:30:04.248 01:24:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:04.248 01:24:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:04.248 01:24:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:04.248 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:04.248 01:24:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:04.248 01:24:18 -- common/autotest_common.sh@10 -- # set +x 00:30:04.248 [2024-11-28 01:24:18.806946] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:04.248 [2024-11-28 01:24:18.807027] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2159323 ] 00:30:04.248 EAL: No free 2048 kB hugepages reported on node 1 00:30:04.505 [2024-11-28 01:24:18.869073] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:04.505 [2024-11-28 01:24:18.952857] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:04.505 01:24:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:04.506 01:24:19 -- common/autotest_common.sh@862 -- # return 0 00:30:04.506 01:24:19 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:30:04.506 01:24:19 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:30:04.506 01:24:19 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:30:05.071 01:24:19 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:05.071 01:24:19 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:05.329 nvme0n1 00:30:05.329 01:24:19 -- host/digest.sh@91 -- # bperf_py perform_tests 00:30:05.329 01:24:19 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:05.329 Running I/O for 2 seconds... 00:30:07.856 00:30:07.856 Latency(us) 00:30:07.856 [2024-11-28T00:24:22.459Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:07.856 [2024-11-28T00:24:22.459Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:30:07.856 nvme0n1 : 2.01 20715.97 80.92 0.00 0.00 6168.68 2560.76 17864.63 00:30:07.856 [2024-11-28T00:24:22.459Z] =================================================================================================================== 00:30:07.856 [2024-11-28T00:24:22.459Z] Total : 20715.97 80.92 0.00 0.00 6168.68 2560.76 17864.63 00:30:07.856 0 00:30:07.856 01:24:21 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:30:07.857 01:24:21 -- host/digest.sh@92 -- # get_accel_stats 00:30:07.857 01:24:21 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:30:07.857 01:24:21 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:30:07.857 | select(.opcode=="crc32c") 00:30:07.857 | "\(.module_name) \(.executed)"' 00:30:07.857 01:24:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:30:07.857 01:24:22 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:30:07.857 01:24:22 -- host/digest.sh@93 -- # exp_module=software 00:30:07.857 01:24:22 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:30:07.857 01:24:22 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:30:07.857 01:24:22 -- host/digest.sh@97 -- # killprocess 2159323 00:30:07.857 01:24:22 -- common/autotest_common.sh@936 -- # '[' -z 2159323 ']' 00:30:07.857 01:24:22 -- common/autotest_common.sh@940 -- # kill -0 2159323 00:30:07.857 01:24:22 -- common/autotest_common.sh@941 -- # uname 00:30:07.857 01:24:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:07.857 01:24:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2159323 00:30:07.857 01:24:22 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:07.857 01:24:22 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:07.857 01:24:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2159323' 00:30:07.857 killing process with pid 2159323 00:30:07.857 01:24:22 -- common/autotest_common.sh@955 -- # kill 2159323 00:30:07.857 Received shutdown signal, test time was about 2.000000 seconds 00:30:07.857 00:30:07.857 Latency(us) 00:30:07.857 [2024-11-28T00:24:22.460Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:07.857 [2024-11-28T00:24:22.460Z] =================================================================================================================== 00:30:07.857 [2024-11-28T00:24:22.460Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:07.857 01:24:22 -- common/autotest_common.sh@960 -- # wait 2159323 00:30:07.857 01:24:22 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:30:07.857 01:24:22 -- host/digest.sh@77 -- # local rw bs qd 00:30:07.857 01:24:22 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:30:07.857 01:24:22 -- host/digest.sh@80 -- # rw=randwrite 00:30:07.857 01:24:22 -- host/digest.sh@80 -- # bs=131072 00:30:07.857 01:24:22 -- host/digest.sh@80 -- # qd=16 00:30:07.857 01:24:22 -- host/digest.sh@82 -- # bperfpid=2159745 00:30:07.857 01:24:22 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:30:07.857 01:24:22 -- host/digest.sh@83 -- # waitforlisten 2159745 /var/tmp/bperf.sock 00:30:07.857 01:24:22 -- common/autotest_common.sh@829 -- # '[' -z 2159745 ']' 00:30:07.857 01:24:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:07.857 01:24:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:07.857 01:24:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:07.857 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:07.857 01:24:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:07.857 01:24:22 -- common/autotest_common.sh@10 -- # set +x 00:30:07.857 [2024-11-28 01:24:22.375588] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:07.857 [2024-11-28 01:24:22.375669] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2159745 ] 00:30:07.857 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:07.857 Zero copy mechanism will not be used. 00:30:07.857 EAL: No free 2048 kB hugepages reported on node 1 00:30:07.857 [2024-11-28 01:24:22.441657] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:08.115 [2024-11-28 01:24:22.530736] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:08.115 01:24:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:08.115 01:24:22 -- common/autotest_common.sh@862 -- # return 0 00:30:08.115 01:24:22 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:30:08.115 01:24:22 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:30:08.115 01:24:22 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:30:08.374 01:24:22 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:08.374 01:24:22 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:08.943 nvme0n1 00:30:08.943 01:24:23 -- host/digest.sh@91 -- # bperf_py perform_tests 00:30:08.943 01:24:23 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:08.943 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:08.943 Zero copy mechanism will not be used. 00:30:08.943 Running I/O for 2 seconds... 00:30:10.859 00:30:10.859 Latency(us) 00:30:10.859 [2024-11-28T00:24:25.462Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:10.859 [2024-11-28T00:24:25.462Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:30:10.859 nvme0n1 : 2.00 4717.14 589.64 0.00 0.00 3384.71 2463.67 8738.13 00:30:10.859 [2024-11-28T00:24:25.462Z] =================================================================================================================== 00:30:10.859 [2024-11-28T00:24:25.462Z] Total : 4717.14 589.64 0.00 0.00 3384.71 2463.67 8738.13 00:30:10.859 0 00:30:10.859 01:24:25 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:30:10.859 01:24:25 -- host/digest.sh@92 -- # get_accel_stats 00:30:10.859 01:24:25 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:30:10.859 01:24:25 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:30:10.859 | select(.opcode=="crc32c") 00:30:10.859 | "\(.module_name) \(.executed)"' 00:30:10.860 01:24:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:30:11.143 01:24:25 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:30:11.143 01:24:25 -- host/digest.sh@93 -- # exp_module=software 00:30:11.143 01:24:25 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:30:11.143 01:24:25 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:30:11.143 01:24:25 -- host/digest.sh@97 -- # killprocess 2159745 00:30:11.143 01:24:25 -- common/autotest_common.sh@936 -- # '[' -z 2159745 ']' 00:30:11.143 01:24:25 -- common/autotest_common.sh@940 -- # kill -0 2159745 00:30:11.143 01:24:25 -- common/autotest_common.sh@941 -- # uname 00:30:11.143 01:24:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:11.143 01:24:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2159745 00:30:11.401 01:24:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:11.401 01:24:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:11.401 01:24:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2159745' 00:30:11.401 killing process with pid 2159745 00:30:11.401 01:24:25 -- common/autotest_common.sh@955 -- # kill 2159745 00:30:11.401 Received shutdown signal, test time was about 2.000000 seconds 00:30:11.401 00:30:11.401 Latency(us) 00:30:11.401 [2024-11-28T00:24:26.004Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:11.401 [2024-11-28T00:24:26.004Z] =================================================================================================================== 00:30:11.401 [2024-11-28T00:24:26.004Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:11.401 01:24:25 -- common/autotest_common.sh@960 -- # wait 2159745 00:30:11.401 01:24:25 -- host/digest.sh@126 -- # killprocess 2158339 00:30:11.401 01:24:25 -- common/autotest_common.sh@936 -- # '[' -z 2158339 ']' 00:30:11.401 01:24:25 -- common/autotest_common.sh@940 -- # kill -0 2158339 00:30:11.401 01:24:25 -- common/autotest_common.sh@941 -- # uname 00:30:11.401 01:24:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:11.401 01:24:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2158339 00:30:11.401 01:24:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:11.401 01:24:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:11.401 01:24:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2158339' 00:30:11.401 killing process with pid 2158339 00:30:11.401 01:24:25 -- common/autotest_common.sh@955 -- # kill 2158339 00:30:11.401 01:24:25 -- common/autotest_common.sh@960 -- # wait 2158339 00:30:11.659 00:30:11.659 real 0m15.185s 00:30:11.659 user 0m30.308s 00:30:11.659 sys 0m4.181s 00:30:11.659 01:24:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:11.659 01:24:26 -- common/autotest_common.sh@10 -- # set +x 00:30:11.659 ************************************ 00:30:11.659 END TEST nvmf_digest_clean 00:30:11.659 ************************************ 00:30:11.659 01:24:26 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:30:11.659 01:24:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:11.659 01:24:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:11.659 01:24:26 -- common/autotest_common.sh@10 -- # set +x 00:30:11.659 ************************************ 00:30:11.659 START TEST nvmf_digest_error 00:30:11.659 ************************************ 00:30:11.659 01:24:26 -- common/autotest_common.sh@1114 -- # run_digest_error 00:30:11.659 01:24:26 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:30:11.659 01:24:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:11.659 01:24:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:11.659 01:24:26 -- common/autotest_common.sh@10 -- # set +x 00:30:11.659 01:24:26 -- nvmf/common.sh@469 -- # nvmfpid=2160316 00:30:11.659 01:24:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:30:11.659 01:24:26 -- nvmf/common.sh@470 -- # waitforlisten 2160316 00:30:11.659 01:24:26 -- common/autotest_common.sh@829 -- # '[' -z 2160316 ']' 00:30:11.659 01:24:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:11.659 01:24:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:11.659 01:24:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:11.659 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:11.659 01:24:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:11.659 01:24:26 -- common/autotest_common.sh@10 -- # set +x 00:30:11.917 [2024-11-28 01:24:26.291879] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:11.917 [2024-11-28 01:24:26.291967] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:11.917 EAL: No free 2048 kB hugepages reported on node 1 00:30:11.917 [2024-11-28 01:24:26.356519] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:11.917 [2024-11-28 01:24:26.439229] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:11.917 [2024-11-28 01:24:26.439383] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:11.917 [2024-11-28 01:24:26.439399] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:11.917 [2024-11-28 01:24:26.439411] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:11.917 [2024-11-28 01:24:26.439436] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:11.917 01:24:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:11.917 01:24:26 -- common/autotest_common.sh@862 -- # return 0 00:30:11.917 01:24:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:11.917 01:24:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:11.917 01:24:26 -- common/autotest_common.sh@10 -- # set +x 00:30:12.176 01:24:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:12.176 01:24:26 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:30:12.176 01:24:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:12.176 01:24:26 -- common/autotest_common.sh@10 -- # set +x 00:30:12.176 [2024-11-28 01:24:26.532077] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:30:12.176 01:24:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:12.176 01:24:26 -- host/digest.sh@104 -- # common_target_config 00:30:12.176 01:24:26 -- host/digest.sh@43 -- # rpc_cmd 00:30:12.176 01:24:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:12.176 01:24:26 -- common/autotest_common.sh@10 -- # set +x 00:30:12.176 null0 00:30:12.176 [2024-11-28 01:24:26.642372] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:12.176 [2024-11-28 01:24:26.666642] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:12.176 01:24:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:12.176 01:24:26 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:30:12.176 01:24:26 -- host/digest.sh@54 -- # local rw bs qd 00:30:12.176 01:24:26 -- host/digest.sh@56 -- # rw=randread 00:30:12.176 01:24:26 -- host/digest.sh@56 -- # bs=4096 00:30:12.176 01:24:26 -- host/digest.sh@56 -- # qd=128 00:30:12.176 01:24:26 -- host/digest.sh@58 -- # bperfpid=2160337 00:30:12.176 01:24:26 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:30:12.176 01:24:26 -- host/digest.sh@60 -- # waitforlisten 2160337 /var/tmp/bperf.sock 00:30:12.176 01:24:26 -- common/autotest_common.sh@829 -- # '[' -z 2160337 ']' 00:30:12.176 01:24:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:12.176 01:24:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:12.176 01:24:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:12.176 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:12.176 01:24:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:12.176 01:24:26 -- common/autotest_common.sh@10 -- # set +x 00:30:12.176 [2024-11-28 01:24:26.711758] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:12.176 [2024-11-28 01:24:26.711818] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2160337 ] 00:30:12.176 EAL: No free 2048 kB hugepages reported on node 1 00:30:12.176 [2024-11-28 01:24:26.774327] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:12.435 [2024-11-28 01:24:26.862875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:13.369 01:24:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:13.369 01:24:27 -- common/autotest_common.sh@862 -- # return 0 00:30:13.369 01:24:27 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:13.369 01:24:27 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:13.369 01:24:27 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:13.369 01:24:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:13.369 01:24:27 -- common/autotest_common.sh@10 -- # set +x 00:30:13.369 01:24:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:13.369 01:24:27 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:13.369 01:24:27 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:13.935 nvme0n1 00:30:13.935 01:24:28 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:30:13.935 01:24:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:13.935 01:24:28 -- common/autotest_common.sh@10 -- # set +x 00:30:13.935 01:24:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:13.935 01:24:28 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:13.935 01:24:28 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:13.935 Running I/O for 2 seconds... 00:30:13.935 [2024-11-28 01:24:28.472723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:13.935 [2024-11-28 01:24:28.472787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6508 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.935 [2024-11-28 01:24:28.472808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:13.935 [2024-11-28 01:24:28.483919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:13.935 [2024-11-28 01:24:28.483953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:11089 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.935 [2024-11-28 01:24:28.483971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:13.935 [2024-11-28 01:24:28.499971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:13.935 [2024-11-28 01:24:28.500007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4682 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.935 [2024-11-28 01:24:28.500026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:13.935 [2024-11-28 01:24:28.517341] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:13.935 [2024-11-28 01:24:28.517378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:14882 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.935 [2024-11-28 01:24:28.517396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:13.935 [2024-11-28 01:24:28.534603] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:13.936 [2024-11-28 01:24:28.534635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:1524 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.936 [2024-11-28 01:24:28.534652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.194 [2024-11-28 01:24:28.550080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.194 [2024-11-28 01:24:28.550111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:14725 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.194 [2024-11-28 01:24:28.550129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.194 [2024-11-28 01:24:28.561921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.194 [2024-11-28 01:24:28.561955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:18269 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.194 [2024-11-28 01:24:28.561973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.194 [2024-11-28 01:24:28.578957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.194 [2024-11-28 01:24:28.578992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:6266 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.194 [2024-11-28 01:24:28.579010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.194 [2024-11-28 01:24:28.595811] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.194 [2024-11-28 01:24:28.595849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:3458 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.194 [2024-11-28 01:24:28.595866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.194 [2024-11-28 01:24:28.612436] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.194 [2024-11-28 01:24:28.612466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:7243 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.194 [2024-11-28 01:24:28.612497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.194 [2024-11-28 01:24:28.634789] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.194 [2024-11-28 01:24:28.634820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:14244 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.194 [2024-11-28 01:24:28.634837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.194 [2024-11-28 01:24:28.646576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.194 [2024-11-28 01:24:28.646620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:4664 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.194 [2024-11-28 01:24:28.646637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.194 [2024-11-28 01:24:28.662003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.194 [2024-11-28 01:24:28.662037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:13423 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.194 [2024-11-28 01:24:28.662055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.194 [2024-11-28 01:24:28.679168] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.194 [2024-11-28 01:24:28.679203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:20521 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.194 [2024-11-28 01:24:28.679222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.194 [2024-11-28 01:24:28.690238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.194 [2024-11-28 01:24:28.690272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:15409 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.194 [2024-11-28 01:24:28.690291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.194 [2024-11-28 01:24:28.706391] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.194 [2024-11-28 01:24:28.706425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:4185 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.194 [2024-11-28 01:24:28.706444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.194 [2024-11-28 01:24:28.723255] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.194 [2024-11-28 01:24:28.723286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:23045 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.194 [2024-11-28 01:24:28.723303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.194 [2024-11-28 01:24:28.738592] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.194 [2024-11-28 01:24:28.738641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:21521 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.194 [2024-11-28 01:24:28.738658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.194 [2024-11-28 01:24:28.750632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.194 [2024-11-28 01:24:28.750661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:13318 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.195 [2024-11-28 01:24:28.750678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.195 [2024-11-28 01:24:28.767174] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.195 [2024-11-28 01:24:28.767209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:18764 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.195 [2024-11-28 01:24:28.767227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.195 [2024-11-28 01:24:28.782209] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.195 [2024-11-28 01:24:28.782243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:11900 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.195 [2024-11-28 01:24:28.782261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.195 [2024-11-28 01:24:28.794298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.195 [2024-11-28 01:24:28.794331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:877 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.195 [2024-11-28 01:24:28.794349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.453 [2024-11-28 01:24:28.810284] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.453 [2024-11-28 01:24:28.810311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:17938 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.453 [2024-11-28 01:24:28.810342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.453 [2024-11-28 01:24:28.826733] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.453 [2024-11-28 01:24:28.826762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:15086 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.453 [2024-11-28 01:24:28.826793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.453 [2024-11-28 01:24:28.843921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.453 [2024-11-28 01:24:28.843955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23807 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.453 [2024-11-28 01:24:28.843974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.453 [2024-11-28 01:24:28.860720] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.453 [2024-11-28 01:24:28.860749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:14352 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.453 [2024-11-28 01:24:28.860770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.453 [2024-11-28 01:24:28.875611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.453 [2024-11-28 01:24:28.875641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:24378 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.453 [2024-11-28 01:24:28.875659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.453 [2024-11-28 01:24:28.887847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.453 [2024-11-28 01:24:28.887894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:2188 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.453 [2024-11-28 01:24:28.887913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.453 [2024-11-28 01:24:28.903513] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.453 [2024-11-28 01:24:28.903556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:4520 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.453 [2024-11-28 01:24:28.903576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.453 [2024-11-28 01:24:28.920980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.453 [2024-11-28 01:24:28.921015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:17472 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.453 [2024-11-28 01:24:28.921033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.453 [2024-11-28 01:24:28.937735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.453 [2024-11-28 01:24:28.937765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:16461 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.453 [2024-11-28 01:24:28.937781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.453 [2024-11-28 01:24:28.949159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.453 [2024-11-28 01:24:28.949203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:8419 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.453 [2024-11-28 01:24:28.949219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.453 [2024-11-28 01:24:28.965226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.453 [2024-11-28 01:24:28.965260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:11135 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.453 [2024-11-28 01:24:28.965278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.453 [2024-11-28 01:24:28.982267] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.453 [2024-11-28 01:24:28.982301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:21682 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.453 [2024-11-28 01:24:28.982320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.453 [2024-11-28 01:24:28.998194] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.453 [2024-11-28 01:24:28.998233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:4110 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.453 [2024-11-28 01:24:28.998252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.453 [2024-11-28 01:24:29.009573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.453 [2024-11-28 01:24:29.009602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:1058 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.453 [2024-11-28 01:24:29.009633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.454 [2024-11-28 01:24:29.026654] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.454 [2024-11-28 01:24:29.026682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22141 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.454 [2024-11-28 01:24:29.026713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.454 [2024-11-28 01:24:29.043667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.454 [2024-11-28 01:24:29.043697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:653 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.454 [2024-11-28 01:24:29.043713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.712 [2024-11-28 01:24:29.058760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.712 [2024-11-28 01:24:29.058790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:9517 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.712 [2024-11-28 01:24:29.058807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.712 [2024-11-28 01:24:29.070541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.712 [2024-11-28 01:24:29.070568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:24038 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.712 [2024-11-28 01:24:29.070598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.712 [2024-11-28 01:24:29.087134] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.712 [2024-11-28 01:24:29.087169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:15759 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.712 [2024-11-28 01:24:29.087187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.712 [2024-11-28 01:24:29.104379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.712 [2024-11-28 01:24:29.104414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:7525 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.712 [2024-11-28 01:24:29.104432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.712 [2024-11-28 01:24:29.121205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.712 [2024-11-28 01:24:29.121239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:16462 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.712 [2024-11-28 01:24:29.121257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.712 [2024-11-28 01:24:29.138127] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.712 [2024-11-28 01:24:29.138161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:2875 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.712 [2024-11-28 01:24:29.138180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.712 [2024-11-28 01:24:29.149257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.712 [2024-11-28 01:24:29.149290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4234 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.712 [2024-11-28 01:24:29.149309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.712 [2024-11-28 01:24:29.164785] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.712 [2024-11-28 01:24:29.164812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:10560 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.712 [2024-11-28 01:24:29.164843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.712 [2024-11-28 01:24:29.181330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.712 [2024-11-28 01:24:29.181363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:5632 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.712 [2024-11-28 01:24:29.181382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.712 [2024-11-28 01:24:29.198089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.712 [2024-11-28 01:24:29.198124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:16545 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.712 [2024-11-28 01:24:29.198142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.712 [2024-11-28 01:24:29.214595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.712 [2024-11-28 01:24:29.214624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:16955 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.712 [2024-11-28 01:24:29.214654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.712 [2024-11-28 01:24:29.231314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.712 [2024-11-28 01:24:29.231348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:13459 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.713 [2024-11-28 01:24:29.231366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.713 [2024-11-28 01:24:29.247885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.713 [2024-11-28 01:24:29.247919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:19653 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.713 [2024-11-28 01:24:29.247937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.713 [2024-11-28 01:24:29.264416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.713 [2024-11-28 01:24:29.264456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:9219 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.713 [2024-11-28 01:24:29.264475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.713 [2024-11-28 01:24:29.280799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.713 [2024-11-28 01:24:29.280829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:4697 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.713 [2024-11-28 01:24:29.280847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.713 [2024-11-28 01:24:29.291627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.713 [2024-11-28 01:24:29.291654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:25156 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.713 [2024-11-28 01:24:29.291684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.713 [2024-11-28 01:24:29.308159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.713 [2024-11-28 01:24:29.308193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:12048 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.713 [2024-11-28 01:24:29.308211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.971 [2024-11-28 01:24:29.325623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.971 [2024-11-28 01:24:29.325651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:5825 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.971 [2024-11-28 01:24:29.325681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.971 [2024-11-28 01:24:29.342595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.971 [2024-11-28 01:24:29.342623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:13200 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.971 [2024-11-28 01:24:29.342651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.971 [2024-11-28 01:24:29.359372] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.971 [2024-11-28 01:24:29.359405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:9129 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.971 [2024-11-28 01:24:29.359422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.971 [2024-11-28 01:24:29.376262] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.971 [2024-11-28 01:24:29.376296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:20800 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.971 [2024-11-28 01:24:29.376314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.971 [2024-11-28 01:24:29.393466] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.971 [2024-11-28 01:24:29.393501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:15270 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.971 [2024-11-28 01:24:29.393520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.971 [2024-11-28 01:24:29.410708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.971 [2024-11-28 01:24:29.410752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:23927 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.971 [2024-11-28 01:24:29.410768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.971 [2024-11-28 01:24:29.427657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.971 [2024-11-28 01:24:29.427684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:6791 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.971 [2024-11-28 01:24:29.427714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.971 [2024-11-28 01:24:29.444295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.971 [2024-11-28 01:24:29.444322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:8104 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.971 [2024-11-28 01:24:29.444353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.971 [2024-11-28 01:24:29.460964] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.971 [2024-11-28 01:24:29.460998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:4337 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.971 [2024-11-28 01:24:29.461016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.971 [2024-11-28 01:24:29.477660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.971 [2024-11-28 01:24:29.477688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:9880 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.971 [2024-11-28 01:24:29.477718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.971 [2024-11-28 01:24:29.494317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.971 [2024-11-28 01:24:29.494351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:13075 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.971 [2024-11-28 01:24:29.494370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.971 [2024-11-28 01:24:29.511052] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.971 [2024-11-28 01:24:29.511086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:22666 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.971 [2024-11-28 01:24:29.511104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.971 [2024-11-28 01:24:29.527973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.971 [2024-11-28 01:24:29.528001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:7760 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.971 [2024-11-28 01:24:29.528032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.971 [2024-11-28 01:24:29.544829] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.971 [2024-11-28 01:24:29.544872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22126 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.971 [2024-11-28 01:24:29.544897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.971 [2024-11-28 01:24:29.561763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:14.971 [2024-11-28 01:24:29.561791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23028 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.971 [2024-11-28 01:24:29.561821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.230 [2024-11-28 01:24:29.578547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.230 [2024-11-28 01:24:29.578580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:15895 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.230 [2024-11-28 01:24:29.578611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.230 [2024-11-28 01:24:29.595647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.230 [2024-11-28 01:24:29.595674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21216 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.230 [2024-11-28 01:24:29.595705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.230 [2024-11-28 01:24:29.612480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.230 [2024-11-28 01:24:29.612515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:15201 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.230 [2024-11-28 01:24:29.612544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.230 [2024-11-28 01:24:29.629119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.230 [2024-11-28 01:24:29.629152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:22078 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.230 [2024-11-28 01:24:29.629171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.230 [2024-11-28 01:24:29.646367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.230 [2024-11-28 01:24:29.646401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:24687 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.230 [2024-11-28 01:24:29.646419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.230 [2024-11-28 01:24:29.663521] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.230 [2024-11-28 01:24:29.663571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:813 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.230 [2024-11-28 01:24:29.663603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.230 [2024-11-28 01:24:29.680347] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.230 [2024-11-28 01:24:29.680383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:17613 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.230 [2024-11-28 01:24:29.680402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.230 [2024-11-28 01:24:29.696995] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.230 [2024-11-28 01:24:29.697035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:22390 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.230 [2024-11-28 01:24:29.697054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.230 [2024-11-28 01:24:29.713925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.230 [2024-11-28 01:24:29.713953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17318 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.230 [2024-11-28 01:24:29.713983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.230 [2024-11-28 01:24:29.730771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.230 [2024-11-28 01:24:29.730815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:14135 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.230 [2024-11-28 01:24:29.730830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.230 [2024-11-28 01:24:29.747833] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.230 [2024-11-28 01:24:29.747877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:13560 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.230 [2024-11-28 01:24:29.747895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.230 [2024-11-28 01:24:29.764902] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.230 [2024-11-28 01:24:29.764936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:14227 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.230 [2024-11-28 01:24:29.764955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.230 [2024-11-28 01:24:29.782130] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.230 [2024-11-28 01:24:29.782163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:15804 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.230 [2024-11-28 01:24:29.782181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.230 [2024-11-28 01:24:29.799181] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.230 [2024-11-28 01:24:29.799215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:11369 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.230 [2024-11-28 01:24:29.799234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.230 [2024-11-28 01:24:29.816463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.230 [2024-11-28 01:24:29.816496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:5917 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.230 [2024-11-28 01:24:29.816514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.489 [2024-11-28 01:24:29.833337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.489 [2024-11-28 01:24:29.833371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:10490 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.489 [2024-11-28 01:24:29.833389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.489 [2024-11-28 01:24:29.850218] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.489 [2024-11-28 01:24:29.850252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:23715 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.489 [2024-11-28 01:24:29.850270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.489 [2024-11-28 01:24:29.867260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.489 [2024-11-28 01:24:29.867293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:20387 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.489 [2024-11-28 01:24:29.867312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.489 [2024-11-28 01:24:29.883995] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.489 [2024-11-28 01:24:29.884028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:15718 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.489 [2024-11-28 01:24:29.884046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.489 [2024-11-28 01:24:29.900751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.489 [2024-11-28 01:24:29.900778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:16514 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.489 [2024-11-28 01:24:29.900809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.489 [2024-11-28 01:24:29.917600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.489 [2024-11-28 01:24:29.917627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:20540 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.489 [2024-11-28 01:24:29.917656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.489 [2024-11-28 01:24:29.934125] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.489 [2024-11-28 01:24:29.934159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:23344 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.489 [2024-11-28 01:24:29.934178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.489 [2024-11-28 01:24:29.951563] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.489 [2024-11-28 01:24:29.951608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:1772 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.489 [2024-11-28 01:24:29.951623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.489 [2024-11-28 01:24:29.968423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.489 [2024-11-28 01:24:29.968456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:14189 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.489 [2024-11-28 01:24:29.968474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.489 [2024-11-28 01:24:29.985063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.489 [2024-11-28 01:24:29.985097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:23641 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.489 [2024-11-28 01:24:29.985121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.489 [2024-11-28 01:24:30.001904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.489 [2024-11-28 01:24:30.001944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:6351 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.489 [2024-11-28 01:24:30.001968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.489 [2024-11-28 01:24:30.019608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.489 [2024-11-28 01:24:30.019642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16824 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.489 [2024-11-28 01:24:30.019659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.489 [2024-11-28 01:24:30.037176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.489 [2024-11-28 01:24:30.037217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:12659 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.489 [2024-11-28 01:24:30.037236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.489 [2024-11-28 01:24:30.054178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.489 [2024-11-28 01:24:30.054212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:22204 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.489 [2024-11-28 01:24:30.054231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.489 [2024-11-28 01:24:30.065352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.489 [2024-11-28 01:24:30.065387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:18350 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.489 [2024-11-28 01:24:30.065406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.489 [2024-11-28 01:24:30.081119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.489 [2024-11-28 01:24:30.081154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19654 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.489 [2024-11-28 01:24:30.081172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.747 [2024-11-28 01:24:30.098185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.747 [2024-11-28 01:24:30.098219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22201 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.747 [2024-11-28 01:24:30.098236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.747 [2024-11-28 01:24:30.115133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.747 [2024-11-28 01:24:30.115167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:11541 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.747 [2024-11-28 01:24:30.115185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.747 [2024-11-28 01:24:30.132273] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.748 [2024-11-28 01:24:30.132308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18025 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.748 [2024-11-28 01:24:30.132327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.748 [2024-11-28 01:24:30.149933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.748 [2024-11-28 01:24:30.149968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:12796 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.748 [2024-11-28 01:24:30.149986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.748 [2024-11-28 01:24:30.165977] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.748 [2024-11-28 01:24:30.166008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:14805 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.748 [2024-11-28 01:24:30.166025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.748 [2024-11-28 01:24:30.178206] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.748 [2024-11-28 01:24:30.178235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:19207 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.748 [2024-11-28 01:24:30.178266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.748 [2024-11-28 01:24:30.194584] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.748 [2024-11-28 01:24:30.194613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:9487 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.748 [2024-11-28 01:24:30.194644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.748 [2024-11-28 01:24:30.211872] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.748 [2024-11-28 01:24:30.211904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:4149 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.748 [2024-11-28 01:24:30.211920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.748 [2024-11-28 01:24:30.227786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.748 [2024-11-28 01:24:30.227843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:2508 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.748 [2024-11-28 01:24:30.227859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.748 [2024-11-28 01:24:30.240581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.748 [2024-11-28 01:24:30.240614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:14370 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.748 [2024-11-28 01:24:30.240632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.748 [2024-11-28 01:24:30.257050] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.748 [2024-11-28 01:24:30.257083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:1819 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.748 [2024-11-28 01:24:30.257108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.748 [2024-11-28 01:24:30.273041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.748 [2024-11-28 01:24:30.273075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:5436 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.748 [2024-11-28 01:24:30.273094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.748 [2024-11-28 01:24:30.285657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.748 [2024-11-28 01:24:30.285687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:3091 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.748 [2024-11-28 01:24:30.285703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.748 [2024-11-28 01:24:30.301328] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.748 [2024-11-28 01:24:30.301355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:25066 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.748 [2024-11-28 01:24:30.301386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.748 [2024-11-28 01:24:30.318286] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.748 [2024-11-28 01:24:30.318319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:8574 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.748 [2024-11-28 01:24:30.318337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.748 [2024-11-28 01:24:30.335242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:15.748 [2024-11-28 01:24:30.335275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:3015 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.748 [2024-11-28 01:24:30.335294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.006 [2024-11-28 01:24:30.351799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:16.006 [2024-11-28 01:24:30.351829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:4752 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.006 [2024-11-28 01:24:30.351846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.006 [2024-11-28 01:24:30.368636] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:16.006 [2024-11-28 01:24:30.368679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:25037 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.006 [2024-11-28 01:24:30.368694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.007 [2024-11-28 01:24:30.385332] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:16.007 [2024-11-28 01:24:30.385359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:4244 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.007 [2024-11-28 01:24:30.385390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.007 [2024-11-28 01:24:30.401237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:16.007 [2024-11-28 01:24:30.401272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:387 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.007 [2024-11-28 01:24:30.401303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.007 [2024-11-28 01:24:30.417390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:16.007 [2024-11-28 01:24:30.417424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1433 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.007 [2024-11-28 01:24:30.417442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.007 [2024-11-28 01:24:30.434099] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:16.007 [2024-11-28 01:24:30.434132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:21295 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.007 [2024-11-28 01:24:30.434151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.007 [2024-11-28 01:24:30.449265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x9d2300) 00:30:16.007 [2024-11-28 01:24:30.449299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:4649 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.007 [2024-11-28 01:24:30.449317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.007 00:30:16.007 Latency(us) 00:30:16.007 [2024-11-28T00:24:30.610Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:16.007 [2024-11-28T00:24:30.610Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:30:16.007 nvme0n1 : 2.00 15834.10 61.85 0.00 0.00 8076.41 3616.62 25826.04 00:30:16.007 [2024-11-28T00:24:30.610Z] =================================================================================================================== 00:30:16.007 [2024-11-28T00:24:30.610Z] Total : 15834.10 61.85 0.00 0.00 8076.41 3616.62 25826.04 00:30:16.007 0 00:30:16.007 01:24:30 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:16.007 01:24:30 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:16.007 01:24:30 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:16.007 01:24:30 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:16.007 | .driver_specific 00:30:16.007 | .nvme_error 00:30:16.007 | .status_code 00:30:16.007 | .command_transient_transport_error' 00:30:16.265 01:24:30 -- host/digest.sh@71 -- # (( 124 > 0 )) 00:30:16.265 01:24:30 -- host/digest.sh@73 -- # killprocess 2160337 00:30:16.265 01:24:30 -- common/autotest_common.sh@936 -- # '[' -z 2160337 ']' 00:30:16.265 01:24:30 -- common/autotest_common.sh@940 -- # kill -0 2160337 00:30:16.265 01:24:30 -- common/autotest_common.sh@941 -- # uname 00:30:16.265 01:24:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:16.265 01:24:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2160337 00:30:16.265 01:24:30 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:16.265 01:24:30 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:16.265 01:24:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2160337' 00:30:16.265 killing process with pid 2160337 00:30:16.265 01:24:30 -- common/autotest_common.sh@955 -- # kill 2160337 00:30:16.265 Received shutdown signal, test time was about 2.000000 seconds 00:30:16.265 00:30:16.265 Latency(us) 00:30:16.265 [2024-11-28T00:24:30.868Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:16.265 [2024-11-28T00:24:30.868Z] =================================================================================================================== 00:30:16.265 [2024-11-28T00:24:30.868Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:16.265 01:24:30 -- common/autotest_common.sh@960 -- # wait 2160337 00:30:16.523 01:24:31 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:30:16.523 01:24:31 -- host/digest.sh@54 -- # local rw bs qd 00:30:16.523 01:24:31 -- host/digest.sh@56 -- # rw=randread 00:30:16.523 01:24:31 -- host/digest.sh@56 -- # bs=131072 00:30:16.523 01:24:31 -- host/digest.sh@56 -- # qd=16 00:30:16.523 01:24:31 -- host/digest.sh@58 -- # bperfpid=2160888 00:30:16.523 01:24:31 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:30:16.523 01:24:31 -- host/digest.sh@60 -- # waitforlisten 2160888 /var/tmp/bperf.sock 00:30:16.523 01:24:31 -- common/autotest_common.sh@829 -- # '[' -z 2160888 ']' 00:30:16.523 01:24:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:16.523 01:24:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:16.523 01:24:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:16.523 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:16.523 01:24:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:16.523 01:24:31 -- common/autotest_common.sh@10 -- # set +x 00:30:16.524 [2024-11-28 01:24:31.045173] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:16.524 [2024-11-28 01:24:31.045252] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2160888 ] 00:30:16.524 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:16.524 Zero copy mechanism will not be used. 00:30:16.524 EAL: No free 2048 kB hugepages reported on node 1 00:30:16.524 [2024-11-28 01:24:31.108191] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:16.782 [2024-11-28 01:24:31.195246] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:17.715 01:24:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:17.715 01:24:31 -- common/autotest_common.sh@862 -- # return 0 00:30:17.715 01:24:31 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:17.715 01:24:31 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:17.715 01:24:32 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:17.715 01:24:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:17.715 01:24:32 -- common/autotest_common.sh@10 -- # set +x 00:30:17.715 01:24:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:17.715 01:24:32 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:17.715 01:24:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:18.281 nvme0n1 00:30:18.281 01:24:32 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:30:18.281 01:24:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:18.281 01:24:32 -- common/autotest_common.sh@10 -- # set +x 00:30:18.281 01:24:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:18.281 01:24:32 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:18.281 01:24:32 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:18.281 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:18.281 Zero copy mechanism will not be used. 00:30:18.281 Running I/O for 2 seconds... 00:30:18.281 [2024-11-28 01:24:32.876945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.281 [2024-11-28 01:24:32.877004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.281 [2024-11-28 01:24:32.877027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.540 [2024-11-28 01:24:32.884015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.540 [2024-11-28 01:24:32.884053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.540 [2024-11-28 01:24:32.884072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:18.540 [2024-11-28 01:24:32.890507] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.540 [2024-11-28 01:24:32.890553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.540 [2024-11-28 01:24:32.890588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:18.540 [2024-11-28 01:24:32.896666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.540 [2024-11-28 01:24:32.896698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.540 [2024-11-28 01:24:32.896715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:18.540 [2024-11-28 01:24:32.903284] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.540 [2024-11-28 01:24:32.903319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.540 [2024-11-28 01:24:32.903338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.540 [2024-11-28 01:24:32.909335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.540 [2024-11-28 01:24:32.909371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.540 [2024-11-28 01:24:32.909390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:18.540 [2024-11-28 01:24:32.915420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.540 [2024-11-28 01:24:32.915455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.540 [2024-11-28 01:24:32.915474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:18.540 [2024-11-28 01:24:32.921677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.540 [2024-11-28 01:24:32.921712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:32.921728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:32.927993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:32.928027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:32.928046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:32.934290] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:32.934324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:32.934349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:32.940601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:32.940632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:32.940650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:32.945747] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:32.945779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:32.945796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:32.950957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:32.950992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:32.951010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:32.955841] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:32.955889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:32.955907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:32.960747] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:32.960779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:32.960795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:32.966005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:32.966039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:32.966058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:32.970777] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:32.970809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:32.970825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:32.976419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:32.976454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:32.976473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:32.983449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:32.983491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:32.983511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:32.990669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:32.990702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:32.990720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:32.998633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:32.998665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:32.998683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:33.007199] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:33.007235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:33.007255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:33.015797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:33.015831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:33.015849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:33.024118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:33.024154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:33.024174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:33.032919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:33.032956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:33.032976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:33.042194] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:33.042231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:33.042250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:33.050801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:33.050852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:33.050871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:33.058196] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:33.058231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:33.058251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:33.066804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:33.066853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:33.066872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:33.075588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:33.075618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:33.075635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:33.083005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:33.083052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:33.083073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:33.090168] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:33.090204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:33.090223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:33.096996] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:33.097033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:33.097052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:33.104709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.541 [2024-11-28 01:24:33.104741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.541 [2024-11-28 01:24:33.104773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:18.541 [2024-11-28 01:24:33.112406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.542 [2024-11-28 01:24:33.112442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.542 [2024-11-28 01:24:33.112461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:18.542 [2024-11-28 01:24:33.118214] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.542 [2024-11-28 01:24:33.118250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.542 [2024-11-28 01:24:33.118275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:18.542 [2024-11-28 01:24:33.125256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.542 [2024-11-28 01:24:33.125292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.542 [2024-11-28 01:24:33.125310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.542 [2024-11-28 01:24:33.132301] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.542 [2024-11-28 01:24:33.132337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.542 [2024-11-28 01:24:33.132357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:18.542 [2024-11-28 01:24:33.139266] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.542 [2024-11-28 01:24:33.139301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.542 [2024-11-28 01:24:33.139320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:18.800 [2024-11-28 01:24:33.145678] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.800 [2024-11-28 01:24:33.145710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.800 [2024-11-28 01:24:33.145727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:18.800 [2024-11-28 01:24:33.151513] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.800 [2024-11-28 01:24:33.151576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.800 [2024-11-28 01:24:33.151595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.800 [2024-11-28 01:24:33.157858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.800 [2024-11-28 01:24:33.157907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.800 [2024-11-28 01:24:33.157926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:18.800 [2024-11-28 01:24:33.164066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.800 [2024-11-28 01:24:33.164100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.800 [2024-11-28 01:24:33.164120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:18.800 [2024-11-28 01:24:33.170317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.800 [2024-11-28 01:24:33.170350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.800 [2024-11-28 01:24:33.170368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:18.800 [2024-11-28 01:24:33.176655] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.800 [2024-11-28 01:24:33.176687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.800 [2024-11-28 01:24:33.176705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.800 [2024-11-28 01:24:33.182915] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.800 [2024-11-28 01:24:33.182949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.800 [2024-11-28 01:24:33.182967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.188480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.188514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.188543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.193798] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.193829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.193862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.199002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.199037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.199055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.205074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.205108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.205127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.211318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.211352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.211370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.217667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.217704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.217721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.223919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.223952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.223976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.230116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.230149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.230168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.236184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.236218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.236236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.242315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.242348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.242366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.248399] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.248432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.248449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.254631] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.254662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.254678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.260930] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.260964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.260983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.266956] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.266989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.267008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.272933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.272967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.272984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.279058] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.279110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.279129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.285182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.285215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.285233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.291371] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.291405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.291423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.297791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.297822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.297857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.304012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.304046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.304065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.310180] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.310214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.310232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.316267] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.316301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.316319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.322648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.322679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.322696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.328872] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.328905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.328923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.334928] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.334963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.334981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.341119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.801 [2024-11-28 01:24:33.341152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.801 [2024-11-28 01:24:33.341170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:18.801 [2024-11-28 01:24:33.347115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.802 [2024-11-28 01:24:33.347149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.802 [2024-11-28 01:24:33.347167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.802 [2024-11-28 01:24:33.352280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.802 [2024-11-28 01:24:33.352313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.802 [2024-11-28 01:24:33.352331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:18.802 [2024-11-28 01:24:33.357703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.802 [2024-11-28 01:24:33.357734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.802 [2024-11-28 01:24:33.357751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:18.802 [2024-11-28 01:24:33.361454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.802 [2024-11-28 01:24:33.361487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.802 [2024-11-28 01:24:33.361506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:18.802 [2024-11-28 01:24:33.367342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.802 [2024-11-28 01:24:33.367376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.802 [2024-11-28 01:24:33.367394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.802 [2024-11-28 01:24:33.373518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.802 [2024-11-28 01:24:33.373573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.802 [2024-11-28 01:24:33.373590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:18.802 [2024-11-28 01:24:33.379826] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.802 [2024-11-28 01:24:33.379855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.802 [2024-11-28 01:24:33.379891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:18.802 [2024-11-28 01:24:33.386022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.802 [2024-11-28 01:24:33.386056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.802 [2024-11-28 01:24:33.386074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:18.802 [2024-11-28 01:24:33.392128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.802 [2024-11-28 01:24:33.392161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.802 [2024-11-28 01:24:33.392179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:18.802 [2024-11-28 01:24:33.398110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:18.802 [2024-11-28 01:24:33.398143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.802 [2024-11-28 01:24:33.398160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.060 [2024-11-28 01:24:33.404189] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.060 [2024-11-28 01:24:33.404223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.060 [2024-11-28 01:24:33.404242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.060 [2024-11-28 01:24:33.410256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.060 [2024-11-28 01:24:33.410290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.060 [2024-11-28 01:24:33.410307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.060 [2024-11-28 01:24:33.416544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.060 [2024-11-28 01:24:33.416590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.416608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.422544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.422593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.422609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.427907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.427940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.427959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.432722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.432757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.432775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.438039] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.438072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.438090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.443020] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.443055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.443073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.448421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.448455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.448474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.454676] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.454705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.454722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.460787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.460815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.460845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.466909] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.466942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.466961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.473017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.473051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.473070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.479154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.479194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.479213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.485420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.485453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.485471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.491415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.491447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.491466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.497466] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.497501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.497520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.503321] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.503354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.503372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.509452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.509485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.509503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.515419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.515451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.515470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.521587] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.521616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.521633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.527423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.527455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.527473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.533552] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.533600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.533617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.539416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.539448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.539466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.545338] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.545371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.545389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.551339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.551373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.551391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.557301] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.557334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.557352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.563390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.563422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.563439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.061 [2024-11-28 01:24:33.569373] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.061 [2024-11-28 01:24:33.569405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.061 [2024-11-28 01:24:33.569423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.062 [2024-11-28 01:24:33.575249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.062 [2024-11-28 01:24:33.575283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.062 [2024-11-28 01:24:33.575301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.062 [2024-11-28 01:24:33.581327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.062 [2024-11-28 01:24:33.581359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.062 [2024-11-28 01:24:33.581377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.062 [2024-11-28 01:24:33.587222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.062 [2024-11-28 01:24:33.587254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.062 [2024-11-28 01:24:33.587273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.062 [2024-11-28 01:24:33.593398] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.062 [2024-11-28 01:24:33.593430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.062 [2024-11-28 01:24:33.593448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.062 [2024-11-28 01:24:33.599412] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.062 [2024-11-28 01:24:33.599444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.062 [2024-11-28 01:24:33.599462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.062 [2024-11-28 01:24:33.605306] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.062 [2024-11-28 01:24:33.605338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.062 [2024-11-28 01:24:33.605355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.062 [2024-11-28 01:24:33.611435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.062 [2024-11-28 01:24:33.611466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.062 [2024-11-28 01:24:33.611485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.062 [2024-11-28 01:24:33.618082] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.062 [2024-11-28 01:24:33.618116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.062 [2024-11-28 01:24:33.618134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.062 [2024-11-28 01:24:33.626026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.062 [2024-11-28 01:24:33.626060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.062 [2024-11-28 01:24:33.626079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.062 [2024-11-28 01:24:33.633677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.062 [2024-11-28 01:24:33.633707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.062 [2024-11-28 01:24:33.633724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.062 [2024-11-28 01:24:33.641022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.062 [2024-11-28 01:24:33.641057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.062 [2024-11-28 01:24:33.641082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.062 [2024-11-28 01:24:33.647483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.062 [2024-11-28 01:24:33.647516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.062 [2024-11-28 01:24:33.647546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.062 [2024-11-28 01:24:33.653326] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.062 [2024-11-28 01:24:33.653358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.062 [2024-11-28 01:24:33.653377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.062 [2024-11-28 01:24:33.659591] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.062 [2024-11-28 01:24:33.659621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.062 [2024-11-28 01:24:33.659638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.321 [2024-11-28 01:24:33.665661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.321 [2024-11-28 01:24:33.665691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.321 [2024-11-28 01:24:33.665707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.321 [2024-11-28 01:24:33.671546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.321 [2024-11-28 01:24:33.671593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.321 [2024-11-28 01:24:33.671609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.321 [2024-11-28 01:24:33.677474] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.321 [2024-11-28 01:24:33.677506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.321 [2024-11-28 01:24:33.677535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.321 [2024-11-28 01:24:33.683397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.321 [2024-11-28 01:24:33.683430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.321 [2024-11-28 01:24:33.683448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.321 [2024-11-28 01:24:33.689358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.321 [2024-11-28 01:24:33.689391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.321 [2024-11-28 01:24:33.689409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.321 [2024-11-28 01:24:33.695476] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.321 [2024-11-28 01:24:33.695514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.321 [2024-11-28 01:24:33.695543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.321 [2024-11-28 01:24:33.701616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.321 [2024-11-28 01:24:33.701660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.321 [2024-11-28 01:24:33.701676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.321 [2024-11-28 01:24:33.708134] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.321 [2024-11-28 01:24:33.708167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.321 [2024-11-28 01:24:33.708185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.321 [2024-11-28 01:24:33.714057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.321 [2024-11-28 01:24:33.714090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.321 [2024-11-28 01:24:33.714108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.321 [2024-11-28 01:24:33.720002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.321 [2024-11-28 01:24:33.720035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.321 [2024-11-28 01:24:33.720054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.321 [2024-11-28 01:24:33.726159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.321 [2024-11-28 01:24:33.726192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.321 [2024-11-28 01:24:33.726210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.321 [2024-11-28 01:24:33.732133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.732166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.732184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.738260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.738294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.738311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.744378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.744411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.744429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.750396] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.750429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.750447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.756391] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.756425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.756444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.762494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.762534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.762570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.768997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.769028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.769046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.775121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.775154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.775172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.781318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.781350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.781368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.787386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.787419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.787436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.793493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.793534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.793555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.799637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.799665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.799687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.805511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.805551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.805585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.811492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.811532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.811552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.817547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.817590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.817606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.823433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.823465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.823482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.829453] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.829485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.829503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.835909] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.835942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.835960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.842131] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.842163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.842182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.848114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.848150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.848168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.854224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.854258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.854276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.860342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.860375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.860393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.866387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.866418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.866437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.872461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.872494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.872513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.878784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.878828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.878843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.884684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.884711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.322 [2024-11-28 01:24:33.884727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.322 [2024-11-28 01:24:33.890596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.322 [2024-11-28 01:24:33.890624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.323 [2024-11-28 01:24:33.890640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.323 [2024-11-28 01:24:33.896607] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.323 [2024-11-28 01:24:33.896635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.323 [2024-11-28 01:24:33.896651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.323 [2024-11-28 01:24:33.902495] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.323 [2024-11-28 01:24:33.902535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.323 [2024-11-28 01:24:33.902561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.323 [2024-11-28 01:24:33.908595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.323 [2024-11-28 01:24:33.908624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.323 [2024-11-28 01:24:33.908640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.323 [2024-11-28 01:24:33.914370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.323 [2024-11-28 01:24:33.914400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.323 [2024-11-28 01:24:33.914430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.323 [2024-11-28 01:24:33.920548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.323 [2024-11-28 01:24:33.920595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.323 [2024-11-28 01:24:33.920611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.582 [2024-11-28 01:24:33.926515] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.582 [2024-11-28 01:24:33.926573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.582 [2024-11-28 01:24:33.926591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.582 [2024-11-28 01:24:33.932660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.582 [2024-11-28 01:24:33.932706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.582 [2024-11-28 01:24:33.932722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.582 [2024-11-28 01:24:33.938758] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.582 [2024-11-28 01:24:33.938788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.582 [2024-11-28 01:24:33.938804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.582 [2024-11-28 01:24:33.944899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.582 [2024-11-28 01:24:33.944933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.582 [2024-11-28 01:24:33.944952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.582 [2024-11-28 01:24:33.950948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.582 [2024-11-28 01:24:33.950980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.582 [2024-11-28 01:24:33.950999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.582 [2024-11-28 01:24:33.956997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.582 [2024-11-28 01:24:33.957036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.582 [2024-11-28 01:24:33.957055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.582 [2024-11-28 01:24:33.962792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.582 [2024-11-28 01:24:33.962835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.582 [2024-11-28 01:24:33.962851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.582 [2024-11-28 01:24:33.968959] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.582 [2024-11-28 01:24:33.968991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.582 [2024-11-28 01:24:33.969009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.582 [2024-11-28 01:24:33.974944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.582 [2024-11-28 01:24:33.974976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.582 [2024-11-28 01:24:33.974994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.582 [2024-11-28 01:24:33.980854] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.582 [2024-11-28 01:24:33.980899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.582 [2024-11-28 01:24:33.980917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.582 [2024-11-28 01:24:33.986859] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.582 [2024-11-28 01:24:33.986904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.582 [2024-11-28 01:24:33.986922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.582 [2024-11-28 01:24:33.992889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.582 [2024-11-28 01:24:33.992923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.582 [2024-11-28 01:24:33.992940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.582 [2024-11-28 01:24:33.998895] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.582 [2024-11-28 01:24:33.998928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.582 [2024-11-28 01:24:33.998946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.582 [2024-11-28 01:24:34.004998] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.582 [2024-11-28 01:24:34.005031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.582 [2024-11-28 01:24:34.005049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.582 [2024-11-28 01:24:34.011199] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.582 [2024-11-28 01:24:34.011232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.582 [2024-11-28 01:24:34.011250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.582 [2024-11-28 01:24:34.017123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.582 [2024-11-28 01:24:34.017156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.582 [2024-11-28 01:24:34.017175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.582 [2024-11-28 01:24:34.023179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.582 [2024-11-28 01:24:34.023211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.582 [2024-11-28 01:24:34.023229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.582 [2024-11-28 01:24:34.029126] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.582 [2024-11-28 01:24:34.029160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.582 [2024-11-28 01:24:34.029178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.582 [2024-11-28 01:24:34.035276] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.582 [2024-11-28 01:24:34.035308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.582 [2024-11-28 01:24:34.035327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.041421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.041454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.041472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.047236] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.047269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.047287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.053424] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.053456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.053474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.059295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.059327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.059352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.065369] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.065401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.065419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.071488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.071521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.071567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.077363] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.077395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.077413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.083390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.083422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.083440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.089338] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.089371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.089389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.095441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.095473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.095492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.101681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.101708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.101723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.107893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.107927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.107945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.114005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.114044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.114062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.120051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.120083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.120102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.125975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.126007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.126025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.132063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.132097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.132115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.138230] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.138265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.138284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.144303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.144337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.144355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.150357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.150389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.150407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.157550] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.157596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.157613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.164833] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.164884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.164905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.171900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.171936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.171955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.583 [2024-11-28 01:24:34.180159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.583 [2024-11-28 01:24:34.180196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.583 [2024-11-28 01:24:34.180216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.841 [2024-11-28 01:24:34.188283] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.841 [2024-11-28 01:24:34.188320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.841 [2024-11-28 01:24:34.188340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.841 [2024-11-28 01:24:34.196508] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.841 [2024-11-28 01:24:34.196570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.841 [2024-11-28 01:24:34.196590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.841 [2024-11-28 01:24:34.204493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.841 [2024-11-28 01:24:34.204537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.841 [2024-11-28 01:24:34.204573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.841 [2024-11-28 01:24:34.212498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.841 [2024-11-28 01:24:34.212543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.841 [2024-11-28 01:24:34.212578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.841 [2024-11-28 01:24:34.220992] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.841 [2024-11-28 01:24:34.221028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.841 [2024-11-28 01:24:34.221047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.841 [2024-11-28 01:24:34.229994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.841 [2024-11-28 01:24:34.230029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.841 [2024-11-28 01:24:34.230048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.841 [2024-11-28 01:24:34.238885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.841 [2024-11-28 01:24:34.238928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.841 [2024-11-28 01:24:34.238948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.841 [2024-11-28 01:24:34.247765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.841 [2024-11-28 01:24:34.247797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.841 [2024-11-28 01:24:34.247816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.841 [2024-11-28 01:24:34.254837] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.841 [2024-11-28 01:24:34.254896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.841 [2024-11-28 01:24:34.254917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.841 [2024-11-28 01:24:34.263716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.841 [2024-11-28 01:24:34.263763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.841 [2024-11-28 01:24:34.263780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.841 [2024-11-28 01:24:34.270932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.841 [2024-11-28 01:24:34.270968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.841 [2024-11-28 01:24:34.270986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.841 [2024-11-28 01:24:34.275740] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.841 [2024-11-28 01:24:34.275770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.841 [2024-11-28 01:24:34.275787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.841 [2024-11-28 01:24:34.280170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.841 [2024-11-28 01:24:34.280200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.841 [2024-11-28 01:24:34.280220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.841 [2024-11-28 01:24:34.285012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.841 [2024-11-28 01:24:34.285044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.841 [2024-11-28 01:24:34.285062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.841 [2024-11-28 01:24:34.290644] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.841 [2024-11-28 01:24:34.290675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.841 [2024-11-28 01:24:34.290692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.841 [2024-11-28 01:24:34.297617] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.841 [2024-11-28 01:24:34.297647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.841 [2024-11-28 01:24:34.297665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.841 [2024-11-28 01:24:34.303719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.841 [2024-11-28 01:24:34.303747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.841 [2024-11-28 01:24:34.303764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.841 [2024-11-28 01:24:34.310129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.841 [2024-11-28 01:24:34.310161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.841 [2024-11-28 01:24:34.310180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.841 [2024-11-28 01:24:34.316600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.841 [2024-11-28 01:24:34.316629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.316645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.322876] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.322910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.322929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.329208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.329241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.329258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.335679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.335724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.335740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.342589] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.342618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.342634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.349383] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.349417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.349442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.355446] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.355480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.355498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.361077] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.361111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.361129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.366276] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.366309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.366328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.372074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.372109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.372126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.377772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.377802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.377819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.382839] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.382872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.382889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.388785] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.388818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.388851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.395132] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.395164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.395181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.401295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.401336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.401355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.407640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.407673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.407691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.412713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.412743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.412759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.417637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.417666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.417682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.422294] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.422326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.422344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.427514] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.427570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.427587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.433659] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.433688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.433704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:19.842 [2024-11-28 01:24:34.439901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:19.842 [2024-11-28 01:24:34.439945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.842 [2024-11-28 01:24:34.439975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:20.099 [2024-11-28 01:24:34.446075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.099 [2024-11-28 01:24:34.446110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.099 [2024-11-28 01:24:34.446129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:20.099 [2024-11-28 01:24:34.452140] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.099 [2024-11-28 01:24:34.452174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.099 [2024-11-28 01:24:34.452192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:20.099 [2024-11-28 01:24:34.458159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.099 [2024-11-28 01:24:34.458191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.099 [2024-11-28 01:24:34.458210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:20.099 [2024-11-28 01:24:34.464178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.099 [2024-11-28 01:24:34.464211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.099 [2024-11-28 01:24:34.464229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:20.099 [2024-11-28 01:24:34.470169] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.099 [2024-11-28 01:24:34.470201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.099 [2024-11-28 01:24:34.470219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:20.099 [2024-11-28 01:24:34.476270] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.099 [2024-11-28 01:24:34.476303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.099 [2024-11-28 01:24:34.476321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:20.099 [2024-11-28 01:24:34.482442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.099 [2024-11-28 01:24:34.482475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.099 [2024-11-28 01:24:34.482492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:20.099 [2024-11-28 01:24:34.488583] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.099 [2024-11-28 01:24:34.488612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.099 [2024-11-28 01:24:34.488628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:20.099 [2024-11-28 01:24:34.494936] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.099 [2024-11-28 01:24:34.494968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.099 [2024-11-28 01:24:34.494986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:20.099 [2024-11-28 01:24:34.501161] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.099 [2024-11-28 01:24:34.501193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.099 [2024-11-28 01:24:34.501217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:20.099 [2024-11-28 01:24:34.507261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.099 [2024-11-28 01:24:34.507292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.099 [2024-11-28 01:24:34.507310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:20.099 [2024-11-28 01:24:34.513297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.099 [2024-11-28 01:24:34.513329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.099 [2024-11-28 01:24:34.513346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:20.099 [2024-11-28 01:24:34.519367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.099 [2024-11-28 01:24:34.519399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.099 [2024-11-28 01:24:34.519417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:20.099 [2024-11-28 01:24:34.525552] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.099 [2024-11-28 01:24:34.525596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.099 [2024-11-28 01:24:34.525613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:20.099 [2024-11-28 01:24:34.533020] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.099 [2024-11-28 01:24:34.533055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.099 [2024-11-28 01:24:34.533073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:20.099 [2024-11-28 01:24:34.541182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.099 [2024-11-28 01:24:34.541216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.099 [2024-11-28 01:24:34.541234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:20.099 [2024-11-28 01:24:34.548617] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.099 [2024-11-28 01:24:34.548662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.099 [2024-11-28 01:24:34.548678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:20.099 [2024-11-28 01:24:34.555005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.099 [2024-11-28 01:24:34.555040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.099 [2024-11-28 01:24:34.555059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:20.099 [2024-11-28 01:24:34.560975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.099 [2024-11-28 01:24:34.561005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.099 [2024-11-28 01:24:34.561022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:20.099 [2024-11-28 01:24:34.566645] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.566675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.566691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.572746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.572776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.572792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.578978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.579011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.579029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.585378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.585411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.585430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.592167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.592201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.592219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.598361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.598394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.598412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.605172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.605206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.605225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.611394] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.611427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.611451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.618082] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.618115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.618134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.624240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.624273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.624291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.630383] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.630417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.630435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.637135] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.637169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.637188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.643820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.643870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.643889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.650066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.650099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.650118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.655913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.655947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.655965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.662384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.662418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.662436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.668682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.668719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.668736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.674482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.674515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.674541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.680422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.680454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.680471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.686382] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.686414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.686432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.692443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.692475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.692493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:20.100 [2024-11-28 01:24:34.698873] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.100 [2024-11-28 01:24:34.698904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.100 [2024-11-28 01:24:34.698920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:20.358 [2024-11-28 01:24:34.705337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.358 [2024-11-28 01:24:34.705374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.358 [2024-11-28 01:24:34.705394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:20.358 [2024-11-28 01:24:34.711621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.358 [2024-11-28 01:24:34.711652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.358 [2024-11-28 01:24:34.711669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:20.358 [2024-11-28 01:24:34.717982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.358 [2024-11-28 01:24:34.718016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.358 [2024-11-28 01:24:34.718034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:20.358 [2024-11-28 01:24:34.724400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.358 [2024-11-28 01:24:34.724433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.358 [2024-11-28 01:24:34.724451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:20.358 [2024-11-28 01:24:34.730767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.358 [2024-11-28 01:24:34.730797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.358 [2024-11-28 01:24:34.730814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:20.358 [2024-11-28 01:24:34.737010] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.358 [2024-11-28 01:24:34.737043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.358 [2024-11-28 01:24:34.737061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:20.358 [2024-11-28 01:24:34.743100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.358 [2024-11-28 01:24:34.743132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.358 [2024-11-28 01:24:34.743150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:20.358 [2024-11-28 01:24:34.749171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.358 [2024-11-28 01:24:34.749204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.358 [2024-11-28 01:24:34.749221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:20.358 [2024-11-28 01:24:34.755179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.358 [2024-11-28 01:24:34.755211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.358 [2024-11-28 01:24:34.755229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:20.358 [2024-11-28 01:24:34.761343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.358 [2024-11-28 01:24:34.761374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.358 [2024-11-28 01:24:34.761392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:20.358 [2024-11-28 01:24:34.767519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.358 [2024-11-28 01:24:34.767578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.358 [2024-11-28 01:24:34.767594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:20.358 [2024-11-28 01:24:34.773652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.358 [2024-11-28 01:24:34.773681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.358 [2024-11-28 01:24:34.773702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:20.358 [2024-11-28 01:24:34.779764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.358 [2024-11-28 01:24:34.779793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.358 [2024-11-28 01:24:34.779809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:20.358 [2024-11-28 01:24:34.785746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.358 [2024-11-28 01:24:34.785775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.358 [2024-11-28 01:24:34.785791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:20.358 [2024-11-28 01:24:34.791776] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.358 [2024-11-28 01:24:34.791805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.358 [2024-11-28 01:24:34.791822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:20.358 [2024-11-28 01:24:34.797713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.358 [2024-11-28 01:24:34.797743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.358 [2024-11-28 01:24:34.797759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:20.358 [2024-11-28 01:24:34.804361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.359 [2024-11-28 01:24:34.804394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.359 [2024-11-28 01:24:34.804412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:20.359 [2024-11-28 01:24:34.810893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.359 [2024-11-28 01:24:34.810927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.359 [2024-11-28 01:24:34.810946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:20.359 [2024-11-28 01:24:34.817561] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.359 [2024-11-28 01:24:34.817609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.359 [2024-11-28 01:24:34.817626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:20.359 [2024-11-28 01:24:34.823771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.359 [2024-11-28 01:24:34.823801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.359 [2024-11-28 01:24:34.823818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:20.359 [2024-11-28 01:24:34.827642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.359 [2024-11-28 01:24:34.827692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.359 [2024-11-28 01:24:34.827708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:20.359 [2024-11-28 01:24:34.834397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.359 [2024-11-28 01:24:34.834430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.359 [2024-11-28 01:24:34.834449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:20.359 [2024-11-28 01:24:34.841148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.359 [2024-11-28 01:24:34.841182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.359 [2024-11-28 01:24:34.841200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:20.359 [2024-11-28 01:24:34.849019] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.359 [2024-11-28 01:24:34.849052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.359 [2024-11-28 01:24:34.849070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:20.359 [2024-11-28 01:24:34.856889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.359 [2024-11-28 01:24:34.856923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.359 [2024-11-28 01:24:34.856941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:20.359 [2024-11-28 01:24:34.864319] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.359 [2024-11-28 01:24:34.864353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.359 [2024-11-28 01:24:34.864371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:20.359 [2024-11-28 01:24:34.872065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2022190) 00:30:20.359 [2024-11-28 01:24:34.872098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:20.359 [2024-11-28 01:24:34.872117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:20.359 00:30:20.359 Latency(us) 00:30:20.359 [2024-11-28T00:24:34.962Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:20.359 [2024-11-28T00:24:34.962Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:30:20.359 nvme0n1 : 2.00 4932.21 616.53 0.00 0.00 3240.05 770.65 10485.76 00:30:20.359 [2024-11-28T00:24:34.962Z] =================================================================================================================== 00:30:20.359 [2024-11-28T00:24:34.962Z] Total : 4932.21 616.53 0.00 0.00 3240.05 770.65 10485.76 00:30:20.359 0 00:30:20.359 01:24:34 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:20.359 01:24:34 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:20.359 01:24:34 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:20.359 | .driver_specific 00:30:20.359 | .nvme_error 00:30:20.359 | .status_code 00:30:20.359 | .command_transient_transport_error' 00:30:20.359 01:24:34 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:20.617 01:24:35 -- host/digest.sh@71 -- # (( 318 > 0 )) 00:30:20.617 01:24:35 -- host/digest.sh@73 -- # killprocess 2160888 00:30:20.617 01:24:35 -- common/autotest_common.sh@936 -- # '[' -z 2160888 ']' 00:30:20.617 01:24:35 -- common/autotest_common.sh@940 -- # kill -0 2160888 00:30:20.617 01:24:35 -- common/autotest_common.sh@941 -- # uname 00:30:20.617 01:24:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:20.617 01:24:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2160888 00:30:20.617 01:24:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:20.617 01:24:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:20.617 01:24:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2160888' 00:30:20.617 killing process with pid 2160888 00:30:20.617 01:24:35 -- common/autotest_common.sh@955 -- # kill 2160888 00:30:20.617 Received shutdown signal, test time was about 2.000000 seconds 00:30:20.617 00:30:20.617 Latency(us) 00:30:20.617 [2024-11-28T00:24:35.220Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:20.617 [2024-11-28T00:24:35.220Z] =================================================================================================================== 00:30:20.617 [2024-11-28T00:24:35.220Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:20.617 01:24:35 -- common/autotest_common.sh@960 -- # wait 2160888 00:30:20.875 01:24:35 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:30:20.875 01:24:35 -- host/digest.sh@54 -- # local rw bs qd 00:30:20.875 01:24:35 -- host/digest.sh@56 -- # rw=randwrite 00:30:20.875 01:24:35 -- host/digest.sh@56 -- # bs=4096 00:30:20.875 01:24:35 -- host/digest.sh@56 -- # qd=128 00:30:20.875 01:24:35 -- host/digest.sh@58 -- # bperfpid=2161439 00:30:20.875 01:24:35 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:30:20.875 01:24:35 -- host/digest.sh@60 -- # waitforlisten 2161439 /var/tmp/bperf.sock 00:30:20.875 01:24:35 -- common/autotest_common.sh@829 -- # '[' -z 2161439 ']' 00:30:20.875 01:24:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:20.875 01:24:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:20.875 01:24:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:20.875 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:20.875 01:24:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:20.875 01:24:35 -- common/autotest_common.sh@10 -- # set +x 00:30:20.875 [2024-11-28 01:24:35.467913] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:20.875 [2024-11-28 01:24:35.467993] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2161439 ] 00:30:21.132 EAL: No free 2048 kB hugepages reported on node 1 00:30:21.132 [2024-11-28 01:24:35.527271] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:21.132 [2024-11-28 01:24:35.616834] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:22.064 01:24:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:22.064 01:24:36 -- common/autotest_common.sh@862 -- # return 0 00:30:22.064 01:24:36 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:22.064 01:24:36 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:22.322 01:24:36 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:22.322 01:24:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:22.322 01:24:36 -- common/autotest_common.sh@10 -- # set +x 00:30:22.322 01:24:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:22.322 01:24:36 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:22.322 01:24:36 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:22.580 nvme0n1 00:30:22.580 01:24:37 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:30:22.580 01:24:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:22.580 01:24:37 -- common/autotest_common.sh@10 -- # set +x 00:30:22.580 01:24:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:22.580 01:24:37 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:22.580 01:24:37 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:22.839 Running I/O for 2 seconds... 00:30:22.839 [2024-11-28 01:24:37.316238] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190eea00 00:30:22.839 [2024-11-28 01:24:37.317675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:4742 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:22.839 [2024-11-28 01:24:37.317719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:22.839 [2024-11-28 01:24:37.328061] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190ee190 00:30:22.839 [2024-11-28 01:24:37.329264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:3702 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:22.839 [2024-11-28 01:24:37.329299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:30:22.839 [2024-11-28 01:24:37.340699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190eea00 00:30:22.839 [2024-11-28 01:24:37.341742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:4362 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:22.839 [2024-11-28 01:24:37.341784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:30:22.839 [2024-11-28 01:24:37.353398] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190eea00 00:30:22.839 [2024-11-28 01:24:37.354490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:4467 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:22.839 [2024-11-28 01:24:37.354523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:30:22.839 [2024-11-28 01:24:37.366068] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190eea00 00:30:22.839 [2024-11-28 01:24:37.367192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:21581 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:22.839 [2024-11-28 01:24:37.367225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:30:22.839 [2024-11-28 01:24:37.378835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190eea00 00:30:22.839 [2024-11-28 01:24:37.379946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:11193 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:22.839 [2024-11-28 01:24:37.379980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:30:22.839 [2024-11-28 01:24:37.391324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190eea00 00:30:22.839 [2024-11-28 01:24:37.392434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:10363 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:22.839 [2024-11-28 01:24:37.392479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:30:22.839 [2024-11-28 01:24:37.403940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190eea00 00:30:22.839 [2024-11-28 01:24:37.405109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:25482 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:22.839 [2024-11-28 01:24:37.405137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:30:22.839 [2024-11-28 01:24:37.417344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190eea00 00:30:22.839 [2024-11-28 01:24:37.418810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:17000 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:22.839 [2024-11-28 01:24:37.418856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:30:22.839 [2024-11-28 01:24:37.429717] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190eb760 00:30:22.839 [2024-11-28 01:24:37.431137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:2982 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:22.839 [2024-11-28 01:24:37.431164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.442128] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190ec408 00:30:23.098 [2024-11-28 01:24:37.443743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:4088 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.443775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.454632] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190ed0b0 00:30:23.098 [2024-11-28 01:24:37.456176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:819 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.456211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.467098] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190ef270 00:30:23.098 [2024-11-28 01:24:37.468634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:9107 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.468665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.479521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e0630 00:30:23.098 [2024-11-28 01:24:37.481062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:23734 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.481095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.491856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190ea248 00:30:23.098 [2024-11-28 01:24:37.493453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:25237 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.493486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.504474] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190edd58 00:30:23.098 [2024-11-28 01:24:37.505853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:3067 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.505905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.516800] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e9168 00:30:23.098 [2024-11-28 01:24:37.518233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:20154 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.518266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.529169] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190eee38 00:30:23.098 [2024-11-28 01:24:37.530649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:21263 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.530677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.541592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190eb328 00:30:23.098 [2024-11-28 01:24:37.543003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:8853 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.543036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.553951] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190ec408 00:30:23.098 [2024-11-28 01:24:37.555402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:11812 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.555434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.566226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190ef270 00:30:23.098 [2024-11-28 01:24:37.567780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:23800 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.567809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.579099] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e88f8 00:30:23.098 [2024-11-28 01:24:37.580196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:18057 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.580235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.591513] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e73e0 00:30:23.098 [2024-11-28 01:24:37.592294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:12139 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.592327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.603859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190ed0b0 00:30:23.098 [2024-11-28 01:24:37.604631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:13467 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.604673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.615985] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190ec408 00:30:23.098 [2024-11-28 01:24:37.616705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:14232 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.616733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.628411] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e0ea0 00:30:23.098 [2024-11-28 01:24:37.629144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:11437 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.629176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.640623] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190ec408 00:30:23.098 [2024-11-28 01:24:37.641244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:3004 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.641276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.652874] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190df118 00:30:23.098 [2024-11-28 01:24:37.653452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:19201 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.653483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.665185] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190f2948 00:30:23.098 [2024-11-28 01:24:37.665751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:534 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.665781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.677739] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190eb328 00:30:23.098 [2024-11-28 01:24:37.678250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:17073 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.678282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:30:23.098 [2024-11-28 01:24:37.689998] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e99d8 00:30:23.098 [2024-11-28 01:24:37.690489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15195 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.098 [2024-11-28 01:24:37.690521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:30:23.357 [2024-11-28 01:24:37.702323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190ebb98 00:30:23.357 [2024-11-28 01:24:37.702991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:13220 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.357 [2024-11-28 01:24:37.703026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:30:23.357 [2024-11-28 01:24:37.714787] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190eea00 00:30:23.357 [2024-11-28 01:24:37.715369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:20510 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.357 [2024-11-28 01:24:37.715401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:30:23.357 [2024-11-28 01:24:37.727070] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e73e0 00:30:23.357 [2024-11-28 01:24:37.727723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7036 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.357 [2024-11-28 01:24:37.727754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:30:23.357 [2024-11-28 01:24:37.739234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e2c28 00:30:23.357 [2024-11-28 01:24:37.740863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:14666 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.357 [2024-11-28 01:24:37.740896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:30:23.357 [2024-11-28 01:24:37.752470] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e9e10 00:30:23.357 [2024-11-28 01:24:37.754067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:17797 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.357 [2024-11-28 01:24:37.754100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:30:23.357 [2024-11-28 01:24:37.765127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e49b0 00:30:23.357 [2024-11-28 01:24:37.766244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:19338 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.357 [2024-11-28 01:24:37.766280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:30:23.357 [2024-11-28 01:24:37.777518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190ef270 00:30:23.357 [2024-11-28 01:24:37.778364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:17830 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.357 [2024-11-28 01:24:37.778396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:30:23.357 [2024-11-28 01:24:37.789897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190ee190 00:30:23.357 [2024-11-28 01:24:37.790713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:18878 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.357 [2024-11-28 01:24:37.790756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:30:23.357 [2024-11-28 01:24:37.802157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190eee38 00:30:23.357 [2024-11-28 01:24:37.802994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:9811 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.357 [2024-11-28 01:24:37.803027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:30:23.357 [2024-11-28 01:24:37.814429] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e2c28 00:30:23.357 [2024-11-28 01:24:37.815142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:5735 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.357 [2024-11-28 01:24:37.815174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:30:23.357 [2024-11-28 01:24:37.826772] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190eee38 00:30:23.357 [2024-11-28 01:24:37.827474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:17784 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.357 [2024-11-28 01:24:37.827512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:30:23.357 [2024-11-28 01:24:37.839089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190f2510 00:30:23.357 [2024-11-28 01:24:37.839729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:18458 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.357 [2024-11-28 01:24:37.839758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:30:23.357 [2024-11-28 01:24:37.851355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e3d08 00:30:23.357 [2024-11-28 01:24:37.852003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:18542 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.357 [2024-11-28 01:24:37.852035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:30:23.358 [2024-11-28 01:24:37.863860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190eff18 00:30:23.358 [2024-11-28 01:24:37.864431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:6383 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.358 [2024-11-28 01:24:37.864463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:30:23.358 [2024-11-28 01:24:37.876056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e1710 00:30:23.358 [2024-11-28 01:24:37.876643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:23272 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.358 [2024-11-28 01:24:37.876672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:30:23.358 [2024-11-28 01:24:37.888298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e8088 00:30:23.358 [2024-11-28 01:24:37.888871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:8434 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.358 [2024-11-28 01:24:37.888903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:30:23.358 [2024-11-28 01:24:37.900651] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190f1ca0 00:30:23.358 [2024-11-28 01:24:37.901313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:7397 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.358 [2024-11-28 01:24:37.901344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:30:23.358 [2024-11-28 01:24:37.912853] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190eb760 00:30:23.358 [2024-11-28 01:24:37.913581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:1936 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.358 [2024-11-28 01:24:37.913611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:30:23.358 [2024-11-28 01:24:37.925032] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e73e0 00:30:23.358 [2024-11-28 01:24:37.926654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:14238 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.358 [2024-11-28 01:24:37.926683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:30:23.358 [2024-11-28 01:24:37.938237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e6300 00:30:23.358 [2024-11-28 01:24:37.939870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:14346 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.358 [2024-11-28 01:24:37.939902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:30:23.358 [2024-11-28 01:24:37.950837] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190ebb98 00:30:23.358 [2024-11-28 01:24:37.952025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:6520 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.358 [2024-11-28 01:24:37.952060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:30:23.616 [2024-11-28 01:24:37.963222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190f1ca0 00:30:23.616 [2024-11-28 01:24:37.964135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:1251 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.616 [2024-11-28 01:24:37.964170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:30:23.616 [2024-11-28 01:24:37.975585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e2c28 00:30:23.616 [2024-11-28 01:24:37.976439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:23793 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.616 [2024-11-28 01:24:37.976472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:30:23.616 [2024-11-28 01:24:37.987873] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e38d0 00:30:23.616 [2024-11-28 01:24:37.988694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:595 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.616 [2024-11-28 01:24:37.988736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:30:23.616 [2024-11-28 01:24:38.000127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190eaab8 00:30:23.616 [2024-11-28 01:24:38.000897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:10901 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.616 [2024-11-28 01:24:38.000930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:30:23.616 [2024-11-28 01:24:38.011769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190f1ca0 00:30:23.616 [2024-11-28 01:24:38.013126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:9140 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.616 [2024-11-28 01:24:38.013158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:30:23.616 [2024-11-28 01:24:38.025616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.616 [2024-11-28 01:24:38.025886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:18921 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.616 [2024-11-28 01:24:38.025918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.616 [2024-11-28 01:24:38.039328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.616 [2024-11-28 01:24:38.039591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:13299 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.617 [2024-11-28 01:24:38.039619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.617 [2024-11-28 01:24:38.053113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.617 [2024-11-28 01:24:38.053354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:3421 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.617 [2024-11-28 01:24:38.053384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.617 [2024-11-28 01:24:38.066822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.617 [2024-11-28 01:24:38.067060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:9471 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.617 [2024-11-28 01:24:38.067091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.617 [2024-11-28 01:24:38.080649] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.617 [2024-11-28 01:24:38.080901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:22845 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.617 [2024-11-28 01:24:38.080932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.617 [2024-11-28 01:24:38.094277] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.617 [2024-11-28 01:24:38.094516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:22077 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.617 [2024-11-28 01:24:38.094569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.617 [2024-11-28 01:24:38.108037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.617 [2024-11-28 01:24:38.108283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:2463 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.617 [2024-11-28 01:24:38.108314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.617 [2024-11-28 01:24:38.121769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.617 [2024-11-28 01:24:38.122034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:17905 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.617 [2024-11-28 01:24:38.122065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.617 [2024-11-28 01:24:38.135516] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.617 [2024-11-28 01:24:38.135795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:5973 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.617 [2024-11-28 01:24:38.135839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.617 [2024-11-28 01:24:38.149321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.617 [2024-11-28 01:24:38.149585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:2484 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.617 [2024-11-28 01:24:38.149613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.617 [2024-11-28 01:24:38.163043] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.617 [2024-11-28 01:24:38.163288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:10203 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.617 [2024-11-28 01:24:38.163326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.617 [2024-11-28 01:24:38.176856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.617 [2024-11-28 01:24:38.177101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:9699 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.617 [2024-11-28 01:24:38.177132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.617 [2024-11-28 01:24:38.190670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.617 [2024-11-28 01:24:38.190912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:12359 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.617 [2024-11-28 01:24:38.190943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.617 [2024-11-28 01:24:38.204454] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.617 [2024-11-28 01:24:38.204697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:9227 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.617 [2024-11-28 01:24:38.204725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.617 [2024-11-28 01:24:38.218173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.876 [2024-11-28 01:24:38.218411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:3903 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.876 [2024-11-28 01:24:38.218446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.876 [2024-11-28 01:24:38.231961] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.876 [2024-11-28 01:24:38.232207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:8289 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.876 [2024-11-28 01:24:38.232241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.876 [2024-11-28 01:24:38.245763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.876 [2024-11-28 01:24:38.246036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:11742 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.876 [2024-11-28 01:24:38.246068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.876 [2024-11-28 01:24:38.259561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.876 [2024-11-28 01:24:38.259807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:5671 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.876 [2024-11-28 01:24:38.259835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.876 [2024-11-28 01:24:38.273298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.876 [2024-11-28 01:24:38.273544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:14252 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.876 [2024-11-28 01:24:38.273589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.876 [2024-11-28 01:24:38.287091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.876 [2024-11-28 01:24:38.287335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:1830 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.876 [2024-11-28 01:24:38.287366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.876 [2024-11-28 01:24:38.300924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.876 [2024-11-28 01:24:38.301166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:15758 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.876 [2024-11-28 01:24:38.301196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.876 [2024-11-28 01:24:38.314712] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.876 [2024-11-28 01:24:38.314988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:17947 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.876 [2024-11-28 01:24:38.315019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.876 [2024-11-28 01:24:38.328585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.876 [2024-11-28 01:24:38.328811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:8113 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.876 [2024-11-28 01:24:38.328862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.876 [2024-11-28 01:24:38.342275] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.876 [2024-11-28 01:24:38.342516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:15393 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.876 [2024-11-28 01:24:38.342568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.876 [2024-11-28 01:24:38.355913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.876 [2024-11-28 01:24:38.356154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:5760 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.876 [2024-11-28 01:24:38.356184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.876 [2024-11-28 01:24:38.369580] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.876 [2024-11-28 01:24:38.369867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:14633 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.876 [2024-11-28 01:24:38.369898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.876 [2024-11-28 01:24:38.383322] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.876 [2024-11-28 01:24:38.383575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:12942 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.876 [2024-11-28 01:24:38.383619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.876 [2024-11-28 01:24:38.397063] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.876 [2024-11-28 01:24:38.397298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:14184 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.876 [2024-11-28 01:24:38.397328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.876 [2024-11-28 01:24:38.410758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.876 [2024-11-28 01:24:38.411023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:20364 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.876 [2024-11-28 01:24:38.411054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.876 [2024-11-28 01:24:38.424577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.876 [2024-11-28 01:24:38.424802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:12743 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.876 [2024-11-28 01:24:38.424830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.876 [2024-11-28 01:24:38.438306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.876 [2024-11-28 01:24:38.438556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:15922 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.876 [2024-11-28 01:24:38.438601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.876 [2024-11-28 01:24:38.452068] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.876 [2024-11-28 01:24:38.452308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:12619 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.876 [2024-11-28 01:24:38.452338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:23.876 [2024-11-28 01:24:38.465774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:23.876 [2024-11-28 01:24:38.466038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:20792 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:23.876 [2024-11-28 01:24:38.466070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.135 [2024-11-28 01:24:38.479430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.135 [2024-11-28 01:24:38.479676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:7574 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.135 [2024-11-28 01:24:38.479707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.135 [2024-11-28 01:24:38.492978] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.135 [2024-11-28 01:24:38.493223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:22844 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.135 [2024-11-28 01:24:38.493258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.135 [2024-11-28 01:24:38.506857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.135 [2024-11-28 01:24:38.507093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:1093 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.135 [2024-11-28 01:24:38.507124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.135 [2024-11-28 01:24:38.520578] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.135 [2024-11-28 01:24:38.520878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:1980 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.135 [2024-11-28 01:24:38.520916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.136 [2024-11-28 01:24:38.534346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.136 [2024-11-28 01:24:38.534609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:24427 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.136 [2024-11-28 01:24:38.534637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.136 [2024-11-28 01:24:38.548203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.136 [2024-11-28 01:24:38.548443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:13565 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.136 [2024-11-28 01:24:38.548474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.136 [2024-11-28 01:24:38.562062] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.136 [2024-11-28 01:24:38.562299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:23295 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.136 [2024-11-28 01:24:38.562330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.136 [2024-11-28 01:24:38.575894] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.136 [2024-11-28 01:24:38.576137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:15616 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.136 [2024-11-28 01:24:38.576169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.136 [2024-11-28 01:24:38.589653] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.136 [2024-11-28 01:24:38.589895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:5449 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.136 [2024-11-28 01:24:38.589926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.136 [2024-11-28 01:24:38.603399] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.136 [2024-11-28 01:24:38.603654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:11123 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.136 [2024-11-28 01:24:38.603682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.136 [2024-11-28 01:24:38.616974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.136 [2024-11-28 01:24:38.617214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:5718 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.136 [2024-11-28 01:24:38.617245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.136 [2024-11-28 01:24:38.630696] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.136 [2024-11-28 01:24:38.630978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:23196 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.136 [2024-11-28 01:24:38.631009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.136 [2024-11-28 01:24:38.644393] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.136 [2024-11-28 01:24:38.644624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:16996 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.136 [2024-11-28 01:24:38.644652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.136 [2024-11-28 01:24:38.658172] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.136 [2024-11-28 01:24:38.658416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:13646 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.136 [2024-11-28 01:24:38.658447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.136 [2024-11-28 01:24:38.671921] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.136 [2024-11-28 01:24:38.672162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:18261 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.136 [2024-11-28 01:24:38.672194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.136 [2024-11-28 01:24:38.685598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.136 [2024-11-28 01:24:38.685881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:13271 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.136 [2024-11-28 01:24:38.685913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.136 [2024-11-28 01:24:38.699380] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.136 [2024-11-28 01:24:38.699637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:13600 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.136 [2024-11-28 01:24:38.699665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.136 [2024-11-28 01:24:38.713128] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.136 [2024-11-28 01:24:38.713375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25582 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.136 [2024-11-28 01:24:38.713406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.136 [2024-11-28 01:24:38.726846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.136 [2024-11-28 01:24:38.727085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:4409 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.136 [2024-11-28 01:24:38.727116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.395 [2024-11-28 01:24:38.740502] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.395 [2024-11-28 01:24:38.740775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:8103 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.395 [2024-11-28 01:24:38.740806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.395 [2024-11-28 01:24:38.754267] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.395 [2024-11-28 01:24:38.754513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:4366 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.395 [2024-11-28 01:24:38.754568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.395 [2024-11-28 01:24:38.768022] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.395 [2024-11-28 01:24:38.768260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:865 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.395 [2024-11-28 01:24:38.768292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.395 [2024-11-28 01:24:38.781717] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.395 [2024-11-28 01:24:38.781959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:13163 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.395 [2024-11-28 01:24:38.781991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.395 [2024-11-28 01:24:38.795556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.395 [2024-11-28 01:24:38.795839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:24246 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.395 [2024-11-28 01:24:38.795870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.395 [2024-11-28 01:24:38.809321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.395 [2024-11-28 01:24:38.809584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:15604 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.395 [2024-11-28 01:24:38.809612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.395 [2024-11-28 01:24:38.823155] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.395 [2024-11-28 01:24:38.823395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:8297 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.395 [2024-11-28 01:24:38.823426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.395 [2024-11-28 01:24:38.837013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.395 [2024-11-28 01:24:38.837258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:22410 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.395 [2024-11-28 01:24:38.837288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.395 [2024-11-28 01:24:38.850753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.395 [2024-11-28 01:24:38.851015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:22873 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.395 [2024-11-28 01:24:38.851046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.395 [2024-11-28 01:24:38.864623] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.395 [2024-11-28 01:24:38.864878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:17605 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.395 [2024-11-28 01:24:38.864909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.395 [2024-11-28 01:24:38.878250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.395 [2024-11-28 01:24:38.878486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:12915 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.395 [2024-11-28 01:24:38.878522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.395 [2024-11-28 01:24:38.891993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.395 [2024-11-28 01:24:38.892232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:15198 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.395 [2024-11-28 01:24:38.892263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.395 [2024-11-28 01:24:38.905875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.395 [2024-11-28 01:24:38.906115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:14746 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.395 [2024-11-28 01:24:38.906145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.395 [2024-11-28 01:24:38.919607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.395 [2024-11-28 01:24:38.919863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:14243 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.395 [2024-11-28 01:24:38.919894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.395 [2024-11-28 01:24:38.933482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.395 [2024-11-28 01:24:38.933736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:5536 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.395 [2024-11-28 01:24:38.933764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.395 [2024-11-28 01:24:38.947243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.395 [2024-11-28 01:24:38.947480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:6885 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.395 [2024-11-28 01:24:38.947511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.396 [2024-11-28 01:24:38.961016] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.396 [2024-11-28 01:24:38.961268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:2351 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.396 [2024-11-28 01:24:38.961299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.396 [2024-11-28 01:24:38.974838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.396 [2024-11-28 01:24:38.975098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:24036 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.396 [2024-11-28 01:24:38.975128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.396 [2024-11-28 01:24:38.988641] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.396 [2024-11-28 01:24:38.988929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:15550 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.396 [2024-11-28 01:24:38.988961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.654 [2024-11-28 01:24:39.002195] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.654 [2024-11-28 01:24:39.002441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:584 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.654 [2024-11-28 01:24:39.002475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.654 [2024-11-28 01:24:39.015921] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.654 [2024-11-28 01:24:39.016164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:9087 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.654 [2024-11-28 01:24:39.016196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.654 [2024-11-28 01:24:39.029720] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.654 [2024-11-28 01:24:39.029991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:5898 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.654 [2024-11-28 01:24:39.030023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.654 [2024-11-28 01:24:39.043538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.654 [2024-11-28 01:24:39.043784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:12110 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.654 [2024-11-28 01:24:39.043812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.654 [2024-11-28 01:24:39.057318] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.654 [2024-11-28 01:24:39.057586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:7140 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.654 [2024-11-28 01:24:39.057614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.654 [2024-11-28 01:24:39.071020] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.654 [2024-11-28 01:24:39.071259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:21411 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.654 [2024-11-28 01:24:39.071289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.654 [2024-11-28 01:24:39.084834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.655 [2024-11-28 01:24:39.085085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:23496 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.655 [2024-11-28 01:24:39.085115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.655 [2024-11-28 01:24:39.098570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.655 [2024-11-28 01:24:39.098835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:14208 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.655 [2024-11-28 01:24:39.098865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.655 [2024-11-28 01:24:39.112302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.655 [2024-11-28 01:24:39.112574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:24133 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.655 [2024-11-28 01:24:39.112602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.655 [2024-11-28 01:24:39.126172] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.655 [2024-11-28 01:24:39.126389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:19042 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.655 [2024-11-28 01:24:39.126420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.655 [2024-11-28 01:24:39.139809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.655 [2024-11-28 01:24:39.140061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:22530 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.655 [2024-11-28 01:24:39.140092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.655 [2024-11-28 01:24:39.153507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.655 [2024-11-28 01:24:39.153758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:8242 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.655 [2024-11-28 01:24:39.153786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.655 [2024-11-28 01:24:39.167269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.655 [2024-11-28 01:24:39.167515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:23078 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.655 [2024-11-28 01:24:39.167553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.655 [2024-11-28 01:24:39.180999] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.655 [2024-11-28 01:24:39.181236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:17458 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.655 [2024-11-28 01:24:39.181266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.655 [2024-11-28 01:24:39.194711] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.655 [2024-11-28 01:24:39.194964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:2252 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.655 [2024-11-28 01:24:39.194995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.655 [2024-11-28 01:24:39.208462] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.655 [2024-11-28 01:24:39.208704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:8948 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.655 [2024-11-28 01:24:39.208732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.655 [2024-11-28 01:24:39.222223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.655 [2024-11-28 01:24:39.222462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:2163 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.655 [2024-11-28 01:24:39.222493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.655 [2024-11-28 01:24:39.236113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.655 [2024-11-28 01:24:39.236355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:14142 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.655 [2024-11-28 01:24:39.236391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.655 [2024-11-28 01:24:39.249970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.655 [2024-11-28 01:24:39.250204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:3690 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.655 [2024-11-28 01:24:39.250234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.913 [2024-11-28 01:24:39.263636] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.913 [2024-11-28 01:24:39.263862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:19973 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.913 [2024-11-28 01:24:39.263911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.913 [2024-11-28 01:24:39.277478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.913 [2024-11-28 01:24:39.277729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:23622 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.913 [2024-11-28 01:24:39.277758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.913 [2024-11-28 01:24:39.291260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.913 [2024-11-28 01:24:39.291498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:23898 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.913 [2024-11-28 01:24:39.291536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.913 [2024-11-28 01:24:39.305047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f63f0) with pdu=0x2000190e7c50 00:30:24.913 [2024-11-28 01:24:39.305240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:25165 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:24.913 [2024-11-28 01:24:39.305270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:24.913 00:30:24.913 Latency(us) 00:30:24.913 [2024-11-28T00:24:39.516Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:24.913 [2024-11-28T00:24:39.516Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:30:24.913 nvme0n1 : 2.01 19213.60 75.05 0.00 0.00 6647.55 3179.71 15825.73 00:30:24.913 [2024-11-28T00:24:39.516Z] =================================================================================================================== 00:30:24.913 [2024-11-28T00:24:39.516Z] Total : 19213.60 75.05 0.00 0.00 6647.55 3179.71 15825.73 00:30:24.913 0 00:30:24.913 01:24:39 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:24.913 01:24:39 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:24.913 01:24:39 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:24.913 | .driver_specific 00:30:24.913 | .nvme_error 00:30:24.913 | .status_code 00:30:24.913 | .command_transient_transport_error' 00:30:24.913 01:24:39 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:25.172 01:24:39 -- host/digest.sh@71 -- # (( 151 > 0 )) 00:30:25.172 01:24:39 -- host/digest.sh@73 -- # killprocess 2161439 00:30:25.172 01:24:39 -- common/autotest_common.sh@936 -- # '[' -z 2161439 ']' 00:30:25.172 01:24:39 -- common/autotest_common.sh@940 -- # kill -0 2161439 00:30:25.172 01:24:39 -- common/autotest_common.sh@941 -- # uname 00:30:25.172 01:24:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:25.172 01:24:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2161439 00:30:25.172 01:24:39 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:25.172 01:24:39 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:25.172 01:24:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2161439' 00:30:25.172 killing process with pid 2161439 00:30:25.172 01:24:39 -- common/autotest_common.sh@955 -- # kill 2161439 00:30:25.172 Received shutdown signal, test time was about 2.000000 seconds 00:30:25.172 00:30:25.172 Latency(us) 00:30:25.172 [2024-11-28T00:24:39.775Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:25.172 [2024-11-28T00:24:39.775Z] =================================================================================================================== 00:30:25.172 [2024-11-28T00:24:39.775Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:25.172 01:24:39 -- common/autotest_common.sh@960 -- # wait 2161439 00:30:25.430 01:24:39 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:30:25.430 01:24:39 -- host/digest.sh@54 -- # local rw bs qd 00:30:25.430 01:24:39 -- host/digest.sh@56 -- # rw=randwrite 00:30:25.430 01:24:39 -- host/digest.sh@56 -- # bs=131072 00:30:25.430 01:24:39 -- host/digest.sh@56 -- # qd=16 00:30:25.430 01:24:39 -- host/digest.sh@58 -- # bperfpid=2161991 00:30:25.430 01:24:39 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:30:25.430 01:24:39 -- host/digest.sh@60 -- # waitforlisten 2161991 /var/tmp/bperf.sock 00:30:25.430 01:24:39 -- common/autotest_common.sh@829 -- # '[' -z 2161991 ']' 00:30:25.430 01:24:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:25.430 01:24:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:25.430 01:24:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:25.430 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:25.430 01:24:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:25.430 01:24:39 -- common/autotest_common.sh@10 -- # set +x 00:30:25.430 [2024-11-28 01:24:39.871212] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:25.430 [2024-11-28 01:24:39.871295] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2161991 ] 00:30:25.430 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:25.430 Zero copy mechanism will not be used. 00:30:25.430 EAL: No free 2048 kB hugepages reported on node 1 00:30:25.431 [2024-11-28 01:24:39.932993] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:25.431 [2024-11-28 01:24:40.027594] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:26.365 01:24:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:26.365 01:24:40 -- common/autotest_common.sh@862 -- # return 0 00:30:26.365 01:24:40 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:26.365 01:24:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:26.624 01:24:41 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:26.624 01:24:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:26.624 01:24:41 -- common/autotest_common.sh@10 -- # set +x 00:30:26.624 01:24:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:26.624 01:24:41 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:26.624 01:24:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:27.191 nvme0n1 00:30:27.191 01:24:41 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:30:27.191 01:24:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:27.191 01:24:41 -- common/autotest_common.sh@10 -- # set +x 00:30:27.191 01:24:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:27.191 01:24:41 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:27.191 01:24:41 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:27.191 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:27.191 Zero copy mechanism will not be used. 00:30:27.191 Running I/O for 2 seconds... 00:30:27.191 [2024-11-28 01:24:41.665318] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.191 [2024-11-28 01:24:41.665635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.191 [2024-11-28 01:24:41.665672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.191 [2024-11-28 01:24:41.673843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.191 [2024-11-28 01:24:41.674053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.191 [2024-11-28 01:24:41.674084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.191 [2024-11-28 01:24:41.682429] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.191 [2024-11-28 01:24:41.682669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.191 [2024-11-28 01:24:41.682699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.191 [2024-11-28 01:24:41.690664] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.191 [2024-11-28 01:24:41.690852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.191 [2024-11-28 01:24:41.690882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.191 [2024-11-28 01:24:41.698738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.191 [2024-11-28 01:24:41.698942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.191 [2024-11-28 01:24:41.698975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.191 [2024-11-28 01:24:41.706817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.191 [2024-11-28 01:24:41.707060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.191 [2024-11-28 01:24:41.707089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.191 [2024-11-28 01:24:41.714861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.191 [2024-11-28 01:24:41.715073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.191 [2024-11-28 01:24:41.715102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.191 [2024-11-28 01:24:41.723488] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.191 [2024-11-28 01:24:41.723778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.191 [2024-11-28 01:24:41.723823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.191 [2024-11-28 01:24:41.731755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.191 [2024-11-28 01:24:41.731927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.191 [2024-11-28 01:24:41.731959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.191 [2024-11-28 01:24:41.740239] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.191 [2024-11-28 01:24:41.740483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.191 [2024-11-28 01:24:41.740536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.191 [2024-11-28 01:24:41.748543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.191 [2024-11-28 01:24:41.748738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.191 [2024-11-28 01:24:41.748766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.191 [2024-11-28 01:24:41.757245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.191 [2024-11-28 01:24:41.757602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.191 [2024-11-28 01:24:41.757630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.191 [2024-11-28 01:24:41.765879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.191 [2024-11-28 01:24:41.766119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.191 [2024-11-28 01:24:41.766149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.191 [2024-11-28 01:24:41.774721] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.191 [2024-11-28 01:24:41.775000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.191 [2024-11-28 01:24:41.775028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.191 [2024-11-28 01:24:41.783590] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.191 [2024-11-28 01:24:41.783740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.191 [2024-11-28 01:24:41.783769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.191 [2024-11-28 01:24:41.792418] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.191 [2024-11-28 01:24:41.792651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.792682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.801144] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.801437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.801491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.810047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.810301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.810331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.818453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.818660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.818689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.827355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.827644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.827677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.836324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.836621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.836653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.845380] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.845634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.845667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.854256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.854489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.854519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.863247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.863498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.863545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.872111] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.872359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.872388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.880710] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.880897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.880925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.889041] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.889300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.889329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.897618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.897854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.897883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.905963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.906279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.906307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.914912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.915170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.915202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.923381] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.923634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.923663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.932170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.932472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.932504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.941037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.941232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.941261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.950066] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.950281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.950310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.958523] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.958760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.958789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.967465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.967667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.967696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.976058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.976264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.976291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.984561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.984825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.984854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:41.993273] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:41.993577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.451 [2024-11-28 01:24:41.993606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.451 [2024-11-28 01:24:42.002047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.451 [2024-11-28 01:24:42.002396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.452 [2024-11-28 01:24:42.002428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.452 [2024-11-28 01:24:42.010809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.452 [2024-11-28 01:24:42.011081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.452 [2024-11-28 01:24:42.011110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.452 [2024-11-28 01:24:42.019507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.452 [2024-11-28 01:24:42.019776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.452 [2024-11-28 01:24:42.019805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.452 [2024-11-28 01:24:42.027931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.452 [2024-11-28 01:24:42.028160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.452 [2024-11-28 01:24:42.028195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.452 [2024-11-28 01:24:42.036606] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.452 [2024-11-28 01:24:42.036792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.452 [2024-11-28 01:24:42.036820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.452 [2024-11-28 01:24:42.044747] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.452 [2024-11-28 01:24:42.045072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.452 [2024-11-28 01:24:42.045100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.711 [2024-11-28 01:24:42.053418] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.711 [2024-11-28 01:24:42.053672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.711 [2024-11-28 01:24:42.053703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.711 [2024-11-28 01:24:42.062071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.711 [2024-11-28 01:24:42.062234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.711 [2024-11-28 01:24:42.062268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.711 [2024-11-28 01:24:42.070583] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.711 [2024-11-28 01:24:42.070868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.070917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.079105] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.079394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.079427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.087446] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.087657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.087687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.095977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.096229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.096274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.104360] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.104614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.104646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.113071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.113311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.113340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.122129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.122291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.122320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.130977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.131243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.131272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.139450] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.139720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.139750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.147913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.148171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.148200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.156616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.156780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.156808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.165101] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.165337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.165365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.173745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.174004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.174036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.182217] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.182405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.182433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.191126] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.191302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.191330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.200118] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.200387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.200419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.208629] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.208943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.208972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.217323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.217549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.217593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.225916] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.226083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.226112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.234640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.234758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.234787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.243319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.243490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.243521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.251869] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.252091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.252124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.260215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.260548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.260577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.268699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.268842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.268871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.277066] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.277324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.277355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.285320] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.285503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.285557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.293768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.712 [2024-11-28 01:24:42.294124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.712 [2024-11-28 01:24:42.294155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.712 [2024-11-28 01:24:42.302208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.713 [2024-11-28 01:24:42.302365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.713 [2024-11-28 01:24:42.302394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.713 [2024-11-28 01:24:42.310547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.713 [2024-11-28 01:24:42.310788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.713 [2024-11-28 01:24:42.310818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.971 [2024-11-28 01:24:42.319355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.971 [2024-11-28 01:24:42.319619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.319650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.328023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.328318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.328348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.337058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.337217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.337249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.346061] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.346335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.346365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.354727] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.354884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.354913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.362758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.362951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.362979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.371158] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.371397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.371443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.379767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.379990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.380022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.388249] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.388461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.388493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.397162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.397422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.397456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.405783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.406039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.406084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.414729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.414980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.415011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.423461] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.423678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.423707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.432342] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.432584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.432612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.441055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.441252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.441279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.449381] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.449610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.449638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.458092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.458263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.458291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.466680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.466958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.466986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.475038] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.475216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.475245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.483678] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.484037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.484070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.492178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.492337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.492365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.500755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.501039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.501087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.509617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.509787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.509815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.517993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.518227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.518256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.526683] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.526851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.526879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.535255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.535506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.535542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:27.972 [2024-11-28 01:24:42.543924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.972 [2024-11-28 01:24:42.544181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.972 [2024-11-28 01:24:42.544210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:27.973 [2024-11-28 01:24:42.553201] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.973 [2024-11-28 01:24:42.553446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.973 [2024-11-28 01:24:42.553475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:27.973 [2024-11-28 01:24:42.561926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.973 [2024-11-28 01:24:42.562123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.973 [2024-11-28 01:24:42.562155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:27.973 [2024-11-28 01:24:42.570210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:27.973 [2024-11-28 01:24:42.570483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.973 [2024-11-28 01:24:42.570517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.231 [2024-11-28 01:24:42.578364] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.231 [2024-11-28 01:24:42.578598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.231 [2024-11-28 01:24:42.578629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.231 [2024-11-28 01:24:42.586727] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.231 [2024-11-28 01:24:42.586855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.231 [2024-11-28 01:24:42.586884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.231 [2024-11-28 01:24:42.595136] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.231 [2024-11-28 01:24:42.595376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.231 [2024-11-28 01:24:42.595405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.231 [2024-11-28 01:24:42.603861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.231 [2024-11-28 01:24:42.604098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.231 [2024-11-28 01:24:42.604130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.231 [2024-11-28 01:24:42.612752] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.231 [2024-11-28 01:24:42.613001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.231 [2024-11-28 01:24:42.613031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.621043] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.621312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.621364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.629777] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.629948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.629977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.638231] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.638406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.638435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.646280] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.646481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.646509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.654950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.655155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.655184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.663303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.663546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.663577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.672012] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.672182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.672208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.680738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.680933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.680961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.689654] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.689893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.689922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.698114] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.698365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.698393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.706962] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.707234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.707262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.715103] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.715336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.715364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.723814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.724039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.724066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.732551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.732781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.732810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.740990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.741181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.741209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.749657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.749917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.749945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.758425] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.758735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.758764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.767207] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.767452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.767499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.775673] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.775845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.775890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.783832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.784050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.784082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.792388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.792626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.792656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.801144] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.801363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.801392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.809918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.810141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.810168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.818415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.818620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.818649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.232 [2024-11-28 01:24:42.827196] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.232 [2024-11-28 01:24:42.827551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.232 [2024-11-28 01:24:42.827598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.491 [2024-11-28 01:24:42.835699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.491 [2024-11-28 01:24:42.835956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.491 [2024-11-28 01:24:42.835992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.491 [2024-11-28 01:24:42.844107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.491 [2024-11-28 01:24:42.844352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.491 [2024-11-28 01:24:42.844387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.491 [2024-11-28 01:24:42.852215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.491 [2024-11-28 01:24:42.852368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.491 [2024-11-28 01:24:42.852397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.491 [2024-11-28 01:24:42.860693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.491 [2024-11-28 01:24:42.860906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.491 [2024-11-28 01:24:42.860937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.491 [2024-11-28 01:24:42.869448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.491 [2024-11-28 01:24:42.869662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.491 [2024-11-28 01:24:42.869690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.491 [2024-11-28 01:24:42.878438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.491 [2024-11-28 01:24:42.878681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.491 [2024-11-28 01:24:42.878709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:42.887093] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:42.887216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:42.887245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:42.895901] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:42.896149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:42.896181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:42.904702] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:42.904954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:42.904984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:42.913333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:42.913494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:42.913530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:42.921425] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:42.921768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:42.921796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:42.930230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:42.930490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:42.930519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:42.938890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:42.939110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:42.939153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:42.947554] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:42.947718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:42.947747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:42.956008] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:42.956227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:42.956271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:42.964784] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:42.965045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:42.965091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:42.973257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:42.973576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:42.973606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:42.981455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:42.981654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:42.981683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:42.988832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:42.989049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:42.989085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:42.997049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:42.997259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:42.997287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:43.004892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:43.005173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:43.005201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:43.013177] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:43.013284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:43.013312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:43.021362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:43.021637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:43.021666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:43.029495] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:43.029734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:43.029764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:43.037794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:43.038028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:43.038057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:43.046034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:43.046297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:43.046325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:43.054098] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:43.054340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:43.054368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:43.062260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:43.062473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:43.062501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:43.070306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:43.070518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:43.070557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:43.078433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:43.078669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:43.078698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.492 [2024-11-28 01:24:43.086673] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.492 [2024-11-28 01:24:43.086820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.492 [2024-11-28 01:24:43.086848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.094385] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.094658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.094690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.102496] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.102774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.102805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.110652] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.110874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.110903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.118867] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.119112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.119141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.127205] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.127518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.127554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.135173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.135418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.135446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.143227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.143463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.143492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.151329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.151604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.151633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.159586] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.159800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.159828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.167784] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.168060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.168089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.175882] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.176116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.176145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.183792] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.183973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.184002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.192254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.192369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.192397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.200007] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.200220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.200256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.208297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.208546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.208575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.216425] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.216695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.216724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.224950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.225183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.225211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.233319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.233520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.233556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.241292] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.241499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.241535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.249315] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.249554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.249583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.257473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.257723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.257751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.265724] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.265962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.265990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.274201] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.274438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.274467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.282300] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.282534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.752 [2024-11-28 01:24:43.282562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.752 [2024-11-28 01:24:43.290353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.752 [2024-11-28 01:24:43.290595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.753 [2024-11-28 01:24:43.290625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.753 [2024-11-28 01:24:43.298161] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.753 [2024-11-28 01:24:43.298318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.753 [2024-11-28 01:24:43.298347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.753 [2024-11-28 01:24:43.306254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.753 [2024-11-28 01:24:43.306424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.753 [2024-11-28 01:24:43.306452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.753 [2024-11-28 01:24:43.314271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.753 [2024-11-28 01:24:43.314479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.753 [2024-11-28 01:24:43.314507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:28.753 [2024-11-28 01:24:43.322421] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.753 [2024-11-28 01:24:43.322638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.753 [2024-11-28 01:24:43.322666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:28.753 [2024-11-28 01:24:43.330584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.753 [2024-11-28 01:24:43.330803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.753 [2024-11-28 01:24:43.330831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:28.753 [2024-11-28 01:24:43.338681] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.753 [2024-11-28 01:24:43.338940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.753 [2024-11-28 01:24:43.338969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:28.753 [2024-11-28 01:24:43.347126] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:28.753 [2024-11-28 01:24:43.347371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:28.753 [2024-11-28 01:24:43.347400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:29.012 [2024-11-28 01:24:43.355625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.012 [2024-11-28 01:24:43.355929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.012 [2024-11-28 01:24:43.355960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:29.012 [2024-11-28 01:24:43.363550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.012 [2024-11-28 01:24:43.363781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.363811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.371568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.371736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.371765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.379902] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.380139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.380168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.387696] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.387925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.387954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.395976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.396066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.396093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.404166] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.404364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.404393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.412485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.412857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.412894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.420579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.420727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.420756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.429113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.429362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.429391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.437222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.437431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.437460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.445336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.445696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.445725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.453539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.453794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.453824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.461926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.462086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.462114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.470268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.470473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.470502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.478346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.478542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.478581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.486439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.486723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.486752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.494694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.494932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.494961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.502671] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.502898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.502927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.510801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.511004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.511033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.518915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.519123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.519152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.526975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.527225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.527254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.534902] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.535120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.535149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.543372] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.543607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.543635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.551533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.551774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.551802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.559761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.560061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.013 [2024-11-28 01:24:43.560089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:29.013 [2024-11-28 01:24:43.567814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.013 [2024-11-28 01:24:43.568012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.014 [2024-11-28 01:24:43.568040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:29.014 [2024-11-28 01:24:43.575885] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.014 [2024-11-28 01:24:43.576107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.014 [2024-11-28 01:24:43.576135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:29.014 [2024-11-28 01:24:43.583975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.014 [2024-11-28 01:24:43.584227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.014 [2024-11-28 01:24:43.584255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:29.014 [2024-11-28 01:24:43.592296] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.014 [2024-11-28 01:24:43.592442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.014 [2024-11-28 01:24:43.592469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:29.014 [2024-11-28 01:24:43.600374] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.014 [2024-11-28 01:24:43.600593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.014 [2024-11-28 01:24:43.600621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:29.014 [2024-11-28 01:24:43.608612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.014 [2024-11-28 01:24:43.608788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.014 [2024-11-28 01:24:43.608816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:29.272 [2024-11-28 01:24:43.616844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.272 [2024-11-28 01:24:43.617109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.272 [2024-11-28 01:24:43.617140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:29.272 [2024-11-28 01:24:43.625103] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.272 [2024-11-28 01:24:43.625340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.272 [2024-11-28 01:24:43.625378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:29.272 [2024-11-28 01:24:43.633245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.272 [2024-11-28 01:24:43.633484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.272 [2024-11-28 01:24:43.633513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:29.272 [2024-11-28 01:24:43.641498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.272 [2024-11-28 01:24:43.641908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.272 [2024-11-28 01:24:43.641937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:29.272 [2024-11-28 01:24:43.649660] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.273 [2024-11-28 01:24:43.649867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.273 [2024-11-28 01:24:43.649895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:29.273 [2024-11-28 01:24:43.657858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x22f6590) with pdu=0x2000190fef90 00:30:29.273 [2024-11-28 01:24:43.658104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:29.273 [2024-11-28 01:24:43.658131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:29.273 00:30:29.273 Latency(us) 00:30:29.273 [2024-11-28T00:24:43.876Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:29.273 [2024-11-28T00:24:43.876Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:30:29.273 nvme0n1 : 2.00 3667.31 458.41 0.00 0.00 4352.69 3349.62 11019.76 00:30:29.273 [2024-11-28T00:24:43.876Z] =================================================================================================================== 00:30:29.273 [2024-11-28T00:24:43.876Z] Total : 3667.31 458.41 0.00 0.00 4352.69 3349.62 11019.76 00:30:29.273 0 00:30:29.273 01:24:43 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:29.273 01:24:43 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:29.273 01:24:43 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:29.273 | .driver_specific 00:30:29.273 | .nvme_error 00:30:29.273 | .status_code 00:30:29.273 | .command_transient_transport_error' 00:30:29.273 01:24:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:29.531 01:24:43 -- host/digest.sh@71 -- # (( 237 > 0 )) 00:30:29.531 01:24:43 -- host/digest.sh@73 -- # killprocess 2161991 00:30:29.531 01:24:43 -- common/autotest_common.sh@936 -- # '[' -z 2161991 ']' 00:30:29.531 01:24:43 -- common/autotest_common.sh@940 -- # kill -0 2161991 00:30:29.531 01:24:43 -- common/autotest_common.sh@941 -- # uname 00:30:29.531 01:24:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:29.531 01:24:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2161991 00:30:29.531 01:24:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:29.531 01:24:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:29.531 01:24:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2161991' 00:30:29.531 killing process with pid 2161991 00:30:29.531 01:24:43 -- common/autotest_common.sh@955 -- # kill 2161991 00:30:29.531 Received shutdown signal, test time was about 2.000000 seconds 00:30:29.531 00:30:29.531 Latency(us) 00:30:29.531 [2024-11-28T00:24:44.134Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:29.531 [2024-11-28T00:24:44.134Z] =================================================================================================================== 00:30:29.531 [2024-11-28T00:24:44.134Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:29.531 01:24:43 -- common/autotest_common.sh@960 -- # wait 2161991 00:30:29.792 01:24:44 -- host/digest.sh@115 -- # killprocess 2160316 00:30:29.793 01:24:44 -- common/autotest_common.sh@936 -- # '[' -z 2160316 ']' 00:30:29.793 01:24:44 -- common/autotest_common.sh@940 -- # kill -0 2160316 00:30:29.793 01:24:44 -- common/autotest_common.sh@941 -- # uname 00:30:29.793 01:24:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:29.793 01:24:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2160316 00:30:29.793 01:24:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:29.793 01:24:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:29.793 01:24:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2160316' 00:30:29.793 killing process with pid 2160316 00:30:29.793 01:24:44 -- common/autotest_common.sh@955 -- # kill 2160316 00:30:29.793 01:24:44 -- common/autotest_common.sh@960 -- # wait 2160316 00:30:30.052 00:30:30.052 real 0m18.227s 00:30:30.052 user 0m36.377s 00:30:30.052 sys 0m4.397s 00:30:30.052 01:24:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:30.052 01:24:44 -- common/autotest_common.sh@10 -- # set +x 00:30:30.052 ************************************ 00:30:30.052 END TEST nvmf_digest_error 00:30:30.052 ************************************ 00:30:30.052 01:24:44 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:30:30.052 01:24:44 -- host/digest.sh@139 -- # nvmftestfini 00:30:30.052 01:24:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:30.052 01:24:44 -- nvmf/common.sh@116 -- # sync 00:30:30.052 01:24:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:30.052 01:24:44 -- nvmf/common.sh@119 -- # set +e 00:30:30.052 01:24:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:30.052 01:24:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:30.052 rmmod nvme_tcp 00:30:30.052 rmmod nvme_fabrics 00:30:30.052 rmmod nvme_keyring 00:30:30.052 01:24:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:30.052 01:24:44 -- nvmf/common.sh@123 -- # set -e 00:30:30.052 01:24:44 -- nvmf/common.sh@124 -- # return 0 00:30:30.052 01:24:44 -- nvmf/common.sh@477 -- # '[' -n 2160316 ']' 00:30:30.052 01:24:44 -- nvmf/common.sh@478 -- # killprocess 2160316 00:30:30.052 01:24:44 -- common/autotest_common.sh@936 -- # '[' -z 2160316 ']' 00:30:30.052 01:24:44 -- common/autotest_common.sh@940 -- # kill -0 2160316 00:30:30.052 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2160316) - No such process 00:30:30.052 01:24:44 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2160316 is not found' 00:30:30.052 Process with pid 2160316 is not found 00:30:30.052 01:24:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:30.052 01:24:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:30.052 01:24:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:30.052 01:24:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:30.052 01:24:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:30.052 01:24:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:30.052 01:24:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:30.052 01:24:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:32.590 01:24:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:32.590 00:30:32.590 real 0m37.860s 00:30:32.590 user 1m7.579s 00:30:32.590 sys 0m10.134s 00:30:32.590 01:24:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:32.590 01:24:46 -- common/autotest_common.sh@10 -- # set +x 00:30:32.590 ************************************ 00:30:32.590 END TEST nvmf_digest 00:30:32.590 ************************************ 00:30:32.590 01:24:46 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:30:32.590 01:24:46 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:30:32.590 01:24:46 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:30:32.590 01:24:46 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:32.590 01:24:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:32.590 01:24:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:32.590 01:24:46 -- common/autotest_common.sh@10 -- # set +x 00:30:32.590 ************************************ 00:30:32.590 START TEST nvmf_bdevperf 00:30:32.590 ************************************ 00:30:32.590 01:24:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:32.590 * Looking for test storage... 00:30:32.590 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:32.590 01:24:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:32.590 01:24:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:32.590 01:24:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:32.590 01:24:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:32.590 01:24:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:32.590 01:24:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:32.590 01:24:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:32.590 01:24:46 -- scripts/common.sh@335 -- # IFS=.-: 00:30:32.590 01:24:46 -- scripts/common.sh@335 -- # read -ra ver1 00:30:32.590 01:24:46 -- scripts/common.sh@336 -- # IFS=.-: 00:30:32.590 01:24:46 -- scripts/common.sh@336 -- # read -ra ver2 00:30:32.590 01:24:46 -- scripts/common.sh@337 -- # local 'op=<' 00:30:32.590 01:24:46 -- scripts/common.sh@339 -- # ver1_l=2 00:30:32.590 01:24:46 -- scripts/common.sh@340 -- # ver2_l=1 00:30:32.590 01:24:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:32.590 01:24:46 -- scripts/common.sh@343 -- # case "$op" in 00:30:32.590 01:24:46 -- scripts/common.sh@344 -- # : 1 00:30:32.590 01:24:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:32.590 01:24:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:32.590 01:24:46 -- scripts/common.sh@364 -- # decimal 1 00:30:32.590 01:24:46 -- scripts/common.sh@352 -- # local d=1 00:30:32.590 01:24:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:32.590 01:24:46 -- scripts/common.sh@354 -- # echo 1 00:30:32.590 01:24:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:32.590 01:24:46 -- scripts/common.sh@365 -- # decimal 2 00:30:32.590 01:24:46 -- scripts/common.sh@352 -- # local d=2 00:30:32.590 01:24:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:32.590 01:24:46 -- scripts/common.sh@354 -- # echo 2 00:30:32.590 01:24:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:32.590 01:24:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:32.590 01:24:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:32.590 01:24:46 -- scripts/common.sh@367 -- # return 0 00:30:32.590 01:24:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:32.590 01:24:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:32.590 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:32.590 --rc genhtml_branch_coverage=1 00:30:32.590 --rc genhtml_function_coverage=1 00:30:32.590 --rc genhtml_legend=1 00:30:32.590 --rc geninfo_all_blocks=1 00:30:32.590 --rc geninfo_unexecuted_blocks=1 00:30:32.590 00:30:32.590 ' 00:30:32.590 01:24:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:32.590 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:32.590 --rc genhtml_branch_coverage=1 00:30:32.590 --rc genhtml_function_coverage=1 00:30:32.590 --rc genhtml_legend=1 00:30:32.590 --rc geninfo_all_blocks=1 00:30:32.590 --rc geninfo_unexecuted_blocks=1 00:30:32.590 00:30:32.590 ' 00:30:32.590 01:24:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:32.590 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:32.590 --rc genhtml_branch_coverage=1 00:30:32.590 --rc genhtml_function_coverage=1 00:30:32.590 --rc genhtml_legend=1 00:30:32.590 --rc geninfo_all_blocks=1 00:30:32.590 --rc geninfo_unexecuted_blocks=1 00:30:32.590 00:30:32.590 ' 00:30:32.590 01:24:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:32.590 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:32.590 --rc genhtml_branch_coverage=1 00:30:32.590 --rc genhtml_function_coverage=1 00:30:32.590 --rc genhtml_legend=1 00:30:32.590 --rc geninfo_all_blocks=1 00:30:32.590 --rc geninfo_unexecuted_blocks=1 00:30:32.590 00:30:32.590 ' 00:30:32.590 01:24:46 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:32.590 01:24:46 -- nvmf/common.sh@7 -- # uname -s 00:30:32.590 01:24:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:32.590 01:24:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:32.590 01:24:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:32.590 01:24:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:32.590 01:24:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:32.590 01:24:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:32.590 01:24:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:32.590 01:24:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:32.590 01:24:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:32.590 01:24:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:32.590 01:24:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:32.590 01:24:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:32.590 01:24:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:32.590 01:24:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:32.590 01:24:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:32.590 01:24:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:32.590 01:24:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:32.590 01:24:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:32.590 01:24:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:32.590 01:24:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:32.590 01:24:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:32.590 01:24:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:32.590 01:24:46 -- paths/export.sh@5 -- # export PATH 00:30:32.590 01:24:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:32.590 01:24:46 -- nvmf/common.sh@46 -- # : 0 00:30:32.590 01:24:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:32.590 01:24:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:32.590 01:24:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:32.591 01:24:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:32.591 01:24:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:32.591 01:24:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:32.591 01:24:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:32.591 01:24:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:32.591 01:24:46 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:30:32.591 01:24:46 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:30:32.591 01:24:46 -- host/bdevperf.sh@24 -- # nvmftestinit 00:30:32.591 01:24:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:32.591 01:24:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:32.591 01:24:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:32.591 01:24:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:32.591 01:24:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:32.591 01:24:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:32.591 01:24:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:32.591 01:24:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:32.591 01:24:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:32.591 01:24:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:32.591 01:24:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:32.591 01:24:46 -- common/autotest_common.sh@10 -- # set +x 00:30:34.512 01:24:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:34.512 01:24:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:34.512 01:24:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:34.512 01:24:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:34.512 01:24:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:34.512 01:24:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:34.512 01:24:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:34.512 01:24:48 -- nvmf/common.sh@294 -- # net_devs=() 00:30:34.512 01:24:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:34.512 01:24:48 -- nvmf/common.sh@295 -- # e810=() 00:30:34.512 01:24:48 -- nvmf/common.sh@295 -- # local -ga e810 00:30:34.512 01:24:48 -- nvmf/common.sh@296 -- # x722=() 00:30:34.512 01:24:48 -- nvmf/common.sh@296 -- # local -ga x722 00:30:34.512 01:24:48 -- nvmf/common.sh@297 -- # mlx=() 00:30:34.512 01:24:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:34.512 01:24:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:34.512 01:24:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:34.512 01:24:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:34.512 01:24:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:34.512 01:24:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:34.512 01:24:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:34.512 01:24:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:34.512 01:24:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:34.512 01:24:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:34.512 01:24:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:34.512 01:24:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:34.513 01:24:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:34.513 01:24:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:34.513 01:24:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:34.513 01:24:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:34.513 01:24:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:34.513 01:24:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:34.513 01:24:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:34.513 01:24:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:34.513 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:34.513 01:24:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:34.513 01:24:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:34.513 01:24:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:34.513 01:24:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:34.513 01:24:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:34.513 01:24:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:34.513 01:24:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:34.513 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:34.513 01:24:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:34.513 01:24:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:34.513 01:24:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:34.513 01:24:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:34.513 01:24:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:34.513 01:24:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:34.513 01:24:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:34.513 01:24:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:34.513 01:24:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:34.513 01:24:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:34.513 01:24:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:34.513 01:24:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:34.513 01:24:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:34.513 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:34.513 01:24:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:34.513 01:24:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:34.513 01:24:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:34.513 01:24:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:34.513 01:24:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:34.513 01:24:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:34.513 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:34.513 01:24:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:34.513 01:24:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:34.513 01:24:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:34.513 01:24:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:34.513 01:24:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:34.513 01:24:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:34.513 01:24:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:34.513 01:24:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:34.513 01:24:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:34.513 01:24:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:34.513 01:24:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:34.513 01:24:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:34.513 01:24:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:34.513 01:24:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:34.513 01:24:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:34.513 01:24:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:34.513 01:24:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:34.513 01:24:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:34.513 01:24:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:34.513 01:24:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:34.513 01:24:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:34.513 01:24:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:34.513 01:24:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:34.513 01:24:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:34.513 01:24:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:34.513 01:24:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:34.513 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:34.513 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.185 ms 00:30:34.513 00:30:34.513 --- 10.0.0.2 ping statistics --- 00:30:34.513 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:34.513 rtt min/avg/max/mdev = 0.185/0.185/0.185/0.000 ms 00:30:34.513 01:24:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:34.513 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:34.513 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.047 ms 00:30:34.513 00:30:34.513 --- 10.0.0.1 ping statistics --- 00:30:34.513 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:34.513 rtt min/avg/max/mdev = 0.047/0.047/0.047/0.000 ms 00:30:34.513 01:24:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:34.513 01:24:48 -- nvmf/common.sh@410 -- # return 0 00:30:34.513 01:24:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:34.513 01:24:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:34.513 01:24:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:34.513 01:24:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:34.513 01:24:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:34.513 01:24:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:34.513 01:24:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:34.513 01:24:49 -- host/bdevperf.sh@25 -- # tgt_init 00:30:34.513 01:24:49 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:34.513 01:24:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:34.513 01:24:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:34.513 01:24:49 -- common/autotest_common.sh@10 -- # set +x 00:30:34.513 01:24:49 -- nvmf/common.sh@469 -- # nvmfpid=2164505 00:30:34.513 01:24:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:34.513 01:24:49 -- nvmf/common.sh@470 -- # waitforlisten 2164505 00:30:34.513 01:24:49 -- common/autotest_common.sh@829 -- # '[' -z 2164505 ']' 00:30:34.513 01:24:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:34.513 01:24:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:34.513 01:24:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:34.513 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:34.513 01:24:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:34.513 01:24:49 -- common/autotest_common.sh@10 -- # set +x 00:30:34.513 [2024-11-28 01:24:49.050295] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:34.513 [2024-11-28 01:24:49.050369] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:34.513 EAL: No free 2048 kB hugepages reported on node 1 00:30:34.513 [2024-11-28 01:24:49.113650] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:34.802 [2024-11-28 01:24:49.202483] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:34.802 [2024-11-28 01:24:49.202700] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:34.802 [2024-11-28 01:24:49.202719] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:34.802 [2024-11-28 01:24:49.202731] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:34.802 [2024-11-28 01:24:49.203008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:34.802 [2024-11-28 01:24:49.203031] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:34.802 [2024-11-28 01:24:49.203034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:35.738 01:24:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:35.738 01:24:50 -- common/autotest_common.sh@862 -- # return 0 00:30:35.738 01:24:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:35.738 01:24:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:35.738 01:24:50 -- common/autotest_common.sh@10 -- # set +x 00:30:35.738 01:24:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:35.738 01:24:50 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:35.738 01:24:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:35.738 01:24:50 -- common/autotest_common.sh@10 -- # set +x 00:30:35.738 [2024-11-28 01:24:50.101009] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:35.738 01:24:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:35.738 01:24:50 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:35.738 01:24:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:35.738 01:24:50 -- common/autotest_common.sh@10 -- # set +x 00:30:35.738 Malloc0 00:30:35.738 01:24:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:35.738 01:24:50 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:35.738 01:24:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:35.738 01:24:50 -- common/autotest_common.sh@10 -- # set +x 00:30:35.738 01:24:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:35.738 01:24:50 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:35.738 01:24:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:35.738 01:24:50 -- common/autotest_common.sh@10 -- # set +x 00:30:35.738 01:24:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:35.738 01:24:50 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:35.738 01:24:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:35.738 01:24:50 -- common/autotest_common.sh@10 -- # set +x 00:30:35.738 [2024-11-28 01:24:50.164362] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:35.738 01:24:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:35.738 01:24:50 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:30:35.738 01:24:50 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:30:35.738 01:24:50 -- nvmf/common.sh@520 -- # config=() 00:30:35.738 01:24:50 -- nvmf/common.sh@520 -- # local subsystem config 00:30:35.738 01:24:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:35.738 01:24:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:35.738 { 00:30:35.738 "params": { 00:30:35.738 "name": "Nvme$subsystem", 00:30:35.738 "trtype": "$TEST_TRANSPORT", 00:30:35.738 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:35.738 "adrfam": "ipv4", 00:30:35.738 "trsvcid": "$NVMF_PORT", 00:30:35.738 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:35.738 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:35.738 "hdgst": ${hdgst:-false}, 00:30:35.738 "ddgst": ${ddgst:-false} 00:30:35.738 }, 00:30:35.738 "method": "bdev_nvme_attach_controller" 00:30:35.738 } 00:30:35.738 EOF 00:30:35.738 )") 00:30:35.738 01:24:50 -- nvmf/common.sh@542 -- # cat 00:30:35.738 01:24:50 -- nvmf/common.sh@544 -- # jq . 00:30:35.738 01:24:50 -- nvmf/common.sh@545 -- # IFS=, 00:30:35.738 01:24:50 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:35.738 "params": { 00:30:35.738 "name": "Nvme1", 00:30:35.738 "trtype": "tcp", 00:30:35.738 "traddr": "10.0.0.2", 00:30:35.738 "adrfam": "ipv4", 00:30:35.738 "trsvcid": "4420", 00:30:35.738 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:35.738 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:35.738 "hdgst": false, 00:30:35.738 "ddgst": false 00:30:35.738 }, 00:30:35.738 "method": "bdev_nvme_attach_controller" 00:30:35.738 }' 00:30:35.739 [2024-11-28 01:24:50.212347] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:35.739 [2024-11-28 01:24:50.212413] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2164664 ] 00:30:35.739 EAL: No free 2048 kB hugepages reported on node 1 00:30:35.739 [2024-11-28 01:24:50.272768] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:35.997 [2024-11-28 01:24:50.359715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:35.997 Running I/O for 1 seconds... 00:30:37.372 00:30:37.372 Latency(us) 00:30:37.372 [2024-11-28T00:24:51.975Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:37.372 [2024-11-28T00:24:51.975Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:37.372 Verification LBA range: start 0x0 length 0x4000 00:30:37.372 Nvme1n1 : 1.01 12733.95 49.74 0.00 0.00 10002.58 1498.83 16990.81 00:30:37.372 [2024-11-28T00:24:51.975Z] =================================================================================================================== 00:30:37.372 [2024-11-28T00:24:51.975Z] Total : 12733.95 49.74 0.00 0.00 10002.58 1498.83 16990.81 00:30:37.372 01:24:51 -- host/bdevperf.sh@30 -- # bdevperfpid=2164818 00:30:37.372 01:24:51 -- host/bdevperf.sh@32 -- # sleep 3 00:30:37.372 01:24:51 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:30:37.372 01:24:51 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:30:37.372 01:24:51 -- nvmf/common.sh@520 -- # config=() 00:30:37.372 01:24:51 -- nvmf/common.sh@520 -- # local subsystem config 00:30:37.372 01:24:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:37.372 01:24:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:37.372 { 00:30:37.372 "params": { 00:30:37.372 "name": "Nvme$subsystem", 00:30:37.372 "trtype": "$TEST_TRANSPORT", 00:30:37.372 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:37.372 "adrfam": "ipv4", 00:30:37.372 "trsvcid": "$NVMF_PORT", 00:30:37.372 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:37.372 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:37.372 "hdgst": ${hdgst:-false}, 00:30:37.372 "ddgst": ${ddgst:-false} 00:30:37.372 }, 00:30:37.372 "method": "bdev_nvme_attach_controller" 00:30:37.372 } 00:30:37.372 EOF 00:30:37.372 )") 00:30:37.372 01:24:51 -- nvmf/common.sh@542 -- # cat 00:30:37.372 01:24:51 -- nvmf/common.sh@544 -- # jq . 00:30:37.372 01:24:51 -- nvmf/common.sh@545 -- # IFS=, 00:30:37.372 01:24:51 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:37.372 "params": { 00:30:37.372 "name": "Nvme1", 00:30:37.372 "trtype": "tcp", 00:30:37.372 "traddr": "10.0.0.2", 00:30:37.372 "adrfam": "ipv4", 00:30:37.372 "trsvcid": "4420", 00:30:37.372 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:37.372 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:37.372 "hdgst": false, 00:30:37.372 "ddgst": false 00:30:37.372 }, 00:30:37.372 "method": "bdev_nvme_attach_controller" 00:30:37.372 }' 00:30:37.372 [2024-11-28 01:24:51.842246] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:37.372 [2024-11-28 01:24:51.842322] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2164818 ] 00:30:37.372 EAL: No free 2048 kB hugepages reported on node 1 00:30:37.372 [2024-11-28 01:24:51.902619] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:37.631 [2024-11-28 01:24:51.988655] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:37.889 Running I/O for 15 seconds... 00:30:40.421 01:24:54 -- host/bdevperf.sh@33 -- # kill -9 2164505 00:30:40.421 01:24:54 -- host/bdevperf.sh@35 -- # sleep 3 00:30:40.421 [2024-11-28 01:24:54.812331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:126808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.812386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.812418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:126824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.812437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.812457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:126184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.812476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.812495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:126192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.812512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.812542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:126232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.812561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.812595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:126240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.812609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.812626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:126248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.812641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.812659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:126256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.812675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.812693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:126264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.812706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.812722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:126272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.812737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.812753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:126864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.812767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.812785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:126880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.812826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.812845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:126888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.812860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.812889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:126912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.812908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.812929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:126928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.812944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.812961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:126936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.812976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.812993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:126280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.813007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.813024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:126296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.813039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.813055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:126312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.813070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.813087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:126328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.813101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.813119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:126360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.813134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.813151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:126368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.813166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.813182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:126376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.813197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.813214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:126392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.813229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.813250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:126952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.813265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.813282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:126960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.813297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.813314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:126976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.813328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.813345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:126408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.813360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.813376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:126416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.813391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.813408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:126424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.813423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.813439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:126432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.813454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.813471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:126464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.813486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.813503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:126472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.813517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.813542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:126480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.813559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.421 [2024-11-28 01:24:54.813591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:126496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.421 [2024-11-28 01:24:54.813604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.813620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:126992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.813634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.813649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:127008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.813666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.813682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:127032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.422 [2024-11-28 01:24:54.813696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.813712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:127040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.422 [2024-11-28 01:24:54.813725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.813740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:127048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.422 [2024-11-28 01:24:54.813754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.813769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:127056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.422 [2024-11-28 01:24:54.813782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.813798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:127064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.422 [2024-11-28 01:24:54.813829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.813847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:127072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.422 [2024-11-28 01:24:54.813862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.813879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:127080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.422 [2024-11-28 01:24:54.813895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.813912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:127088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.813928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.813945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:127096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.813960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.813977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:127104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.422 [2024-11-28 01:24:54.813992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:127112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.422 [2024-11-28 01:24:54.814024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:127120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.422 [2024-11-28 01:24:54.814056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:127128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:127136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:127144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:127152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:127160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:127168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.422 [2024-11-28 01:24:54.814257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:126520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:126528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:126544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:126584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:126616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:126624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:126632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:126648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:127176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.422 [2024-11-28 01:24:54.814552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:127184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:127192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:127200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.422 [2024-11-28 01:24:54.814655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:127208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.422 [2024-11-28 01:24:54.814686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:127216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.422 [2024-11-28 01:24:54.814715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:126656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:126688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:126704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:126720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:126736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:126744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:126752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:126768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.814980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.814996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:127224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.422 [2024-11-28 01:24:54.815012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.815028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:127232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.815043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.815060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:127240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.815075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.422 [2024-11-28 01:24:54.815092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:127248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.422 [2024-11-28 01:24:54.815107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:127256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.815138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:127264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.815170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:127272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.423 [2024-11-28 01:24:54.815203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:127280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.423 [2024-11-28 01:24:54.815235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:127288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.815267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:127296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.815298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:127304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.815335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:127312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.815367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:127320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.815399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:127328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.815431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:127336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.815463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:127344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.815495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:127352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.423 [2024-11-28 01:24:54.815534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:126800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.815583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:126816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.815613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:126832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.815642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:126840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.815670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:126848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.815699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:126856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.815735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:126872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.815766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:126896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.815795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:127360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.815843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:127368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.423 [2024-11-28 01:24:54.815874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:127376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.815906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:127384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.423 [2024-11-28 01:24:54.815938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:127392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.423 [2024-11-28 01:24:54.815971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.815987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:127400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.423 [2024-11-28 01:24:54.816002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.816019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:127408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.423 [2024-11-28 01:24:54.816034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.816051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:127416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.816065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.816082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:127424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.423 [2024-11-28 01:24:54.816097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.816114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:127432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.816129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.816151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:127440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.816168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.816186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:127448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.423 [2024-11-28 01:24:54.816201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.816218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:127456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.423 [2024-11-28 01:24:54.816233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.816251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:127464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.816266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.816283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:127472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.816298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.816315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:127480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.423 [2024-11-28 01:24:54.816331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.816347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:127488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:40.423 [2024-11-28 01:24:54.816363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.816381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:127496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.816396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.816413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:126904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.816428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.816445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:126920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.816460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.816477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:126944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.816492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.816509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:126968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.816532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.816553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:126984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.816573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.816606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:127000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.816620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.423 [2024-11-28 01:24:54.816635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:127016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.423 [2024-11-28 01:24:54.816649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.424 [2024-11-28 01:24:54.816664] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x69c900 is same with the state(5) to be set 00:30:40.424 [2024-11-28 01:24:54.816681] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:30:40.424 [2024-11-28 01:24:54.816693] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:30:40.424 [2024-11-28 01:24:54.816705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:127024 len:8 PRP1 0x0 PRP2 0x0 00:30:40.424 [2024-11-28 01:24:54.816718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:40.424 [2024-11-28 01:24:54.816781] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x69c900 was disconnected and freed. reset controller. 00:30:40.424 [2024-11-28 01:24:54.819021] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.424 [2024-11-28 01:24:54.819096] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.424 [2024-11-28 01:24:54.819655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.424 [2024-11-28 01:24:54.819773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.424 [2024-11-28 01:24:54.819800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.424 [2024-11-28 01:24:54.819817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.424 [2024-11-28 01:24:54.819998] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.424 [2024-11-28 01:24:54.820176] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.424 [2024-11-28 01:24:54.820200] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.424 [2024-11-28 01:24:54.820219] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.424 [2024-11-28 01:24:54.822892] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.424 [2024-11-28 01:24:54.831783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.424 [2024-11-28 01:24:54.832259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.424 [2024-11-28 01:24:54.832482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.424 [2024-11-28 01:24:54.832512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.424 [2024-11-28 01:24:54.832541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.424 [2024-11-28 01:24:54.832695] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.424 [2024-11-28 01:24:54.832888] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.424 [2024-11-28 01:24:54.832912] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.424 [2024-11-28 01:24:54.832933] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.424 [2024-11-28 01:24:54.835357] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.424 [2024-11-28 01:24:54.844256] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.424 [2024-11-28 01:24:54.844631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.424 [2024-11-28 01:24:54.844747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.424 [2024-11-28 01:24:54.844776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.424 [2024-11-28 01:24:54.844794] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.424 [2024-11-28 01:24:54.844976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.424 [2024-11-28 01:24:54.845181] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.424 [2024-11-28 01:24:54.845204] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.424 [2024-11-28 01:24:54.845220] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.424 [2024-11-28 01:24:54.847696] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.424 [2024-11-28 01:24:54.856742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.424 [2024-11-28 01:24:54.857058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.424 [2024-11-28 01:24:54.857214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.424 [2024-11-28 01:24:54.857239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.424 [2024-11-28 01:24:54.857256] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.424 [2024-11-28 01:24:54.857418] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.424 [2024-11-28 01:24:54.857613] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.424 [2024-11-28 01:24:54.857639] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.424 [2024-11-28 01:24:54.857655] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.424 [2024-11-28 01:24:54.859958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.424 [2024-11-28 01:24:54.869247] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.424 [2024-11-28 01:24:54.869592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.424 [2024-11-28 01:24:54.869728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.424 [2024-11-28 01:24:54.869754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.424 [2024-11-28 01:24:54.869770] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.424 [2024-11-28 01:24:54.869902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.424 [2024-11-28 01:24:54.870155] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.424 [2024-11-28 01:24:54.870180] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.424 [2024-11-28 01:24:54.870196] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.424 [2024-11-28 01:24:54.872662] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.424 [2024-11-28 01:24:54.881884] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.424 [2024-11-28 01:24:54.882214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.424 [2024-11-28 01:24:54.882359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.424 [2024-11-28 01:24:54.882388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.424 [2024-11-28 01:24:54.882406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.424 [2024-11-28 01:24:54.882545] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.424 [2024-11-28 01:24:54.882715] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.424 [2024-11-28 01:24:54.882739] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.424 [2024-11-28 01:24:54.882755] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.424 [2024-11-28 01:24:54.885079] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.424 [2024-11-28 01:24:54.894377] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.424 [2024-11-28 01:24:54.894720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.424 [2024-11-28 01:24:54.894954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.424 [2024-11-28 01:24:54.894982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.424 [2024-11-28 01:24:54.894999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.424 [2024-11-28 01:24:54.895182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.424 [2024-11-28 01:24:54.895296] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.424 [2024-11-28 01:24:54.895320] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.424 [2024-11-28 01:24:54.895336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.424 [2024-11-28 01:24:54.897517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.424 [2024-11-28 01:24:54.907067] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.424 [2024-11-28 01:24:54.907373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.424 [2024-11-28 01:24:54.907508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.424 [2024-11-28 01:24:54.907547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.424 [2024-11-28 01:24:54.907566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.424 [2024-11-28 01:24:54.907713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.424 [2024-11-28 01:24:54.907882] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.424 [2024-11-28 01:24:54.907906] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.424 [2024-11-28 01:24:54.907921] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.424 [2024-11-28 01:24:54.910064] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.424 [2024-11-28 01:24:54.919718] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.424 [2024-11-28 01:24:54.920006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.424 [2024-11-28 01:24:54.920169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.424 [2024-11-28 01:24:54.920196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.424 [2024-11-28 01:24:54.920212] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.424 [2024-11-28 01:24:54.920326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.424 [2024-11-28 01:24:54.920509] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.424 [2024-11-28 01:24:54.920548] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.424 [2024-11-28 01:24:54.920565] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.424 [2024-11-28 01:24:54.923094] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.424 [2024-11-28 01:24:54.932213] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.424 [2024-11-28 01:24:54.932543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.424 [2024-11-28 01:24:54.932694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.424 [2024-11-28 01:24:54.932720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.424 [2024-11-28 01:24:54.932736] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.424 [2024-11-28 01:24:54.932868] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.424 [2024-11-28 01:24:54.933064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.424 [2024-11-28 01:24:54.933089] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.424 [2024-11-28 01:24:54.933105] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.424 [2024-11-28 01:24:54.935482] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.424 [2024-11-28 01:24:54.944779] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.425 [2024-11-28 01:24:54.945074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.425 [2024-11-28 01:24:54.945243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.425 [2024-11-28 01:24:54.945271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.425 [2024-11-28 01:24:54.945289] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.425 [2024-11-28 01:24:54.945471] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.425 [2024-11-28 01:24:54.945666] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.425 [2024-11-28 01:24:54.945691] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.425 [2024-11-28 01:24:54.945706] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.425 [2024-11-28 01:24:54.947846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.425 [2024-11-28 01:24:54.957220] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.425 [2024-11-28 01:24:54.957563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.425 [2024-11-28 01:24:54.957749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.425 [2024-11-28 01:24:54.957775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.425 [2024-11-28 01:24:54.957790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.425 [2024-11-28 01:24:54.957921] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.425 [2024-11-28 01:24:54.958073] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.425 [2024-11-28 01:24:54.958096] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.425 [2024-11-28 01:24:54.958111] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.425 [2024-11-28 01:24:54.960327] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.425 [2024-11-28 01:24:54.969837] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.425 [2024-11-28 01:24:54.970224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.425 [2024-11-28 01:24:54.970371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.425 [2024-11-28 01:24:54.970400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.425 [2024-11-28 01:24:54.970417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.425 [2024-11-28 01:24:54.970575] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.425 [2024-11-28 01:24:54.970709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.425 [2024-11-28 01:24:54.970732] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.425 [2024-11-28 01:24:54.970747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.425 [2024-11-28 01:24:54.973036] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.425 [2024-11-28 01:24:54.982478] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.425 [2024-11-28 01:24:54.982790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.425 [2024-11-28 01:24:54.982922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.425 [2024-11-28 01:24:54.982966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.425 [2024-11-28 01:24:54.982982] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.425 [2024-11-28 01:24:54.983161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.425 [2024-11-28 01:24:54.983362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.425 [2024-11-28 01:24:54.983386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.425 [2024-11-28 01:24:54.983401] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.425 [2024-11-28 01:24:54.985821] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.425 [2024-11-28 01:24:54.994828] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.425 [2024-11-28 01:24:54.995185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.425 [2024-11-28 01:24:54.995315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.425 [2024-11-28 01:24:54.995348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.425 [2024-11-28 01:24:54.995365] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.425 [2024-11-28 01:24:54.995565] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.425 [2024-11-28 01:24:54.995754] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.425 [2024-11-28 01:24:54.995777] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.425 [2024-11-28 01:24:54.995793] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.425 [2024-11-28 01:24:54.998029] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.425 [2024-11-28 01:24:55.007491] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.425 [2024-11-28 01:24:55.007755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.425 [2024-11-28 01:24:55.007887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.425 [2024-11-28 01:24:55.007918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.425 [2024-11-28 01:24:55.007936] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.425 [2024-11-28 01:24:55.008101] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.425 [2024-11-28 01:24:55.008324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.425 [2024-11-28 01:24:55.008348] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.425 [2024-11-28 01:24:55.008363] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.425 [2024-11-28 01:24:55.010913] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.685 [2024-11-28 01:24:55.020256] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.685 [2024-11-28 01:24:55.020633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 01:24:55.020764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 01:24:55.020791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.685 [2024-11-28 01:24:55.020806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.685 [2024-11-28 01:24:55.020971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.685 [2024-11-28 01:24:55.021157] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.685 [2024-11-28 01:24:55.021181] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.685 [2024-11-28 01:24:55.021196] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.685 [2024-11-28 01:24:55.023413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.685 [2024-11-28 01:24:55.033067] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.685 [2024-11-28 01:24:55.033388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 01:24:55.033569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 01:24:55.033599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.685 [2024-11-28 01:24:55.033622] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.685 [2024-11-28 01:24:55.033806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.685 [2024-11-28 01:24:55.033993] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.685 [2024-11-28 01:24:55.034017] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.685 [2024-11-28 01:24:55.034032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.685 [2024-11-28 01:24:55.036231] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.685 [2024-11-28 01:24:55.045631] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.685 [2024-11-28 01:24:55.045938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 01:24:55.046097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 01:24:55.046123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.685 [2024-11-28 01:24:55.046139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.685 [2024-11-28 01:24:55.046302] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.685 [2024-11-28 01:24:55.046484] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.685 [2024-11-28 01:24:55.046508] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.685 [2024-11-28 01:24:55.046533] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.685 [2024-11-28 01:24:55.048877] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.685 [2024-11-28 01:24:55.058329] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.685 [2024-11-28 01:24:55.058678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 01:24:55.058780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 01:24:55.058806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.685 [2024-11-28 01:24:55.058822] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.685 [2024-11-28 01:24:55.059037] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.685 [2024-11-28 01:24:55.059224] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.685 [2024-11-28 01:24:55.059248] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.685 [2024-11-28 01:24:55.059263] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.685 [2024-11-28 01:24:55.061500] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.685 [2024-11-28 01:24:55.071106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.685 [2024-11-28 01:24:55.071409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 01:24:55.071571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 01:24:55.071601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.685 [2024-11-28 01:24:55.071619] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.685 [2024-11-28 01:24:55.071808] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.685 [2024-11-28 01:24:55.071959] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.685 [2024-11-28 01:24:55.071982] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.685 [2024-11-28 01:24:55.071997] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.685 [2024-11-28 01:24:55.074375] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.685 [2024-11-28 01:24:55.083631] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.685 [2024-11-28 01:24:55.083910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 01:24:55.084053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 01:24:55.084082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.685 [2024-11-28 01:24:55.084099] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.685 [2024-11-28 01:24:55.084227] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.685 [2024-11-28 01:24:55.084397] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.685 [2024-11-28 01:24:55.084421] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.685 [2024-11-28 01:24:55.084436] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.685 [2024-11-28 01:24:55.086785] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.685 [2024-11-28 01:24:55.096200] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.685 [2024-11-28 01:24:55.096501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 01:24:55.096629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 01:24:55.096659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.686 [2024-11-28 01:24:55.096677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.686 [2024-11-28 01:24:55.096878] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.686 [2024-11-28 01:24:55.097048] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.686 [2024-11-28 01:24:55.097072] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.686 [2024-11-28 01:24:55.097087] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.686 [2024-11-28 01:24:55.099249] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.686 [2024-11-28 01:24:55.108696] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.686 [2024-11-28 01:24:55.108995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 01:24:55.109131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 01:24:55.109157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.686 [2024-11-28 01:24:55.109173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.686 [2024-11-28 01:24:55.109316] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.686 [2024-11-28 01:24:55.109491] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.686 [2024-11-28 01:24:55.109515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.686 [2024-11-28 01:24:55.109540] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.686 [2024-11-28 01:24:55.111991] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.686 [2024-11-28 01:24:55.121176] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.686 [2024-11-28 01:24:55.121537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 01:24:55.121656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 01:24:55.121684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.686 [2024-11-28 01:24:55.121701] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.686 [2024-11-28 01:24:55.121920] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.686 [2024-11-28 01:24:55.122089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.686 [2024-11-28 01:24:55.122112] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.686 [2024-11-28 01:24:55.122128] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.686 [2024-11-28 01:24:55.124474] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.686 [2024-11-28 01:24:55.133760] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.686 [2024-11-28 01:24:55.134077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 01:24:55.134188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 01:24:55.134214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.686 [2024-11-28 01:24:55.134230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.686 [2024-11-28 01:24:55.134368] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.686 [2024-11-28 01:24:55.134568] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.686 [2024-11-28 01:24:55.134593] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.686 [2024-11-28 01:24:55.134608] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.686 [2024-11-28 01:24:55.136875] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.686 [2024-11-28 01:24:55.146174] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.686 [2024-11-28 01:24:55.146485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 01:24:55.146675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 01:24:55.146701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.686 [2024-11-28 01:24:55.146717] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.686 [2024-11-28 01:24:55.146897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.686 [2024-11-28 01:24:55.147081] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.686 [2024-11-28 01:24:55.147110] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.686 [2024-11-28 01:24:55.147127] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.686 [2024-11-28 01:24:55.149491] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.686 [2024-11-28 01:24:55.158743] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.686 [2024-11-28 01:24:55.159100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 01:24:55.159254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 01:24:55.159280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.686 [2024-11-28 01:24:55.159296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.686 [2024-11-28 01:24:55.159469] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.686 [2024-11-28 01:24:55.159631] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.686 [2024-11-28 01:24:55.159656] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.686 [2024-11-28 01:24:55.159672] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.686 [2024-11-28 01:24:55.161959] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.686 [2024-11-28 01:24:55.171348] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.686 [2024-11-28 01:24:55.171719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 01:24:55.171832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 01:24:55.171860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.686 [2024-11-28 01:24:55.171878] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.686 [2024-11-28 01:24:55.172078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.686 [2024-11-28 01:24:55.172248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.686 [2024-11-28 01:24:55.172271] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.686 [2024-11-28 01:24:55.172287] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.686 [2024-11-28 01:24:55.174341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.686 [2024-11-28 01:24:55.184034] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.686 [2024-11-28 01:24:55.184336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 01:24:55.184478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 01:24:55.184507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.686 [2024-11-28 01:24:55.184533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.686 [2024-11-28 01:24:55.184700] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.686 [2024-11-28 01:24:55.184887] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.686 [2024-11-28 01:24:55.184911] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.686 [2024-11-28 01:24:55.184935] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.686 [2024-11-28 01:24:55.187316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.686 [2024-11-28 01:24:55.196493] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.686 [2024-11-28 01:24:55.196803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 01:24:55.196936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 01:24:55.196979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.686 [2024-11-28 01:24:55.196996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.686 [2024-11-28 01:24:55.197141] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.686 [2024-11-28 01:24:55.197301] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.686 [2024-11-28 01:24:55.197325] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.686 [2024-11-28 01:24:55.197340] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.686 [2024-11-28 01:24:55.199802] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.686 [2024-11-28 01:24:55.209058] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.686 [2024-11-28 01:24:55.209405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 01:24:55.209532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 01:24:55.209559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.686 [2024-11-28 01:24:55.209575] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.686 [2024-11-28 01:24:55.209732] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.686 [2024-11-28 01:24:55.209883] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.687 [2024-11-28 01:24:55.209907] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.687 [2024-11-28 01:24:55.209922] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.687 [2024-11-28 01:24:55.212192] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.687 [2024-11-28 01:24:55.221622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.687 [2024-11-28 01:24:55.222004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-28 01:24:55.222144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-28 01:24:55.222172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.687 [2024-11-28 01:24:55.222190] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.687 [2024-11-28 01:24:55.222354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.687 [2024-11-28 01:24:55.222533] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.687 [2024-11-28 01:24:55.222558] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.687 [2024-11-28 01:24:55.222574] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.687 [2024-11-28 01:24:55.224883] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.687 [2024-11-28 01:24:55.234118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.687 [2024-11-28 01:24:55.234477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-28 01:24:55.234636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-28 01:24:55.234664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.687 [2024-11-28 01:24:55.234681] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.687 [2024-11-28 01:24:55.234841] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.687 [2024-11-28 01:24:55.235047] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.687 [2024-11-28 01:24:55.235070] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.687 [2024-11-28 01:24:55.235086] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.687 [2024-11-28 01:24:55.237500] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.687 [2024-11-28 01:24:55.246730] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.687 [2024-11-28 01:24:55.247028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-28 01:24:55.247164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-28 01:24:55.247191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.687 [2024-11-28 01:24:55.247206] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.687 [2024-11-28 01:24:55.247370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.687 [2024-11-28 01:24:55.247570] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.687 [2024-11-28 01:24:55.247595] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.687 [2024-11-28 01:24:55.247619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.687 [2024-11-28 01:24:55.249867] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.687 [2024-11-28 01:24:55.259390] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.687 [2024-11-28 01:24:55.259701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-28 01:24:55.259965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-28 01:24:55.260016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.687 [2024-11-28 01:24:55.260033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.687 [2024-11-28 01:24:55.260199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.687 [2024-11-28 01:24:55.260350] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.687 [2024-11-28 01:24:55.260373] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.687 [2024-11-28 01:24:55.260388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.687 [2024-11-28 01:24:55.262742] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.687 [2024-11-28 01:24:55.271918] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.687 [2024-11-28 01:24:55.272257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-28 01:24:55.272390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-28 01:24:55.272419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.687 [2024-11-28 01:24:55.272437] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.687 [2024-11-28 01:24:55.272577] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.687 [2024-11-28 01:24:55.272729] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.687 [2024-11-28 01:24:55.272752] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.687 [2024-11-28 01:24:55.272768] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.687 [2024-11-28 01:24:55.274910] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.687 [2024-11-28 01:24:55.284393] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.687 [2024-11-28 01:24:55.284741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-28 01:24:55.284882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-28 01:24:55.284910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.687 [2024-11-28 01:24:55.284928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.687 [2024-11-28 01:24:55.285074] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.687 [2024-11-28 01:24:55.285243] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.687 [2024-11-28 01:24:55.285267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.687 [2024-11-28 01:24:55.285282] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.946 [2024-11-28 01:24:55.287562] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.947 [2024-11-28 01:24:55.297071] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.947 [2024-11-28 01:24:55.297413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.947 [2024-11-28 01:24:55.297577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.947 [2024-11-28 01:24:55.297606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.947 [2024-11-28 01:24:55.297624] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.947 [2024-11-28 01:24:55.297843] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.947 [2024-11-28 01:24:55.298012] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.947 [2024-11-28 01:24:55.298035] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.947 [2024-11-28 01:24:55.298051] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.947 [2024-11-28 01:24:55.300230] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.947 [2024-11-28 01:24:55.309803] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.947 [2024-11-28 01:24:55.310123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.947 [2024-11-28 01:24:55.310245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.947 [2024-11-28 01:24:55.310274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.947 [2024-11-28 01:24:55.310291] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.947 [2024-11-28 01:24:55.310456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.947 [2024-11-28 01:24:55.310653] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.947 [2024-11-28 01:24:55.310678] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.947 [2024-11-28 01:24:55.310693] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.947 [2024-11-28 01:24:55.312997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.947 [2024-11-28 01:24:55.322239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.947 [2024-11-28 01:24:55.322650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.947 [2024-11-28 01:24:55.322794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.947 [2024-11-28 01:24:55.322838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.947 [2024-11-28 01:24:55.322854] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.947 [2024-11-28 01:24:55.322969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.947 [2024-11-28 01:24:55.323139] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.947 [2024-11-28 01:24:55.323163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.947 [2024-11-28 01:24:55.323179] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.947 [2024-11-28 01:24:55.325357] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.947 [2024-11-28 01:24:55.334803] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.947 [2024-11-28 01:24:55.335128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.947 [2024-11-28 01:24:55.335266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.947 [2024-11-28 01:24:55.335294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.947 [2024-11-28 01:24:55.335312] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.947 [2024-11-28 01:24:55.335494] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.947 [2024-11-28 01:24:55.335708] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.947 [2024-11-28 01:24:55.335733] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.947 [2024-11-28 01:24:55.335748] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.947 [2024-11-28 01:24:55.337963] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.947 [2024-11-28 01:24:55.347348] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.947 [2024-11-28 01:24:55.347616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.947 [2024-11-28 01:24:55.347764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.947 [2024-11-28 01:24:55.347793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.947 [2024-11-28 01:24:55.347816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.947 [2024-11-28 01:24:55.347982] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.947 [2024-11-28 01:24:55.348150] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.947 [2024-11-28 01:24:55.348174] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.947 [2024-11-28 01:24:55.348189] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.947 [2024-11-28 01:24:55.350404] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.947 [2024-11-28 01:24:55.359896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.947 [2024-11-28 01:24:55.360174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.947 [2024-11-28 01:24:55.360342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.947 [2024-11-28 01:24:55.360370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.947 [2024-11-28 01:24:55.360388] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.947 [2024-11-28 01:24:55.360599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.947 [2024-11-28 01:24:55.360751] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.947 [2024-11-28 01:24:55.360774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.947 [2024-11-28 01:24:55.360790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.947 [2024-11-28 01:24:55.363039] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.947 [2024-11-28 01:24:55.372566] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.947 [2024-11-28 01:24:55.372843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.947 [2024-11-28 01:24:55.372989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.947 [2024-11-28 01:24:55.373017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.947 [2024-11-28 01:24:55.373035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.947 [2024-11-28 01:24:55.373235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.947 [2024-11-28 01:24:55.373459] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.947 [2024-11-28 01:24:55.373482] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.947 [2024-11-28 01:24:55.373498] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.947 [2024-11-28 01:24:55.375819] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.947 [2024-11-28 01:24:55.385064] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.947 [2024-11-28 01:24:55.385374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.947 [2024-11-28 01:24:55.385515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.947 [2024-11-28 01:24:55.385554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.947 [2024-11-28 01:24:55.385572] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.947 [2024-11-28 01:24:55.385725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.947 [2024-11-28 01:24:55.385894] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.947 [2024-11-28 01:24:55.385917] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.947 [2024-11-28 01:24:55.385932] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.947 [2024-11-28 01:24:55.388220] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.947 [2024-11-28 01:24:55.397563] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.947 [2024-11-28 01:24:55.397916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.947 [2024-11-28 01:24:55.398047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.947 [2024-11-28 01:24:55.398072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.947 [2024-11-28 01:24:55.398088] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.947 [2024-11-28 01:24:55.398219] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.947 [2024-11-28 01:24:55.398410] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.947 [2024-11-28 01:24:55.398433] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.947 [2024-11-28 01:24:55.398448] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.947 [2024-11-28 01:24:55.400856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.947 [2024-11-28 01:24:55.410110] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.947 [2024-11-28 01:24:55.410479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.948 [2024-11-28 01:24:55.410623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.948 [2024-11-28 01:24:55.410649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.948 [2024-11-28 01:24:55.410666] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.948 [2024-11-28 01:24:55.410820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.948 [2024-11-28 01:24:55.411043] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.948 [2024-11-28 01:24:55.411066] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.948 [2024-11-28 01:24:55.411082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.948 [2024-11-28 01:24:55.413423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.948 [2024-11-28 01:24:55.422459] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.948 [2024-11-28 01:24:55.422839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.948 [2024-11-28 01:24:55.423003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.948 [2024-11-28 01:24:55.423032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.948 [2024-11-28 01:24:55.423050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.948 [2024-11-28 01:24:55.423214] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.948 [2024-11-28 01:24:55.423371] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.948 [2024-11-28 01:24:55.423395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.948 [2024-11-28 01:24:55.423411] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.948 [2024-11-28 01:24:55.425653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.948 [2024-11-28 01:24:55.435032] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.948 [2024-11-28 01:24:55.435396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.948 [2024-11-28 01:24:55.435564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.948 [2024-11-28 01:24:55.435594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.948 [2024-11-28 01:24:55.435612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.948 [2024-11-28 01:24:55.435794] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.948 [2024-11-28 01:24:55.435946] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.948 [2024-11-28 01:24:55.435969] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.948 [2024-11-28 01:24:55.435985] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.948 [2024-11-28 01:24:55.438343] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.948 [2024-11-28 01:24:55.447916] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.948 [2024-11-28 01:24:55.448201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.948 [2024-11-28 01:24:55.448365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.948 [2024-11-28 01:24:55.448391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.948 [2024-11-28 01:24:55.448407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.948 [2024-11-28 01:24:55.448596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.948 [2024-11-28 01:24:55.448747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.948 [2024-11-28 01:24:55.448771] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.948 [2024-11-28 01:24:55.448786] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.948 [2024-11-28 01:24:55.451099] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.948 [2024-11-28 01:24:55.460327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.948 [2024-11-28 01:24:55.460612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.948 [2024-11-28 01:24:55.460731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.948 [2024-11-28 01:24:55.460759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.948 [2024-11-28 01:24:55.460777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.948 [2024-11-28 01:24:55.460941] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.948 [2024-11-28 01:24:55.461093] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.948 [2024-11-28 01:24:55.461122] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.948 [2024-11-28 01:24:55.461138] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.948 [2024-11-28 01:24:55.463395] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.948 [2024-11-28 01:24:55.472717] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.948 [2024-11-28 01:24:55.473056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.948 [2024-11-28 01:24:55.473190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.948 [2024-11-28 01:24:55.473218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.948 [2024-11-28 01:24:55.473233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.948 [2024-11-28 01:24:55.473427] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.948 [2024-11-28 01:24:55.473590] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.948 [2024-11-28 01:24:55.473614] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.948 [2024-11-28 01:24:55.473630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.948 [2024-11-28 01:24:55.476007] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.948 [2024-11-28 01:24:55.485414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.948 [2024-11-28 01:24:55.485675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.948 [2024-11-28 01:24:55.485801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.948 [2024-11-28 01:24:55.485829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.948 [2024-11-28 01:24:55.485847] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.948 [2024-11-28 01:24:55.486047] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.948 [2024-11-28 01:24:55.486235] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.948 [2024-11-28 01:24:55.486259] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.948 [2024-11-28 01:24:55.486275] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.948 [2024-11-28 01:24:55.488784] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.948 [2024-11-28 01:24:55.498017] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.948 [2024-11-28 01:24:55.498363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.948 [2024-11-28 01:24:55.498523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.948 [2024-11-28 01:24:55.498558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.948 [2024-11-28 01:24:55.498574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.948 [2024-11-28 01:24:55.498706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.948 [2024-11-28 01:24:55.498924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.948 [2024-11-28 01:24:55.498948] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.948 [2024-11-28 01:24:55.498969] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.948 [2024-11-28 01:24:55.501438] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.948 [2024-11-28 01:24:55.510719] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.948 [2024-11-28 01:24:55.511018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.948 [2024-11-28 01:24:55.511143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.948 [2024-11-28 01:24:55.511172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.948 [2024-11-28 01:24:55.511189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.948 [2024-11-28 01:24:55.511371] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.948 [2024-11-28 01:24:55.511572] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.948 [2024-11-28 01:24:55.511597] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.948 [2024-11-28 01:24:55.511613] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.948 [2024-11-28 01:24:55.514011] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.948 [2024-11-28 01:24:55.523282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.948 [2024-11-28 01:24:55.523623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.948 [2024-11-28 01:24:55.523761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.948 [2024-11-28 01:24:55.523790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.949 [2024-11-28 01:24:55.523808] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.949 [2024-11-28 01:24:55.524008] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.949 [2024-11-28 01:24:55.524232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.949 [2024-11-28 01:24:55.524256] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.949 [2024-11-28 01:24:55.524271] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.949 [2024-11-28 01:24:55.526573] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:40.949 [2024-11-28 01:24:55.536104] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:40.949 [2024-11-28 01:24:55.536429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.949 [2024-11-28 01:24:55.536555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.949 [2024-11-28 01:24:55.536585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:40.949 [2024-11-28 01:24:55.536603] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:40.949 [2024-11-28 01:24:55.536768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:40.949 [2024-11-28 01:24:55.536974] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:40.949 [2024-11-28 01:24:55.536998] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:40.949 [2024-11-28 01:24:55.537013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:40.949 [2024-11-28 01:24:55.539484] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.208 [2024-11-28 01:24:55.548603] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.208 [2024-11-28 01:24:55.548978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-28 01:24:55.549112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-28 01:24:55.549139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.208 [2024-11-28 01:24:55.549154] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.208 [2024-11-28 01:24:55.549270] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.208 [2024-11-28 01:24:55.549518] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.208 [2024-11-28 01:24:55.549552] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.208 [2024-11-28 01:24:55.549594] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.208 [2024-11-28 01:24:55.551962] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.208 [2024-11-28 01:24:55.561311] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.208 [2024-11-28 01:24:55.561608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-28 01:24:55.561769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.208 [2024-11-28 01:24:55.561795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.208 [2024-11-28 01:24:55.561811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.208 [2024-11-28 01:24:55.562007] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.209 [2024-11-28 01:24:55.562142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.209 [2024-11-28 01:24:55.562165] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.209 [2024-11-28 01:24:55.562180] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.209 [2024-11-28 01:24:55.564623] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.209 [2024-11-28 01:24:55.573892] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.209 [2024-11-28 01:24:55.574224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-28 01:24:55.574340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-28 01:24:55.574368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.209 [2024-11-28 01:24:55.574386] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.209 [2024-11-28 01:24:55.574543] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.209 [2024-11-28 01:24:55.574742] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.209 [2024-11-28 01:24:55.574763] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.209 [2024-11-28 01:24:55.574777] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.209 [2024-11-28 01:24:55.577186] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.209 [2024-11-28 01:24:55.586613] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.209 [2024-11-28 01:24:55.587027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-28 01:24:55.587166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-28 01:24:55.587193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.209 [2024-11-28 01:24:55.587210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.209 [2024-11-28 01:24:55.587357] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.209 [2024-11-28 01:24:55.587508] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.209 [2024-11-28 01:24:55.587543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.209 [2024-11-28 01:24:55.587575] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.209 [2024-11-28 01:24:55.589902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.209 [2024-11-28 01:24:55.599108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.209 [2024-11-28 01:24:55.599423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-28 01:24:55.599564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-28 01:24:55.599603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.209 [2024-11-28 01:24:55.599621] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.209 [2024-11-28 01:24:55.599750] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.209 [2024-11-28 01:24:55.599955] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.209 [2024-11-28 01:24:55.599979] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.209 [2024-11-28 01:24:55.599994] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.209 [2024-11-28 01:24:55.602391] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.209 [2024-11-28 01:24:55.611672] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.209 [2024-11-28 01:24:55.612035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-28 01:24:55.612180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-28 01:24:55.612208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.209 [2024-11-28 01:24:55.612226] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.209 [2024-11-28 01:24:55.612354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.209 [2024-11-28 01:24:55.612551] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.209 [2024-11-28 01:24:55.612576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.209 [2024-11-28 01:24:55.612598] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.209 [2024-11-28 01:24:55.614922] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.209 [2024-11-28 01:24:55.624401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.209 [2024-11-28 01:24:55.624756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-28 01:24:55.624900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-28 01:24:55.624928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.209 [2024-11-28 01:24:55.624945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.209 [2024-11-28 01:24:55.625109] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.209 [2024-11-28 01:24:55.625278] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.209 [2024-11-28 01:24:55.625302] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.209 [2024-11-28 01:24:55.625317] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.209 [2024-11-28 01:24:55.627687] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.209 [2024-11-28 01:24:55.637087] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.209 [2024-11-28 01:24:55.637404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-28 01:24:55.637556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-28 01:24:55.637590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.209 [2024-11-28 01:24:55.637606] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.209 [2024-11-28 01:24:55.637784] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.209 [2024-11-28 01:24:55.637994] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.209 [2024-11-28 01:24:55.638018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.209 [2024-11-28 01:24:55.638033] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.209 [2024-11-28 01:24:55.640325] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.209 [2024-11-28 01:24:55.649718] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.209 [2024-11-28 01:24:55.650023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-28 01:24:55.650208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-28 01:24:55.650233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.209 [2024-11-28 01:24:55.650250] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.209 [2024-11-28 01:24:55.650457] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.209 [2024-11-28 01:24:55.650628] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.209 [2024-11-28 01:24:55.650653] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.209 [2024-11-28 01:24:55.650668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.209 [2024-11-28 01:24:55.653028] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.209 [2024-11-28 01:24:55.662377] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.209 [2024-11-28 01:24:55.662725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-28 01:24:55.662858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-28 01:24:55.662889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.209 [2024-11-28 01:24:55.662921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.209 [2024-11-28 01:24:55.663086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.209 [2024-11-28 01:24:55.663237] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.209 [2024-11-28 01:24:55.663261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.209 [2024-11-28 01:24:55.663276] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.209 [2024-11-28 01:24:55.665426] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.209 [2024-11-28 01:24:55.674845] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.209 [2024-11-28 01:24:55.675170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-28 01:24:55.675311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.209 [2024-11-28 01:24:55.675341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.209 [2024-11-28 01:24:55.675359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.209 [2024-11-28 01:24:55.675505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.209 [2024-11-28 01:24:55.675758] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.210 [2024-11-28 01:24:55.675782] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.210 [2024-11-28 01:24:55.675797] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.210 [2024-11-28 01:24:55.678285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.210 [2024-11-28 01:24:55.687157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.210 [2024-11-28 01:24:55.687458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-28 01:24:55.687611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-28 01:24:55.687639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.210 [2024-11-28 01:24:55.687655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.210 [2024-11-28 01:24:55.687869] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.210 [2024-11-28 01:24:55.688021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.210 [2024-11-28 01:24:55.688045] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.210 [2024-11-28 01:24:55.688060] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.210 [2024-11-28 01:24:55.690349] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.210 [2024-11-28 01:24:55.699653] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.210 [2024-11-28 01:24:55.699899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-28 01:24:55.700092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-28 01:24:55.700118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.210 [2024-11-28 01:24:55.700140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.210 [2024-11-28 01:24:55.700271] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.210 [2024-11-28 01:24:55.700477] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.210 [2024-11-28 01:24:55.700501] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.210 [2024-11-28 01:24:55.700516] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.210 [2024-11-28 01:24:55.702965] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.210 [2024-11-28 01:24:55.712383] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.210 [2024-11-28 01:24:55.712641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-28 01:24:55.712790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-28 01:24:55.712819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.210 [2024-11-28 01:24:55.712837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.210 [2024-11-28 01:24:55.712966] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.210 [2024-11-28 01:24:55.713152] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.210 [2024-11-28 01:24:55.713176] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.210 [2024-11-28 01:24:55.713191] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.210 [2024-11-28 01:24:55.715447] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.210 [2024-11-28 01:24:55.724922] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.210 [2024-11-28 01:24:55.725222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-28 01:24:55.725369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-28 01:24:55.725399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.210 [2024-11-28 01:24:55.725416] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.210 [2024-11-28 01:24:55.725594] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.210 [2024-11-28 01:24:55.725747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.210 [2024-11-28 01:24:55.725770] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.210 [2024-11-28 01:24:55.725785] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.210 [2024-11-28 01:24:55.728163] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.210 [2024-11-28 01:24:55.737374] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.210 [2024-11-28 01:24:55.737693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-28 01:24:55.737810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-28 01:24:55.737852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.210 [2024-11-28 01:24:55.737868] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.210 [2024-11-28 01:24:55.738065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.210 [2024-11-28 01:24:55.738248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.210 [2024-11-28 01:24:55.738271] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.210 [2024-11-28 01:24:55.738286] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.210 [2024-11-28 01:24:55.740346] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.210 [2024-11-28 01:24:55.749843] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.210 [2024-11-28 01:24:55.750186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-28 01:24:55.750368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-28 01:24:55.750394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.210 [2024-11-28 01:24:55.750409] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.210 [2024-11-28 01:24:55.750556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.210 [2024-11-28 01:24:55.750703] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.210 [2024-11-28 01:24:55.750727] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.210 [2024-11-28 01:24:55.750743] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.210 [2024-11-28 01:24:55.752886] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.210 [2024-11-28 01:24:55.762561] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.210 [2024-11-28 01:24:55.762884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-28 01:24:55.763025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-28 01:24:55.763054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.210 [2024-11-28 01:24:55.763072] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.210 [2024-11-28 01:24:55.763236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.210 [2024-11-28 01:24:55.763405] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.210 [2024-11-28 01:24:55.763428] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.210 [2024-11-28 01:24:55.763444] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.210 [2024-11-28 01:24:55.765925] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.210 [2024-11-28 01:24:55.775164] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.210 [2024-11-28 01:24:55.775546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-28 01:24:55.775663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-28 01:24:55.775692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.210 [2024-11-28 01:24:55.775709] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.210 [2024-11-28 01:24:55.775837] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.210 [2024-11-28 01:24:55.775997] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.210 [2024-11-28 01:24:55.776020] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.210 [2024-11-28 01:24:55.776036] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.210 [2024-11-28 01:24:55.778379] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.210 [2024-11-28 01:24:55.787780] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.210 [2024-11-28 01:24:55.788131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-28 01:24:55.788286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.210 [2024-11-28 01:24:55.788312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.210 [2024-11-28 01:24:55.788327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.210 [2024-11-28 01:24:55.788483] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.210 [2024-11-28 01:24:55.788627] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.210 [2024-11-28 01:24:55.788652] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.210 [2024-11-28 01:24:55.788668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.210 [2024-11-28 01:24:55.791029] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.210 [2024-11-28 01:24:55.800246] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.211 [2024-11-28 01:24:55.800546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-28 01:24:55.800694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.211 [2024-11-28 01:24:55.800723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.211 [2024-11-28 01:24:55.800741] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.211 [2024-11-28 01:24:55.800923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.211 [2024-11-28 01:24:55.801128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.211 [2024-11-28 01:24:55.801152] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.211 [2024-11-28 01:24:55.801168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.211 [2024-11-28 01:24:55.803495] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.470 [2024-11-28 01:24:55.812898] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.470 [2024-11-28 01:24:55.813237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.470 [2024-11-28 01:24:55.813410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.470 [2024-11-28 01:24:55.813439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.470 [2024-11-28 01:24:55.813457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.470 [2024-11-28 01:24:55.813598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.470 [2024-11-28 01:24:55.813786] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.470 [2024-11-28 01:24:55.813815] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.470 [2024-11-28 01:24:55.813832] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.470 [2024-11-28 01:24:55.816104] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.470 [2024-11-28 01:24:55.825446] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.470 [2024-11-28 01:24:55.825736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.470 [2024-11-28 01:24:55.825890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.470 [2024-11-28 01:24:55.825918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.470 [2024-11-28 01:24:55.825935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.470 [2024-11-28 01:24:55.826064] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.470 [2024-11-28 01:24:55.826215] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.470 [2024-11-28 01:24:55.826239] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.470 [2024-11-28 01:24:55.826254] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.470 [2024-11-28 01:24:55.828457] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.470 [2024-11-28 01:24:55.838196] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.470 [2024-11-28 01:24:55.838477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.470 [2024-11-28 01:24:55.838637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.470 [2024-11-28 01:24:55.838665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.470 [2024-11-28 01:24:55.838680] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.470 [2024-11-28 01:24:55.838862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.470 [2024-11-28 01:24:55.839042] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.470 [2024-11-28 01:24:55.839066] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.470 [2024-11-28 01:24:55.839081] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.470 [2024-11-28 01:24:55.841495] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.470 [2024-11-28 01:24:55.850943] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.470 [2024-11-28 01:24:55.851319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.470 [2024-11-28 01:24:55.851439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.470 [2024-11-28 01:24:55.851469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.470 [2024-11-28 01:24:55.851487] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.470 [2024-11-28 01:24:55.851646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.470 [2024-11-28 01:24:55.851815] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.470 [2024-11-28 01:24:55.851839] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.470 [2024-11-28 01:24:55.851860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.470 [2024-11-28 01:24:55.854007] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.470 [2024-11-28 01:24:55.863571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.470 [2024-11-28 01:24:55.863813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.470 [2024-11-28 01:24:55.863959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.470 [2024-11-28 01:24:55.863988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.470 [2024-11-28 01:24:55.864005] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.470 [2024-11-28 01:24:55.864151] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.470 [2024-11-28 01:24:55.864302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.470 [2024-11-28 01:24:55.864326] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.470 [2024-11-28 01:24:55.864342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.470 [2024-11-28 01:24:55.866683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.471 [2024-11-28 01:24:55.876126] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.471 [2024-11-28 01:24:55.876459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.471 [2024-11-28 01:24:55.876563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.471 [2024-11-28 01:24:55.876590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.471 [2024-11-28 01:24:55.876606] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.471 [2024-11-28 01:24:55.876738] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.471 [2024-11-28 01:24:55.876935] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.471 [2024-11-28 01:24:55.876959] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.471 [2024-11-28 01:24:55.876974] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.471 [2024-11-28 01:24:55.879338] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.471 [2024-11-28 01:24:55.888577] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.471 [2024-11-28 01:24:55.888920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.471 [2024-11-28 01:24:55.889065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.471 [2024-11-28 01:24:55.889094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.471 [2024-11-28 01:24:55.889111] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.471 [2024-11-28 01:24:55.889239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.471 [2024-11-28 01:24:55.889409] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.471 [2024-11-28 01:24:55.889433] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.471 [2024-11-28 01:24:55.889448] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.471 [2024-11-28 01:24:55.891755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.471 [2024-11-28 01:24:55.901160] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.471 [2024-11-28 01:24:55.901505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.471 [2024-11-28 01:24:55.901638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.471 [2024-11-28 01:24:55.901667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.471 [2024-11-28 01:24:55.901685] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.471 [2024-11-28 01:24:55.901867] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.471 [2024-11-28 01:24:55.902055] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.471 [2024-11-28 01:24:55.902078] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.471 [2024-11-28 01:24:55.902093] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.471 [2024-11-28 01:24:55.904423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.471 [2024-11-28 01:24:55.913741] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.471 [2024-11-28 01:24:55.914123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.471 [2024-11-28 01:24:55.914241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.471 [2024-11-28 01:24:55.914271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.471 [2024-11-28 01:24:55.914288] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.471 [2024-11-28 01:24:55.914471] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.471 [2024-11-28 01:24:55.914688] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.471 [2024-11-28 01:24:55.914713] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.471 [2024-11-28 01:24:55.914728] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.471 [2024-11-28 01:24:55.916963] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.471 [2024-11-28 01:24:55.926207] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.471 [2024-11-28 01:24:55.926544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.471 [2024-11-28 01:24:55.926676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.471 [2024-11-28 01:24:55.926702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.471 [2024-11-28 01:24:55.926717] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.471 [2024-11-28 01:24:55.926896] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.471 [2024-11-28 01:24:55.927029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.471 [2024-11-28 01:24:55.927052] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.471 [2024-11-28 01:24:55.927068] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.471 [2024-11-28 01:24:55.929431] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.471 [2024-11-28 01:24:55.938593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.471 [2024-11-28 01:24:55.938907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.471 [2024-11-28 01:24:55.939076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.471 [2024-11-28 01:24:55.939104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.471 [2024-11-28 01:24:55.939122] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.471 [2024-11-28 01:24:55.939286] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.471 [2024-11-28 01:24:55.939491] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.471 [2024-11-28 01:24:55.939515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.471 [2024-11-28 01:24:55.939542] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.471 [2024-11-28 01:24:55.941723] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.471 [2024-11-28 01:24:55.951069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.471 [2024-11-28 01:24:55.951417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.471 [2024-11-28 01:24:55.951584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.471 [2024-11-28 01:24:55.951611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.471 [2024-11-28 01:24:55.951627] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.471 [2024-11-28 01:24:55.951847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.471 [2024-11-28 01:24:55.951989] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.471 [2024-11-28 01:24:55.952013] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.471 [2024-11-28 01:24:55.952028] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.471 [2024-11-28 01:24:55.954409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.471 [2024-11-28 01:24:55.963751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.471 [2024-11-28 01:24:55.964079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.471 [2024-11-28 01:24:55.964264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.471 [2024-11-28 01:24:55.964290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.471 [2024-11-28 01:24:55.964306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.471 [2024-11-28 01:24:55.964453] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.471 [2024-11-28 01:24:55.964636] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.471 [2024-11-28 01:24:55.964661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.471 [2024-11-28 01:24:55.964677] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.471 [2024-11-28 01:24:55.967056] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.471 [2024-11-28 01:24:55.976247] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.471 [2024-11-28 01:24:55.976558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.471 [2024-11-28 01:24:55.976711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.471 [2024-11-28 01:24:55.976740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.471 [2024-11-28 01:24:55.976758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.471 [2024-11-28 01:24:55.976941] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.471 [2024-11-28 01:24:55.977093] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.471 [2024-11-28 01:24:55.977117] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.471 [2024-11-28 01:24:55.977132] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.471 [2024-11-28 01:24:55.979296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.471 [2024-11-28 01:24:55.988658] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.471 [2024-11-28 01:24:55.989006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.471 [2024-11-28 01:24:55.989184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.472 [2024-11-28 01:24:55.989212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.472 [2024-11-28 01:24:55.989230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.472 [2024-11-28 01:24:55.989358] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.472 [2024-11-28 01:24:55.989559] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.472 [2024-11-28 01:24:55.989587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.472 [2024-11-28 01:24:55.989602] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.472 [2024-11-28 01:24:55.991892] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.472 [2024-11-28 01:24:56.001126] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.472 [2024-11-28 01:24:56.001500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.472 [2024-11-28 01:24:56.001687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.472 [2024-11-28 01:24:56.001716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.472 [2024-11-28 01:24:56.001735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.472 [2024-11-28 01:24:56.001917] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.472 [2024-11-28 01:24:56.002068] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.472 [2024-11-28 01:24:56.002092] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.472 [2024-11-28 01:24:56.002108] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.472 [2024-11-28 01:24:56.004550] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.472 [2024-11-28 01:24:56.013743] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.472 [2024-11-28 01:24:56.014031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.472 [2024-11-28 01:24:56.014171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.472 [2024-11-28 01:24:56.014206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.472 [2024-11-28 01:24:56.014225] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.472 [2024-11-28 01:24:56.014371] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.472 [2024-11-28 01:24:56.014522] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.472 [2024-11-28 01:24:56.014558] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.472 [2024-11-28 01:24:56.014574] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.472 [2024-11-28 01:24:56.017008] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.472 [2024-11-28 01:24:56.026421] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.472 [2024-11-28 01:24:56.026749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.472 [2024-11-28 01:24:56.026854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.472 [2024-11-28 01:24:56.026894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.472 [2024-11-28 01:24:56.026910] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.472 [2024-11-28 01:24:56.027052] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.472 [2024-11-28 01:24:56.027214] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.472 [2024-11-28 01:24:56.027238] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.472 [2024-11-28 01:24:56.027253] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.472 [2024-11-28 01:24:56.029567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.472 [2024-11-28 01:24:56.038926] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.472 [2024-11-28 01:24:56.039253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.472 [2024-11-28 01:24:56.039433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.472 [2024-11-28 01:24:56.039459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.472 [2024-11-28 01:24:56.039475] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.472 [2024-11-28 01:24:56.039647] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.472 [2024-11-28 01:24:56.039821] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.472 [2024-11-28 01:24:56.039845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.472 [2024-11-28 01:24:56.039860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.472 [2024-11-28 01:24:56.042190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.472 [2024-11-28 01:24:56.051397] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.472 [2024-11-28 01:24:56.051714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.472 [2024-11-28 01:24:56.051853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.472 [2024-11-28 01:24:56.051880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.472 [2024-11-28 01:24:56.051901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.472 [2024-11-28 01:24:56.052097] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.472 [2024-11-28 01:24:56.052249] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.472 [2024-11-28 01:24:56.052273] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.472 [2024-11-28 01:24:56.052288] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.472 [2024-11-28 01:24:56.054710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.472 [2024-11-28 01:24:56.063788] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.472 [2024-11-28 01:24:56.064047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.472 [2024-11-28 01:24:56.064201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.472 [2024-11-28 01:24:56.064227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.472 [2024-11-28 01:24:56.064243] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.472 [2024-11-28 01:24:56.064417] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.472 [2024-11-28 01:24:56.064648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.472 [2024-11-28 01:24:56.064673] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.472 [2024-11-28 01:24:56.064689] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.472 [2024-11-28 01:24:56.066928] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.732 [2024-11-28 01:24:56.076378] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.732 [2024-11-28 01:24:56.076674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-28 01:24:56.076797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-28 01:24:56.076826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.732 [2024-11-28 01:24:56.076843] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.732 [2024-11-28 01:24:56.077008] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.732 [2024-11-28 01:24:56.077196] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.732 [2024-11-28 01:24:56.077219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.732 [2024-11-28 01:24:56.077235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.732 [2024-11-28 01:24:56.079455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.732 [2024-11-28 01:24:56.089070] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.732 [2024-11-28 01:24:56.089443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-28 01:24:56.089608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-28 01:24:56.089635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.732 [2024-11-28 01:24:56.089651] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.732 [2024-11-28 01:24:56.089788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.732 [2024-11-28 01:24:56.089976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.732 [2024-11-28 01:24:56.090000] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.732 [2024-11-28 01:24:56.090016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.732 [2024-11-28 01:24:56.092386] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.732 [2024-11-28 01:24:56.101486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.732 [2024-11-28 01:24:56.101812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-28 01:24:56.101965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-28 01:24:56.101991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.732 [2024-11-28 01:24:56.102007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.732 [2024-11-28 01:24:56.102147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.732 [2024-11-28 01:24:56.102298] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.732 [2024-11-28 01:24:56.102321] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.732 [2024-11-28 01:24:56.102336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.732 [2024-11-28 01:24:56.104763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.732 [2024-11-28 01:24:56.114144] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.732 [2024-11-28 01:24:56.114484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-28 01:24:56.114643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-28 01:24:56.114673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.732 [2024-11-28 01:24:56.114691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.732 [2024-11-28 01:24:56.114874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.732 [2024-11-28 01:24:56.115043] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.732 [2024-11-28 01:24:56.115066] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.732 [2024-11-28 01:24:56.115082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.732 [2024-11-28 01:24:56.117427] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.732 [2024-11-28 01:24:56.126854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.732 [2024-11-28 01:24:56.127141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-28 01:24:56.127311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-28 01:24:56.127336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.732 [2024-11-28 01:24:56.127352] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.732 [2024-11-28 01:24:56.127499] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.732 [2024-11-28 01:24:56.127708] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.732 [2024-11-28 01:24:56.127738] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.732 [2024-11-28 01:24:56.127755] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.732 [2024-11-28 01:24:56.130196] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.732 [2024-11-28 01:24:56.139342] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.732 [2024-11-28 01:24:56.139680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-28 01:24:56.139801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-28 01:24:56.139829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.732 [2024-11-28 01:24:56.139847] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.732 [2024-11-28 01:24:56.140029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.732 [2024-11-28 01:24:56.140216] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.732 [2024-11-28 01:24:56.140241] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.732 [2024-11-28 01:24:56.140257] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.732 [2024-11-28 01:24:56.142634] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.732 [2024-11-28 01:24:56.152053] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.732 [2024-11-28 01:24:56.152303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-28 01:24:56.152438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-28 01:24:56.152466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.732 [2024-11-28 01:24:56.152484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.732 [2024-11-28 01:24:56.152679] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.732 [2024-11-28 01:24:56.152866] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.732 [2024-11-28 01:24:56.152890] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.732 [2024-11-28 01:24:56.152906] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.732 [2024-11-28 01:24:56.155142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.732 [2024-11-28 01:24:56.164934] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.732 [2024-11-28 01:24:56.165224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-28 01:24:56.165367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-28 01:24:56.165397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.732 [2024-11-28 01:24:56.165414] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.732 [2024-11-28 01:24:56.165591] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.732 [2024-11-28 01:24:56.165779] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.732 [2024-11-28 01:24:56.165803] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.732 [2024-11-28 01:24:56.165823] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.732 [2024-11-28 01:24:56.168258] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.733 [2024-11-28 01:24:56.177559] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.733 [2024-11-28 01:24:56.177840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-28 01:24:56.178022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-28 01:24:56.178048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.733 [2024-11-28 01:24:56.178064] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.733 [2024-11-28 01:24:56.178259] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.733 [2024-11-28 01:24:56.178428] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.733 [2024-11-28 01:24:56.178453] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.733 [2024-11-28 01:24:56.178468] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.733 [2024-11-28 01:24:56.180860] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.733 [2024-11-28 01:24:56.190131] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.733 [2024-11-28 01:24:56.190413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-28 01:24:56.190554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-28 01:24:56.190583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.733 [2024-11-28 01:24:56.190601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.733 [2024-11-28 01:24:56.190802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.733 [2024-11-28 01:24:56.190971] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.733 [2024-11-28 01:24:56.190995] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.733 [2024-11-28 01:24:56.191010] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.733 [2024-11-28 01:24:56.193318] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.733 [2024-11-28 01:24:56.202775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.733 [2024-11-28 01:24:56.203070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-28 01:24:56.203209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-28 01:24:56.203238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.733 [2024-11-28 01:24:56.203255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.733 [2024-11-28 01:24:56.203474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.733 [2024-11-28 01:24:56.203654] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.733 [2024-11-28 01:24:56.203679] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.733 [2024-11-28 01:24:56.203695] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.733 [2024-11-28 01:24:56.206061] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.733 [2024-11-28 01:24:56.215448] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.733 [2024-11-28 01:24:56.215815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-28 01:24:56.215956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-28 01:24:56.215982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.733 [2024-11-28 01:24:56.215998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.733 [2024-11-28 01:24:56.216140] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.733 [2024-11-28 01:24:56.216292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.733 [2024-11-28 01:24:56.216315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.733 [2024-11-28 01:24:56.216330] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.733 [2024-11-28 01:24:56.218576] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.733 [2024-11-28 01:24:56.227875] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.733 [2024-11-28 01:24:56.228224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-28 01:24:56.228405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-28 01:24:56.228431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.733 [2024-11-28 01:24:56.228446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.733 [2024-11-28 01:24:56.228623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.733 [2024-11-28 01:24:56.228758] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.733 [2024-11-28 01:24:56.228781] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.733 [2024-11-28 01:24:56.228796] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.733 [2024-11-28 01:24:56.231175] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.733 [2024-11-28 01:24:56.240564] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.733 [2024-11-28 01:24:56.240872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-28 01:24:56.241023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-28 01:24:56.241052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.733 [2024-11-28 01:24:56.241069] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.733 [2024-11-28 01:24:56.241233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.733 [2024-11-28 01:24:56.241438] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.733 [2024-11-28 01:24:56.241462] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.733 [2024-11-28 01:24:56.241477] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.733 [2024-11-28 01:24:56.243813] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.733 [2024-11-28 01:24:56.253124] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.733 [2024-11-28 01:24:56.253423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-28 01:24:56.253542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-28 01:24:56.253569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.733 [2024-11-28 01:24:56.253585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.733 [2024-11-28 01:24:56.253735] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.733 [2024-11-28 01:24:56.253886] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.733 [2024-11-28 01:24:56.253909] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.733 [2024-11-28 01:24:56.253924] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.733 [2024-11-28 01:24:56.256338] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.733 [2024-11-28 01:24:56.265717] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.733 [2024-11-28 01:24:56.266046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-28 01:24:56.266196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-28 01:24:56.266225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.733 [2024-11-28 01:24:56.266243] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.733 [2024-11-28 01:24:56.266425] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.733 [2024-11-28 01:24:56.266625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.733 [2024-11-28 01:24:56.266650] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.733 [2024-11-28 01:24:56.266665] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.733 [2024-11-28 01:24:56.269187] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.733 [2024-11-28 01:24:56.278176] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.733 [2024-11-28 01:24:56.278461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-28 01:24:56.278571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-28 01:24:56.278601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.733 [2024-11-28 01:24:56.278619] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.733 [2024-11-28 01:24:56.278802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.733 [2024-11-28 01:24:56.278989] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.733 [2024-11-28 01:24:56.279012] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.733 [2024-11-28 01:24:56.279027] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.733 [2024-11-28 01:24:56.281298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.733 [2024-11-28 01:24:56.290810] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.733 [2024-11-28 01:24:56.291142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-28 01:24:56.291264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-28 01:24:56.291292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.734 [2024-11-28 01:24:56.291310] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.734 [2024-11-28 01:24:56.291511] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.734 [2024-11-28 01:24:56.291695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.734 [2024-11-28 01:24:56.291719] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.734 [2024-11-28 01:24:56.291735] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.734 [2024-11-28 01:24:56.293970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.734 [2024-11-28 01:24:56.303473] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.734 [2024-11-28 01:24:56.303785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-28 01:24:56.303942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-28 01:24:56.303968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.734 [2024-11-28 01:24:56.303984] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.734 [2024-11-28 01:24:56.304216] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.734 [2024-11-28 01:24:56.304403] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.734 [2024-11-28 01:24:56.304426] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.734 [2024-11-28 01:24:56.304442] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.734 [2024-11-28 01:24:56.306812] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.734 [2024-11-28 01:24:56.315872] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.734 [2024-11-28 01:24:56.316180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-28 01:24:56.316316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-28 01:24:56.316345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.734 [2024-11-28 01:24:56.316363] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.734 [2024-11-28 01:24:56.316594] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.734 [2024-11-28 01:24:56.316782] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.734 [2024-11-28 01:24:56.316805] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.734 [2024-11-28 01:24:56.316820] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.734 [2024-11-28 01:24:56.319216] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.734 [2024-11-28 01:24:56.328264] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.734 [2024-11-28 01:24:56.328588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-28 01:24:56.328733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-28 01:24:56.328768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.734 [2024-11-28 01:24:56.328787] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.734 [2024-11-28 01:24:56.328933] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.734 [2024-11-28 01:24:56.329121] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.734 [2024-11-28 01:24:56.329144] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.734 [2024-11-28 01:24:56.329159] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.734 [2024-11-28 01:24:56.331427] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.993 [2024-11-28 01:24:56.340966] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.993 [2024-11-28 01:24:56.341321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.993 [2024-11-28 01:24:56.341479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.993 [2024-11-28 01:24:56.341507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.993 [2024-11-28 01:24:56.341533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.993 [2024-11-28 01:24:56.341683] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.993 [2024-11-28 01:24:56.341834] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.993 [2024-11-28 01:24:56.341858] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.993 [2024-11-28 01:24:56.341873] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.993 [2024-11-28 01:24:56.344178] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.993 [2024-11-28 01:24:56.353468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.993 [2024-11-28 01:24:56.353742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.993 [2024-11-28 01:24:56.353931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.993 [2024-11-28 01:24:56.353957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.993 [2024-11-28 01:24:56.353973] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.993 [2024-11-28 01:24:56.354169] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.993 [2024-11-28 01:24:56.354356] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.993 [2024-11-28 01:24:56.354380] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.993 [2024-11-28 01:24:56.354395] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.993 [2024-11-28 01:24:56.356454] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.993 [2024-11-28 01:24:56.365989] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.993 [2024-11-28 01:24:56.366303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.993 [2024-11-28 01:24:56.366445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.993 [2024-11-28 01:24:56.366474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.993 [2024-11-28 01:24:56.366500] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.993 [2024-11-28 01:24:56.366748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.993 [2024-11-28 01:24:56.366954] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.993 [2024-11-28 01:24:56.366978] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.993 [2024-11-28 01:24:56.366993] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.993 [2024-11-28 01:24:56.369104] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.993 [2024-11-28 01:24:56.378302] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.994 [2024-11-28 01:24:56.378644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.994 [2024-11-28 01:24:56.378754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.994 [2024-11-28 01:24:56.378780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.994 [2024-11-28 01:24:56.378796] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.994 [2024-11-28 01:24:56.378968] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.994 [2024-11-28 01:24:56.379119] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.994 [2024-11-28 01:24:56.379143] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.994 [2024-11-28 01:24:56.379158] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.994 [2024-11-28 01:24:56.381359] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.994 [2024-11-28 01:24:56.390881] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.994 [2024-11-28 01:24:56.391157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.994 [2024-11-28 01:24:56.391303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.994 [2024-11-28 01:24:56.391331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.994 [2024-11-28 01:24:56.391348] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.994 [2024-11-28 01:24:56.391513] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.994 [2024-11-28 01:24:56.391694] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.994 [2024-11-28 01:24:56.391718] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.994 [2024-11-28 01:24:56.391734] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.994 [2024-11-28 01:24:56.394057] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.994 [2024-11-28 01:24:56.403345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.994 [2024-11-28 01:24:56.403661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.994 [2024-11-28 01:24:56.403838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.994 [2024-11-28 01:24:56.403864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.994 [2024-11-28 01:24:56.403879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.994 [2024-11-28 01:24:56.404047] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.994 [2024-11-28 01:24:56.404231] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.994 [2024-11-28 01:24:56.404255] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.994 [2024-11-28 01:24:56.404270] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.994 [2024-11-28 01:24:56.406538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.994 [2024-11-28 01:24:56.415971] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.994 [2024-11-28 01:24:56.416261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.994 [2024-11-28 01:24:56.416405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.994 [2024-11-28 01:24:56.416433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.994 [2024-11-28 01:24:56.416451] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.994 [2024-11-28 01:24:56.416591] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.994 [2024-11-28 01:24:56.416760] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.994 [2024-11-28 01:24:56.416784] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.994 [2024-11-28 01:24:56.416799] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.994 [2024-11-28 01:24:56.419107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.994 [2024-11-28 01:24:56.428855] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.994 [2024-11-28 01:24:56.429201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.994 [2024-11-28 01:24:56.429308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.994 [2024-11-28 01:24:56.429336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.994 [2024-11-28 01:24:56.429354] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.994 [2024-11-28 01:24:56.429500] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.994 [2024-11-28 01:24:56.429697] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.994 [2024-11-28 01:24:56.429722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.994 [2024-11-28 01:24:56.429738] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.994 [2024-11-28 01:24:56.431955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.994 [2024-11-28 01:24:56.441427] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.994 [2024-11-28 01:24:56.441740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.994 [2024-11-28 01:24:56.441886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.994 [2024-11-28 01:24:56.441916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.994 [2024-11-28 01:24:56.441934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.994 [2024-11-28 01:24:56.442116] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.994 [2024-11-28 01:24:56.442255] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.994 [2024-11-28 01:24:56.442280] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.994 [2024-11-28 01:24:56.442295] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.994 [2024-11-28 01:24:56.444766] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.994 [2024-11-28 01:24:56.453728] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.994 [2024-11-28 01:24:56.454077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.994 [2024-11-28 01:24:56.454212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.994 [2024-11-28 01:24:56.454238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.994 [2024-11-28 01:24:56.454253] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.994 [2024-11-28 01:24:56.454461] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.994 [2024-11-28 01:24:56.454641] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.994 [2024-11-28 01:24:56.454666] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.994 [2024-11-28 01:24:56.454682] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.994 [2024-11-28 01:24:56.457098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.994 [2024-11-28 01:24:56.466339] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.994 [2024-11-28 01:24:56.466648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.994 [2024-11-28 01:24:56.466791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.994 [2024-11-28 01:24:56.466820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.994 [2024-11-28 01:24:56.466837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.994 [2024-11-28 01:24:56.466983] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.994 [2024-11-28 01:24:56.467134] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.994 [2024-11-28 01:24:56.467158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.994 [2024-11-28 01:24:56.467174] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.994 [2024-11-28 01:24:56.469412] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.994 [2024-11-28 01:24:56.478952] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.994 [2024-11-28 01:24:56.479322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.994 [2024-11-28 01:24:56.479485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.994 [2024-11-28 01:24:56.479513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.994 [2024-11-28 01:24:56.479542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.994 [2024-11-28 01:24:56.479690] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.994 [2024-11-28 01:24:56.479877] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.995 [2024-11-28 01:24:56.479906] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.995 [2024-11-28 01:24:56.479922] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.995 [2024-11-28 01:24:56.482320] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.995 [2024-11-28 01:24:56.491484] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.995 [2024-11-28 01:24:56.491861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.995 [2024-11-28 01:24:56.492007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.995 [2024-11-28 01:24:56.492035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.995 [2024-11-28 01:24:56.492052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.995 [2024-11-28 01:24:56.492216] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.995 [2024-11-28 01:24:56.492385] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.995 [2024-11-28 01:24:56.492409] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.995 [2024-11-28 01:24:56.492424] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.995 [2024-11-28 01:24:56.494761] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.995 [2024-11-28 01:24:56.504062] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.995 [2024-11-28 01:24:56.504557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.995 [2024-11-28 01:24:56.504773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.995 [2024-11-28 01:24:56.504813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.995 [2024-11-28 01:24:56.504829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.995 [2024-11-28 01:24:56.504970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.995 [2024-11-28 01:24:56.505150] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.995 [2024-11-28 01:24:56.505173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.995 [2024-11-28 01:24:56.505189] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.995 [2024-11-28 01:24:56.507445] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.995 [2024-11-28 01:24:56.516573] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.995 [2024-11-28 01:24:56.516892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.995 [2024-11-28 01:24:56.517039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.995 [2024-11-28 01:24:56.517068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.995 [2024-11-28 01:24:56.517085] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.995 [2024-11-28 01:24:56.517232] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.995 [2024-11-28 01:24:56.517402] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.995 [2024-11-28 01:24:56.517426] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.995 [2024-11-28 01:24:56.517448] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.995 [2024-11-28 01:24:56.519744] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.995 [2024-11-28 01:24:56.529043] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.995 [2024-11-28 01:24:56.529445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.995 [2024-11-28 01:24:56.529628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.995 [2024-11-28 01:24:56.529655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.995 [2024-11-28 01:24:56.529671] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.995 [2024-11-28 01:24:56.529849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.995 [2024-11-28 01:24:56.530021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.995 [2024-11-28 01:24:56.530044] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.995 [2024-11-28 01:24:56.530060] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.995 [2024-11-28 01:24:56.532427] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.995 [2024-11-28 01:24:56.541316] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.995 [2024-11-28 01:24:56.541644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.995 [2024-11-28 01:24:56.541777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.995 [2024-11-28 01:24:56.541803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.995 [2024-11-28 01:24:56.541819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.995 [2024-11-28 01:24:56.541981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.995 [2024-11-28 01:24:56.542125] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.995 [2024-11-28 01:24:56.542149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.995 [2024-11-28 01:24:56.542164] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.995 [2024-11-28 01:24:56.544302] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.995 [2024-11-28 01:24:56.553954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.995 [2024-11-28 01:24:56.554265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.995 [2024-11-28 01:24:56.554402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.995 [2024-11-28 01:24:56.554430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.995 [2024-11-28 01:24:56.554447] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.995 [2024-11-28 01:24:56.554605] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.995 [2024-11-28 01:24:56.554738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.995 [2024-11-28 01:24:56.554761] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.995 [2024-11-28 01:24:56.554777] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.995 [2024-11-28 01:24:56.557042] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.995 [2024-11-28 01:24:56.566401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.995 [2024-11-28 01:24:56.566803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.995 [2024-11-28 01:24:56.566967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.995 [2024-11-28 01:24:56.566993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.995 [2024-11-28 01:24:56.567008] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.995 [2024-11-28 01:24:56.567155] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.995 [2024-11-28 01:24:56.567355] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.995 [2024-11-28 01:24:56.567379] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.995 [2024-11-28 01:24:56.567397] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.995 [2024-11-28 01:24:56.569718] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.995 [2024-11-28 01:24:56.578870] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.995 [2024-11-28 01:24:56.579190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.995 [2024-11-28 01:24:56.579339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.995 [2024-11-28 01:24:56.579367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.995 [2024-11-28 01:24:56.579385] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.995 [2024-11-28 01:24:56.579542] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.995 [2024-11-28 01:24:56.579712] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.995 [2024-11-28 01:24:56.579736] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.995 [2024-11-28 01:24:56.579751] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.995 [2024-11-28 01:24:56.582095] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:41.995 [2024-11-28 01:24:56.591315] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:41.995 [2024-11-28 01:24:56.591652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.995 [2024-11-28 01:24:56.591767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.995 [2024-11-28 01:24:56.591792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:41.995 [2024-11-28 01:24:56.591808] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:41.995 [2024-11-28 01:24:56.591940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:41.995 [2024-11-28 01:24:56.592093] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.995 [2024-11-28 01:24:56.592114] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.995 [2024-11-28 01:24:56.592127] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.995 [2024-11-28 01:24:56.594255] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.255 [2024-11-28 01:24:56.603584] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.255 [2024-11-28 01:24:56.603847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.255 [2024-11-28 01:24:56.604005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.255 [2024-11-28 01:24:56.604031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.255 [2024-11-28 01:24:56.604047] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.255 [2024-11-28 01:24:56.604244] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.255 [2024-11-28 01:24:56.604370] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.255 [2024-11-28 01:24:56.604390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.255 [2024-11-28 01:24:56.604402] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.255 [2024-11-28 01:24:56.606398] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.255 [2024-11-28 01:24:56.615609] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.255 [2024-11-28 01:24:56.615964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.256 [2024-11-28 01:24:56.616096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.256 [2024-11-28 01:24:56.616122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.256 [2024-11-28 01:24:56.616137] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.256 [2024-11-28 01:24:56.616237] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.256 [2024-11-28 01:24:56.616443] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.256 [2024-11-28 01:24:56.616464] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.256 [2024-11-28 01:24:56.616477] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.256 [2024-11-28 01:24:56.618433] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.256 [2024-11-28 01:24:56.627474] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.256 [2024-11-28 01:24:56.627745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.256 [2024-11-28 01:24:56.627903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.256 [2024-11-28 01:24:56.627928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.256 [2024-11-28 01:24:56.627944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.256 [2024-11-28 01:24:56.628123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.256 [2024-11-28 01:24:56.628281] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.256 [2024-11-28 01:24:56.628301] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.256 [2024-11-28 01:24:56.628313] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.256 [2024-11-28 01:24:56.630345] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.256 [2024-11-28 01:24:56.639853] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.256 [2024-11-28 01:24:56.640195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.256 [2024-11-28 01:24:56.640337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.256 [2024-11-28 01:24:56.640363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.256 [2024-11-28 01:24:56.640379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.256 [2024-11-28 01:24:56.640536] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.256 [2024-11-28 01:24:56.640726] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.256 [2024-11-28 01:24:56.640747] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.256 [2024-11-28 01:24:56.640761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.256 [2024-11-28 01:24:56.642689] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.256 [2024-11-28 01:24:56.651911] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.256 [2024-11-28 01:24:56.652281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.256 [2024-11-28 01:24:56.652426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.256 [2024-11-28 01:24:56.652452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.256 [2024-11-28 01:24:56.652468] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.256 [2024-11-28 01:24:56.652602] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.256 [2024-11-28 01:24:56.652812] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.256 [2024-11-28 01:24:56.652832] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.256 [2024-11-28 01:24:56.652860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.256 [2024-11-28 01:24:56.654848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.256 [2024-11-28 01:24:56.664095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.256 [2024-11-28 01:24:56.664354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.256 [2024-11-28 01:24:56.664496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.256 [2024-11-28 01:24:56.664522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.256 [2024-11-28 01:24:56.664548] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.256 [2024-11-28 01:24:56.664713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.256 [2024-11-28 01:24:56.664888] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.256 [2024-11-28 01:24:56.664907] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.256 [2024-11-28 01:24:56.664920] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.256 [2024-11-28 01:24:56.666860] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.256 [2024-11-28 01:24:56.676393] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.256 [2024-11-28 01:24:56.676707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.256 [2024-11-28 01:24:56.676846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.256 [2024-11-28 01:24:56.676877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.256 [2024-11-28 01:24:56.676894] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.256 [2024-11-28 01:24:56.677089] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.256 [2024-11-28 01:24:56.677279] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.256 [2024-11-28 01:24:56.677298] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.256 [2024-11-28 01:24:56.677311] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.256 [2024-11-28 01:24:56.679256] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.256 [2024-11-28 01:24:56.688400] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.256 [2024-11-28 01:24:56.688770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.256 [2024-11-28 01:24:56.688876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.256 [2024-11-28 01:24:56.688902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.256 [2024-11-28 01:24:56.688917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.256 [2024-11-28 01:24:56.689065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.256 [2024-11-28 01:24:56.689241] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.256 [2024-11-28 01:24:56.689261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.256 [2024-11-28 01:24:56.689274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.256 [2024-11-28 01:24:56.691425] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.256 [2024-11-28 01:24:56.700486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.256 [2024-11-28 01:24:56.700882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.256 [2024-11-28 01:24:56.701009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.256 [2024-11-28 01:24:56.701034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.256 [2024-11-28 01:24:56.701050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.256 [2024-11-28 01:24:56.701166] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.256 [2024-11-28 01:24:56.701325] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.256 [2024-11-28 01:24:56.701345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.256 [2024-11-28 01:24:56.701357] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.256 [2024-11-28 01:24:56.703427] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.256 [2024-11-28 01:24:56.712600] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.256 [2024-11-28 01:24:56.712927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.256 [2024-11-28 01:24:56.713092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.256 [2024-11-28 01:24:56.713118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.256 [2024-11-28 01:24:56.713138] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.256 [2024-11-28 01:24:56.713332] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.256 [2024-11-28 01:24:56.713516] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.256 [2024-11-28 01:24:56.713560] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.256 [2024-11-28 01:24:56.713574] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.256 [2024-11-28 01:24:56.715554] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.256 [2024-11-28 01:24:56.724868] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.256 [2024-11-28 01:24:56.725135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.256 [2024-11-28 01:24:56.725260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.256 [2024-11-28 01:24:56.725287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.257 [2024-11-28 01:24:56.725303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.257 [2024-11-28 01:24:56.725433] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.257 [2024-11-28 01:24:56.725627] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.257 [2024-11-28 01:24:56.725648] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.257 [2024-11-28 01:24:56.725661] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.257 [2024-11-28 01:24:56.727453] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.257 [2024-11-28 01:24:56.736965] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.257 [2024-11-28 01:24:56.737289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.257 [2024-11-28 01:24:56.737408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.257 [2024-11-28 01:24:56.737434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.257 [2024-11-28 01:24:56.737450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.257 [2024-11-28 01:24:56.737655] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.257 [2024-11-28 01:24:56.737800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.257 [2024-11-28 01:24:56.737820] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.257 [2024-11-28 01:24:56.737848] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.257 [2024-11-28 01:24:56.739824] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.257 [2024-11-28 01:24:56.749269] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.257 [2024-11-28 01:24:56.749567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.257 [2024-11-28 01:24:56.749687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.257 [2024-11-28 01:24:56.749713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.257 [2024-11-28 01:24:56.749729] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.257 [2024-11-28 01:24:56.749911] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.257 [2024-11-28 01:24:56.750024] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.257 [2024-11-28 01:24:56.750044] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.257 [2024-11-28 01:24:56.750057] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.257 [2024-11-28 01:24:56.752132] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.257 [2024-11-28 01:24:56.761485] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.257 [2024-11-28 01:24:56.761772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.257 [2024-11-28 01:24:56.761913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.257 [2024-11-28 01:24:56.761940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.257 [2024-11-28 01:24:56.761956] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.257 [2024-11-28 01:24:56.762088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.257 [2024-11-28 01:24:56.762265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.257 [2024-11-28 01:24:56.762284] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.257 [2024-11-28 01:24:56.762297] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.257 [2024-11-28 01:24:56.764306] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.257 [2024-11-28 01:24:56.773563] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.257 [2024-11-28 01:24:56.773909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.257 [2024-11-28 01:24:56.774048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.257 [2024-11-28 01:24:56.774073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.257 [2024-11-28 01:24:56.774089] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.257 [2024-11-28 01:24:56.774237] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.257 [2024-11-28 01:24:56.774412] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.257 [2024-11-28 01:24:56.774431] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.257 [2024-11-28 01:24:56.774444] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.257 [2024-11-28 01:24:56.776399] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.257 [2024-11-28 01:24:56.785648] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.257 [2024-11-28 01:24:56.786016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.257 [2024-11-28 01:24:56.786123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.257 [2024-11-28 01:24:56.786150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.257 [2024-11-28 01:24:56.786166] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.257 [2024-11-28 01:24:56.786359] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.257 [2024-11-28 01:24:56.786549] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.257 [2024-11-28 01:24:56.786572] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.257 [2024-11-28 01:24:56.786585] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.257 [2024-11-28 01:24:56.788673] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.257 [2024-11-28 01:24:56.797751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.257 [2024-11-28 01:24:56.798094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.257 [2024-11-28 01:24:56.798260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.257 [2024-11-28 01:24:56.798286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.257 [2024-11-28 01:24:56.798302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.257 [2024-11-28 01:24:56.798497] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.257 [2024-11-28 01:24:56.798650] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.257 [2024-11-28 01:24:56.798671] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.257 [2024-11-28 01:24:56.798684] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.257 [2024-11-28 01:24:56.800780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.257 [2024-11-28 01:24:56.809759] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.257 [2024-11-28 01:24:56.810116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.257 [2024-11-28 01:24:56.810284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.257 [2024-11-28 01:24:56.810309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.257 [2024-11-28 01:24:56.810325] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.257 [2024-11-28 01:24:56.810473] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.257 [2024-11-28 01:24:56.810662] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.257 [2024-11-28 01:24:56.810684] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.257 [2024-11-28 01:24:56.810697] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.257 [2024-11-28 01:24:56.812595] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.257 [2024-11-28 01:24:56.821729] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.257 [2024-11-28 01:24:56.822088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.257 [2024-11-28 01:24:56.822195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.257 [2024-11-28 01:24:56.822220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.257 [2024-11-28 01:24:56.822236] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.257 [2024-11-28 01:24:56.822383] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.257 [2024-11-28 01:24:56.822583] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.257 [2024-11-28 01:24:56.822604] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.257 [2024-11-28 01:24:56.822622] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.257 [2024-11-28 01:24:56.824582] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.257 [2024-11-28 01:24:56.833816] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.257 [2024-11-28 01:24:56.834092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.257 [2024-11-28 01:24:56.834201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.257 [2024-11-28 01:24:56.834226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.257 [2024-11-28 01:24:56.834242] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.257 [2024-11-28 01:24:56.834358] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.257 [2024-11-28 01:24:56.834597] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.258 [2024-11-28 01:24:56.834620] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.258 [2024-11-28 01:24:56.834634] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.258 [2024-11-28 01:24:56.836689] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.258 [2024-11-28 01:24:56.846040] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.258 [2024-11-28 01:24:56.846318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.258 [2024-11-28 01:24:56.846459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.258 [2024-11-28 01:24:56.846485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.258 [2024-11-28 01:24:56.846501] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.258 [2024-11-28 01:24:56.846687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.258 [2024-11-28 01:24:56.846847] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.258 [2024-11-28 01:24:56.846867] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.258 [2024-11-28 01:24:56.846879] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.258 [2024-11-28 01:24:56.848818] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.517 [2024-11-28 01:24:56.858449] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.517 [2024-11-28 01:24:56.858759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-28 01:24:56.858889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-28 01:24:56.858914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.517 [2024-11-28 01:24:56.858930] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.517 [2024-11-28 01:24:56.859060] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.517 [2024-11-28 01:24:56.859231] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.517 [2024-11-28 01:24:56.859251] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.517 [2024-11-28 01:24:56.859263] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.517 [2024-11-28 01:24:56.861476] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.517 [2024-11-28 01:24:56.870668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.517 [2024-11-28 01:24:56.870995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-28 01:24:56.871129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.517 [2024-11-28 01:24:56.871154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.517 [2024-11-28 01:24:56.871170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.517 [2024-11-28 01:24:56.871365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.517 [2024-11-28 01:24:56.871549] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.517 [2024-11-28 01:24:56.871570] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.517 [2024-11-28 01:24:56.871582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.517 [2024-11-28 01:24:56.873848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.517 [2024-11-28 01:24:56.882784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.517 [2024-11-28 01:24:56.883127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-28 01:24:56.883256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-28 01:24:56.883282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.518 [2024-11-28 01:24:56.883297] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.518 [2024-11-28 01:24:56.883446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.518 [2024-11-28 01:24:56.883646] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.518 [2024-11-28 01:24:56.883667] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.518 [2024-11-28 01:24:56.883680] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.518 [2024-11-28 01:24:56.885658] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.518 [2024-11-28 01:24:56.894971] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.518 [2024-11-28 01:24:56.895264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-28 01:24:56.895417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-28 01:24:56.895443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.518 [2024-11-28 01:24:56.895459] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.518 [2024-11-28 01:24:56.895600] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.518 [2024-11-28 01:24:56.895793] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.518 [2024-11-28 01:24:56.895827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.518 [2024-11-28 01:24:56.895839] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.518 [2024-11-28 01:24:56.897875] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.518 [2024-11-28 01:24:56.907214] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.518 [2024-11-28 01:24:56.907541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-28 01:24:56.907689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-28 01:24:56.907715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.518 [2024-11-28 01:24:56.907731] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.518 [2024-11-28 01:24:56.907894] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.518 [2024-11-28 01:24:56.908080] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.518 [2024-11-28 01:24:56.908099] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.518 [2024-11-28 01:24:56.908112] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.518 [2024-11-28 01:24:56.910045] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.518 [2024-11-28 01:24:56.919485] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.518 [2024-11-28 01:24:56.919852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-28 01:24:56.919982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-28 01:24:56.920007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.518 [2024-11-28 01:24:56.920023] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.518 [2024-11-28 01:24:56.920187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.518 [2024-11-28 01:24:56.920375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.518 [2024-11-28 01:24:56.920395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.518 [2024-11-28 01:24:56.920407] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.518 [2024-11-28 01:24:56.922369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.518 [2024-11-28 01:24:56.931763] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.518 [2024-11-28 01:24:56.932091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-28 01:24:56.932220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-28 01:24:56.932245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.518 [2024-11-28 01:24:56.932261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.518 [2024-11-28 01:24:56.932409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.518 [2024-11-28 01:24:56.932609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.518 [2024-11-28 01:24:56.932630] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.518 [2024-11-28 01:24:56.932644] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.518 [2024-11-28 01:24:56.934564] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.518 [2024-11-28 01:24:56.943930] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.518 [2024-11-28 01:24:56.944213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-28 01:24:56.944370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-28 01:24:56.944395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.518 [2024-11-28 01:24:56.944410] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.518 [2024-11-28 01:24:56.944552] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.518 [2024-11-28 01:24:56.944747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.518 [2024-11-28 01:24:56.944767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.518 [2024-11-28 01:24:56.944780] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.518 [2024-11-28 01:24:56.946869] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.518 [2024-11-28 01:24:56.955961] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.518 [2024-11-28 01:24:56.956240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-28 01:24:56.956365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-28 01:24:56.956391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.518 [2024-11-28 01:24:56.956407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.518 [2024-11-28 01:24:56.956579] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.518 [2024-11-28 01:24:56.956754] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.518 [2024-11-28 01:24:56.956774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.518 [2024-11-28 01:24:56.956787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.518 [2024-11-28 01:24:56.958688] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.518 [2024-11-28 01:24:56.967970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.518 [2024-11-28 01:24:56.968250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-28 01:24:56.968366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-28 01:24:56.968391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.518 [2024-11-28 01:24:56.968407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.518 [2024-11-28 01:24:56.968578] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.518 [2024-11-28 01:24:56.968709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.518 [2024-11-28 01:24:56.968729] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.518 [2024-11-28 01:24:56.968742] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.518 [2024-11-28 01:24:56.970661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.518 [2024-11-28 01:24:56.980077] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.518 [2024-11-28 01:24:56.980465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-28 01:24:56.980580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-28 01:24:56.980612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.518 [2024-11-28 01:24:56.980628] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.518 [2024-11-28 01:24:56.980744] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.518 [2024-11-28 01:24:56.980906] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.518 [2024-11-28 01:24:56.980926] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.518 [2024-11-28 01:24:56.980939] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.518 [2024-11-28 01:24:56.983012] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.518 [2024-11-28 01:24:56.992092] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.518 [2024-11-28 01:24:56.992439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-28 01:24:56.992546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.518 [2024-11-28 01:24:56.992573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.518 [2024-11-28 01:24:56.992589] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.519 [2024-11-28 01:24:56.992769] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.519 [2024-11-28 01:24:56.992913] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.519 [2024-11-28 01:24:56.992933] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.519 [2024-11-28 01:24:56.992945] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.519 [2024-11-28 01:24:56.994974] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.519 [2024-11-28 01:24:57.004350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.519 [2024-11-28 01:24:57.004719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-28 01:24:57.004829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-28 01:24:57.004857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.519 [2024-11-28 01:24:57.004873] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.519 [2024-11-28 01:24:57.005021] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.519 [2024-11-28 01:24:57.005197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.519 [2024-11-28 01:24:57.005217] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.519 [2024-11-28 01:24:57.005230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.519 [2024-11-28 01:24:57.007294] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.519 [2024-11-28 01:24:57.016437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.519 [2024-11-28 01:24:57.016755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-28 01:24:57.016914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-28 01:24:57.016940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.519 [2024-11-28 01:24:57.016961] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.519 [2024-11-28 01:24:57.017108] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.519 [2024-11-28 01:24:57.017295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.519 [2024-11-28 01:24:57.017315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.519 [2024-11-28 01:24:57.017327] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.519 [2024-11-28 01:24:57.019361] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.519 [2024-11-28 01:24:57.028732] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.519 [2024-11-28 01:24:57.029123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-28 01:24:57.029247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-28 01:24:57.029273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.519 [2024-11-28 01:24:57.029289] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.519 [2024-11-28 01:24:57.029437] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.519 [2024-11-28 01:24:57.029651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.519 [2024-11-28 01:24:57.029672] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.519 [2024-11-28 01:24:57.029685] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.519 [2024-11-28 01:24:57.031648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.519 [2024-11-28 01:24:57.041159] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.519 [2024-11-28 01:24:57.041564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-28 01:24:57.041674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-28 01:24:57.041700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.519 [2024-11-28 01:24:57.041716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.519 [2024-11-28 01:24:57.041896] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.519 [2024-11-28 01:24:57.042039] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.519 [2024-11-28 01:24:57.042058] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.519 [2024-11-28 01:24:57.042071] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.519 [2024-11-28 01:24:57.044111] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.519 [2024-11-28 01:24:57.053281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.519 [2024-11-28 01:24:57.053637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-28 01:24:57.053801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-28 01:24:57.053827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.519 [2024-11-28 01:24:57.053842] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.519 [2024-11-28 01:24:57.054028] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.519 [2024-11-28 01:24:57.054215] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.519 [2024-11-28 01:24:57.054235] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.519 [2024-11-28 01:24:57.054247] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.519 [2024-11-28 01:24:57.056056] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.519 [2024-11-28 01:24:57.065622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.519 [2024-11-28 01:24:57.065977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-28 01:24:57.066143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-28 01:24:57.066169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.519 [2024-11-28 01:24:57.066185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.519 [2024-11-28 01:24:57.066380] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.519 [2024-11-28 01:24:57.066563] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.519 [2024-11-28 01:24:57.066585] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.519 [2024-11-28 01:24:57.066598] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.519 [2024-11-28 01:24:57.068540] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.519 [2024-11-28 01:24:57.077629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.519 [2024-11-28 01:24:57.077961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-28 01:24:57.078117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-28 01:24:57.078143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.519 [2024-11-28 01:24:57.078158] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.519 [2024-11-28 01:24:57.078306] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.519 [2024-11-28 01:24:57.078495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.519 [2024-11-28 01:24:57.078514] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.519 [2024-11-28 01:24:57.078550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.519 [2024-11-28 01:24:57.080482] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.519 [2024-11-28 01:24:57.089963] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.519 [2024-11-28 01:24:57.090291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-28 01:24:57.090399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-28 01:24:57.090425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.519 [2024-11-28 01:24:57.090441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.519 [2024-11-28 01:24:57.090648] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.519 [2024-11-28 01:24:57.090847] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.519 [2024-11-28 01:24:57.090869] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.519 [2024-11-28 01:24:57.090882] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.519 [2024-11-28 01:24:57.092959] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.519 [2024-11-28 01:24:57.102523] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.519 [2024-11-28 01:24:57.102855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-28 01:24:57.102987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.519 [2024-11-28 01:24:57.103013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.519 [2024-11-28 01:24:57.103029] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.519 [2024-11-28 01:24:57.103191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.519 [2024-11-28 01:24:57.103365] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.519 [2024-11-28 01:24:57.103385] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.520 [2024-11-28 01:24:57.103397] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.520 [2024-11-28 01:24:57.105410] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.520 [2024-11-28 01:24:57.114869] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.520 [2024-11-28 01:24:57.115201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-28 01:24:57.115335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.520 [2024-11-28 01:24:57.115361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.520 [2024-11-28 01:24:57.115376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.520 [2024-11-28 01:24:57.115532] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.520 [2024-11-28 01:24:57.115679] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.520 [2024-11-28 01:24:57.115699] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.520 [2024-11-28 01:24:57.115713] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.520 [2024-11-28 01:24:57.117641] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.779 [2024-11-28 01:24:57.127125] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.779 [2024-11-28 01:24:57.127545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-28 01:24:57.127651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-28 01:24:57.127680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.779 [2024-11-28 01:24:57.127696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.779 [2024-11-28 01:24:57.127843] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.779 [2024-11-28 01:24:57.128029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.779 [2024-11-28 01:24:57.128054] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.779 [2024-11-28 01:24:57.128067] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.779 [2024-11-28 01:24:57.129974] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.779 [2024-11-28 01:24:57.139450] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.779 [2024-11-28 01:24:57.139819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-28 01:24:57.139991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-28 01:24:57.140017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.779 [2024-11-28 01:24:57.140033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.779 [2024-11-28 01:24:57.140166] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.779 [2024-11-28 01:24:57.140344] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.779 [2024-11-28 01:24:57.140364] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.779 [2024-11-28 01:24:57.140376] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.779 [2024-11-28 01:24:57.142184] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.779 [2024-11-28 01:24:57.151736] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.779 [2024-11-28 01:24:57.152107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-28 01:24:57.152248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-28 01:24:57.152274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.779 [2024-11-28 01:24:57.152290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.779 [2024-11-28 01:24:57.152484] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.779 [2024-11-28 01:24:57.152652] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.779 [2024-11-28 01:24:57.152673] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.779 [2024-11-28 01:24:57.152687] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.779 [2024-11-28 01:24:57.154737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.779 [2024-11-28 01:24:57.163722] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.779 [2024-11-28 01:24:57.164079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-28 01:24:57.164219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-28 01:24:57.164244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.779 [2024-11-28 01:24:57.164260] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.779 [2024-11-28 01:24:57.164424] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.779 [2024-11-28 01:24:57.164610] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.779 [2024-11-28 01:24:57.164631] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.780 [2024-11-28 01:24:57.164649] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.780 [2024-11-28 01:24:57.166447] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.780 [2024-11-28 01:24:57.175925] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.780 [2024-11-28 01:24:57.176271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-28 01:24:57.176380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-28 01:24:57.176407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.780 [2024-11-28 01:24:57.176423] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.780 [2024-11-28 01:24:57.176596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.780 [2024-11-28 01:24:57.176755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.780 [2024-11-28 01:24:57.176775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.780 [2024-11-28 01:24:57.176787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.780 [2024-11-28 01:24:57.178741] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.780 [2024-11-28 01:24:57.188090] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.780 [2024-11-28 01:24:57.188508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-28 01:24:57.188631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-28 01:24:57.188667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.780 [2024-11-28 01:24:57.188684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.780 [2024-11-28 01:24:57.188863] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.780 [2024-11-28 01:24:57.188975] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.780 [2024-11-28 01:24:57.188994] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.780 [2024-11-28 01:24:57.189007] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.780 [2024-11-28 01:24:57.190888] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.780 [2024-11-28 01:24:57.200030] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.780 [2024-11-28 01:24:57.200381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-28 01:24:57.200543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-28 01:24:57.200569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.780 [2024-11-28 01:24:57.200585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.780 [2024-11-28 01:24:57.200715] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.780 [2024-11-28 01:24:57.200890] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.780 [2024-11-28 01:24:57.200909] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.780 [2024-11-28 01:24:57.200922] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.780 [2024-11-28 01:24:57.203048] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.780 [2024-11-28 01:24:57.212443] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.780 [2024-11-28 01:24:57.212737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-28 01:24:57.212903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-28 01:24:57.212929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.780 [2024-11-28 01:24:57.212945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.780 [2024-11-28 01:24:57.213093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.780 [2024-11-28 01:24:57.213252] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.780 [2024-11-28 01:24:57.213272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.780 [2024-11-28 01:24:57.213285] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.780 [2024-11-28 01:24:57.215205] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.780 [2024-11-28 01:24:57.224583] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.780 [2024-11-28 01:24:57.224981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-28 01:24:57.225091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-28 01:24:57.225117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.780 [2024-11-28 01:24:57.225133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.780 [2024-11-28 01:24:57.225295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.780 [2024-11-28 01:24:57.225438] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.780 [2024-11-28 01:24:57.225458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.780 [2024-11-28 01:24:57.225471] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.780 [2024-11-28 01:24:57.227454] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.780 [2024-11-28 01:24:57.236832] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.780 [2024-11-28 01:24:57.237127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-28 01:24:57.237293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-28 01:24:57.237319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.780 [2024-11-28 01:24:57.237335] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.780 [2024-11-28 01:24:57.237467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.780 [2024-11-28 01:24:57.237629] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.780 [2024-11-28 01:24:57.237659] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.780 [2024-11-28 01:24:57.237673] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.780 [2024-11-28 01:24:57.239553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.780 [2024-11-28 01:24:57.248934] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.780 [2024-11-28 01:24:57.249294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-28 01:24:57.249437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-28 01:24:57.249463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.780 [2024-11-28 01:24:57.249478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.780 [2024-11-28 01:24:57.249670] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.780 [2024-11-28 01:24:57.249831] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.780 [2024-11-28 01:24:57.249850] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.780 [2024-11-28 01:24:57.249863] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.780 [2024-11-28 01:24:57.251861] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.780 [2024-11-28 01:24:57.261093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.780 [2024-11-28 01:24:57.261374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-28 01:24:57.261544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-28 01:24:57.261571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.780 [2024-11-28 01:24:57.261587] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.780 [2024-11-28 01:24:57.261687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.780 [2024-11-28 01:24:57.261921] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.780 [2024-11-28 01:24:57.261941] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.780 [2024-11-28 01:24:57.261954] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.780 [2024-11-28 01:24:57.263829] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.780 [2024-11-28 01:24:57.273186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.780 [2024-11-28 01:24:57.273543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-28 01:24:57.273703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-28 01:24:57.273730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.780 [2024-11-28 01:24:57.273746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.780 [2024-11-28 01:24:57.273894] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.780 [2024-11-28 01:24:57.274082] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.780 [2024-11-28 01:24:57.274102] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.780 [2024-11-28 01:24:57.274115] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.780 [2024-11-28 01:24:57.276116] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.780 [2024-11-28 01:24:57.285354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.780 [2024-11-28 01:24:57.285711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-28 01:24:57.285855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-28 01:24:57.285882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.781 [2024-11-28 01:24:57.285898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.781 [2024-11-28 01:24:57.286073] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.781 [2024-11-28 01:24:57.286258] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.781 [2024-11-28 01:24:57.286277] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.781 [2024-11-28 01:24:57.286290] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.781 [2024-11-28 01:24:57.288229] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.781 [2024-11-28 01:24:57.297565] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.781 [2024-11-28 01:24:57.297857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-28 01:24:57.297994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-28 01:24:57.298019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.781 [2024-11-28 01:24:57.298035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.781 [2024-11-28 01:24:57.298199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.781 [2024-11-28 01:24:57.298402] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.781 [2024-11-28 01:24:57.298422] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.781 [2024-11-28 01:24:57.298435] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.781 [2024-11-28 01:24:57.300425] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.781 [2024-11-28 01:24:57.309919] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.781 [2024-11-28 01:24:57.310275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-28 01:24:57.310488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-28 01:24:57.310514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.781 [2024-11-28 01:24:57.310539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.781 [2024-11-28 01:24:57.310690] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.781 [2024-11-28 01:24:57.310851] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.781 [2024-11-28 01:24:57.310870] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.781 [2024-11-28 01:24:57.310883] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.781 [2024-11-28 01:24:57.312762] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.781 [2024-11-28 01:24:57.321906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.781 [2024-11-28 01:24:57.322309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-28 01:24:57.322418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-28 01:24:57.322450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.781 [2024-11-28 01:24:57.322466] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.781 [2024-11-28 01:24:57.322608] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.781 [2024-11-28 01:24:57.322772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.781 [2024-11-28 01:24:57.322792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.781 [2024-11-28 01:24:57.322821] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.781 [2024-11-28 01:24:57.324523] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.781 [2024-11-28 01:24:57.333991] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.781 [2024-11-28 01:24:57.334317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-28 01:24:57.334426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-28 01:24:57.334452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.781 [2024-11-28 01:24:57.334467] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.781 [2024-11-28 01:24:57.334672] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.781 [2024-11-28 01:24:57.334844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.781 [2024-11-28 01:24:57.334864] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.781 [2024-11-28 01:24:57.334877] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.781 [2024-11-28 01:24:57.336856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.781 [2024-11-28 01:24:57.346157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.781 [2024-11-28 01:24:57.346559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-28 01:24:57.346718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-28 01:24:57.346745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.781 [2024-11-28 01:24:57.346760] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.781 [2024-11-28 01:24:57.346892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.781 [2024-11-28 01:24:57.347075] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.781 [2024-11-28 01:24:57.347096] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.781 [2024-11-28 01:24:57.347125] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.781 [2024-11-28 01:24:57.349152] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.781 [2024-11-28 01:24:57.358550] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.781 [2024-11-28 01:24:57.358844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-28 01:24:57.358983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-28 01:24:57.359009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.781 [2024-11-28 01:24:57.359030] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.781 [2024-11-28 01:24:57.359210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.781 [2024-11-28 01:24:57.359382] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.781 [2024-11-28 01:24:57.359402] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.781 [2024-11-28 01:24:57.359414] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.781 [2024-11-28 01:24:57.361384] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:42.781 [2024-11-28 01:24:57.370676] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:42.781 [2024-11-28 01:24:57.371057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-28 01:24:57.371215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-28 01:24:57.371241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:42.781 [2024-11-28 01:24:57.371257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:42.781 [2024-11-28 01:24:57.371405] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:42.781 [2024-11-28 01:24:57.371625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:42.781 [2024-11-28 01:24:57.371647] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:42.781 [2024-11-28 01:24:57.371660] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:42.781 [2024-11-28 01:24:57.373595] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.041 [2024-11-28 01:24:57.382976] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.041 [2024-11-28 01:24:57.383366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.041 [2024-11-28 01:24:57.383520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.041 [2024-11-28 01:24:57.383555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.041 [2024-11-28 01:24:57.383571] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.041 [2024-11-28 01:24:57.383750] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.041 [2024-11-28 01:24:57.383924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.041 [2024-11-28 01:24:57.383943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.041 [2024-11-28 01:24:57.383956] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.041 [2024-11-28 01:24:57.386128] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.041 [2024-11-28 01:24:57.395117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.041 [2024-11-28 01:24:57.395446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.041 [2024-11-28 01:24:57.395604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.041 [2024-11-28 01:24:57.395631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.041 [2024-11-28 01:24:57.395647] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.041 [2024-11-28 01:24:57.395831] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.041 [2024-11-28 01:24:57.395959] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.041 [2024-11-28 01:24:57.395978] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.041 [2024-11-28 01:24:57.395991] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.041 [2024-11-28 01:24:57.397953] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.041 [2024-11-28 01:24:57.407156] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.041 [2024-11-28 01:24:57.407410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.041 [2024-11-28 01:24:57.407553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.041 [2024-11-28 01:24:57.407580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.041 [2024-11-28 01:24:57.407595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.041 [2024-11-28 01:24:57.407774] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.041 [2024-11-28 01:24:57.407932] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.041 [2024-11-28 01:24:57.407951] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.041 [2024-11-28 01:24:57.407964] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.041 [2024-11-28 01:24:57.409912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.041 [2024-11-28 01:24:57.419469] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.041 [2024-11-28 01:24:57.419770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.041 [2024-11-28 01:24:57.419929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.041 [2024-11-28 01:24:57.419955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.041 [2024-11-28 01:24:57.419971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.041 [2024-11-28 01:24:57.420167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.041 [2024-11-28 01:24:57.420279] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.041 [2024-11-28 01:24:57.420298] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.041 [2024-11-28 01:24:57.420311] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.041 [2024-11-28 01:24:57.422363] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.041 [2024-11-28 01:24:57.431612] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.041 [2024-11-28 01:24:57.432126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.041 [2024-11-28 01:24:57.432272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.042 [2024-11-28 01:24:57.432298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.042 [2024-11-28 01:24:57.432313] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.042 [2024-11-28 01:24:57.432509] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.042 [2024-11-28 01:24:57.432654] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.042 [2024-11-28 01:24:57.432673] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.042 [2024-11-28 01:24:57.432686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.042 [2024-11-28 01:24:57.434674] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.042 [2024-11-28 01:24:57.443623] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.042 [2024-11-28 01:24:57.443960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.042 [2024-11-28 01:24:57.444117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.042 [2024-11-28 01:24:57.444142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.042 [2024-11-28 01:24:57.444158] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.042 [2024-11-28 01:24:57.444321] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.042 [2024-11-28 01:24:57.444508] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.042 [2024-11-28 01:24:57.444550] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.042 [2024-11-28 01:24:57.444566] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.042 [2024-11-28 01:24:57.446518] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.042 [2024-11-28 01:24:57.455874] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.042 [2024-11-28 01:24:57.456200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.042 [2024-11-28 01:24:57.456357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.042 [2024-11-28 01:24:57.456383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.042 [2024-11-28 01:24:57.456398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.042 [2024-11-28 01:24:57.456604] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.042 [2024-11-28 01:24:57.456765] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.042 [2024-11-28 01:24:57.456784] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.042 [2024-11-28 01:24:57.456797] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.042 [2024-11-28 01:24:57.458804] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.042 [2024-11-28 01:24:57.468008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.042 [2024-11-28 01:24:57.468336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.042 [2024-11-28 01:24:57.468457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.042 [2024-11-28 01:24:57.468482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.042 [2024-11-28 01:24:57.468498] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.042 [2024-11-28 01:24:57.468641] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.042 [2024-11-28 01:24:57.468789] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.042 [2024-11-28 01:24:57.468824] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.042 [2024-11-28 01:24:57.468841] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.042 [2024-11-28 01:24:57.470807] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.042 [2024-11-28 01:24:57.480181] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.042 [2024-11-28 01:24:57.480584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.042 [2024-11-28 01:24:57.480721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.042 [2024-11-28 01:24:57.480747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.042 [2024-11-28 01:24:57.480763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.042 [2024-11-28 01:24:57.480895] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.042 [2024-11-28 01:24:57.481116] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.042 [2024-11-28 01:24:57.481136] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.042 [2024-11-28 01:24:57.481148] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.042 [2024-11-28 01:24:57.482851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.042 [2024-11-28 01:24:57.492266] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.042 [2024-11-28 01:24:57.492595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.042 [2024-11-28 01:24:57.492716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.042 [2024-11-28 01:24:57.492742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.042 [2024-11-28 01:24:57.492758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.042 [2024-11-28 01:24:57.492888] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.042 [2024-11-28 01:24:57.493045] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.042 [2024-11-28 01:24:57.493065] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.042 [2024-11-28 01:24:57.493078] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.042 [2024-11-28 01:24:57.495058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.042 [2024-11-28 01:24:57.504850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.042 [2024-11-28 01:24:57.505173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.042 [2024-11-28 01:24:57.505333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.042 [2024-11-28 01:24:57.505358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.042 [2024-11-28 01:24:57.505374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.042 [2024-11-28 01:24:57.505490] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.042 [2024-11-28 01:24:57.505689] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.042 [2024-11-28 01:24:57.505714] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.042 [2024-11-28 01:24:57.505737] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.042 [2024-11-28 01:24:57.507923] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.042 [2024-11-28 01:24:57.517513] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.042 [2024-11-28 01:24:57.517811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.042 [2024-11-28 01:24:57.517993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.042 [2024-11-28 01:24:57.518046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.042 [2024-11-28 01:24:57.518064] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.042 [2024-11-28 01:24:57.518192] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.042 [2024-11-28 01:24:57.518397] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.042 [2024-11-28 01:24:57.518421] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.042 [2024-11-28 01:24:57.518436] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.042 [2024-11-28 01:24:57.520556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.042 [2024-11-28 01:24:57.530171] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.042 [2024-11-28 01:24:57.530515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.042 [2024-11-28 01:24:57.530705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.042 [2024-11-28 01:24:57.530731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.042 [2024-11-28 01:24:57.530747] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.042 [2024-11-28 01:24:57.530939] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.042 [2024-11-28 01:24:57.531116] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.042 [2024-11-28 01:24:57.531140] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.042 [2024-11-28 01:24:57.531155] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.042 [2024-11-28 01:24:57.533637] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.042 [2024-11-28 01:24:57.542662] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.042 [2024-11-28 01:24:57.542948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.042 [2024-11-28 01:24:57.543097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.042 [2024-11-28 01:24:57.543126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.042 [2024-11-28 01:24:57.543143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.042 [2024-11-28 01:24:57.543290] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.042 [2024-11-28 01:24:57.543440] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.043 [2024-11-28 01:24:57.543463] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.043 [2024-11-28 01:24:57.543479] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.043 [2024-11-28 01:24:57.545689] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.043 [2024-11-28 01:24:57.555342] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.043 [2024-11-28 01:24:57.555712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.043 [2024-11-28 01:24:57.555830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.043 [2024-11-28 01:24:57.555855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.043 [2024-11-28 01:24:57.555871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.043 [2024-11-28 01:24:57.556033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.043 [2024-11-28 01:24:57.556259] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.043 [2024-11-28 01:24:57.556283] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.043 [2024-11-28 01:24:57.556299] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.043 [2024-11-28 01:24:57.558580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.043 [2024-11-28 01:24:57.567878] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.043 [2024-11-28 01:24:57.568165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.043 [2024-11-28 01:24:57.568321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.043 [2024-11-28 01:24:57.568347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.043 [2024-11-28 01:24:57.568362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.043 [2024-11-28 01:24:57.568461] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.043 [2024-11-28 01:24:57.568603] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.043 [2024-11-28 01:24:57.568640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.043 [2024-11-28 01:24:57.568656] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.043 [2024-11-28 01:24:57.570938] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.043 [2024-11-28 01:24:57.580676] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.043 [2024-11-28 01:24:57.581021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.043 [2024-11-28 01:24:57.581218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.043 [2024-11-28 01:24:57.581263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.043 [2024-11-28 01:24:57.581281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.043 [2024-11-28 01:24:57.581445] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.043 [2024-11-28 01:24:57.581626] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.043 [2024-11-28 01:24:57.581652] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.043 [2024-11-28 01:24:57.581667] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.043 [2024-11-28 01:24:57.583902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.043 [2024-11-28 01:24:57.593047] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.043 [2024-11-28 01:24:57.593408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.043 [2024-11-28 01:24:57.593548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.043 [2024-11-28 01:24:57.593575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.043 [2024-11-28 01:24:57.593591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.043 [2024-11-28 01:24:57.593754] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.043 [2024-11-28 01:24:57.593905] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.043 [2024-11-28 01:24:57.593928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.043 [2024-11-28 01:24:57.593944] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.043 [2024-11-28 01:24:57.596275] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.043 [2024-11-28 01:24:57.605572] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.043 [2024-11-28 01:24:57.605938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.043 [2024-11-28 01:24:57.606089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.043 [2024-11-28 01:24:57.606118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.043 [2024-11-28 01:24:57.606136] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.043 [2024-11-28 01:24:57.606282] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.043 [2024-11-28 01:24:57.606451] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.043 [2024-11-28 01:24:57.606474] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.043 [2024-11-28 01:24:57.606490] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.043 [2024-11-28 01:24:57.609002] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.043 [2024-11-28 01:24:57.618260] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.043 [2024-11-28 01:24:57.618597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.043 [2024-11-28 01:24:57.618736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.043 [2024-11-28 01:24:57.618762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.043 [2024-11-28 01:24:57.618778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.043 [2024-11-28 01:24:57.618951] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.043 [2024-11-28 01:24:57.619085] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.043 [2024-11-28 01:24:57.619108] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.043 [2024-11-28 01:24:57.619124] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.043 [2024-11-28 01:24:57.621451] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.043 [2024-11-28 01:24:57.630885] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.043 [2024-11-28 01:24:57.631189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.043 [2024-11-28 01:24:57.631340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.043 [2024-11-28 01:24:57.631370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.043 [2024-11-28 01:24:57.631387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.043 [2024-11-28 01:24:57.631562] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.043 [2024-11-28 01:24:57.631756] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.043 [2024-11-28 01:24:57.631780] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.043 [2024-11-28 01:24:57.631796] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.043 [2024-11-28 01:24:57.634050] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.304 [2024-11-28 01:24:57.643289] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.304 [2024-11-28 01:24:57.643619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.304 [2024-11-28 01:24:57.643778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.304 [2024-11-28 01:24:57.643804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.304 [2024-11-28 01:24:57.643820] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.304 [2024-11-28 01:24:57.643919] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.304 [2024-11-28 01:24:57.644064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.304 [2024-11-28 01:24:57.644103] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.304 [2024-11-28 01:24:57.644118] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.304 [2024-11-28 01:24:57.646446] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.304 [2024-11-28 01:24:57.655951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.304 [2024-11-28 01:24:57.656310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.304 [2024-11-28 01:24:57.656434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.304 [2024-11-28 01:24:57.656460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.304 [2024-11-28 01:24:57.656475] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.304 [2024-11-28 01:24:57.656642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.304 [2024-11-28 01:24:57.656795] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.304 [2024-11-28 01:24:57.656818] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.304 [2024-11-28 01:24:57.656833] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.304 [2024-11-28 01:24:57.659069] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.304 [2024-11-28 01:24:57.668566] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.304 [2024-11-28 01:24:57.668904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.304 [2024-11-28 01:24:57.669023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.304 [2024-11-28 01:24:57.669051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.304 [2024-11-28 01:24:57.669074] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.304 [2024-11-28 01:24:57.669276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.304 [2024-11-28 01:24:57.669445] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.304 [2024-11-28 01:24:57.669469] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.304 [2024-11-28 01:24:57.669485] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.304 [2024-11-28 01:24:57.671857] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.304 [2024-11-28 01:24:57.681185] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.304 [2024-11-28 01:24:57.681547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.304 [2024-11-28 01:24:57.681703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.304 [2024-11-28 01:24:57.681728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.304 [2024-11-28 01:24:57.681744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.304 [2024-11-28 01:24:57.681924] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.304 [2024-11-28 01:24:57.682090] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.304 [2024-11-28 01:24:57.682113] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.304 [2024-11-28 01:24:57.682129] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.304 [2024-11-28 01:24:57.684536] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.304 [2024-11-28 01:24:57.693585] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.304 [2024-11-28 01:24:57.693902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.304 [2024-11-28 01:24:57.694043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.304 [2024-11-28 01:24:57.694068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.304 [2024-11-28 01:24:57.694084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.304 [2024-11-28 01:24:57.694274] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.304 [2024-11-28 01:24:57.694443] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.304 [2024-11-28 01:24:57.694466] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.304 [2024-11-28 01:24:57.694481] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.304 [2024-11-28 01:24:57.696890] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.304 [2024-11-28 01:24:57.706208] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.304 [2024-11-28 01:24:57.706472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.304 [2024-11-28 01:24:57.706627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.304 [2024-11-28 01:24:57.706654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.304 [2024-11-28 01:24:57.706670] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.304 [2024-11-28 01:24:57.706822] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.304 [2024-11-28 01:24:57.706997] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.304 [2024-11-28 01:24:57.707021] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.304 [2024-11-28 01:24:57.707036] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.304 [2024-11-28 01:24:57.709378] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.304 [2024-11-28 01:24:57.718786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.304 [2024-11-28 01:24:57.719150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.304 [2024-11-28 01:24:57.719310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.304 [2024-11-28 01:24:57.719336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.304 [2024-11-28 01:24:57.719352] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.304 [2024-11-28 01:24:57.719512] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.304 [2024-11-28 01:24:57.719705] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.304 [2024-11-28 01:24:57.719729] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.304 [2024-11-28 01:24:57.719744] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.304 [2024-11-28 01:24:57.722194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.304 [2024-11-28 01:24:57.731412] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.304 [2024-11-28 01:24:57.731727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.305 [2024-11-28 01:24:57.731836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.305 [2024-11-28 01:24:57.731862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.305 [2024-11-28 01:24:57.731878] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.305 [2024-11-28 01:24:57.732039] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.305 [2024-11-28 01:24:57.732239] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.305 [2024-11-28 01:24:57.732263] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.305 [2024-11-28 01:24:57.732279] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.305 [2024-11-28 01:24:57.734654] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.305 [2024-11-28 01:24:57.743923] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.305 [2024-11-28 01:24:57.744214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.305 [2024-11-28 01:24:57.744346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.305 [2024-11-28 01:24:57.744374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.305 [2024-11-28 01:24:57.744391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.305 [2024-11-28 01:24:57.744586] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.305 [2024-11-28 01:24:57.744744] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.305 [2024-11-28 01:24:57.744767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.305 [2024-11-28 01:24:57.744783] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.305 [2024-11-28 01:24:57.747485] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.305 [2024-11-28 01:24:57.756438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.305 [2024-11-28 01:24:57.756743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.305 [2024-11-28 01:24:57.756893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.305 [2024-11-28 01:24:57.756922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.305 [2024-11-28 01:24:57.756939] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.305 [2024-11-28 01:24:57.757104] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.305 [2024-11-28 01:24:57.757273] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.305 [2024-11-28 01:24:57.757297] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.305 [2024-11-28 01:24:57.757312] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.305 [2024-11-28 01:24:57.759683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.305 [2024-11-28 01:24:57.768884] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.305 [2024-11-28 01:24:57.769234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.305 [2024-11-28 01:24:57.769385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.305 [2024-11-28 01:24:57.769415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.305 [2024-11-28 01:24:57.769433] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.305 [2024-11-28 01:24:57.769646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.305 [2024-11-28 01:24:57.769834] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.305 [2024-11-28 01:24:57.769858] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.305 [2024-11-28 01:24:57.769874] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.305 [2024-11-28 01:24:57.772094] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.305 [2024-11-28 01:24:57.781532] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.305 [2024-11-28 01:24:57.781878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.305 [2024-11-28 01:24:57.782012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.305 [2024-11-28 01:24:57.782040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.305 [2024-11-28 01:24:57.782058] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.305 [2024-11-28 01:24:57.782240] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.305 [2024-11-28 01:24:57.782409] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.305 [2024-11-28 01:24:57.782438] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.305 [2024-11-28 01:24:57.782455] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.305 [2024-11-28 01:24:57.784797] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.305 [2024-11-28 01:24:57.794210] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.305 [2024-11-28 01:24:57.794550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.305 [2024-11-28 01:24:57.794746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.305 [2024-11-28 01:24:57.794772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.305 [2024-11-28 01:24:57.794793] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.305 [2024-11-28 01:24:57.794991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.305 [2024-11-28 01:24:57.795179] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.305 [2024-11-28 01:24:57.795202] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.305 [2024-11-28 01:24:57.795217] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.305 [2024-11-28 01:24:57.797515] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.305 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 2164505 Killed "${NVMF_APP[@]}" "$@" 00:30:43.305 01:24:57 -- host/bdevperf.sh@36 -- # tgt_init 00:30:43.305 01:24:57 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:43.305 01:24:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:43.305 01:24:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:43.305 01:24:57 -- common/autotest_common.sh@10 -- # set +x 00:30:43.305 [2024-11-28 01:24:57.806866] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.305 [2024-11-28 01:24:57.807169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.305 [2024-11-28 01:24:57.807337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.305 [2024-11-28 01:24:57.807366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.305 [2024-11-28 01:24:57.807384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.305 [2024-11-28 01:24:57.807576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.305 [2024-11-28 01:24:57.807729] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.305 [2024-11-28 01:24:57.807752] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.305 [2024-11-28 01:24:57.807768] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.305 [2024-11-28 01:24:57.810076] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.305 01:24:57 -- nvmf/common.sh@469 -- # nvmfpid=2165537 00:30:43.305 01:24:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:43.305 01:24:57 -- nvmf/common.sh@470 -- # waitforlisten 2165537 00:30:43.305 01:24:57 -- common/autotest_common.sh@829 -- # '[' -z 2165537 ']' 00:30:43.305 01:24:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:43.305 01:24:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:43.305 01:24:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:43.305 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:43.305 01:24:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:43.305 01:24:57 -- common/autotest_common.sh@10 -- # set +x 00:30:43.305 [2024-11-28 01:24:57.819354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.305 [2024-11-28 01:24:57.819655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.305 [2024-11-28 01:24:57.819816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.305 [2024-11-28 01:24:57.819842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.305 [2024-11-28 01:24:57.819857] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.305 [2024-11-28 01:24:57.820020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.305 [2024-11-28 01:24:57.820201] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.305 [2024-11-28 01:24:57.820225] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.305 [2024-11-28 01:24:57.820240] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.305 [2024-11-28 01:24:57.822367] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.305 [2024-11-28 01:24:57.831773] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.305 [2024-11-28 01:24:57.832050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.305 [2024-11-28 01:24:57.832183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.306 [2024-11-28 01:24:57.832211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.306 [2024-11-28 01:24:57.832227] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.306 [2024-11-28 01:24:57.832380] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.306 [2024-11-28 01:24:57.832521] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.306 [2024-11-28 01:24:57.832554] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.306 [2024-11-28 01:24:57.832583] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.306 [2024-11-28 01:24:57.834443] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.306 [2024-11-28 01:24:57.844040] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.306 [2024-11-28 01:24:57.844345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.306 [2024-11-28 01:24:57.844463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.306 [2024-11-28 01:24:57.844489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.306 [2024-11-28 01:24:57.844505] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.306 [2024-11-28 01:24:57.844660] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.306 [2024-11-28 01:24:57.844764] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.306 [2024-11-28 01:24:57.844786] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.306 [2024-11-28 01:24:57.844801] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.306 [2024-11-28 01:24:57.847005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.306 [2024-11-28 01:24:57.856095] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:43.306 [2024-11-28 01:24:57.856159] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:43.306 [2024-11-28 01:24:57.856677] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.306 [2024-11-28 01:24:57.856999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.306 [2024-11-28 01:24:57.857137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.306 [2024-11-28 01:24:57.857163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.306 [2024-11-28 01:24:57.857179] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.306 [2024-11-28 01:24:57.857310] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.306 [2024-11-28 01:24:57.857492] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.306 [2024-11-28 01:24:57.857513] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.306 [2024-11-28 01:24:57.857550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.306 [2024-11-28 01:24:57.859712] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.306 [2024-11-28 01:24:57.868927] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.306 [2024-11-28 01:24:57.869241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.306 [2024-11-28 01:24:57.869372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.306 [2024-11-28 01:24:57.869398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.306 [2024-11-28 01:24:57.869414] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.306 [2024-11-28 01:24:57.869570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.306 [2024-11-28 01:24:57.869724] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.306 [2024-11-28 01:24:57.869745] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.306 [2024-11-28 01:24:57.869759] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.306 [2024-11-28 01:24:57.871824] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.306 [2024-11-28 01:24:57.881036] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.306 [2024-11-28 01:24:57.881406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.306 [2024-11-28 01:24:57.881569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.306 [2024-11-28 01:24:57.881596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.306 [2024-11-28 01:24:57.881613] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.306 [2024-11-28 01:24:57.881761] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.306 [2024-11-28 01:24:57.881921] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.306 [2024-11-28 01:24:57.881940] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.306 [2024-11-28 01:24:57.881958] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.306 [2024-11-28 01:24:57.883902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.306 [2024-11-28 01:24:57.893154] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.306 [2024-11-28 01:24:57.893419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.306 [2024-11-28 01:24:57.893567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.306 [2024-11-28 01:24:57.893594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.306 [2024-11-28 01:24:57.893610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.306 EAL: No free 2048 kB hugepages reported on node 1 00:30:43.306 [2024-11-28 01:24:57.893774] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.306 [2024-11-28 01:24:57.893964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.306 [2024-11-28 01:24:57.893983] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.306 [2024-11-28 01:24:57.893996] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.306 [2024-11-28 01:24:57.895871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.567 [2024-11-28 01:24:57.905778] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.567 [2024-11-28 01:24:57.906187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-28 01:24:57.906333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-28 01:24:57.906361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.567 [2024-11-28 01:24:57.906379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.567 [2024-11-28 01:24:57.906535] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.567 [2024-11-28 01:24:57.906702] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.567 [2024-11-28 01:24:57.906723] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.567 [2024-11-28 01:24:57.906736] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.567 [2024-11-28 01:24:57.908986] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.567 [2024-11-28 01:24:57.918207] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.567 [2024-11-28 01:24:57.918556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-28 01:24:57.918708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-28 01:24:57.918734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.567 [2024-11-28 01:24:57.918750] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.567 [2024-11-28 01:24:57.918930] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.567 [2024-11-28 01:24:57.919132] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.567 [2024-11-28 01:24:57.919156] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.567 [2024-11-28 01:24:57.919171] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.567 [2024-11-28 01:24:57.921753] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.567 [2024-11-28 01:24:57.928898] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:43.567 [2024-11-28 01:24:57.930787] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.567 [2024-11-28 01:24:57.931081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-28 01:24:57.931230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-28 01:24:57.931259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.567 [2024-11-28 01:24:57.931277] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.567 [2024-11-28 01:24:57.931478] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.567 [2024-11-28 01:24:57.931631] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.567 [2024-11-28 01:24:57.931652] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.567 [2024-11-28 01:24:57.931666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.567 [2024-11-28 01:24:57.933749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.567 [2024-11-28 01:24:57.943368] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.567 [2024-11-28 01:24:57.943890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-28 01:24:57.944015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-28 01:24:57.944042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.567 [2024-11-28 01:24:57.944064] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.567 [2024-11-28 01:24:57.944247] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.567 [2024-11-28 01:24:57.944423] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.567 [2024-11-28 01:24:57.944448] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.567 [2024-11-28 01:24:57.944467] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.567 [2024-11-28 01:24:57.946860] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.567 [2024-11-28 01:24:57.956072] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.567 [2024-11-28 01:24:57.956445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-28 01:24:57.956581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-28 01:24:57.956609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.567 [2024-11-28 01:24:57.956625] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.567 [2024-11-28 01:24:57.956742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.567 [2024-11-28 01:24:57.956933] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.567 [2024-11-28 01:24:57.956958] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.567 [2024-11-28 01:24:57.956974] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.567 [2024-11-28 01:24:57.959273] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.567 [2024-11-28 01:24:57.968860] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.567 [2024-11-28 01:24:57.969239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-28 01:24:57.969414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-28 01:24:57.969443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.567 [2024-11-28 01:24:57.969462] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.567 [2024-11-28 01:24:57.969641] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.567 [2024-11-28 01:24:57.969833] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.567 [2024-11-28 01:24:57.969868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.567 [2024-11-28 01:24:57.969885] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.567 [2024-11-28 01:24:57.972143] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.567 [2024-11-28 01:24:57.981255] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.567 [2024-11-28 01:24:57.981728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-28 01:24:57.981862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.567 [2024-11-28 01:24:57.981890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.567 [2024-11-28 01:24:57.981909] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.567 [2024-11-28 01:24:57.982082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.567 [2024-11-28 01:24:57.982250] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.568 [2024-11-28 01:24:57.982275] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.568 [2024-11-28 01:24:57.982296] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.568 [2024-11-28 01:24:57.984625] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.568 [2024-11-28 01:24:57.993767] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.568 [2024-11-28 01:24:57.994132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-28 01:24:57.994302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-28 01:24:57.994332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.568 [2024-11-28 01:24:57.994352] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.568 [2024-11-28 01:24:57.994523] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.568 [2024-11-28 01:24:57.994735] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.568 [2024-11-28 01:24:57.994758] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.568 [2024-11-28 01:24:57.994775] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.568 [2024-11-28 01:24:57.997036] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.568 [2024-11-28 01:24:58.006367] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.568 [2024-11-28 01:24:58.006707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-28 01:24:58.006867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-28 01:24:58.006896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.568 [2024-11-28 01:24:58.006914] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.568 [2024-11-28 01:24:58.007027] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.568 [2024-11-28 01:24:58.007215] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.568 [2024-11-28 01:24:58.007239] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.568 [2024-11-28 01:24:58.007255] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.568 [2024-11-28 01:24:58.009577] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.568 [2024-11-28 01:24:58.018860] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.568 [2024-11-28 01:24:58.019175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-28 01:24:58.019345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-28 01:24:58.019349] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:43.568 [2024-11-28 01:24:58.019371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.568 [2024-11-28 01:24:58.019389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.568 [2024-11-28 01:24:58.019469] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:43.568 [2024-11-28 01:24:58.019486] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:43.568 [2024-11-28 01:24:58.019498] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:43.568 [2024-11-28 01:24:58.019551] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.568 [2024-11-28 01:24:58.019562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:43.568 [2024-11-28 01:24:58.019656] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.568 [2024-11-28 01:24:58.019677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.568 [2024-11-28 01:24:58.019690] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.568 [2024-11-28 01:24:58.019661] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:43.568 [2024-11-28 01:24:58.019665] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:43.568 [2024-11-28 01:24:58.021772] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.568 [2024-11-28 01:24:58.031418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.568 [2024-11-28 01:24:58.031893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-28 01:24:58.032027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-28 01:24:58.032054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.568 [2024-11-28 01:24:58.032075] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.568 [2024-11-28 01:24:58.032235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.568 [2024-11-28 01:24:58.032432] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.568 [2024-11-28 01:24:58.032455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.568 [2024-11-28 01:24:58.032473] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.568 [2024-11-28 01:24:58.034557] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.568 [2024-11-28 01:24:58.043738] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.568 [2024-11-28 01:24:58.044125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-28 01:24:58.044280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-28 01:24:58.044307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.568 [2024-11-28 01:24:58.044330] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.568 [2024-11-28 01:24:58.044507] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.568 [2024-11-28 01:24:58.044686] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.568 [2024-11-28 01:24:58.044709] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.568 [2024-11-28 01:24:58.044727] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.568 [2024-11-28 01:24:58.046759] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.568 [2024-11-28 01:24:58.056198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.568 [2024-11-28 01:24:58.056629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-28 01:24:58.056786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-28 01:24:58.056813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.568 [2024-11-28 01:24:58.056835] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.568 [2024-11-28 01:24:58.057010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.568 [2024-11-28 01:24:58.057149] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.568 [2024-11-28 01:24:58.057170] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.568 [2024-11-28 01:24:58.057189] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.568 [2024-11-28 01:24:58.059178] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.568 [2024-11-28 01:24:58.068479] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.568 [2024-11-28 01:24:58.068960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-28 01:24:58.069114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-28 01:24:58.069141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.568 [2024-11-28 01:24:58.069162] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.568 [2024-11-28 01:24:58.069323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.568 [2024-11-28 01:24:58.069537] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.568 [2024-11-28 01:24:58.069569] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.568 [2024-11-28 01:24:58.069587] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.568 [2024-11-28 01:24:58.071615] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.568 [2024-11-28 01:24:58.080728] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.568 [2024-11-28 01:24:58.081067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-28 01:24:58.081203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-28 01:24:58.081229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.568 [2024-11-28 01:24:58.081248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.568 [2024-11-28 01:24:58.081405] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.568 [2024-11-28 01:24:58.081565] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.568 [2024-11-28 01:24:58.081588] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.568 [2024-11-28 01:24:58.081606] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.568 [2024-11-28 01:24:58.083517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.568 [2024-11-28 01:24:58.093104] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.568 [2024-11-28 01:24:58.093561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-28 01:24:58.093679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.568 [2024-11-28 01:24:58.093706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.569 [2024-11-28 01:24:58.093727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.569 [2024-11-28 01:24:58.093870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.569 [2024-11-28 01:24:58.094044] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.569 [2024-11-28 01:24:58.094065] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.569 [2024-11-28 01:24:58.094083] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.569 [2024-11-28 01:24:58.096003] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.569 [2024-11-28 01:24:58.105326] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.569 [2024-11-28 01:24:58.105674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-28 01:24:58.105801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-28 01:24:58.105827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.569 [2024-11-28 01:24:58.105844] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.569 [2024-11-28 01:24:58.105993] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.569 [2024-11-28 01:24:58.106112] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.569 [2024-11-28 01:24:58.106134] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.569 [2024-11-28 01:24:58.106160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.569 [2024-11-28 01:24:58.108319] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.569 [2024-11-28 01:24:58.117617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.569 [2024-11-28 01:24:58.117920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-28 01:24:58.118036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-28 01:24:58.118063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.569 [2024-11-28 01:24:58.118079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.569 [2024-11-28 01:24:58.118211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.569 [2024-11-28 01:24:58.118377] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.569 [2024-11-28 01:24:58.118397] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.569 [2024-11-28 01:24:58.118411] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.569 [2024-11-28 01:24:58.120400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.569 [2024-11-28 01:24:58.129877] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.569 [2024-11-28 01:24:58.130170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-28 01:24:58.130302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-28 01:24:58.130328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.569 [2024-11-28 01:24:58.130343] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.569 [2024-11-28 01:24:58.130491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.569 [2024-11-28 01:24:58.130797] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.569 [2024-11-28 01:24:58.130821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.569 [2024-11-28 01:24:58.130836] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.569 [2024-11-28 01:24:58.132909] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.569 [2024-11-28 01:24:58.142203] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.569 [2024-11-28 01:24:58.142540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-28 01:24:58.142707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-28 01:24:58.142733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.569 [2024-11-28 01:24:58.142749] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.569 [2024-11-28 01:24:58.142914] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.569 [2024-11-28 01:24:58.143063] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.569 [2024-11-28 01:24:58.143084] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.569 [2024-11-28 01:24:58.143098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.569 [2024-11-28 01:24:58.145193] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.569 [2024-11-28 01:24:58.154398] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.569 [2024-11-28 01:24:58.154671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-28 01:24:58.154810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-28 01:24:58.154837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.569 [2024-11-28 01:24:58.154853] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.569 [2024-11-28 01:24:58.154952] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.569 [2024-11-28 01:24:58.155151] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.569 [2024-11-28 01:24:58.155172] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.569 [2024-11-28 01:24:58.155185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.569 [2024-11-28 01:24:58.157222] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.569 [2024-11-28 01:24:58.166927] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.569 [2024-11-28 01:24:58.167167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.569 [2024-11-28 01:24:58.167271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.830 [2024-11-28 01:24:58.167296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.830 [2024-11-28 01:24:58.167312] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.830 [2024-11-28 01:24:58.167412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.830 [2024-11-28 01:24:58.167573] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.830 [2024-11-28 01:24:58.167595] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.830 [2024-11-28 01:24:58.167609] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.830 [2024-11-28 01:24:58.169657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.830 [2024-11-28 01:24:58.179238] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.830 [2024-11-28 01:24:58.179538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.830 [2024-11-28 01:24:58.179669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.830 [2024-11-28 01:24:58.179694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.830 [2024-11-28 01:24:58.179710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.830 [2024-11-28 01:24:58.179874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.830 [2024-11-28 01:24:58.180054] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.830 [2024-11-28 01:24:58.180074] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.830 [2024-11-28 01:24:58.180089] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.830 [2024-11-28 01:24:58.182243] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.830 [2024-11-28 01:24:58.191482] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.830 [2024-11-28 01:24:58.191825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.830 [2024-11-28 01:24:58.191959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.830 [2024-11-28 01:24:58.191984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.830 [2024-11-28 01:24:58.192000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.830 [2024-11-28 01:24:58.192132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.830 [2024-11-28 01:24:58.192297] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.830 [2024-11-28 01:24:58.192318] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.830 [2024-11-28 01:24:58.192332] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.830 [2024-11-28 01:24:58.194267] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.830 [2024-11-28 01:24:58.203745] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.830 [2024-11-28 01:24:58.204075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.830 [2024-11-28 01:24:58.204215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.830 [2024-11-28 01:24:58.204243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.830 [2024-11-28 01:24:58.204258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.830 [2024-11-28 01:24:58.204390] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.830 [2024-11-28 01:24:58.204594] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.830 [2024-11-28 01:24:58.204616] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.830 [2024-11-28 01:24:58.204630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.830 [2024-11-28 01:24:58.206694] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.830 [2024-11-28 01:24:58.215922] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.830 [2024-11-28 01:24:58.216200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.830 [2024-11-28 01:24:58.216358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.830 [2024-11-28 01:24:58.216383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.830 [2024-11-28 01:24:58.216399] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.830 [2024-11-28 01:24:58.216539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.830 [2024-11-28 01:24:58.216721] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.830 [2024-11-28 01:24:58.216742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.830 [2024-11-28 01:24:58.216755] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.830 [2024-11-28 01:24:58.218612] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.830 [2024-11-28 01:24:58.228327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.830 [2024-11-28 01:24:58.228588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.830 [2024-11-28 01:24:58.228699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.830 [2024-11-28 01:24:58.228725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.830 [2024-11-28 01:24:58.228741] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.830 [2024-11-28 01:24:58.228889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.830 [2024-11-28 01:24:58.229023] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.830 [2024-11-28 01:24:58.229043] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.830 [2024-11-28 01:24:58.229056] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.830 [2024-11-28 01:24:58.230915] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.830 [2024-11-28 01:24:58.240773] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.830 [2024-11-28 01:24:58.241038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.830 [2024-11-28 01:24:58.241143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.830 [2024-11-28 01:24:58.241169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.830 [2024-11-28 01:24:58.241185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.830 [2024-11-28 01:24:58.241317] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.830 [2024-11-28 01:24:58.241483] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.830 [2024-11-28 01:24:58.241504] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.830 [2024-11-28 01:24:58.241517] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.830 [2024-11-28 01:24:58.243458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.830 [2024-11-28 01:24:58.253003] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.830 [2024-11-28 01:24:58.253311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.830 [2024-11-28 01:24:58.253471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.830 [2024-11-28 01:24:58.253497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.830 [2024-11-28 01:24:58.253513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.830 [2024-11-28 01:24:58.253637] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.830 [2024-11-28 01:24:58.253806] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.830 [2024-11-28 01:24:58.253828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.830 [2024-11-28 01:24:58.253841] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.830 [2024-11-28 01:24:58.255941] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.830 [2024-11-28 01:24:58.265481] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.830 [2024-11-28 01:24:58.265832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.830 [2024-11-28 01:24:58.265962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.830 [2024-11-28 01:24:58.265995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.831 [2024-11-28 01:24:58.266012] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.831 [2024-11-28 01:24:58.266095] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.831 [2024-11-28 01:24:58.266261] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.831 [2024-11-28 01:24:58.266282] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.831 [2024-11-28 01:24:58.266295] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.831 [2024-11-28 01:24:58.268316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.831 [2024-11-28 01:24:58.277523] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.831 [2024-11-28 01:24:58.277828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.831 [2024-11-28 01:24:58.277960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.831 [2024-11-28 01:24:58.277987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.831 [2024-11-28 01:24:58.278003] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.831 [2024-11-28 01:24:58.278151] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.831 [2024-11-28 01:24:58.278299] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.831 [2024-11-28 01:24:58.278321] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.831 [2024-11-28 01:24:58.278334] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.831 [2024-11-28 01:24:58.280427] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.831 [2024-11-28 01:24:58.289723] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.831 [2024-11-28 01:24:58.290039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.831 [2024-11-28 01:24:58.290168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.831 [2024-11-28 01:24:58.290194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.831 [2024-11-28 01:24:58.290210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.831 [2024-11-28 01:24:58.290358] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.831 [2024-11-28 01:24:58.290492] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.831 [2024-11-28 01:24:58.290513] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.831 [2024-11-28 01:24:58.290535] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.831 [2024-11-28 01:24:58.292649] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.831 [2024-11-28 01:24:58.302157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.831 [2024-11-28 01:24:58.302411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.831 [2024-11-28 01:24:58.302506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.831 [2024-11-28 01:24:58.302540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.831 [2024-11-28 01:24:58.302562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.831 [2024-11-28 01:24:58.302728] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.831 [2024-11-28 01:24:58.302877] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.831 [2024-11-28 01:24:58.302898] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.831 [2024-11-28 01:24:58.302912] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.831 [2024-11-28 01:24:58.304970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.831 [2024-11-28 01:24:58.314383] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.831 [2024-11-28 01:24:58.314692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.831 [2024-11-28 01:24:58.314804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.831 [2024-11-28 01:24:58.314830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.831 [2024-11-28 01:24:58.314846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.831 [2024-11-28 01:24:58.315010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.831 [2024-11-28 01:24:58.315160] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.831 [2024-11-28 01:24:58.315180] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.831 [2024-11-28 01:24:58.315194] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.831 [2024-11-28 01:24:58.317189] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.831 [2024-11-28 01:24:58.326690] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.831 [2024-11-28 01:24:58.326965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.831 [2024-11-28 01:24:58.327096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.831 [2024-11-28 01:24:58.327122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.831 [2024-11-28 01:24:58.327138] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.831 [2024-11-28 01:24:58.327270] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.831 [2024-11-28 01:24:58.327437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.831 [2024-11-28 01:24:58.327457] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.831 [2024-11-28 01:24:58.327471] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.831 [2024-11-28 01:24:58.329556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.831 [2024-11-28 01:24:58.339114] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.831 [2024-11-28 01:24:58.339396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.831 [2024-11-28 01:24:58.339512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.831 [2024-11-28 01:24:58.339545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.831 [2024-11-28 01:24:58.339561] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.831 [2024-11-28 01:24:58.339731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.831 [2024-11-28 01:24:58.339912] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.831 [2024-11-28 01:24:58.339933] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.831 [2024-11-28 01:24:58.339946] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.831 [2024-11-28 01:24:58.341815] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.831 [2024-11-28 01:24:58.351467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.831 [2024-11-28 01:24:58.351781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.831 [2024-11-28 01:24:58.351881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.831 [2024-11-28 01:24:58.351907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.831 [2024-11-28 01:24:58.351923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.831 [2024-11-28 01:24:58.352038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.831 [2024-11-28 01:24:58.352203] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.831 [2024-11-28 01:24:58.352224] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.831 [2024-11-28 01:24:58.352238] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.831 [2024-11-28 01:24:58.354291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.831 [2024-11-28 01:24:58.363632] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.831 [2024-11-28 01:24:58.363915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.831 [2024-11-28 01:24:58.364038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.831 [2024-11-28 01:24:58.364064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.831 [2024-11-28 01:24:58.364080] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.831 [2024-11-28 01:24:58.364212] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.831 [2024-11-28 01:24:58.364364] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.831 [2024-11-28 01:24:58.364385] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.831 [2024-11-28 01:24:58.364399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.831 [2024-11-28 01:24:58.366545] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.831 [2024-11-28 01:24:58.375982] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.831 [2024-11-28 01:24:58.376298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.831 [2024-11-28 01:24:58.376426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.831 [2024-11-28 01:24:58.376452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.831 [2024-11-28 01:24:58.376468] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.831 [2024-11-28 01:24:58.376594] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.831 [2024-11-28 01:24:58.376768] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.832 [2024-11-28 01:24:58.376790] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.832 [2024-11-28 01:24:58.376804] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.832 [2024-11-28 01:24:58.379088] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.832 [2024-11-28 01:24:58.388310] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.832 [2024-11-28 01:24:58.388610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.832 [2024-11-28 01:24:58.388748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.832 [2024-11-28 01:24:58.388774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.832 [2024-11-28 01:24:58.388790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.832 [2024-11-28 01:24:58.388889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.832 [2024-11-28 01:24:58.389041] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.832 [2024-11-28 01:24:58.389062] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.832 [2024-11-28 01:24:58.389075] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.832 [2024-11-28 01:24:58.391127] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.832 [2024-11-28 01:24:58.400759] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.832 [2024-11-28 01:24:58.401066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.832 [2024-11-28 01:24:58.401189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.832 [2024-11-28 01:24:58.401215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.832 [2024-11-28 01:24:58.401231] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.832 [2024-11-28 01:24:58.401330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.832 [2024-11-28 01:24:58.401465] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.832 [2024-11-28 01:24:58.401486] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.832 [2024-11-28 01:24:58.401499] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.832 [2024-11-28 01:24:58.403585] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.832 [2024-11-28 01:24:58.412795] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.832 [2024-11-28 01:24:58.413082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.832 [2024-11-28 01:24:58.413179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.832 [2024-11-28 01:24:58.413205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.832 [2024-11-28 01:24:58.413221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.832 [2024-11-28 01:24:58.413385] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.832 [2024-11-28 01:24:58.413560] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.832 [2024-11-28 01:24:58.413582] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.832 [2024-11-28 01:24:58.413600] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.832 [2024-11-28 01:24:58.415648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:43.832 [2024-11-28 01:24:58.425096] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:43.832 [2024-11-28 01:24:58.425386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.832 [2024-11-28 01:24:58.425522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.832 [2024-11-28 01:24:58.425555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:43.832 [2024-11-28 01:24:58.425572] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:43.832 [2024-11-28 01:24:58.425736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:43.832 [2024-11-28 01:24:58.425873] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:43.832 [2024-11-28 01:24:58.425894] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:43.832 [2024-11-28 01:24:58.425908] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:43.832 [2024-11-28 01:24:58.427907] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.092 [2024-11-28 01:24:58.437592] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.092 [2024-11-28 01:24:58.437899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.092 [2024-11-28 01:24:58.438054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.092 [2024-11-28 01:24:58.438080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.092 [2024-11-28 01:24:58.438096] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.092 [2024-11-28 01:24:58.438227] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.092 [2024-11-28 01:24:58.438346] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.092 [2024-11-28 01:24:58.438367] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.092 [2024-11-28 01:24:58.438381] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.092 [2024-11-28 01:24:58.440410] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.092 [2024-11-28 01:24:58.449812] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.092 [2024-11-28 01:24:58.450134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.092 [2024-11-28 01:24:58.450260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.092 [2024-11-28 01:24:58.450286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.092 [2024-11-28 01:24:58.450302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.092 [2024-11-28 01:24:58.450433] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.093 [2024-11-28 01:24:58.450599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.093 [2024-11-28 01:24:58.450621] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.093 [2024-11-28 01:24:58.450634] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.093 [2024-11-28 01:24:58.452563] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.093 [2024-11-28 01:24:58.462195] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.093 [2024-11-28 01:24:58.462467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.093 [2024-11-28 01:24:58.462566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.093 [2024-11-28 01:24:58.462593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.093 [2024-11-28 01:24:58.462609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.093 [2024-11-28 01:24:58.462773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.093 [2024-11-28 01:24:58.462955] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.093 [2024-11-28 01:24:58.462976] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.093 [2024-11-28 01:24:58.462989] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.093 [2024-11-28 01:24:58.465155] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.093 [2024-11-28 01:24:58.474557] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.093 [2024-11-28 01:24:58.474853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.093 [2024-11-28 01:24:58.474957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.093 [2024-11-28 01:24:58.474982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.093 [2024-11-28 01:24:58.474998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.093 [2024-11-28 01:24:58.475161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.093 [2024-11-28 01:24:58.475358] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.093 [2024-11-28 01:24:58.475379] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.093 [2024-11-28 01:24:58.475392] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.093 [2024-11-28 01:24:58.477497] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.093 [2024-11-28 01:24:58.486752] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.093 [2024-11-28 01:24:58.487083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.093 [2024-11-28 01:24:58.487187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.093 [2024-11-28 01:24:58.487213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.093 [2024-11-28 01:24:58.487228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.093 [2024-11-28 01:24:58.487409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.093 [2024-11-28 01:24:58.487598] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.093 [2024-11-28 01:24:58.487620] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.093 [2024-11-28 01:24:58.487633] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.093 [2024-11-28 01:24:58.489669] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.093 [2024-11-28 01:24:58.498953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.093 [2024-11-28 01:24:58.499236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.093 [2024-11-28 01:24:58.499366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.093 [2024-11-28 01:24:58.499391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.093 [2024-11-28 01:24:58.499407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.093 [2024-11-28 01:24:58.499550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.093 [2024-11-28 01:24:58.499720] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.093 [2024-11-28 01:24:58.499742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.093 [2024-11-28 01:24:58.499756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.093 [2024-11-28 01:24:58.501982] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.093 [2024-11-28 01:24:58.511110] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.093 [2024-11-28 01:24:58.511442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.093 [2024-11-28 01:24:58.511540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.093 [2024-11-28 01:24:58.511571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.093 [2024-11-28 01:24:58.511587] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.093 [2024-11-28 01:24:58.511752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.093 [2024-11-28 01:24:58.511904] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.093 [2024-11-28 01:24:58.511925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.093 [2024-11-28 01:24:58.511938] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.093 [2024-11-28 01:24:58.514123] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.093 [2024-11-28 01:24:58.523366] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.093 [2024-11-28 01:24:58.523704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.093 [2024-11-28 01:24:58.523819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.093 [2024-11-28 01:24:58.523845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.093 [2024-11-28 01:24:58.523861] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.093 [2024-11-28 01:24:58.524039] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.093 [2024-11-28 01:24:58.524219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.093 [2024-11-28 01:24:58.524240] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.093 [2024-11-28 01:24:58.524253] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.093 [2024-11-28 01:24:58.526295] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.093 [2024-11-28 01:24:58.535670] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.093 [2024-11-28 01:24:58.536001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.093 [2024-11-28 01:24:58.536157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.093 [2024-11-28 01:24:58.536183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.093 [2024-11-28 01:24:58.536199] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.093 [2024-11-28 01:24:58.536347] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.093 [2024-11-28 01:24:58.536481] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.093 [2024-11-28 01:24:58.536502] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.093 [2024-11-28 01:24:58.536515] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.093 [2024-11-28 01:24:58.538649] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.093 [2024-11-28 01:24:58.547878] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.093 [2024-11-28 01:24:58.548171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.093 [2024-11-28 01:24:58.548327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.093 [2024-11-28 01:24:58.548354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.093 [2024-11-28 01:24:58.548370] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.093 [2024-11-28 01:24:58.548502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.093 [2024-11-28 01:24:58.548693] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.093 [2024-11-28 01:24:58.548715] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.093 [2024-11-28 01:24:58.548728] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.093 [2024-11-28 01:24:58.550861] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.093 [2024-11-28 01:24:58.560097] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.093 [2024-11-28 01:24:58.560442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.093 [2024-11-28 01:24:58.560617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.093 [2024-11-28 01:24:58.560644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.093 [2024-11-28 01:24:58.560660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.093 [2024-11-28 01:24:58.560776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.093 [2024-11-28 01:24:58.560908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.094 [2024-11-28 01:24:58.560929] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.094 [2024-11-28 01:24:58.560942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.094 [2024-11-28 01:24:58.563004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.094 [2024-11-28 01:24:58.572354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.094 [2024-11-28 01:24:58.572633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.094 [2024-11-28 01:24:58.572797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.094 [2024-11-28 01:24:58.572823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.094 [2024-11-28 01:24:58.572839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.094 [2024-11-28 01:24:58.573004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.094 [2024-11-28 01:24:58.573199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.094 [2024-11-28 01:24:58.573220] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.094 [2024-11-28 01:24:58.573234] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.094 [2024-11-28 01:24:58.575050] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.094 [2024-11-28 01:24:58.584750] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.094 [2024-11-28 01:24:58.585027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.094 [2024-11-28 01:24:58.585157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.094 [2024-11-28 01:24:58.585184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.094 [2024-11-28 01:24:58.585200] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.094 [2024-11-28 01:24:58.585348] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.094 [2024-11-28 01:24:58.585450] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.094 [2024-11-28 01:24:58.585470] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.094 [2024-11-28 01:24:58.585484] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.094 [2024-11-28 01:24:58.587453] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.094 [2024-11-28 01:24:58.597093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.094 [2024-11-28 01:24:58.597392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.094 [2024-11-28 01:24:58.597536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.094 [2024-11-28 01:24:58.597563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.094 [2024-11-28 01:24:58.597578] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.094 [2024-11-28 01:24:58.597710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.094 [2024-11-28 01:24:58.597845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.094 [2024-11-28 01:24:58.597865] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.094 [2024-11-28 01:24:58.597879] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.094 [2024-11-28 01:24:58.599809] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.094 [2024-11-28 01:24:58.609083] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.094 [2024-11-28 01:24:58.609399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.094 [2024-11-28 01:24:58.609504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.094 [2024-11-28 01:24:58.609537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.094 [2024-11-28 01:24:58.609561] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.094 [2024-11-28 01:24:58.609710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.094 [2024-11-28 01:24:58.609858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.094 [2024-11-28 01:24:58.609879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.094 [2024-11-28 01:24:58.609892] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.094 [2024-11-28 01:24:58.611950] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.094 [2024-11-28 01:24:58.621324] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.094 [2024-11-28 01:24:58.621653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.094 [2024-11-28 01:24:58.621795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.094 [2024-11-28 01:24:58.621821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.094 [2024-11-28 01:24:58.621837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.094 [2024-11-28 01:24:58.622000] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.094 [2024-11-28 01:24:58.622137] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.094 [2024-11-28 01:24:58.622158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.094 [2024-11-28 01:24:58.622172] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.094 [2024-11-28 01:24:58.624201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.094 [2024-11-28 01:24:58.633828] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.094 [2024-11-28 01:24:58.634129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.094 [2024-11-28 01:24:58.634265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.094 [2024-11-28 01:24:58.634291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.094 [2024-11-28 01:24:58.634306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.094 [2024-11-28 01:24:58.634487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.094 [2024-11-28 01:24:58.634666] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.094 [2024-11-28 01:24:58.634689] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.094 [2024-11-28 01:24:58.634702] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.094 [2024-11-28 01:24:58.637071] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.094 [2024-11-28 01:24:58.646264] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.094 [2024-11-28 01:24:58.646562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.094 [2024-11-28 01:24:58.646687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.094 [2024-11-28 01:24:58.646713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.094 [2024-11-28 01:24:58.646728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.094 [2024-11-28 01:24:58.646897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.094 [2024-11-28 01:24:58.647063] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.094 [2024-11-28 01:24:58.647083] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.094 [2024-11-28 01:24:58.647097] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.094 [2024-11-28 01:24:58.649091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.094 [2024-11-28 01:24:58.658486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.094 [2024-11-28 01:24:58.658844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.094 [2024-11-28 01:24:58.658949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.094 [2024-11-28 01:24:58.658975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.094 [2024-11-28 01:24:58.658990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.094 [2024-11-28 01:24:58.659187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.094 [2024-11-28 01:24:58.659351] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.094 [2024-11-28 01:24:58.659372] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.094 [2024-11-28 01:24:58.659385] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.094 [2024-11-28 01:24:58.661354] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.094 [2024-11-28 01:24:58.670603] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.094 [2024-11-28 01:24:58.670851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.094 [2024-11-28 01:24:58.670948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.094 [2024-11-28 01:24:58.670974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.094 [2024-11-28 01:24:58.670990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.094 [2024-11-28 01:24:58.671171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.094 [2024-11-28 01:24:58.671339] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.094 [2024-11-28 01:24:58.671374] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.094 [2024-11-28 01:24:58.671388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.094 [2024-11-28 01:24:58.673433] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.095 [2024-11-28 01:24:58.682825] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.095 [2024-11-28 01:24:58.683094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.095 [2024-11-28 01:24:58.683204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.095 [2024-11-28 01:24:58.683230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.095 [2024-11-28 01:24:58.683245] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.095 [2024-11-28 01:24:58.683378] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.095 [2024-11-28 01:24:58.683577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.095 [2024-11-28 01:24:58.683599] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.095 [2024-11-28 01:24:58.683612] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.095 [2024-11-28 01:24:58.685709] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.355 [2024-11-28 01:24:58.695190] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.355 [2024-11-28 01:24:58.695492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.355 [2024-11-28 01:24:58.695636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.355 [2024-11-28 01:24:58.695662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.355 [2024-11-28 01:24:58.695679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.355 [2024-11-28 01:24:58.695859] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.355 [2024-11-28 01:24:58.696070] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.355 [2024-11-28 01:24:58.696091] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.355 [2024-11-28 01:24:58.696104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.355 [2024-11-28 01:24:58.698322] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.355 [2024-11-28 01:24:58.707495] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.355 [2024-11-28 01:24:58.707780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.355 [2024-11-28 01:24:58.707934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.355 [2024-11-28 01:24:58.707959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.355 [2024-11-28 01:24:58.707975] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.355 [2024-11-28 01:24:58.708171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.355 [2024-11-28 01:24:58.708303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.355 [2024-11-28 01:24:58.708324] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.355 [2024-11-28 01:24:58.708337] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.355 [2024-11-28 01:24:58.710417] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.355 [2024-11-28 01:24:58.719798] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.355 [2024-11-28 01:24:58.720056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.355 [2024-11-28 01:24:58.720149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.355 [2024-11-28 01:24:58.720174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.355 [2024-11-28 01:24:58.720191] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.355 [2024-11-28 01:24:58.720355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.355 [2024-11-28 01:24:58.720546] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.355 [2024-11-28 01:24:58.720573] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.355 [2024-11-28 01:24:58.720587] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.356 [2024-11-28 01:24:58.722700] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.356 [2024-11-28 01:24:58.732111] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.356 [2024-11-28 01:24:58.732403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.356 [2024-11-28 01:24:58.732549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.356 [2024-11-28 01:24:58.732576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.356 [2024-11-28 01:24:58.732592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.356 [2024-11-28 01:24:58.732741] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.356 [2024-11-28 01:24:58.732922] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.356 [2024-11-28 01:24:58.732944] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.356 [2024-11-28 01:24:58.732957] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.356 [2024-11-28 01:24:58.735009] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.356 [2024-11-28 01:24:58.744438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.356 [2024-11-28 01:24:58.744713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.356 [2024-11-28 01:24:58.744825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.356 [2024-11-28 01:24:58.744850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.356 [2024-11-28 01:24:58.744866] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.356 [2024-11-28 01:24:58.744981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.356 [2024-11-28 01:24:58.745116] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.356 [2024-11-28 01:24:58.745137] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.356 [2024-11-28 01:24:58.745151] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.356 [2024-11-28 01:24:58.747139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.356 [2024-11-28 01:24:58.756762] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.356 [2024-11-28 01:24:58.757109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.356 [2024-11-28 01:24:58.757218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.356 [2024-11-28 01:24:58.757243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.356 [2024-11-28 01:24:58.757259] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.356 [2024-11-28 01:24:58.757439] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.356 [2024-11-28 01:24:58.757612] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.356 [2024-11-28 01:24:58.757634] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.356 [2024-11-28 01:24:58.757652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.356 [2024-11-28 01:24:58.759734] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.356 [2024-11-28 01:24:58.769020] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.356 [2024-11-28 01:24:58.769313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.356 [2024-11-28 01:24:58.769439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.356 [2024-11-28 01:24:58.769464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.356 [2024-11-28 01:24:58.769480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.356 [2024-11-28 01:24:58.769606] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.356 [2024-11-28 01:24:58.769805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.356 [2024-11-28 01:24:58.769826] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.356 [2024-11-28 01:24:58.769840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.356 [2024-11-28 01:24:58.771948] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.356 [2024-11-28 01:24:58.781094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.356 [2024-11-28 01:24:58.781384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.356 [2024-11-28 01:24:58.781487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.356 [2024-11-28 01:24:58.781513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.356 [2024-11-28 01:24:58.781537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.356 [2024-11-28 01:24:58.781719] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.356 [2024-11-28 01:24:58.781868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.356 [2024-11-28 01:24:58.781889] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.356 [2024-11-28 01:24:58.781902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.356 [2024-11-28 01:24:58.784185] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.356 [2024-11-28 01:24:58.793192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.356 [2024-11-28 01:24:58.793506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.356 [2024-11-28 01:24:58.793657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.356 [2024-11-28 01:24:58.793682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.356 [2024-11-28 01:24:58.793698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.356 [2024-11-28 01:24:58.793862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.356 [2024-11-28 01:24:58.794010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.356 [2024-11-28 01:24:58.794031] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.356 [2024-11-28 01:24:58.794044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.356 [2024-11-28 01:24:58.796175] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.356 [2024-11-28 01:24:58.805317] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.356 [2024-11-28 01:24:58.805661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.356 [2024-11-28 01:24:58.805761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.356 [2024-11-28 01:24:58.805787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.356 [2024-11-28 01:24:58.805802] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.356 [2024-11-28 01:24:58.805934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.356 [2024-11-28 01:24:58.806101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.356 [2024-11-28 01:24:58.806122] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.356 [2024-11-28 01:24:58.806136] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.356 [2024-11-28 01:24:58.808142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.356 [2024-11-28 01:24:58.817619] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.356 [2024-11-28 01:24:58.817900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.356 [2024-11-28 01:24:58.818007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.356 [2024-11-28 01:24:58.818033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.356 [2024-11-28 01:24:58.818048] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.356 [2024-11-28 01:24:58.818180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.356 [2024-11-28 01:24:58.818345] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.356 [2024-11-28 01:24:58.818366] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.356 [2024-11-28 01:24:58.818379] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.356 [2024-11-28 01:24:58.820350] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.356 [2024-11-28 01:24:58.829827] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.356 [2024-11-28 01:24:58.830149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.356 [2024-11-28 01:24:58.830280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.356 [2024-11-28 01:24:58.830305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.356 [2024-11-28 01:24:58.830322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.356 [2024-11-28 01:24:58.830487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.356 [2024-11-28 01:24:58.830615] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.356 [2024-11-28 01:24:58.830637] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.356 [2024-11-28 01:24:58.830651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.356 [2024-11-28 01:24:58.832643] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.356 [2024-11-28 01:24:58.842193] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.356 [2024-11-28 01:24:58.842485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.357 [2024-11-28 01:24:58.842601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.357 [2024-11-28 01:24:58.842627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.357 [2024-11-28 01:24:58.842643] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.357 [2024-11-28 01:24:58.842791] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.357 [2024-11-28 01:24:58.842945] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.357 [2024-11-28 01:24:58.842965] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.357 [2024-11-28 01:24:58.842979] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.357 [2024-11-28 01:24:58.845108] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.357 [2024-11-28 01:24:58.854643] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.357 01:24:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:44.357 01:24:58 -- common/autotest_common.sh@862 -- # return 0 00:30:44.357 01:24:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:44.357 [2024-11-28 01:24:58.854984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.357 01:24:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:44.357 [2024-11-28 01:24:58.855104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.357 [2024-11-28 01:24:58.855130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.357 [2024-11-28 01:24:58.855145] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.357 01:24:58 -- common/autotest_common.sh@10 -- # set +x 00:30:44.357 [2024-11-28 01:24:58.855244] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.357 [2024-11-28 01:24:58.855396] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.357 [2024-11-28 01:24:58.855418] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.357 [2024-11-28 01:24:58.855432] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.357 [2024-11-28 01:24:58.857736] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.357 [2024-11-28 01:24:58.867065] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.357 [2024-11-28 01:24:58.867343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.357 [2024-11-28 01:24:58.867457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.357 [2024-11-28 01:24:58.867482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.357 [2024-11-28 01:24:58.867498] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.357 [2024-11-28 01:24:58.867622] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.357 [2024-11-28 01:24:58.867792] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.357 [2024-11-28 01:24:58.867827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.357 [2024-11-28 01:24:58.867841] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.357 [2024-11-28 01:24:58.870034] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.357 01:24:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:44.357 01:24:58 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:44.357 01:24:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:44.357 01:24:58 -- common/autotest_common.sh@10 -- # set +x 00:30:44.357 [2024-11-28 01:24:58.878753] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:44.357 [2024-11-28 01:24:58.879513] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.357 [2024-11-28 01:24:58.879798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.357 [2024-11-28 01:24:58.879934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.357 [2024-11-28 01:24:58.879960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.357 [2024-11-28 01:24:58.879976] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.357 [2024-11-28 01:24:58.880107] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.357 [2024-11-28 01:24:58.880244] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.357 [2024-11-28 01:24:58.880266] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.357 [2024-11-28 01:24:58.880280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.357 [2024-11-28 01:24:58.882329] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.357 01:24:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:44.357 01:24:58 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:44.357 01:24:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:44.357 01:24:58 -- common/autotest_common.sh@10 -- # set +x 00:30:44.357 [2024-11-28 01:24:58.891789] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.357 [2024-11-28 01:24:58.892165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.357 [2024-11-28 01:24:58.892265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.357 [2024-11-28 01:24:58.892291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.357 [2024-11-28 01:24:58.892306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.357 [2024-11-28 01:24:58.892438] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.357 [2024-11-28 01:24:58.892632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.357 [2024-11-28 01:24:58.892654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.357 [2024-11-28 01:24:58.892668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.357 [2024-11-28 01:24:58.894574] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.357 [2024-11-28 01:24:58.904221] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.357 [2024-11-28 01:24:58.904473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.357 [2024-11-28 01:24:58.904595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.357 [2024-11-28 01:24:58.904623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.357 [2024-11-28 01:24:58.904641] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.357 [2024-11-28 01:24:58.904757] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.357 [2024-11-28 01:24:58.904936] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.357 [2024-11-28 01:24:58.904957] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.357 [2024-11-28 01:24:58.904971] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.357 [2024-11-28 01:24:58.906940] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.357 [2024-11-28 01:24:58.916769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.357 [2024-11-28 01:24:58.917178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.357 [2024-11-28 01:24:58.917324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.357 [2024-11-28 01:24:58.917351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.357 [2024-11-28 01:24:58.917371] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.357 [2024-11-28 01:24:58.917559] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.357 [2024-11-28 01:24:58.917729] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.357 [2024-11-28 01:24:58.917751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.357 [2024-11-28 01:24:58.917769] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.357 [2024-11-28 01:24:58.919880] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.357 Malloc0 00:30:44.357 01:24:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:44.357 01:24:58 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:44.357 01:24:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:44.357 01:24:58 -- common/autotest_common.sh@10 -- # set +x 00:30:44.357 [2024-11-28 01:24:58.929323] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.357 [2024-11-28 01:24:58.929659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.357 01:24:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:44.357 [2024-11-28 01:24:58.929777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:44.357 [2024-11-28 01:24:58.929803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x67d870 with addr=10.0.0.2, port=4420 00:30:44.357 [2024-11-28 01:24:58.929820] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x67d870 is same with the state(5) to be set 00:30:44.357 01:24:58 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:44.357 01:24:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:44.357 [2024-11-28 01:24:58.930009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x67d870 (9): Bad file descriptor 00:30:44.357 01:24:58 -- common/autotest_common.sh@10 -- # set +x 00:30:44.357 [2024-11-28 01:24:58.930179] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:44.357 [2024-11-28 01:24:58.930209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:44.357 [2024-11-28 01:24:58.930224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:44.357 [2024-11-28 01:24:58.932434] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:44.358 01:24:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:44.358 01:24:58 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:44.358 01:24:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:44.358 01:24:58 -- common/autotest_common.sh@10 -- # set +x 00:30:44.358 [2024-11-28 01:24:58.941545] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:44.358 [2024-11-28 01:24:58.941660] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:44.358 01:24:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:44.358 01:24:58 -- host/bdevperf.sh@38 -- # wait 2164818 00:30:44.616 [2024-11-28 01:24:58.977454] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:54.586 00:30:54.586 Latency(us) 00:30:54.586 [2024-11-28T00:25:09.189Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:54.586 [2024-11-28T00:25:09.189Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:54.586 Verification LBA range: start 0x0 length 0x4000 00:30:54.586 Nvme1n1 : 15.01 9277.11 36.24 16654.69 0.00 4921.75 767.62 20874.43 00:30:54.586 [2024-11-28T00:25:09.189Z] =================================================================================================================== 00:30:54.586 [2024-11-28T00:25:09.189Z] Total : 9277.11 36.24 16654.69 0.00 4921.75 767.62 20874.43 00:30:54.586 01:25:07 -- host/bdevperf.sh@39 -- # sync 00:30:54.586 01:25:07 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:54.586 01:25:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:54.586 01:25:07 -- common/autotest_common.sh@10 -- # set +x 00:30:54.586 01:25:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:54.586 01:25:07 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:30:54.586 01:25:07 -- host/bdevperf.sh@44 -- # nvmftestfini 00:30:54.586 01:25:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:54.586 01:25:07 -- nvmf/common.sh@116 -- # sync 00:30:54.586 01:25:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:54.586 01:25:07 -- nvmf/common.sh@119 -- # set +e 00:30:54.586 01:25:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:54.586 01:25:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:54.586 rmmod nvme_tcp 00:30:54.586 rmmod nvme_fabrics 00:30:54.586 rmmod nvme_keyring 00:30:54.586 01:25:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:54.586 01:25:07 -- nvmf/common.sh@123 -- # set -e 00:30:54.586 01:25:07 -- nvmf/common.sh@124 -- # return 0 00:30:54.586 01:25:07 -- nvmf/common.sh@477 -- # '[' -n 2165537 ']' 00:30:54.586 01:25:07 -- nvmf/common.sh@478 -- # killprocess 2165537 00:30:54.586 01:25:07 -- common/autotest_common.sh@936 -- # '[' -z 2165537 ']' 00:30:54.586 01:25:07 -- common/autotest_common.sh@940 -- # kill -0 2165537 00:30:54.586 01:25:07 -- common/autotest_common.sh@941 -- # uname 00:30:54.586 01:25:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:54.586 01:25:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2165537 00:30:54.586 01:25:07 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:54.586 01:25:07 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:54.586 01:25:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2165537' 00:30:54.586 killing process with pid 2165537 00:30:54.586 01:25:07 -- common/autotest_common.sh@955 -- # kill 2165537 00:30:54.586 01:25:07 -- common/autotest_common.sh@960 -- # wait 2165537 00:30:54.586 01:25:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:54.586 01:25:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:54.586 01:25:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:54.586 01:25:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:54.586 01:25:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:54.586 01:25:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:54.586 01:25:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:54.586 01:25:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:55.524 01:25:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:55.524 00:30:55.524 real 0m23.340s 00:30:55.524 user 1m2.707s 00:30:55.524 sys 0m4.427s 00:30:55.524 01:25:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:55.524 01:25:09 -- common/autotest_common.sh@10 -- # set +x 00:30:55.524 ************************************ 00:30:55.524 END TEST nvmf_bdevperf 00:30:55.524 ************************************ 00:30:55.524 01:25:09 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:55.524 01:25:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:55.524 01:25:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:55.524 01:25:09 -- common/autotest_common.sh@10 -- # set +x 00:30:55.525 ************************************ 00:30:55.525 START TEST nvmf_target_disconnect 00:30:55.525 ************************************ 00:30:55.525 01:25:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:55.525 * Looking for test storage... 00:30:55.525 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:55.525 01:25:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:55.525 01:25:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:55.525 01:25:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:55.782 01:25:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:55.782 01:25:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:55.782 01:25:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:55.783 01:25:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:55.783 01:25:10 -- scripts/common.sh@335 -- # IFS=.-: 00:30:55.783 01:25:10 -- scripts/common.sh@335 -- # read -ra ver1 00:30:55.783 01:25:10 -- scripts/common.sh@336 -- # IFS=.-: 00:30:55.783 01:25:10 -- scripts/common.sh@336 -- # read -ra ver2 00:30:55.783 01:25:10 -- scripts/common.sh@337 -- # local 'op=<' 00:30:55.783 01:25:10 -- scripts/common.sh@339 -- # ver1_l=2 00:30:55.783 01:25:10 -- scripts/common.sh@340 -- # ver2_l=1 00:30:55.783 01:25:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:55.783 01:25:10 -- scripts/common.sh@343 -- # case "$op" in 00:30:55.783 01:25:10 -- scripts/common.sh@344 -- # : 1 00:30:55.783 01:25:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:55.783 01:25:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:55.783 01:25:10 -- scripts/common.sh@364 -- # decimal 1 00:30:55.783 01:25:10 -- scripts/common.sh@352 -- # local d=1 00:30:55.783 01:25:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:55.783 01:25:10 -- scripts/common.sh@354 -- # echo 1 00:30:55.783 01:25:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:55.783 01:25:10 -- scripts/common.sh@365 -- # decimal 2 00:30:55.783 01:25:10 -- scripts/common.sh@352 -- # local d=2 00:30:55.783 01:25:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:55.783 01:25:10 -- scripts/common.sh@354 -- # echo 2 00:30:55.783 01:25:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:55.783 01:25:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:55.783 01:25:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:55.783 01:25:10 -- scripts/common.sh@367 -- # return 0 00:30:55.783 01:25:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:55.783 01:25:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:55.783 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:55.783 --rc genhtml_branch_coverage=1 00:30:55.783 --rc genhtml_function_coverage=1 00:30:55.783 --rc genhtml_legend=1 00:30:55.783 --rc geninfo_all_blocks=1 00:30:55.783 --rc geninfo_unexecuted_blocks=1 00:30:55.783 00:30:55.783 ' 00:30:55.783 01:25:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:55.783 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:55.783 --rc genhtml_branch_coverage=1 00:30:55.783 --rc genhtml_function_coverage=1 00:30:55.783 --rc genhtml_legend=1 00:30:55.783 --rc geninfo_all_blocks=1 00:30:55.783 --rc geninfo_unexecuted_blocks=1 00:30:55.783 00:30:55.783 ' 00:30:55.783 01:25:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:55.783 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:55.783 --rc genhtml_branch_coverage=1 00:30:55.783 --rc genhtml_function_coverage=1 00:30:55.783 --rc genhtml_legend=1 00:30:55.783 --rc geninfo_all_blocks=1 00:30:55.783 --rc geninfo_unexecuted_blocks=1 00:30:55.783 00:30:55.783 ' 00:30:55.783 01:25:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:55.783 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:55.783 --rc genhtml_branch_coverage=1 00:30:55.783 --rc genhtml_function_coverage=1 00:30:55.783 --rc genhtml_legend=1 00:30:55.783 --rc geninfo_all_blocks=1 00:30:55.783 --rc geninfo_unexecuted_blocks=1 00:30:55.783 00:30:55.783 ' 00:30:55.783 01:25:10 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:55.783 01:25:10 -- nvmf/common.sh@7 -- # uname -s 00:30:55.783 01:25:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:55.783 01:25:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:55.783 01:25:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:55.783 01:25:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:55.783 01:25:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:55.783 01:25:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:55.783 01:25:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:55.783 01:25:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:55.783 01:25:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:55.783 01:25:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:55.783 01:25:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:55.783 01:25:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:55.783 01:25:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:55.783 01:25:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:55.783 01:25:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:55.783 01:25:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:55.783 01:25:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:55.783 01:25:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:55.783 01:25:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:55.783 01:25:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:55.783 01:25:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:55.783 01:25:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:55.783 01:25:10 -- paths/export.sh@5 -- # export PATH 00:30:55.783 01:25:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:55.783 01:25:10 -- nvmf/common.sh@46 -- # : 0 00:30:55.783 01:25:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:55.783 01:25:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:55.783 01:25:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:55.783 01:25:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:55.783 01:25:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:55.783 01:25:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:55.783 01:25:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:55.783 01:25:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:55.783 01:25:10 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:30:55.783 01:25:10 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:30:55.783 01:25:10 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:30:55.783 01:25:10 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:30:55.783 01:25:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:55.783 01:25:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:55.783 01:25:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:55.783 01:25:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:55.783 01:25:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:55.783 01:25:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:55.783 01:25:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:55.783 01:25:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:55.783 01:25:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:55.783 01:25:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:55.783 01:25:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:55.783 01:25:10 -- common/autotest_common.sh@10 -- # set +x 00:30:57.685 01:25:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:57.685 01:25:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:57.685 01:25:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:57.685 01:25:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:57.685 01:25:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:57.685 01:25:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:57.685 01:25:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:57.685 01:25:12 -- nvmf/common.sh@294 -- # net_devs=() 00:30:57.685 01:25:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:57.685 01:25:12 -- nvmf/common.sh@295 -- # e810=() 00:30:57.685 01:25:12 -- nvmf/common.sh@295 -- # local -ga e810 00:30:57.685 01:25:12 -- nvmf/common.sh@296 -- # x722=() 00:30:57.685 01:25:12 -- nvmf/common.sh@296 -- # local -ga x722 00:30:57.685 01:25:12 -- nvmf/common.sh@297 -- # mlx=() 00:30:57.685 01:25:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:57.685 01:25:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:57.685 01:25:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:57.685 01:25:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:57.685 01:25:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:57.685 01:25:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:57.685 01:25:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:57.685 01:25:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:57.685 01:25:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:57.685 01:25:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:57.685 01:25:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:57.685 01:25:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:57.685 01:25:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:57.685 01:25:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:57.685 01:25:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:57.685 01:25:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:57.685 01:25:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:57.685 01:25:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:57.685 01:25:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:57.685 01:25:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:57.685 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:57.685 01:25:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:57.685 01:25:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:57.685 01:25:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:57.685 01:25:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:57.685 01:25:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:57.685 01:25:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:57.685 01:25:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:57.685 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:57.685 01:25:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:57.685 01:25:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:57.685 01:25:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:57.685 01:25:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:57.685 01:25:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:57.685 01:25:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:57.685 01:25:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:57.685 01:25:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:57.685 01:25:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:57.685 01:25:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:57.685 01:25:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:57.685 01:25:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:57.685 01:25:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:57.685 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:57.685 01:25:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:57.685 01:25:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:57.685 01:25:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:57.685 01:25:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:57.685 01:25:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:57.685 01:25:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:57.685 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:57.685 01:25:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:57.685 01:25:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:57.685 01:25:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:57.685 01:25:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:57.685 01:25:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:57.685 01:25:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:57.685 01:25:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:57.685 01:25:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:57.685 01:25:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:57.685 01:25:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:57.685 01:25:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:57.685 01:25:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:57.685 01:25:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:57.685 01:25:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:57.685 01:25:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:57.685 01:25:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:57.685 01:25:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:57.685 01:25:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:57.685 01:25:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:57.685 01:25:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:57.685 01:25:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:57.685 01:25:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:57.685 01:25:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:57.685 01:25:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:57.685 01:25:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:57.685 01:25:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:57.685 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:57.685 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.316 ms 00:30:57.685 00:30:57.685 --- 10.0.0.2 ping statistics --- 00:30:57.685 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:57.685 rtt min/avg/max/mdev = 0.316/0.316/0.316/0.000 ms 00:30:57.685 01:25:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:57.685 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:57.686 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.082 ms 00:30:57.686 00:30:57.686 --- 10.0.0.1 ping statistics --- 00:30:57.686 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:57.686 rtt min/avg/max/mdev = 0.082/0.082/0.082/0.000 ms 00:30:57.686 01:25:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:57.686 01:25:12 -- nvmf/common.sh@410 -- # return 0 00:30:57.686 01:25:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:57.686 01:25:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:57.686 01:25:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:57.686 01:25:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:57.686 01:25:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:57.686 01:25:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:57.686 01:25:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:57.944 01:25:12 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:30:57.944 01:25:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:57.944 01:25:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:57.944 01:25:12 -- common/autotest_common.sh@10 -- # set +x 00:30:57.944 ************************************ 00:30:57.944 START TEST nvmf_target_disconnect_tc1 00:30:57.945 ************************************ 00:30:57.945 01:25:12 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:30:57.945 01:25:12 -- host/target_disconnect.sh@32 -- # set +e 00:30:57.945 01:25:12 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:57.945 EAL: No free 2048 kB hugepages reported on node 1 00:30:57.945 [2024-11-28 01:25:12.365990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:57.945 [2024-11-28 01:25:12.366196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:57.945 [2024-11-28 01:25:12.366224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14ebdf0 with addr=10.0.0.2, port=4420 00:30:57.945 [2024-11-28 01:25:12.366254] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:57.945 [2024-11-28 01:25:12.366274] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:57.945 [2024-11-28 01:25:12.366287] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:30:57.945 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:30:57.945 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:30:57.945 Initializing NVMe Controllers 00:30:57.945 01:25:12 -- host/target_disconnect.sh@33 -- # trap - ERR 00:30:57.945 01:25:12 -- host/target_disconnect.sh@33 -- # print_backtrace 00:30:57.945 01:25:12 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:30:57.945 01:25:12 -- common/autotest_common.sh@1142 -- # return 0 00:30:57.945 01:25:12 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:30:57.945 01:25:12 -- host/target_disconnect.sh@41 -- # set -e 00:30:57.945 00:30:57.945 real 0m0.084s 00:30:57.945 user 0m0.035s 00:30:57.945 sys 0m0.048s 00:30:57.945 01:25:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:57.945 01:25:12 -- common/autotest_common.sh@10 -- # set +x 00:30:57.945 ************************************ 00:30:57.945 END TEST nvmf_target_disconnect_tc1 00:30:57.945 ************************************ 00:30:57.945 01:25:12 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:30:57.945 01:25:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:57.945 01:25:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:57.945 01:25:12 -- common/autotest_common.sh@10 -- # set +x 00:30:57.945 ************************************ 00:30:57.945 START TEST nvmf_target_disconnect_tc2 00:30:57.945 ************************************ 00:30:57.945 01:25:12 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:30:57.945 01:25:12 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:30:57.945 01:25:12 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:57.945 01:25:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:57.945 01:25:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:57.945 01:25:12 -- common/autotest_common.sh@10 -- # set +x 00:30:57.945 01:25:12 -- nvmf/common.sh@469 -- # nvmfpid=2168700 00:30:57.945 01:25:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:57.945 01:25:12 -- nvmf/common.sh@470 -- # waitforlisten 2168700 00:30:57.945 01:25:12 -- common/autotest_common.sh@829 -- # '[' -z 2168700 ']' 00:30:57.945 01:25:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:57.945 01:25:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:57.945 01:25:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:57.945 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:57.945 01:25:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:57.945 01:25:12 -- common/autotest_common.sh@10 -- # set +x 00:30:57.945 [2024-11-28 01:25:12.452019] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:57.945 [2024-11-28 01:25:12.452107] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:57.945 EAL: No free 2048 kB hugepages reported on node 1 00:30:57.945 [2024-11-28 01:25:12.516109] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:58.203 [2024-11-28 01:25:12.606229] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:58.203 [2024-11-28 01:25:12.606384] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:58.203 [2024-11-28 01:25:12.606402] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:58.203 [2024-11-28 01:25:12.606413] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:58.203 [2024-11-28 01:25:12.606497] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:58.203 [2024-11-28 01:25:12.606565] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:58.203 [2024-11-28 01:25:12.606640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:58.203 [2024-11-28 01:25:12.606642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:59.137 01:25:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:59.137 01:25:13 -- common/autotest_common.sh@862 -- # return 0 00:30:59.137 01:25:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:59.137 01:25:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:59.137 01:25:13 -- common/autotest_common.sh@10 -- # set +x 00:30:59.137 01:25:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:59.137 01:25:13 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:59.137 01:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:59.137 01:25:13 -- common/autotest_common.sh@10 -- # set +x 00:30:59.137 Malloc0 00:30:59.137 01:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:59.137 01:25:13 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:59.137 01:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:59.137 01:25:13 -- common/autotest_common.sh@10 -- # set +x 00:30:59.137 [2024-11-28 01:25:13.478357] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:59.137 01:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:59.137 01:25:13 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:59.137 01:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:59.137 01:25:13 -- common/autotest_common.sh@10 -- # set +x 00:30:59.137 01:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:59.137 01:25:13 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:59.137 01:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:59.137 01:25:13 -- common/autotest_common.sh@10 -- # set +x 00:30:59.137 01:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:59.137 01:25:13 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:59.137 01:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:59.137 01:25:13 -- common/autotest_common.sh@10 -- # set +x 00:30:59.137 [2024-11-28 01:25:13.506641] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:59.137 01:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:59.137 01:25:13 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:59.137 01:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:59.137 01:25:13 -- common/autotest_common.sh@10 -- # set +x 00:30:59.137 01:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:59.137 01:25:13 -- host/target_disconnect.sh@50 -- # reconnectpid=2168856 00:30:59.137 01:25:13 -- host/target_disconnect.sh@52 -- # sleep 2 00:30:59.137 01:25:13 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:59.137 EAL: No free 2048 kB hugepages reported on node 1 00:31:01.051 01:25:15 -- host/target_disconnect.sh@53 -- # kill -9 2168700 00:31:01.051 01:25:15 -- host/target_disconnect.sh@55 -- # sleep 2 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 [2024-11-28 01:25:15.531333] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 [2024-11-28 01:25:15.531707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Write completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 Read completed with error (sct=0, sc=8) 00:31:01.051 starting I/O failed 00:31:01.051 [2024-11-28 01:25:15.532052] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:01.051 [2024-11-28 01:25:15.532254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.532472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.532501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.532622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.532731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.532758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.532887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.533026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.533053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.533154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.533311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.533338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.533438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.533543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.533571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.533667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.533784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.533810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.533939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.534032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.534057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.534207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.534338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.534364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.534485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.534594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.534621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.534736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.534841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.534868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.534965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.535066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.535094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.535232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.535323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.535350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.535472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.535604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.535631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.535736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.535825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.535851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.536017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.536119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.536146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.536295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.536398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.536424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.536563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.536675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.536701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.536798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.536897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.536923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.537054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.537185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.537212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.537307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.537431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.537457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.537584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.537703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.537729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.537854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.538013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.538039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.538165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.538321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.538347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.538446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.538538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.538565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.538674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.538775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.538802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.538958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.539089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.539116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.539245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.539380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.539407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.539573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.539673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.539699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.539799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.539898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.539926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.540052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.540214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.540239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.540430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.540631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.540658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.540759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.540886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.540927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.051 [2024-11-28 01:25:15.541079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.541288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.051 [2024-11-28 01:25:15.541329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.051 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.541515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.541656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.541682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.541857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.541992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.542017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.542239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.542350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.542390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.542549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.542687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.542713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.542855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.542955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.542983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.543079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.543239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.543265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.543372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.543506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.543545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.543697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.543844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.543886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.544093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.544244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.544269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.544369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.544487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.544512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.544626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.544749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.544774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.544893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.545025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.545050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.545183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.545284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.545311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.545445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.545548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.545585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.545684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.545838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.545865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.546000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.546142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.546168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.546353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.546521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.546552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.546654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.546780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.546834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.547013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.547173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.547200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.547355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.547517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.547558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.547694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.547835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.547885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.548146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.548273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.548299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.548418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.548546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.548573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.548704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.548864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.548890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.549015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.549136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.549162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.549287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.549440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.549467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.549608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.549815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.549842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.550001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.550128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.550153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.550284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.550420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.550447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.550593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.550725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.550755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.550944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.551087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.551114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.551267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.551373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.551400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.551504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.551694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.551739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.052 qpair failed and we were unable to recover it. 00:31:01.052 [2024-11-28 01:25:15.551889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.052 [2024-11-28 01:25:15.552050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.552078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.552217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.552369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.552395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.552499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.552631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.552657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.552788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.552897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.552923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.553023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.553119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.553146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.553244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.553374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.553401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.553523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.553650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.553694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.553802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.553929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.553956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.554109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.554238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.554267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.554405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.554511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.554549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.554682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.554812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.554838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.555002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.555109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.555135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.555268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.555427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.555454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.555575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.555668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.555693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.555825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.555986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.556012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.556149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.556250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.556277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.556430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.556535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.556572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.556699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.556839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.556867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.556993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.557113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.557141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.557292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.557434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.557460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.557605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.557750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.557775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.557928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.558098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.558124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.558239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.558365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.558392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.558518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.558661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.558687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.558849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.558946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.558972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.559102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.559191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.559218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.053 [2024-11-28 01:25:15.559340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.559441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.053 [2024-11-28 01:25:15.559468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.053 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.559605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.559730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.559758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.559912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.560045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.560073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.560225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.560352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.560379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.560480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.560621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.560648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.560750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.560852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.560878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.561005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.561130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.561156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.561310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.561440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.561467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.561573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.561725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.561752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.561906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.562047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.562073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.562202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.562357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.562383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.562510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.562691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.562739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.562905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.563058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.563085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.563215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.563372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.563398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.563564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.563693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.563724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.563856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.564023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.564050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.564205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.564360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.564386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.564518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.564633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.564660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.564783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.564935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.564961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.565117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.565273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.565300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.565451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.565611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.565638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.565765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.565896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.565924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.566056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.566188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.566214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.566326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.566480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.566506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.054 qpair failed and we were unable to recover it. 00:31:01.054 [2024-11-28 01:25:15.566675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.054 [2024-11-28 01:25:15.566799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.566831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.567037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.567162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.567187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.567278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.567429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.567455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.567548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.567702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.567746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.567938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.568068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.568094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.568222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.568352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.568378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.568481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.568605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.568632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.568727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.568848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.568874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.568996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.569123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.569150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.569271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.569367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.569394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.569532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.569628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.569660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.569816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.569944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.569972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.570098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.570192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.570218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.570340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.570467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.570493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.570602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.570732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.570759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.570886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.570988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.571014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.571142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.571268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.571293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.571431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.571549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.571576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.571682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.571858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.571908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.572015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.572139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.572166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.572321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.572457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.572488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.572625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.572762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.572798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.572954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.573087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.573113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.573241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.573337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.573370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.573472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.573578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.573605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.573753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.573894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.573942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.574095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.574193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.574220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.574351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.574472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.574499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.055 qpair failed and we were unable to recover it. 00:31:01.055 [2024-11-28 01:25:15.574623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.055 [2024-11-28 01:25:15.574754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.574791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.574914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.575039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.575066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.575188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.575293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.575324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.575438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.575567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.575594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.575721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.575826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.575852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.575956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.576052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.576084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.576213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.576367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.576392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.576520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.576638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.576664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.576790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.576921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.576948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.577074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.577199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.577226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.577353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.577473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.577500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.577644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.577770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.577797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.577919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.578041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.578067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.578197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.578317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.578343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.578443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.578571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.578597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.578730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.578858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.578885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.579011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.579166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.579192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.579343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.579447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.579473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.579655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.579797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.579842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.579972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.580132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.580158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.580286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.580447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.580473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.580568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.580706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.580731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.580882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.581069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.581097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.581238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.581365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.581392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.581519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.581685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.581711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.581850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.581993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.582020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.056 qpair failed and we were unable to recover it. 00:31:01.056 [2024-11-28 01:25:15.582178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.056 [2024-11-28 01:25:15.582309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.582336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.582440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.582536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.582562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.582663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.582762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.582795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.582951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.583077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.583103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.583257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.583388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.583415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.583507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.583615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.583642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.583770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.583939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.583966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.584091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.584193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.584220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.584348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.584482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.584508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.584663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.584789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.584815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.584976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.585101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.585127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.585277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.585378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.585405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.585501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.585637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.585663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.585791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.585942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.585968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.586098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.586229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.586255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.586384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.586511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.586547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.586728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.586890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.586933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.587069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.587196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.587223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.587328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.587454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.587480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.587625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.587731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.587758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.587901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.588062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.588089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.588219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.588382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.588408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.588574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.588775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.588808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.588960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.589093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.589119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.589248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.589364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.589391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.589521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.589690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.589716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.589845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.589953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.589979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.590087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.590242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.590268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.057 qpair failed and we were unable to recover it. 00:31:01.057 [2024-11-28 01:25:15.590421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.057 [2024-11-28 01:25:15.590513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.590546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.590681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.590812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.590840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.590964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.591057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.591086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.591214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.591362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.591389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.591521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.591670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.591695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.591800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.591960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.591986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.592114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.592265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.592292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.592426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.592556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.592593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.592716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.592844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.592872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.593034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.593191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.593218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.593349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.593472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.593499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.593661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.593831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.593859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.593986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.594109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.594136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.594268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.594404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.594431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.594556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.594721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.594748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.594906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.595011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.595037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.595130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.595228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.595254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.595383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.595512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.595546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.595686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.595818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.595843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.595983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.596111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.596138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.596272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.596404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.596430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.596569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.596726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.596752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.596913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.597068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.597095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.597252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.597354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.597381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.597487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.597623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.597650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.597757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.597891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.597917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.058 qpair failed and we were unable to recover it. 00:31:01.058 [2024-11-28 01:25:15.598069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.058 [2024-11-28 01:25:15.598166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.598192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.598347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.598474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.598500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.598638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.598742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.598769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.598906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.599017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.599044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.599173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.599328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.599354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.599491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.599663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.599688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.599789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.599954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.599980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.600109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.600237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.600263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.600368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.600502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.600538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.600692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.600880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.600909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.601064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.601217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.601244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.601346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.601479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.601506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.601698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.601853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.601880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.601978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.602106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.602133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.602283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.602379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.602407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.602544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.602751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.602777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.602913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.603044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.603070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.603193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.603285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.603312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.603408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.603540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.603566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.603690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.603871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.603897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.604026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.604151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.604178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.604308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.604466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.604493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.604611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.604745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.604770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.604878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.604996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.605022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.605150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.605252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.605279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.059 qpair failed and we were unable to recover it. 00:31:01.059 [2024-11-28 01:25:15.605408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.059 [2024-11-28 01:25:15.605545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.605584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.605711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.605887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.605932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.606071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.606173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.606199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.606325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.606420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.606447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.606608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.606734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.606759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.606872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.606999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.607026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.607178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.607305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.607332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.607455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.607607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.607633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.607737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.607855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.607882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.608039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.608193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.608220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.608346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.608474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.608501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.608628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.608782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.608808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.608916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.609019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.609048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.609204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.609331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.609358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.609461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.609571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.609596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.609728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.609854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.609881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.609980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.610108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.610134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.610232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.610333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.610359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.610460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.610612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.610643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.610773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.610930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.610977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.611083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.611211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.611238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.611340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.611460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.611487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.611631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.611757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.611784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.611912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.612030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.612057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.612155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.612309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.612336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.612463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.612568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.612595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.612743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.612907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.612950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.613052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.613148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.613174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.060 qpair failed and we were unable to recover it. 00:31:01.060 [2024-11-28 01:25:15.613299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.613393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.060 [2024-11-28 01:25:15.613424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.613551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.613708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.613734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.613863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.613981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.614007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.614137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.614299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.614325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.614425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.614555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.614583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.614711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.614799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.614825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.614954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.615082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.615108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.615260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.615364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.615391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.615520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.615621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.615650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.615758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.615918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.615945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.616077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.616186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.616218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.616349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.616480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.616508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.616658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.616802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.616831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.616998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.617113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.617139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.617290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.617394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.617420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.617534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.617637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.617663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.617754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.617907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.617933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.618035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.618164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.618191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.618291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.618416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.618442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.618540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.618690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.618716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.618849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.618976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.619007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.619107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.619212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.619239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.619396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.619493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.619520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.619654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.619748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.619774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.619869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.619994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.620020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.620152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.620281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.620307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.620436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.620592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.620619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.620719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.620836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.620863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.620996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.621096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.061 [2024-11-28 01:25:15.621124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.061 qpair failed and we were unable to recover it. 00:31:01.061 [2024-11-28 01:25:15.621274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.621401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.621428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.621533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.621650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.621680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.621840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.621992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.622018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.622147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.622298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.622325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.622424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.622536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.622564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.622691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.622817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.622845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.622981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.623136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.623162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.623285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.623389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.623428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.623576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.623704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.623731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.623871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.624018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.624045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.624180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.624282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.624309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.624410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.624562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.624589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.624751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.624908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.624934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.625038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.625185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.625212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.625315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.625420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.625447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.625574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.625698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.625725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.625889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.626021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.626048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.626173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.626297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.626324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.626420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.626541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.626569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.626674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.626777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.626805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.626933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.627063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.627091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.627194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.627297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.627326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.627464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.627614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.627658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.627762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.627914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.627941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.628094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.628222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.628248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.628384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.628514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.628549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.628738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.628838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.628867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.628993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.629140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.629167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.062 [2024-11-28 01:25:15.629325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.629420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.062 [2024-11-28 01:25:15.629447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.062 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.629556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.629709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.629736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.629857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.629986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.630015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.630160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.630286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.630312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.630473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.630602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.630629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.630727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.630898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.630942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.631127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.631255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.631281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.631384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.631513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.631550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.631674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.631832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.631876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.632044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.632193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.632220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.632346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.632478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.632505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.632663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.632814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.632841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.632951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.633103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.633129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.633289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.633405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.633430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.633606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.633730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.633756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.633895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.633994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.634020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.634151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.634272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.634299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.634429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.634588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.634615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.634720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.634845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.634871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.635002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.635094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.635120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.635250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.635347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.635384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.635506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.635656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.635683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.635844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.635947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.635975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.636132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.636261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.636287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.636419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.636582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.636610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.636739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.636913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.636940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.063 qpair failed and we were unable to recover it. 00:31:01.063 [2024-11-28 01:25:15.637095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.063 [2024-11-28 01:25:15.637248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.637284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.637435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.637538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.637566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.637721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.637876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.637903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.638028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.638184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.638211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.638345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.638476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.638503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.638617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.638737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.638763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.638931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.639058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.639085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.639238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.639366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.639393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.639535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.639683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.639727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.639842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.639958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.639985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.640088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.640237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.640264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.640421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.640556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.640595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.640698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.640845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.640883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.641058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.641221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.641248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.641349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.641478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.641505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.641616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.641708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.641734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.641845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.641947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.641973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.642073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.642192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.642220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.642362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.642516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.642551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.642678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.642802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.642856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.643034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.643200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.643227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.643384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.643541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.643570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.643703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.643794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.643822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.643949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.644073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.644100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.644251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.644376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.644404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.644507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.644673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.644727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.064 [2024-11-28 01:25:15.644914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.645106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.064 [2024-11-28 01:25:15.645136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.064 qpair failed and we were unable to recover it. 00:31:01.342 [2024-11-28 01:25:15.645291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.342 [2024-11-28 01:25:15.645380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.342 [2024-11-28 01:25:15.645406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.342 qpair failed and we were unable to recover it. 00:31:01.342 [2024-11-28 01:25:15.645509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.645637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.645663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.645761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.645882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.645910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.646035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.646167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.646193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.646322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.646480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.646506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.646663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.646795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.646822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.646980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.647105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.647132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.647261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.647419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.647446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.647550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.647680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.647705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.647801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.647938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.647964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.648118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.648276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.648302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.648407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.648511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.648562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.648693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.648848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.648876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.649029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.649156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.649184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.649307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.649435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.649462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.649573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.649672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.649698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.649805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.649936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.649964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.650093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.650218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.650245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.650345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.650472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.650500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.650625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.650756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.650782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.650932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.651109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.651135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.651264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.651372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.651398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.651534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.651662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.651688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.651788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.651913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.651940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.652040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.652171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.652198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.652298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.652401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.652428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.652559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.652689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.652715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.343 qpair failed and we were unable to recover it. 00:31:01.343 [2024-11-28 01:25:15.652844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.343 [2024-11-28 01:25:15.652975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.653001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.653104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.653200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.653226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.653356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.653506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.653538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.653671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.653775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.653801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.653899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.653999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.654025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.654128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.654275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.654300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.654428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.654562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.654599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.654729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.654852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.654878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.655002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.655094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.655120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.655250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.655378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.655406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.655545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.655671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.655700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.655886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.656039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.656064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.656156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.656275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.656300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.656409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.656561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.656587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.656729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.656879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.656908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.657000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.657099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.657126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.657232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.657325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.657351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.657482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.657608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.657633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.657729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.657836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.657860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.657986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.658117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.658142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.658267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.658391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.658416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.658515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.658653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.658677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.658776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.658897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.658922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.659078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.659172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.659197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.659317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.659469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.659497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.659634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.659738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.659765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.659902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.660025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.660051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.660175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.660295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.660320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.344 qpair failed and we were unable to recover it. 00:31:01.344 [2024-11-28 01:25:15.660452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.660578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.344 [2024-11-28 01:25:15.660604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.660708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.660837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.660863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.660993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.661122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.661147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.661275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.661379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.661405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.661536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.661708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.661750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.661901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.662047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.662073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.662202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.662332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.662361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.662471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.662657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.662699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.662862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.663002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.663028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.663156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.663287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.663312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.663475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.663630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.663676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.663832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.663989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.664032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.664186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.664309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.664335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.664492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.664692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.664738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.664858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.665065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.665090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.665217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.665353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.665378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.665486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.665644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.665686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.665836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.665979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.666005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.666164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.666315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.666341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.666497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.666621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.666646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.666778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.666937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.666961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.667068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.667163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.667189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.667292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.667417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.667442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.667595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.667751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.667775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.667933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.668057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.668092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.668263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.668390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.668416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.668541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.668697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.668725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.668828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.668931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.668968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.345 [2024-11-28 01:25:15.669103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.669253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.345 [2024-11-28 01:25:15.669281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.345 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.669439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.669535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.669562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.669689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.669818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.669842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.669993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.670084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.670109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.670215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.670375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.670401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.670535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.670687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.670731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.670888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.670999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.671023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.671177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.671278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.671303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.671433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.671561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.671587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.671727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.671882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.671907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.672033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.672131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.672156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.672257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.672357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.672382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.672482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.672640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.672666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.672791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.672890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.672915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.673035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.673165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.673190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.673319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.673415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.673440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.673569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.673699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.673724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.673852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.673972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.673998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.674100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.674223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.674247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.674358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.674461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.674486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.674594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.674689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.674715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.674847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.674972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.674999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.675105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.675210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.675235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.675361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.675488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.675513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.675627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.675730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.675755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.675855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.676003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.676028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.676189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.676295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.676319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.676478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.676614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.676640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.676794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.676940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.346 [2024-11-28 01:25:15.676981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.346 qpair failed and we were unable to recover it. 00:31:01.346 [2024-11-28 01:25:15.677080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.677204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.677229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.677352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.677506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.677537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.677665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.677786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.677811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.677937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.678052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.678077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.678236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.678339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.678364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.678529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.678629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.678655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.678783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.678890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.678915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.679071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.679227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.679252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.679378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.679471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.679497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.679624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.679762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.679787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.679943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.680060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.680085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.680213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.680343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.680369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.680468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.680616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.680660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.680752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.680880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.680906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.681035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.681159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.681184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.681318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.681444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.681468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.681625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.681802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.681848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.681962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.682124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.682149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.682273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.682395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.682420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.682522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.682667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.682709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.682862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.683051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.683093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.683237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.683356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.683381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.683504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.683636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.683679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.683822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.683991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.684015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.347 qpair failed and we were unable to recover it. 00:31:01.347 [2024-11-28 01:25:15.684143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.347 [2024-11-28 01:25:15.684270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.684295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.684393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.684489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.684515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.684675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.684826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.684851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.685006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.685134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.685160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.685269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.685391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.685416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.685544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.685669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.685696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.685853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.685982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.686008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.686139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.686262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.686286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.686415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.686588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.686633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.686757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.686875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.686900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.687006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.687128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.687155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.687258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.687381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.687406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.687541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.687657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.687701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.687854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.687975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.688001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.688103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.688197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.688223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.688356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.688476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.688501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.688680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.688868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.688913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.689057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.689173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.689199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.689332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.689462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.689488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.689649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.689809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.689852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.690025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.690198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.690223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.690328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.690489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.690514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.690648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.690812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.690854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.690983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.691137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.691162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.691320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.691445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.691470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.691655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.691825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.691871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.691988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.692183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.692225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.692320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.692448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.692473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.348 [2024-11-28 01:25:15.692625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.692818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.348 [2024-11-28 01:25:15.692862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.348 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.693013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.693160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.693185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.693307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.693431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.693456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.693621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.693765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.693809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.693955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.694101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.694125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.694255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.694375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.694400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.694496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.694649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.694691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.694816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.694974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.695017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.695143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.695259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.695284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.695392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.695485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.695510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.695693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.695816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.695843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.695988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.696119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.696144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.696239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.696362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.696387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.696556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.696700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.696742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.696905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.697053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.697078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.697212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.697317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.697343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.697464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.697566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.697592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.697694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.697793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.697818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.697947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.698082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.698108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.698235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.698384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.698410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.698534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.698679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.698707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.698902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.699042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.699067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.699185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.699306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.699331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.699485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.699633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.699677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.699798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.699964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.700005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.700096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.700223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.700248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.700373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.700504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.700550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.700696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.700816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.700840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.700944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.701073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.701102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.349 qpair failed and we were unable to recover it. 00:31:01.349 [2024-11-28 01:25:15.701212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.349 [2024-11-28 01:25:15.701363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.701388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.701520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.701654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.701680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.701805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.701948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.701992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.702126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.702254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.702278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.702438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.702541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.702567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.702682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.702852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.702894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.703017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.703170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.703194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.703295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.703449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.703474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.703692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.703854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.703899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.704073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.704185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.704213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.704345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.704438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.704462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.704608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.704804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.704848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.705017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.705142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.705168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.705330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.705457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.705482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.705604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.705776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.705801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.705933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.706034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.706059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.706190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.706321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.706346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.706474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.706581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.706635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.706759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.706932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.706976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.707108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.707259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.707290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.707422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.707519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.707550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.707677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.707823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.707848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.707980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.708087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.708111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.708239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.708402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.708426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.708560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.708713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.708739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.708866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.708992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.709017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.709148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.709248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.709272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.709399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.709547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.709573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.709731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.709845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.350 [2024-11-28 01:25:15.709871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.350 qpair failed and we were unable to recover it. 00:31:01.350 [2024-11-28 01:25:15.710001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.710158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.710188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.710280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.710410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.710435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.710560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.710737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.710781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.710931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.711105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.711129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.711283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.711409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.711433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.711590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.711759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.711804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.711960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.712104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.712129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.712262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.712436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.712461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.712614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.712803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.712846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.712989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.713124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.713165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.713268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.713426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.713450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.713583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.713749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.713790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.713942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.714090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.714133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.714286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.714454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.714479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.714635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.714786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.714811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.714914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.715037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.715061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.715212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.715346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.715371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.715506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.715664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.715690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.715816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.715973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.715999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.716131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.716252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.716278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.716430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.716559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.716586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.716718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.716866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.716910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.717044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.717165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.717190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.717294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.717456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.717481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.717628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.717757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.717786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.717937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.718086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.718111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.718247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.718371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.718397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.718494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.718613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.718657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.351 qpair failed and we were unable to recover it. 00:31:01.351 [2024-11-28 01:25:15.718807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.351 [2024-11-28 01:25:15.718975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.719018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.719150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.719274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.719300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.719455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.719624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.719668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.719850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.720044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.720085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.720212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.720336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.720361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.720519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.720634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.720662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.720831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.720972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.721015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.721138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.721307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.721332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.721487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.721593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.721619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.721808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.721964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.721989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.722119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.722243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.722268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.722397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.722501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.722533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.722674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.722794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.722820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.722925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.723081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.723106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.723229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.723358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.723382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.723537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.723648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.723677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.723842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.723987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.724012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.724149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.724281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.724308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.724436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.724559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.724585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.724685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.724856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.724900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.724999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.725130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.725154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.725285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.725413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.725437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.725578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.725717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.725746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.725919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.726070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.726095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.726199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.726298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.352 [2024-11-28 01:25:15.726322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.352 qpair failed and we were unable to recover it. 00:31:01.352 [2024-11-28 01:25:15.726479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.726655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.726683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.726840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.726998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.727041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.727165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.727316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.727342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.727497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.727674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.727718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.727838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.728045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.728087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.728187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.728341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.728366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.728491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.728652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.728697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.728844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.729006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.729048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.729181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.729278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.729304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.729433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.729557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.729583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.729706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.729826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.729850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.729975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.730145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.730171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.730281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.730410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.730435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.730569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.730721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.730746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.730873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.731003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.731028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.731140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.731268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.731292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.731421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.731514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.731546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.731646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.731774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.731798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.731929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.732030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.732055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.732182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.732334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.732359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.732486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.732640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.732666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.732798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.732923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.732948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.733101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.733251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.733276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.733439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.733540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.733567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.733677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.733842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.733869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.734009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.734150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.734175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.734299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.734398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.734422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.734523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.734676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.734718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.353 qpair failed and we were unable to recover it. 00:31:01.353 [2024-11-28 01:25:15.734847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.353 [2024-11-28 01:25:15.735005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.735030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.735188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.735317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.735341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.735443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.735578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.735607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.735734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.735885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.735910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.736034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.736159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.736184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.736279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.736375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.736401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.736568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.736737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.736765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.736877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.737003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.737029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.737153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.737253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.737278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.737410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.737593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.737621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.737741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.737871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.737897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.738027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.738186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.738212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.738367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.738492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.738518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.738680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.738785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.738810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.738948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.739065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.739090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.739241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.739338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.739364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.739471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.739613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.739642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.739825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.740017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.740059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.740213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.740342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.740366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.740498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.740681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.740709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.740854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.741034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.741060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.741205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.741352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.741377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.741568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.741722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.741766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.741919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.742043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.742070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.742174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.742327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.742353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.742480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.742632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.742677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.742787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.742940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.742965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.743120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.743247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.743273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.354 qpair failed and we were unable to recover it. 00:31:01.354 [2024-11-28 01:25:15.743426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.743523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.354 [2024-11-28 01:25:15.743554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.743691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.743814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.743840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.743975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.744105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.744130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.744261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.744389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.744415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.744543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.744691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.744733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.744899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.745021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.745048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.745221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.745315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.745339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.745499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.745613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.745639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.745767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.745885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.745911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.746041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.746141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.746166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.746294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.746420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.746445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.746619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.746777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.746820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.746970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.747101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.747126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.747278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.747406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.747432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.747559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.747657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.747684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.747787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.747917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.747944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.748073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.748167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.748192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.748350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.748475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.748501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.748638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.748778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.748806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.748952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.749079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.749105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.749260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.749386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.749411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.749570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.749722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.749747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.749880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.750038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.750068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.750220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.750322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.750347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.750504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.750665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.750708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.750856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.750972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.750996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.751152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.751256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.751283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.751382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.751513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.751546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.355 [2024-11-28 01:25:15.751657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.751836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.355 [2024-11-28 01:25:15.751879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.355 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.752006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.752125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.752149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.752284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.752405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.752430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.752557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.752733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.752776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.752955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.753091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.753120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.753245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.753372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.753398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.753532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.753681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.753724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.753885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.754038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.754063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.754194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.754352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.754376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.754511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.754619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.754645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.754763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.754886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.754912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.755067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.755189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.755215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.755344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.755438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.755463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.755636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.755797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.755840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.755959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.756079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.756108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.756214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.756342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.756368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.756522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.756672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.756716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.756841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.756997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.757044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.757176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.757309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.757334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.757498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.757626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.757670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.757787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.757923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.757952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.758096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.758248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.758273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.758399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.758500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.758532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.758663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.758795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.758820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.758979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.759077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.759111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.759242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.759398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.759424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.356 qpair failed and we were unable to recover it. 00:31:01.356 [2024-11-28 01:25:15.759597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.356 [2024-11-28 01:25:15.759744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.759770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.759957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.760136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.760161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.760287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.760380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.760405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.760546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.760679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.760705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.760813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.760931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.760956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.761053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.761204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.761229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.761325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.761476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.761501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.761635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.761793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.761818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.761944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.762068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.762093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.762257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.762355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.762381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.762540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.762690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.762733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.762847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.763024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.763067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.763202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.763335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.763361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.763486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.763674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.763719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.763862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.763979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.764004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.764095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.764229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.764254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.764411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.764548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.764574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.764754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.764916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.764960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.765110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.765249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.765274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.765441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.765584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.765629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.765794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.765917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.765943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.766086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.766189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.766214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.766369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.766534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.766560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.766691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.766819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.766844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.766965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.767140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.767183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.767313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.767436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.767461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.767631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.767763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.767791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.767983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.768127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.768153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.357 [2024-11-28 01:25:15.768285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.768389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.357 [2024-11-28 01:25:15.768414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.357 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.768518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.768694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.768719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.768845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.768984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.769030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.769139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.769290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.769315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.769412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.769583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.769612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.769796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.769925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.769949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.770056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.770164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.770189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.770287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.770417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.770441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.770585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.770733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.770758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.770863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.770994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.771019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.771148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.771249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.771274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.771401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.771521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.771550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.771702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.771868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.771910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.772010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.772138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.772164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.772262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.772399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.772424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.772555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.772675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.772718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.772848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.772973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.772998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.773125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.773251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.773276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.773407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.773534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.773559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.773665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.773789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.773814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.773918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.774068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.774093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.774230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.774352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.774376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.774505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.774688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.774732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.774909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.775054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.775079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.775176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.775274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.775299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.775430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.775560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.775587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.775708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.775824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.775849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.775973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.776070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.776096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.776250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.776385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.776411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.358 qpair failed and we were unable to recover it. 00:31:01.358 [2024-11-28 01:25:15.776539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.358 [2024-11-28 01:25:15.776702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.776728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.776879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.777044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.777069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.777202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.777329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.777354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.777509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.777644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.777670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.777804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.777955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.777980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.778139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.778270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.778295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.778421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.778554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.778579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.778711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.778823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.778851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.778989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.779142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.779168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.779301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.779407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.779434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.779540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.779669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.779694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.779801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.779926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.779952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.780084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.780193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.780218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.780373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.780500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.780546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.780710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.780869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.780894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.781049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.781187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.781212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.781317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.781438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.781463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.781649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.781788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.781833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.781991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.782159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.782184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.782336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.782443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.782468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.782592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.782744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.782770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.782908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.783003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.783028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.783137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.783277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.783302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.783401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.783500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.783532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.783659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.783781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.783806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.783910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.784040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.784066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.784174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.784302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.784327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.784434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.784598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.784623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.359 [2024-11-28 01:25:15.784720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.784822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.359 [2024-11-28 01:25:15.784846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.359 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.784981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.785076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.785102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.785227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.785322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.785348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.785447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.785551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.785577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.785737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.785877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.785904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.786037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.786134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.786158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.786265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.786362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.786386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.786542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.786636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.786661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.786769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.786920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.786945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.787098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.787220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.787245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.787383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.787486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.787512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.787676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.787802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.787845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.787947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.788051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.788076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.788181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.788313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.788338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.788439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.788576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.788601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.788734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.788866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.788890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.789000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.789127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.789152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.789246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.789399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.789424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.789601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.789743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.789768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.789878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.790006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.790031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.790155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.790253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.790277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.790364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.790489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.790513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.790635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.790764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.790788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.790913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.791004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.791029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.791166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.791293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.791318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.791450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.791568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.791596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.791743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.791886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.791915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.792064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.792193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.792218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.792325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.792449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.792475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.360 qpair failed and we were unable to recover it. 00:31:01.360 [2024-11-28 01:25:15.792608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.360 [2024-11-28 01:25:15.792754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.792795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.792949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.793103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.793127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.793256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.793385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.793410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.793506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.793621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.793648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.793772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.793884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.793913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.794050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.794180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.794205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.794334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.794463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.794487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.794608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.794789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.794837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.794953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.795095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.795121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.795225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.795361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.795386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.795507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.795635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.795679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.795846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.795981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.796006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.796103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.796205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.796230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.796382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.796477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.796502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.796623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.796749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.796775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.796935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.797063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.797092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.797223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.797347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.797372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.797503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.797609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.797637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.797764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.797892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.797917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.798043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.798146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.798172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.798276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.798430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.798455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.798551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.798672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.798700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.798820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.798919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.798945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.799043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.799140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.799166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.799269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.799388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.799413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.361 qpair failed and we were unable to recover it. 00:31:01.361 [2024-11-28 01:25:15.799515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.799672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.361 [2024-11-28 01:25:15.799702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.799854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.799946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.799971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.800073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.800164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.800188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.800316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.800438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.800462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.800578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.800744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.800785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.800880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.800982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.801007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.801164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.801289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.801314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.801449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.801549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.801575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.801703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.801816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.801845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.802021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.802144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.802171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.802307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.802461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.802494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.802633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.802765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.802790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.802891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.803000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.803025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.803154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.803247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.803272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.803401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.803536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.803562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.803669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.803768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.803793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.803904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.804065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.804090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.804187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.804286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.804312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.804411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.804502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.804552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.804690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.804842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.804867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.804997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.805124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.805149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.805258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.805414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.805439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.805547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.805687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.805714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.805883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.806054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.806079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.806185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.806334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.806359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.806489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.806648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.806692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.806798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.806906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.806931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.807058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.807159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.807183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.807317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.807445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.807471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.362 qpair failed and we were unable to recover it. 00:31:01.362 [2024-11-28 01:25:15.807599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.362 [2024-11-28 01:25:15.807732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.807756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.807889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.808019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.808043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.808185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.808283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.808309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.808404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.808533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.808559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.808703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.808862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.808889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.809012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.809107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.809132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.809233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.809392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.809418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.809531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.809663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.809688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.809823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.809982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.810008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.810110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.810215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.810240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.810365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.810458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.810485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.810630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.810732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.810757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.810918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.811019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.811043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.811169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.811299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.811325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.811464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.811566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.811592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.811757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.811855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.811886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.812030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.812131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.812156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.812287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.812375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.812401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.812548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.812649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.812675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.812770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.812869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.812896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.813033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.813167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.813192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.813286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.813413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.813438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.813568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.813670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.813696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.813808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.813928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.813953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.814054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.814150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.814176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.814282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.814407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.814432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.814566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.814719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.814746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.814872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.815035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.815061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.363 [2024-11-28 01:25:15.815165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.815271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.363 [2024-11-28 01:25:15.815296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.363 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.815398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.815518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.815552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.815653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.815809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.815835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.815935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.816058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.816083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.816195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.816320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.816345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.816444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.816581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.816607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.816735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.816896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.816922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.817028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.817137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.817163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.817291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.817393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.817417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.817516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.817636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.817662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.817792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.817903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.817929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.818030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.818152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.818180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.818316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.818427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.818453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.818574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.818727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.818770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.818929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.819079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.819103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.819199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.819362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.819387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.819489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.819614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.819657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.819780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.819897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.819923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.820061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.820160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.820185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.820318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.820453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.820478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.820612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.820746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.820772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.820872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.820991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.821016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.821174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.821270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.821297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.821401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.821537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.821575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.821698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.821858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.821885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.822034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.822180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.822205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.822309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.822416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.822440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.822559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.822691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.822715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.822820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.822960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.364 [2024-11-28 01:25:15.822984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.364 qpair failed and we were unable to recover it. 00:31:01.364 [2024-11-28 01:25:15.823091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.823217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.823242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.823372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.823469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.823494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.823612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.823743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.823767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.823872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.823979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.824004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.824101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.824196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.824221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.824352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.824451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.824476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.824597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.824707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.824732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.824836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.824933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.824958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.825086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.825211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.825237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.825341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.825443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.825467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.825624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.825755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.825798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.825945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.826072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.826096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.826226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.826352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.826378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.826481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.826595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.826620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.826732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.826858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.826883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.826983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.827090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.827115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.827220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.827345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.827369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.827497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.827600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.827627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.827766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.827894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.827918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.828057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.828160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.828185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.828289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.828418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.828442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.828567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.828728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.828753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.828864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.828990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.829015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.829116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.829209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.829233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.829328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.829455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.829480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.365 qpair failed and we were unable to recover it. 00:31:01.365 [2024-11-28 01:25:15.829619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.829743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.365 [2024-11-28 01:25:15.829768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.829901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.829999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.830024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.830151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.830261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.830286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.830381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.830486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.830510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.830648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.830751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.830775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.830899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.831022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.831046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.831144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.831270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.831294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.831392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.831530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.831555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.831682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.831794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.831822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.831967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.832086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.832111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.832221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.832325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.832351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.832452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.832550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.832576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.832682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.832834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.832860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.833021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.833124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.833151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.833304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.833404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.833430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.833544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.833693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.833736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.833851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.833965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.833990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.834101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.834199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.834224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.834353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.834446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.834470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.834577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.834712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.834738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.834876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.835007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.835032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.835189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.835315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.835340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.835435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.835564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.835599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.835721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.835848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.835874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.836035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.836137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.836163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.836260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.836384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.836409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.836507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.836699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.836724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.836831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.836955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.836979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.366 qpair failed and we were unable to recover it. 00:31:01.366 [2024-11-28 01:25:15.837105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.366 [2024-11-28 01:25:15.837204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.837229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.837331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.837456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.837481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.837588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.837714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.837744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.837842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.837947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.837971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.838106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.838230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.838256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.838355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.838458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.838483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.838594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.838715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.838741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.838867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.838994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.839019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.839145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.839270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.839295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.839399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.839533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.839560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.839666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.839786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.839830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.839955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.840050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.840075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.840178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.840283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.840313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.840418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.840522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.840557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.840657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.840759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.840783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.840891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.840992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.841017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.841151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.841299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.841323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.841420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.841572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.841599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.841727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.841855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.841880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.841976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.842104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.842129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.842266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.842361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.842387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.842483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.842591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.842617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.842720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.842874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.842907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.843014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.843112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.843137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.843244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.843368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.843392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.843514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.843645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.843671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.843792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.843919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.843944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.844075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.844173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.844199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.367 [2024-11-28 01:25:15.844357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.844458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.367 [2024-11-28 01:25:15.844484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.367 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.844614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.844720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.844746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.844880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.844983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.845008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.845113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.845232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.845257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.845393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.845491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.845522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.845693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.845794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.845820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.845919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.846077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.846103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.846206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.846333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.846357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.846460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.846561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.846587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.846748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.846872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.846896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.847022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.847137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.847162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.847298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.847398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.847423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.847530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.847641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.847666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.847765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.847870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.847894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.848039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.848139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.848163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.848257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.848382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.848406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.848515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.848627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.848653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.848750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.848852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.848878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.848999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.849118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.849142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.849248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.849376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.849400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.849509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.849620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.849646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.849744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.849871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.849897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.850024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.850149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.850173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.850277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.850380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.850404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.850500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.850618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.850643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.850799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.850902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.850928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.851033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.851159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.851183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.851272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.851395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.851419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.851523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.851629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.368 [2024-11-28 01:25:15.851655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.368 qpair failed and we were unable to recover it. 00:31:01.368 [2024-11-28 01:25:15.851810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.851929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.851953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.852048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.852146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.852171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.852307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.852405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.852430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.852556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.852680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.852707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.852842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.852973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.852998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.853123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.853232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.853256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.853412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.853520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.853552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.853656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.853757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.853783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.853907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.854000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.854026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.854131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.854232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.854257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.854361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.854454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.854479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.854586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.854721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.854747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.854875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.854976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.855003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.855136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.855240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.855266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.855359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.855485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.855510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.855620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.855746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.855771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.855887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.855994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.856020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.856157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.856252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.856276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.856404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.856585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.856613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.856759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.856925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.856952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.857099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.857224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.857250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.857356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.857483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.857508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.857627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.857728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.857753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.857884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.857976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.858002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.858126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.858226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.858251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.858411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.858536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.858561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.858714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.858842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.858869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.858984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.859092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.859116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.369 qpair failed and we were unable to recover it. 00:31:01.369 [2024-11-28 01:25:15.859238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.859333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.369 [2024-11-28 01:25:15.859357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.859518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.859656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.859681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.859784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.859881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.859905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.860006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.860111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.860136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.860228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.860356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.860381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.860477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.860581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.860607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.860732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.860832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.860858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.860993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.861098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.861123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.861227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.861323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.861347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.861456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.861584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.861610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.861736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.861859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.861883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.862015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.862146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.862170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.862297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.862391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.862416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.862580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.862688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.862712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.862836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.862936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.862961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.863091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.863217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.863241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.863367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.863463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.863487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.863632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.863730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.863755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.863885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.863982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.864008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.864114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.864264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.864289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.864386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.864480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.864504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.864672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.864773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.864798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.864898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.865029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.865054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.865148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.865239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.865264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.865396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.865535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.865561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.370 [2024-11-28 01:25:15.865677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.865798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.370 [2024-11-28 01:25:15.865823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.370 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.865923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.866055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.866080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.866208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.866316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.866341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.866444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.866551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.866578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.866690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.866815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.866841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.866964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.867095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.867121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.867248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.867403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.867428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.867534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.867660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.867705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.867836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.867935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.867959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.868082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.868188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.868213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.868343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.868470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.868494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.868640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.868781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.868823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.868951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.869097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.869123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.869249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.869372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.869398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.869494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.869651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.869675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.869779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.869879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.869904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.870035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.870159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.870183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.870309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.870399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.870423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.870551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.870700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.870742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.870841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.870942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.870967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.871074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.871228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.871252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.871381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.871484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.871510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.871616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.871746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.871771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.871871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.872043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.872068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.872198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.872300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.872324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.872424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.872553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.872579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.872705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.872865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.872889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.872993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.873093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.873117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.873223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.873312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.873337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.371 qpair failed and we were unable to recover it. 00:31:01.371 [2024-11-28 01:25:15.873429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.371 [2024-11-28 01:25:15.873553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.873579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.873679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.873808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.873833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.873931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.874055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.874081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.874204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.874322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.874347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.874473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.874637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.874682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.874803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.874972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.875016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.875124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.875224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.875249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.875362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.875487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.875512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.875617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.875745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.875769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.875911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.876039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.876064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.876189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.876292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.876316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.876448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.876579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.876605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.876730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.876836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.876861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.876984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.877080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.877105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.877234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.877335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.877360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.877467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.877609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.877634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.877739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.877888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.877912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.878026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.878126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.878151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.878248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.878380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.878405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.878551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.878711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.878736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.878841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.878939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.878965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.879094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.879217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.879243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.879345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.879462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.879487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.879625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.879729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.879754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.879862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.879986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.880015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.880142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.880236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.880261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.880396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.880522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.880574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.880684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.880815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.880840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.372 [2024-11-28 01:25:15.880944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.881049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.372 [2024-11-28 01:25:15.881073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.372 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.881207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.881328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.881352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.881476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.881588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.881615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.881713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.881849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.881876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.882031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.882127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.882154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.882277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.882401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.882426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.882562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.882681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.882730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.882840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.882992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.883017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.883182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.883283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.883307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.883407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.883537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.883564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.883656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.883784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.883810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.883944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.884047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.884072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.884176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.884295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.884321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.884421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.884523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.884557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.884695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.884827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.884854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.885016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.885147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.885173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.885282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.885424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.885453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.885578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.885744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.885789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.885922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.886025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.886051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.886160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.886254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.886278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.886401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.886497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.886522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.886655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.886778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.886804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.886937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.887072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.887097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.887229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.887337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.887363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.887476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.887596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.887639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.887766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.887912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.887936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.888044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.888148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.888178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.888278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.888382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.888407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.888506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.888680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.888705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.373 qpair failed and we were unable to recover it. 00:31:01.373 [2024-11-28 01:25:15.888843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.373 [2024-11-28 01:25:15.888968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.888992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.889096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.889194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.889220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.889349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.889444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.889468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.889607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.889721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.889748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.889883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.889981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.890006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.890136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.890232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.890257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.890394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.890519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.890552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.890702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.890838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.890883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.891025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.891124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.891148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.891280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.891377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.891402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.891537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.891688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.891713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.891844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.891942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.891968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.892584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.892775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.892820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.892948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.893074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.893100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.893204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.893331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.893356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.893483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.893639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.893682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.893807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.893965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.894006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.894137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.894287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.894311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.894421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.894531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.894557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.894676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.894845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.894888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.894993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.895119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.895145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.895246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.895337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.895362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.895487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.895644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.895670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.895798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.895900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.895926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.896044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.896144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.896169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.896290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.896386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.896412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.896556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.896683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.896708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.896813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.896941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.896966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.374 [2024-11-28 01:25:15.897075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.897172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.374 [2024-11-28 01:25:15.897198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.374 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.897329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.897462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.897487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.897638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.897739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.897763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.897928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.898057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.898082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.898205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.898297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.898321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.898445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.898572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.898598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.898716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.898869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.898911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.899065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.899154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.899179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.899303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.899451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.899477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.899636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.899776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.899823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.899952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.900070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.900096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.900223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.900323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.900348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.900482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.900636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.900679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.900796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.900981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.901024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.901150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.901253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.901280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.901384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.901515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.901551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.901651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.901777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.901803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.901945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.902086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.902113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.902231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.902361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.902387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.902489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.902634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.902677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.902827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.902946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.902973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.903068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.903229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.903255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.903351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.903503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.903543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.903640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.903741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.903766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.903897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.904031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.904056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.904149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.904258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.375 [2024-11-28 01:25:15.904284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.375 qpair failed and we were unable to recover it. 00:31:01.375 [2024-11-28 01:25:15.904407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.904505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.904551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.904658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.904787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.904813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.904914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.905008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.905033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.905187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.905282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.905307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.905465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.905609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.905635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.905738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.905862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.905898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.906031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.906155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.906182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.906315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.906416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.906441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.906549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.906649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.906674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.906796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.906940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.906964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.907121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.907228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.907253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.907394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.907489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.907513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.907667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.907788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.907814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.907998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.908165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.908190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.908307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.908400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.908425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.908567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.908659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.908684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.908845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.908953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.908981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.909129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.909226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.909251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.909378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.909477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.909502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.909648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.909776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.909802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.909896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.909998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.910025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.910124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.910224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.910250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.910369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.910491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.910516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.910632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.910732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.910757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.910928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.911095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.911129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.911234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.911360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.911385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.911510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.911622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.911648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.911752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.911921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.911949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.376 qpair failed and we were unable to recover it. 00:31:01.376 [2024-11-28 01:25:15.912101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.912231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.376 [2024-11-28 01:25:15.912258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.912392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.912519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.912552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.912658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.912778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.912804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.912915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.913019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.913049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.913192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.913334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.913361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.913483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.913626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.913651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.913770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.913897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.913926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.914057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.914177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.914205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.914311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.914450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.914478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.914641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.914742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.914766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.914898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.915043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.915070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.915185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.915348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.915378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.915502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.915649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.915674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.915781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.915936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.915964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.916167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.916306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.916333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.916431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.916557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.916598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.916699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.916794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.916823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.916935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.917063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.917091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.917248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.917404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.917430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.917541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.917662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.917686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.917814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.917921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.917945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.918122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.918262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.918290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.918419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.918521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.918571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.918680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.918778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.918803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.918932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.919034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.919058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.919181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.919355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.919382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.919494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.919619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.919644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.919748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.919866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.919893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.920027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.920139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.920166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.377 qpair failed and we were unable to recover it. 00:31:01.377 [2024-11-28 01:25:15.920306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.377 [2024-11-28 01:25:15.920409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.920436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.378 qpair failed and we were unable to recover it. 00:31:01.378 [2024-11-28 01:25:15.920561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.920708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.920734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.378 qpair failed and we were unable to recover it. 00:31:01.378 [2024-11-28 01:25:15.920860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.920962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.920986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.378 qpair failed and we were unable to recover it. 00:31:01.378 [2024-11-28 01:25:15.921150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.921249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.921276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.378 qpair failed and we were unable to recover it. 00:31:01.378 [2024-11-28 01:25:15.921388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.921498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.921539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.378 qpair failed and we were unable to recover it. 00:31:01.378 [2024-11-28 01:25:15.921661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.921760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.921784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.378 qpair failed and we were unable to recover it. 00:31:01.378 [2024-11-28 01:25:15.921897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.922076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.922103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.378 qpair failed and we were unable to recover it. 00:31:01.378 [2024-11-28 01:25:15.922238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.922396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.922424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.378 qpair failed and we were unable to recover it. 00:31:01.378 [2024-11-28 01:25:15.922596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.922690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.922714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.378 qpair failed and we were unable to recover it. 00:31:01.378 [2024-11-28 01:25:15.922842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.923011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.923034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.378 qpair failed and we were unable to recover it. 00:31:01.378 [2024-11-28 01:25:15.923175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.923346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.923372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.378 qpair failed and we were unable to recover it. 00:31:01.378 [2024-11-28 01:25:15.923490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.923658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.923685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.378 qpair failed and we were unable to recover it. 00:31:01.378 [2024-11-28 01:25:15.923778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.923916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.923943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.378 qpair failed and we were unable to recover it. 00:31:01.378 [2024-11-28 01:25:15.924063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.924199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.378 [2024-11-28 01:25:15.924227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.378 qpair failed and we were unable to recover it. 00:31:01.657 [2024-11-28 01:25:15.924364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.924483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.924510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.657 qpair failed and we were unable to recover it. 00:31:01.657 [2024-11-28 01:25:15.924646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.924742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.924767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.657 qpair failed and we were unable to recover it. 00:31:01.657 [2024-11-28 01:25:15.924918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.925054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.925080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.657 qpair failed and we were unable to recover it. 00:31:01.657 [2024-11-28 01:25:15.925232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.925382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.925409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.657 qpair failed and we were unable to recover it. 00:31:01.657 [2024-11-28 01:25:15.925532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.925634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.925659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.657 qpair failed and we were unable to recover it. 00:31:01.657 [2024-11-28 01:25:15.925807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.925909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.925935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.657 qpair failed and we were unable to recover it. 00:31:01.657 [2024-11-28 01:25:15.926072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.926193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.926220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.657 qpair failed and we were unable to recover it. 00:31:01.657 [2024-11-28 01:25:15.926403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.926502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.926533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.657 qpair failed and we were unable to recover it. 00:31:01.657 [2024-11-28 01:25:15.926639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.926735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.926759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.657 qpair failed and we were unable to recover it. 00:31:01.657 [2024-11-28 01:25:15.926888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.926998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.927026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.657 qpair failed and we were unable to recover it. 00:31:01.657 [2024-11-28 01:25:15.927168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.927277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.927304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.657 qpair failed and we were unable to recover it. 00:31:01.657 [2024-11-28 01:25:15.927440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.927558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.927600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.657 qpair failed and we were unable to recover it. 00:31:01.657 [2024-11-28 01:25:15.927750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.927902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.657 [2024-11-28 01:25:15.927927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.657 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.928103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.928243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.928270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.928386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.928502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.928553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.928668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.928804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.928829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.928985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.929095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.929122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.929246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.929379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.929408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.929604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.929705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.929729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.929875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.929989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.930015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.930150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.930321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.930349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.930480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.930620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.930646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.930756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.930904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.930928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.931036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.931216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.931243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.931352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.931496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.931551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.931661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.931760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.931786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.931909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.932027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.932051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.932203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.932351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.932378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.932493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.932620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.932645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.932746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.932876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.932901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.933051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.933195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.933223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.933386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.933474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.933498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.933636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.933744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.933771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.933889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.934040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.934064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.934231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.934357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.934382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.934537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.934642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.934669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.934776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.934913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.934940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.935056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.935154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.935178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.935301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.935436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.935486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.935629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.935746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.935773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.935877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.936016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.658 [2024-11-28 01:25:15.936043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.658 qpair failed and we were unable to recover it. 00:31:01.658 [2024-11-28 01:25:15.936198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.936322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.936347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.936495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.936663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.936690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.936820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.936942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.936969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.937081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.937217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.937244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.937401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.937534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.937559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.937707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.937825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.937852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.937958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.938092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.938118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.938265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.938409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.938436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.938594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.938694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.938719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.938836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.938947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.938975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.939107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.939222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.939249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.939391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.939504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.939539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.939672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.939765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.939790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.939886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.940022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.940046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.940150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.940306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.940331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.940461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.940608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.940636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.940755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.940870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.940894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.941021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.941151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.941178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.941300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.941416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.941442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.941590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.941720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.941743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.941862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.941968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.941993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.942174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.942326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.942351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.942450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.942554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.942579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.942704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.942873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.942900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.943040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.943189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.943218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.943372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.943530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.943558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.943680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.943818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.943845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.943954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.944106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.944130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.659 [2024-11-28 01:25:15.944230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.944355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.659 [2024-11-28 01:25:15.944379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.659 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.944570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.944667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.944692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.944792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.944936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.944963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.945079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.945239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.945266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.945410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.945507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.945539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.945659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.945796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.945823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.945976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.946100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.946124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.946281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.946375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.946399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.946532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.946659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.946683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.946835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.946976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.947003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.947117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.947267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.947292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.947394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.947483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.947508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.947646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.947761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.947787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.947892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.948029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.948053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.948181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.948294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.948321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.948450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.948578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.948607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.948730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.948829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.948854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.949001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.949146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.949170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.949269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.949442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.949470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.949623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.949780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.949804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.949955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.950055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.950078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.950218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.950329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.950364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.950517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.950645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.950670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.950820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.950926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.950953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.951112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.951227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.951251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.951401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.951548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.951575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.951687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.951794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.951820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.951979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.952077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.952104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.952214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.952363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.952387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.660 qpair failed and we were unable to recover it. 00:31:01.660 [2024-11-28 01:25:15.952501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.952641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.660 [2024-11-28 01:25:15.952669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.952837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.952985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.953009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.953120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.953234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.953262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.953382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.953489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.953514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.953649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.953751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.953775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.953869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.953962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.954004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.954114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.954254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.954281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.954412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.954505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.954537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.954695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.954815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.954860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.954988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.955106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.955133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.955263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.955370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.955397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.955532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.955663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.955688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.955836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.955943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.955969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.956073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.956207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.956233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.956394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.956536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.956561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.956665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.956790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.956814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.956934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.957097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.957124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.957238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.957355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.957383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.957489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.957620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.957650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.957775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.957920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.957945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.958046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.958147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.958172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.958334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.958479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.958506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.958657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.958758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.958783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.958983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.959080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.959104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.959232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.959363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.959390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.959498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.959633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.959658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.959764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.959881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.959905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.960015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.960103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.960127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.960257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.960410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.960436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.661 qpair failed and we were unable to recover it. 00:31:01.661 [2024-11-28 01:25:15.960576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.661 [2024-11-28 01:25:15.960699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.960723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.960822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.960921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.960945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.961106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.961232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.961257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.961405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.961507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.961543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.961658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.961762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.961788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.961918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.962031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.962059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.962200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.962295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.962318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.962438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.962560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.962587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.962693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.962832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.962859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.962981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.963113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.963141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.963275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.963431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.963457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.963611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.963707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.963734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.963892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.963992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.964016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.964187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.964343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.964367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.964514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.964656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.964697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.964803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.964975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.965002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.965133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.965273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.965300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.965440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.965573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.965597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.965722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.965820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.965844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.965969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.966110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.966136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.966272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.966377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.966405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.966508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.966642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.966667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.966795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.966893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.966917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.967045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.967173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.662 [2024-11-28 01:25:15.967197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.662 qpair failed and we were unable to recover it. 00:31:01.662 [2024-11-28 01:25:15.967356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.967465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.967492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.967648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.967782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.967823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.967956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.968074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.968099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.968243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.968345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.968371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.968552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.968659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.968684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.968842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.968996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.969021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.969147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.969301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.969330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.969429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.969558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.969585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.969744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.969853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.969896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.970004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.970153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.970180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.970328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.970436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.970460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.970562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.970706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.970733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.970865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.970960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.970985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.971112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.971256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.971284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.971438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.971601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.971627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.971754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.971902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.971929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.972037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.972171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.972203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.972348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.972460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.972489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.972729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.972885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.972913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.973069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.973205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.973232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.973359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.973464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.973487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.973644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.973814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.973840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.973972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.974090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.974113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.974207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.974332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.974356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.974451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.974589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.974616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.974762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.974933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.974960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.975080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.975197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.975221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.975352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.975486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.975513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.663 [2024-11-28 01:25:15.975640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.975775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.663 [2024-11-28 01:25:15.975801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.663 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.975946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.976052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.976090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.976215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.976343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.976368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.976535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.976636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.976661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.976757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.976886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.976911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.977051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.977167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.977195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.977309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.977411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.977437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.977600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.977737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.977764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.977880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.978025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.978049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.978157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.978287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.978312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.978411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.978517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.978557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.978682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.978818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.978845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.978954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.979065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.979108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.979260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.979371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.979399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.979553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.979654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.979680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.979831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.979965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.979997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.980112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.980252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.980280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.980417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.980565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.980593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.980714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.980812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.980843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.981015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.981111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.981135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.981262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.981365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.981389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.981485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.981606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.981631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.981758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.981871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.981895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.982068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.982167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.982192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.982291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.982420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.982448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.982597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.982696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.982721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.982823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.982915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.982943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.983048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.983138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.983164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.664 [2024-11-28 01:25:15.983307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.983405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.664 [2024-11-28 01:25:15.983429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.664 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.983521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.983628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.983656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.983828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.983948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.983973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.984114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.984233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.984274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.984373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.984472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.984496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.984622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.984763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.984791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.984947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.985051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.985075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.985175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.985275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.985300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.985403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.985564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.985589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.985711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.985856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.985883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.985992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.986088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.986112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.986274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.986417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.986449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.986622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.986733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.986758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.986861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.986967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.986992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.987091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.987218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.987243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.987382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.987512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.987546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.987686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.987820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.987847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.987965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.988106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.988133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.988265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.988358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.988382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.988492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.988695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.988723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.988857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.988983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.989011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.989119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.989253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.989280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.989418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.989522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.989555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.989722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.989862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.989889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.990011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.990124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.990165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.990287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.990414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.990439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.990567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.990664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.990688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.990812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.990933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.990960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.991115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.991207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.991232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.665 [2024-11-28 01:25:15.991390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.991500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.665 [2024-11-28 01:25:15.991531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.665 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.991678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.991804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.991828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.991938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.992079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.992106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.992232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.992367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.992393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.992542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.992648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.992673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.992769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.992890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.992915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.993047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.993211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.993239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.993381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.993513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.993546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.993681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.993848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.993874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.994026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.994149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.994174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.994335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.994441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.994466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.994595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.994703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.994731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.994878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.994984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.995011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.995135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.995261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.995285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.995410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.995580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.995606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.995735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.995864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.995888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.995986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.996152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.996177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.996276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.996378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.996404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.996498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.996656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.996700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.996804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.996905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.996930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.997047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.997138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.997162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.997269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.997374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.997398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.997511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.997647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.997674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.997804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.997944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.997976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.998092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.998266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.998293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.998414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.998520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.998554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.666 qpair failed and we were unable to recover it. 00:31:01.666 [2024-11-28 01:25:15.998682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.666 [2024-11-28 01:25:15.998803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:15.998830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:15.998948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:15.999096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:15.999123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:15.999272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:15.999373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:15.999397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:15.999496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:15.999597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:15.999622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:15.999776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:15.999888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:15.999915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.000031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.000200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.000228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.000344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.000444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.000471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.000608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.000708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.000733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.000840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.001007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.001032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.001170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.001285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.001312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.001433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.001568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.001596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.001719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.001880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.001904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.002052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.002207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.002231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.002366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.002541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.002567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.002662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.002786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.002830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.003027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.003125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.003149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.003258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.003347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.003388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.003538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.003664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.003688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.003797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.003944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.003971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.004116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.004215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.004240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.004350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.004501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.004550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.004658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.004760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.004784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.004918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.005055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.005083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.005204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.005306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.005331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.005459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.005604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.005633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.005748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.005892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.005918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.006039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.006191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.006219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.006334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.006467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.006491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.667 [2024-11-28 01:25:16.006598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.006725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.667 [2024-11-28 01:25:16.006750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.667 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.006919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.007031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.007058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.007192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.007291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.007318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.007460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.007597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.007623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.007803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.007931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.007955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.008095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.008205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.008232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.008368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.008473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.008500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.008630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.008756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.008782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.008908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.009025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.009050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.009223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.009324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.009352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.009530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.009648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.009676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.009772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.009873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.009898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.009997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.010120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.010148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.010259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.010363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.010391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.010565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.010676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.010704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.010822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.010959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.010984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.011094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.011204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.011231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.011340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.011485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.011510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.011666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.011769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.011794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.011892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.012021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.012046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.012168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.012263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.012308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.012425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.012563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.012592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.012700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.012866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.012891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.013039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.013140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.013165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.013292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.013390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.013418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.013584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.013709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.013734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.013838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.013933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.013958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.014110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.014235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.014260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.014390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.014504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.014536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.668 qpair failed and we were unable to recover it. 00:31:01.668 [2024-11-28 01:25:16.014658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.014790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.668 [2024-11-28 01:25:16.014817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.014968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.015065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.015090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.015194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.015286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.015311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.015411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.015503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.015535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.015635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.015760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.015790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.015954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.016087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.016115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.016242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.016367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.016393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.016508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.016651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.016678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.016810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.016956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.016981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.017104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.017205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.017229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.017347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.017476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.017504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.017628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.017746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.017771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.017913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.018015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.018040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.018134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.018230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.018271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.018419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.018554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.018580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.018706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.018799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.018823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.018950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.019090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.019117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.019236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.019336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.019364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.019480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.019603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.019628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.019752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.019856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.019883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.019994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.020126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.020150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.020249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.020367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.020391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.020488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.020644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.020669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.020824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.020952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.020976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.021090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.021209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.021237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.021373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.021473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.021501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.021630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.021757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.021781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.021941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.022095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.022120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.022262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.022431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.022455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.669 qpair failed and we were unable to recover it. 00:31:01.669 [2024-11-28 01:25:16.022597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.669 [2024-11-28 01:25:16.022714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.022738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.022872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.022998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.023022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.023181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.023307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.023331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.023442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.023622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.023651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.023754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.023914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.023942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.024089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.024188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.024212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.024344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.024489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.024516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.024628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.024738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.024766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.024882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.025021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.025049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.025216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.025342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.025367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.025467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.025612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.025640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.025751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.025858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.025886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.025999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.026136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.026163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.026292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.026393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.026417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.026533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.026624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.026649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.026744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.026875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.026916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.027018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.027160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.027187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.027303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.027405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.027429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.027560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.027666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.027691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.027812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.027924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.027952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.028066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.028169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.028196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.028385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.028488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.028512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.028683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.028811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.028836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.028981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.029081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.029107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.029260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.029370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.029397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.029534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.029672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.029700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.029827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.029937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.029961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.030058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.030153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.030178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.030280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.030400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.030428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.670 qpair failed and we were unable to recover it. 00:31:01.670 [2024-11-28 01:25:16.030554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.670 [2024-11-28 01:25:16.030673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.030698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.030800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.030926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.030950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.031110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.031237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.031261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.031377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.031487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.031514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.031665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.031754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.031778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.031883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.031984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.032008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.032159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.032290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.032317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.032469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.032609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.032635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.032767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.032931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.032956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.033080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.033175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.033200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.033351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.033518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.033552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.033688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.033804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.033831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.033960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.034083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.034108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.034226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.034332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.034359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.034470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.034618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.034645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.034764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.034925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.034949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.035066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.035215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.035239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.035339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.035483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.035511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.035670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.035800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.035824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.035954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.036053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.036077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.036219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.036320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.036346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.036492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.036628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.036653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.036754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.036856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.036880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.037010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.037109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.037133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.037252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.037383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.037409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.671 [2024-11-28 01:25:16.037558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.037672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.671 [2024-11-28 01:25:16.037701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.671 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.037818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.037973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.037998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.038097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.038217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.038241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.038419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.038532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.038561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.038673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.038793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.038818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.038964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.039074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.039116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.039247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.039343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.039368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.039459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.039598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.039626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.039744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.039862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.039904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.040012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.040142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.040167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.040294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.040412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.040437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.040549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.040650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.040675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.040772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.040901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.040926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.041026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.041117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.041141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.041238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.041360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.041384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.041522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.041642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.041669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.041780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.041884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.041911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.042048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.042170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.042195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.042330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.042442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.042470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.042597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.042700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.042724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.042871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.042976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.043003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.043153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.043299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.043325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.043427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.043556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.043582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.043704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.043851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.043876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.043998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.044140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.044167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.044307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.044427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.044454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.044580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.044708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.044732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.044831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.044960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.044984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.045135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.045249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.045276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.672 qpair failed and we were unable to recover it. 00:31:01.672 [2024-11-28 01:25:16.045428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.045573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.672 [2024-11-28 01:25:16.045599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.045727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.045824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.045849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.045988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.046089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.046117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.046224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.046387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.046414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.046586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.046693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.046721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.046865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.046958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.046983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.047110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.047208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.047233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.047352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.047499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.047532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.047680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.047796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.047824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.047966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.048093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.048118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.048265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.048365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.048392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.048540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.048641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.048665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.048812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.048987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.049016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.049121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.049222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.049246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.049388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.049534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.049578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.049715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.049863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.049905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.050004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.050134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.050159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.050286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.050411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.050436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.050602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.050701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.050726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.050851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.050974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.050999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.051126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.051247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.051273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.051360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.051453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.051478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.051638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.051766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.051798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.051930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.052039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.052067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.052201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.052299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.052340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.052431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.052552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.052578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.052704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.052832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.052857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.052979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.053084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.053127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.053221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.053363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.053391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.673 qpair failed and we were unable to recover it. 00:31:01.673 [2024-11-28 01:25:16.053509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.673 [2024-11-28 01:25:16.053614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.053640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.053743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.053846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.053871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.053981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.054106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.054131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.054248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.054416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.054440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.054565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.054670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.054695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.054840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.054967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.054995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.055150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.055261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.055285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.055434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.055584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.055609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.055709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.055868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.055893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.056010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.056173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.056198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.056325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.056446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.056474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.056595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.056691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.056716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.056821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.056920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.056944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.057071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.057161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.057186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.057287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.057384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.057408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.057512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.057649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.057692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.057840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.057940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.057965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.058061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.058152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.058177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.058333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.058473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.058501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.058612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.058724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.058752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.058901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.059000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.059025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.059155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.059278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.059302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.059401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.059533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.059558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.059683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.059774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.059798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.059916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.060051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.060076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.060192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.060295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.060322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.060457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.060565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.060593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.060733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.060844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.060873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.060994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.061126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.674 [2024-11-28 01:25:16.061150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.674 qpair failed and we were unable to recover it. 00:31:01.674 [2024-11-28 01:25:16.061283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.061449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.061477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.061635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.061774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.061801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.061947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.062081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.062104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.062209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.062309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.062333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.062451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.062574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.062599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.062703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.062804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.062832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.062952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.063080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.063107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.063256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.063384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.063410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.063569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.063685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.063712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.063831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.063933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.063961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.064077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.064236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.064264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.064435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.064541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.064566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.064717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.064852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.064879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.065028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.065126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.065151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.065252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.065443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.065467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.065570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.065671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.065696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.065847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.066010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.066034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.066159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.066285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.066325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.066477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.066611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.066636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.066738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.066890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.066915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.067068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.067201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.067228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.067346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.067477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.067504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.067664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.067795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.067819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.067916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.068015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.068041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.068175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.068300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.068326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.675 qpair failed and we were unable to recover it. 00:31:01.675 [2024-11-28 01:25:16.068462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.068619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.675 [2024-11-28 01:25:16.068647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.068760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.068903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.068928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.069028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.069131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.069154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.069299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.069443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.069471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.069615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.069752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.069780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.069921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.070058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.070086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.070237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.070335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.070359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.070475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.070584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.070626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.070730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.070822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.070862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.071004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.071144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.071170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.071289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.071412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.071439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.071587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.071737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.071762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.071914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.072056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.072083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.072188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.072305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.072333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.072446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.072540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.072565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.072709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.072846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.072872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.073025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.073130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.073155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.073261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.073374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.073400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.073523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.073634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.073658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.073784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.073914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.073938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.074062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.074177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.074204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.074325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.074430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.074454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.074578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.074680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.074705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.074826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.074931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.074958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.075069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.075217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.075241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.075363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.075507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.075540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.075684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.075810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.075835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.075950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.076091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.076118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.076226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.076355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.076382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.676 qpair failed and we were unable to recover it. 00:31:01.676 [2024-11-28 01:25:16.076561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.676 [2024-11-28 01:25:16.076669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.076696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.076860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.076958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.076984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.077093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.077196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.077225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.077330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.077444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.077472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.077608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.077753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.077777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.077903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.078023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.078047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.078199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.078298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.078322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.078471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.078595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.078623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.078769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.078868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.078892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.078991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.079113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.079138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.079254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.079404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.079431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.079584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.079712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.079737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.079851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.080002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.080026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.080130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.080224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.080249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.080345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.080480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.080507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.080643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.080799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.080823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.080959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.081097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.081124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.081277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.081426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.081451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.081605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.081750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.081777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.081877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.082015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.082042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.082223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.082320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.082344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.082467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.082589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.082615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.082761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.082879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.082907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.083041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.083178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.083205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.083341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.083480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.083507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.083633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.083740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.083764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.083893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.084028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.084055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.084150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.084253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.084280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.677 [2024-11-28 01:25:16.084392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.084535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.677 [2024-11-28 01:25:16.084564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.677 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.084721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.084871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.084895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.085021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.085160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.085187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.085314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.085444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.085468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.085585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.085733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.085758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.085888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.086018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.086043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.086157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.086264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.086291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.086435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.086554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.086583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.086698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.086838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.086863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.086987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.087084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.087108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.087290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.087385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.087427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.087556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.087667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.087692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.087844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.087954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.087995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.088119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.088220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.088243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.088389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.088515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.088560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.088667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.088765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.088793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.088935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.089088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.089113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.089265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.089358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.089382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.089541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.089649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.089676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.089787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.089890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.089918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.090035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.090139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.090167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.090292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.090395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.090419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.090521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.090651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.090675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.090775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.090880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.090905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.091032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.091162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.091190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.091312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.091416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.091452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.091605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.091772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.091799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.091904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.092053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.092078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.092173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.092268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.092293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.678 qpair failed and we were unable to recover it. 00:31:01.678 [2024-11-28 01:25:16.092388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.092490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.678 [2024-11-28 01:25:16.092514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.092646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.092799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.092827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.092928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.093035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.093063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.093177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.093288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.093315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.093443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.093554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.093580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.093685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.093774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.093816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.093924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.094021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.094049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.094163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.094261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.094289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.094424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.094548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.094574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.094698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.094803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.094830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.094938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.095048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.095073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.095179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.095272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.095296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.095445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.095579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.095605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.095732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.095878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.095907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.096074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.096188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.096215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.096323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.096435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.096462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.096586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.096684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.096709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.096801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.096949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.096977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.097117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.097230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.097257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.097394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.097507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.097545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.097700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.097801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.097827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.097976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.098090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.098117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.098256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.098367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.098409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.098500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.098647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.098676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.098791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.098887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.098912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.099007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.099135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.099160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.099264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.099358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.099382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.099474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.099567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.099592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.099690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.099813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.099838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.679 qpair failed and we were unable to recover it. 00:31:01.679 [2024-11-28 01:25:16.099956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.679 [2024-11-28 01:25:16.100066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.100094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.100228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.100377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.100402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.100552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.100659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.100687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.100806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.100903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.100929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.101073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.101237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.101261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.101438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.101568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.101596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.101706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.101808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.101835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.102008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.102111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.102136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.102296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.102442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.102474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.102600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.102740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.102767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.102870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.102978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.103005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.103127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.103217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.103241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.103345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.103537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.103565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.103678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.103818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.103846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.103942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.104065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.104092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.104219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.104325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.104365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.104502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.104627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.104652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.104779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.104891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.104918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.105030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.105178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.105203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.105309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.105409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.105433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.105557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.105683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.105707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.105802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.105895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.105919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.106018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.106178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.106202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.106330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.106450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.106474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.106591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.106727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.106754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.680 qpair failed and we were unable to recover it. 00:31:01.680 [2024-11-28 01:25:16.106898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.680 [2024-11-28 01:25:16.106988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.107012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.107113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.107282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.107310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.107476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.107575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.107600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.107718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.107857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.107881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.108016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.108133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.108161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.108275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.108376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.108403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.108555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.108655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.108680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.108779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.108873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.108898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.108989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.109111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.109136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.109281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.109375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.109403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.109522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.109619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.109644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.109749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.109899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.109927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.110068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.110206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.110233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.110336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.110440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.110466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.110583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.110676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.110702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.110820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.110962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.110986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.111086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.111187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.111214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.111368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.111533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.111561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.111686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.111793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.111816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.111940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.112057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.112099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.112225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.112378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.112419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.112549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.112693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.112722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.112875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.112972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.112995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.113100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.113229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.113272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.113383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.113498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.113522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.113634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.113752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.113779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.113879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.113998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.114022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.114127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.114229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.114254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.114341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.114458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.681 [2024-11-28 01:25:16.114483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.681 qpair failed and we were unable to recover it. 00:31:01.681 [2024-11-28 01:25:16.114673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.114805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.114829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.114947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.115036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.115060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.115158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.115284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.115309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.115405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.115509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.115543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.115643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.115746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.115771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.115875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.115975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.116004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.116133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.116236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.116261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.116419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.116535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.116560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.116698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.116806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.116834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.116951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.117048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.117073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.117241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.117336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.117362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.117536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.117636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.117660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.117758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.117901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.117928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.118048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.118168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.118193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.118312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.118425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.118451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.118560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.118667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.118692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.118814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.118928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.118956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.119079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.119235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.119259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.119419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.119520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.119551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.119701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.119800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.119828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.119965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.120071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.120097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.120220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.120376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.120400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.120571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.120698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.120722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.120837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.120976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.121000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.121097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.121245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.121274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.121423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.121559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.121602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.121732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.121843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.121870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.122016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.122142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.122167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.682 [2024-11-28 01:25:16.122258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.122357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.682 [2024-11-28 01:25:16.122381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.682 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.122480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.122592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.122618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.122760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.122913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.122937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.123031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.123123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.123149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.123274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.123406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.123433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.123589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.123715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.123739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.123852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.123958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.124000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.124104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.124204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.124228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.124334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.124463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.124490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.124633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.124766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.124790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.124916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.125052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.125080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.125185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.125364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.125388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.125511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.125615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.125656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.125778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.125875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.125899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.126023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.126190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.126217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.126368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.126518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.126550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.126655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.126794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.126823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.126948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.127094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.127119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.127275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.127394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.127422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.127554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.127653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.127679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.127844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.127987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.128013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.128153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.128282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.128307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.128434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.128584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.128609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.128756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.128892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.128919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.129091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.129238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.129263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.129366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.129487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.129510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.129660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.129801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.129828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.129973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.130084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.130110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.130285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.130414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.130440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.683 qpair failed and we were unable to recover it. 00:31:01.683 [2024-11-28 01:25:16.130631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.130763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.683 [2024-11-28 01:25:16.130788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.130913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.131056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.131082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.131212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.131360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.131387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.131553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.131657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.131686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.131808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.131904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.131930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.132099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.132238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.132265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.132430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.132606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.132632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.132728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.132873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.132900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.133074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.133175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.133200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.133362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.133490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.133515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.133673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.133787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.133814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.133921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.134083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.134110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.134256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.134384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.134408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.134540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.134677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.134705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.134844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.134989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.135016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.135152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.135291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.135319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.135486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.135623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.135666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.135775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.135935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.135960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.136091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.136247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.136272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.136397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.136579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.136608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.136766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.136920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.136962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.137102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.137237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.137264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.137375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.137483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.137532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.137628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.137753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.137777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.137930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.138049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.138089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.138219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.138323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.138350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.138496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.138670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.138697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.138874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.139002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.139029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.139198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.139300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.139325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.684 qpair failed and we were unable to recover it. 00:31:01.684 [2024-11-28 01:25:16.139477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.139630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.684 [2024-11-28 01:25:16.139658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.139800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.139965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.139993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.140133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.140244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.140271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.140376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.140494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.140519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.140674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.140790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.140816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.140926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.141027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.141054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.141189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.141321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.141348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.141468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.141594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.141619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.141797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.141975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.142000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.142094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.142245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.142270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.142393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.142516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.142546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.142679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.142777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.142805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.142953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.143063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.143090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.143245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.143397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.143421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.143583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.143684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.143712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.143836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.143939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.143963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.144088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.144191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.144216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.144342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.144498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.144523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.144703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.144853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.144877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.145009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.145135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.145159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.145252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.145374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.145414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.145512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.145620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.145644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.145760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.145864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.145892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.146014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.146140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.146165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.146286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.146432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.146459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.146610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.146761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.685 [2024-11-28 01:25:16.146786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.685 qpair failed and we were unable to recover it. 00:31:01.685 [2024-11-28 01:25:16.146941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.147081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.147108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.147231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.147356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.147380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.147509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.147655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.147682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.147861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.147960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.147984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.148124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.148252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.148279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.148401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.148564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.148590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.148750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.148891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.148917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.149119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.149283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.149309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.149448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.149556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.149584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.149708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.149835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.149859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.150002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.150163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.150191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.150326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.150491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.150518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.150676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.150840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.150867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.151041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.151137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.151162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.151324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.151446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.151470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.151573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.151677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.151701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.151833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.151935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.151959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.152096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.152193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.152218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.152344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.152488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.152515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.152652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.152758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.152784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.152888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.153046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.153073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.153197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.153346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.153370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.153515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.153664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.153692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.153838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.153958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.153983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.154099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.154248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.154275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.154465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.154619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.154644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.154769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.154891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.154918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.155044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.155175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.155202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.686 [2024-11-28 01:25:16.155340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.155452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.686 [2024-11-28 01:25:16.155480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.686 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.155632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.155753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.155777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.155938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.156111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.156139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.156319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.156464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.156490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.156632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.156765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.156792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.156937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.157060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.157085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.157225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.157390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.157417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.157550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.157726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.157750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.157845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.157964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.157992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.158117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.158239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.158264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.158438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.158576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.158604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.158717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.158848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.158888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.158984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.159113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.159149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.159277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.159401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.159426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.159554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.159694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.159721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.159826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.159938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.159965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.160102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.160237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.160265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.160392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.160491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.160515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.160674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.160796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.160823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.160967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.161068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.161095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.161205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.161353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.161377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.161502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.161604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.161628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.161757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.161856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.161879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.162031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.162161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.162184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.162288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.162410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.162434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.162586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.162754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.162782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.162894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.163007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.163036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.163176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.163339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.163366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.163466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.163608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.163636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.687 qpair failed and we were unable to recover it. 00:31:01.687 [2024-11-28 01:25:16.163825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.163981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.687 [2024-11-28 01:25:16.164022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.164131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.164277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.164301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.164399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.164539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.164566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.164701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.164809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.164852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.164979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.165081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.165105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.165199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.165291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.165316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.165492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.165637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.165665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.165772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.165941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.165968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.166087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.166240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.166263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.166432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.166537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.166562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.166659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.166812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.166839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.166972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.167107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.167147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.167251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.167403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.167428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.167591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.167726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.167754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.167931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.168085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.168110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.168256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.168361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.168388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.168554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.168709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.168732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.168872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.168978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.169005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.169156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.169255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.169279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.169409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.169546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.169573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.169719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.169845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.169873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.169973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.170100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.170124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.170267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.170403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.170431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.170597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.170734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.170775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.170937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.171042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.171065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.171219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.171367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.171393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.171541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.171705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.171730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.171832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.171953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.171980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.172155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.172274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.172298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.688 qpair failed and we were unable to recover it. 00:31:01.688 [2024-11-28 01:25:16.172452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.688 [2024-11-28 01:25:16.172557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.172586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.172748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.172904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.172928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.173050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.173167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.173195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.173343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.173471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.173496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.173599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.173731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.173756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.173886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.174059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.174083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.174232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.174401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.174425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.174547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.174648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.174674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.174778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.174935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.174962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.175103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.175263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.175288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.175388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.175535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.175563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.175710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.175811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.175836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.175960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.176057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.176099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.176233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.176367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.176394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.176501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.176658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.176687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.176835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.176959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.176984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.177162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.177262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.177289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.177422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.177537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.177566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.177673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.177812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.177853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.177954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.178046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.178071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.178166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.178308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.178335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.178489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.178622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.178647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.178855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.179110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.179138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.179283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.179410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.179434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.179555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.179659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.179686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.689 [2024-11-28 01:25:16.179807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.179919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.689 [2024-11-28 01:25:16.179946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.689 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.180052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.180193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.180217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.180342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.180441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.180465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.180592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.180733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.180761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.180883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.181025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.181052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.181192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.181325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.181353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.181510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.181646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.181670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.181784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.181921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.181948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.182054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.182170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.182194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.182352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.182477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.182500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.182602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.182720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.182744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.182897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.183044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.183070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.183180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.183285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.183311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.183442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.183540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.183567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.183723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.183852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.183877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.184047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.184189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.184216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.184387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.184521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.184578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.184733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.184881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.184913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.185054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.185148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.185172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.185289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.185452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.185480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.185611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.185708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.185733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.185837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.185935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.185959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.186080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.186180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.186204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.186345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.186518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.186553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.186734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.186861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.186885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.186987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.187161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.187188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.187336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.187492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.187516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.187680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.187792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.187820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.187928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.188091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.188118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.690 qpair failed and we were unable to recover it. 00:31:01.690 [2024-11-28 01:25:16.188229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.188370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.690 [2024-11-28 01:25:16.188395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.188520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.188634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.188659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.188833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.188966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.188991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.189121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.189269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.189294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.189419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.189548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.189573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.189697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.189825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.189849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.189996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.190119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.190145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.190284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.190391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.190432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.190557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.190660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.190684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.190818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.190956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.190981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.191113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.191213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.191237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.191351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.191462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.191489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.191640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.191734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.191759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.191846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.191998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.192022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.192144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.192255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.192279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.192383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.192531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.192558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.192698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.192836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.192863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.193020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.193139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.193163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.193313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.193459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.193486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.193612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.193755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.193781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.193909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.194045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.194072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.194183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.194306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.194329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.194470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.194586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.194612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.194753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.194887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.194913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.195053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.195158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.195185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.195328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.195452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.195476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.195600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.195702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.195728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.195871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.195999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.196026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.196166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.196267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.196294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.691 qpair failed and we were unable to recover it. 00:31:01.691 [2024-11-28 01:25:16.196410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.691 [2024-11-28 01:25:16.196571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.196596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.196747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.196852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.196878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.196986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.197123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.197147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.197295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.197429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.197456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.197605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.197733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.197758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.197945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.198044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.198070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.198238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.198373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.198399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.198550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.198647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.198670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.198770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.198904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.198928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.199070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.199178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.199205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.199346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.199479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.199511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.199670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.199797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.199822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.199972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.200066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.200089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.200242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.200336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.200361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.200515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.200643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.200669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.200807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.200903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.200929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.201106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.201203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.201227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.201408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.201547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.201589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.201715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.201808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.201850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.201987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.202097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.202125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.202245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.202370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.202395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.202589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.202745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.202769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.202946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.203069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.203093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.203220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.203345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.203369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.203517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.203618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.203642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.203756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.203870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.203897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.204033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.204137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.204163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.204303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.204458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.204481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.204606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.204732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.204756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.692 qpair failed and we were unable to recover it. 00:31:01.692 [2024-11-28 01:25:16.204933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.692 [2024-11-28 01:25:16.205093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.205120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.205275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.205431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.205455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.205606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.205741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.205768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.205877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.206028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.206052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.206166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.206278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.206306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.206457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.206561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.206586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.206701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.206799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.206828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.206954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.207044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.207068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.207177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.207276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.207300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.207434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.207553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.207580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.207690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.207813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.207837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.207937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.208056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.208081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.208254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.208402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.208426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.208634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.208762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.208786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.208907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.209078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.209102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.209253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.209345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.209369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.209531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.209660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.209684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.209854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.209959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.209986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.210115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.210219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.210245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.210386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.210482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.210505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.210606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.210712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.210736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.210868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.210972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.211013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.211115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.211259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.211288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.211414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.211514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.211547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.211725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.211827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.211854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.212026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.212140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.212164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.212269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.212421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.212461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.212636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.212764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.212789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.212886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.213010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.693 [2024-11-28 01:25:16.213035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.693 qpair failed and we were unable to recover it. 00:31:01.693 [2024-11-28 01:25:16.213162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.213287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.213312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.213434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.213554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.213597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.213721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.213825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.213850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.213979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.214072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.214097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.214267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.214416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.214442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.214595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.214697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.214721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.214877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.215002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.215042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.215223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.215373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.215397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.215575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.215737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.215789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.215932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.216069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.216095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.216235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.216352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.216376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.216550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.216690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.216719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.216829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.216930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.216957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.217095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.217206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.217233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.217362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.217514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.217545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.217682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.217817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.217843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.217979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.218124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.218151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.218282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.218433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.218458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.218611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.218710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.218734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.218905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.219049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.219072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.219224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.219372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.219399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.219535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.219672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.219700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.219847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.219974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.219999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.220129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.220267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.220295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.220434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.220576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.694 [2024-11-28 01:25:16.220604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.694 qpair failed and we were unable to recover it. 00:31:01.694 [2024-11-28 01:25:16.220744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.220927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.220951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.221048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.221209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.221233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.221352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.221491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.221518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.221676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.221786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.221813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.221947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.222097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.222122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.222247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.222372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.222397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.222492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.222615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.222640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.222742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.222864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.222889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.223012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.223134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.223158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.223253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.223378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.223403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.223567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.223697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.223721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.223824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.223936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.223964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.224077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.224219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.224246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.224383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.224511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.224543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.224665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.224835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.224859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.224964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.225113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.225137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.225301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.225400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.225425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.225554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.225687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.225712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.225837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.225935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.225960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.226079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.226199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.226228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.226322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.226413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.226439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.226570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.226679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.226704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.226855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.226941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.226966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.227093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.227209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.227234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.227382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.227507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.227540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.227663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.227784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.227808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.227933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.228053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.228077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.228224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.228333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.228359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.228491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.228614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.695 [2024-11-28 01:25:16.228641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.695 qpair failed and we were unable to recover it. 00:31:01.695 [2024-11-28 01:25:16.228781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.228911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.228935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.229088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.229227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.229268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.229398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.229553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.229581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.229713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.229855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.229883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.230003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.230138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.230163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.230291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.230492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.230516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.230648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.230768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.230796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.230931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.231038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.231065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.231236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.231361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.231387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.231556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.231694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.231719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.231864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.231993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.232019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.232149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.232313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.232340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.232489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.232618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.232644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.232817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.232991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.233016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.233141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.233253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.233280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.233452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.233581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.233606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.233736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.233827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.233852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.234023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.234123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.234148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.234299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.234417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.234441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.234536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.234632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.234657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.234810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.234902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.234927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.235054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.235174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.235215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.235313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.235415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.235458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.235571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.235709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.235738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.235912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.236032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.236057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.236231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.236364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.236391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.236502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.236609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.236636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.236778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.236917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.236944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.696 [2024-11-28 01:25:16.237066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.237189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.696 [2024-11-28 01:25:16.237213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.696 qpair failed and we were unable to recover it. 00:31:01.697 [2024-11-28 01:25:16.237343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.697 [2024-11-28 01:25:16.237481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.697 [2024-11-28 01:25:16.237508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.697 qpair failed and we were unable to recover it. 00:31:01.697 [2024-11-28 01:25:16.237667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.697 [2024-11-28 01:25:16.237816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.697 [2024-11-28 01:25:16.237840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.697 qpair failed and we were unable to recover it. 00:31:01.697 [2024-11-28 01:25:16.237964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.697 [2024-11-28 01:25:16.238089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.697 [2024-11-28 01:25:16.238115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.697 qpair failed and we were unable to recover it. 00:31:01.697 [2024-11-28 01:25:16.238247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.697 [2024-11-28 01:25:16.238347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.697 [2024-11-28 01:25:16.238372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.697 qpair failed and we were unable to recover it. 00:31:01.986 [2024-11-28 01:25:16.238501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.986 [2024-11-28 01:25:16.238619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.986 [2024-11-28 01:25:16.238647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.986 qpair failed and we were unable to recover it. 00:31:01.986 [2024-11-28 01:25:16.238758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.986 [2024-11-28 01:25:16.238854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.986 [2024-11-28 01:25:16.238880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.986 qpair failed and we were unable to recover it. 00:31:01.986 [2024-11-28 01:25:16.239026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.986 [2024-11-28 01:25:16.239201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.986 [2024-11-28 01:25:16.239226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.986 qpair failed and we were unable to recover it. 00:31:01.986 [2024-11-28 01:25:16.239349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.986 [2024-11-28 01:25:16.239441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.986 [2024-11-28 01:25:16.239466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.239568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.239675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.239702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.239812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.239928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.239955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.240066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.240186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.240210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.240360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.240481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.240506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.240691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.240859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.240888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.241016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.241109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.241133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.241239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.241333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.241357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.241455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.241579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.241604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.241780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.241921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.241948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.242109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.242247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.242274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.242411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.242546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.242574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.242697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.242819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.242844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.243021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.243129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.243156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.243297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.243408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.243433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.243605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.243716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.243744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.243883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.244030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.244054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.244173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.244274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.244301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.244464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.244611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.244637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.244739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.244868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.244892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.245017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.245119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.245145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.245291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.245429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.245457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.245561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.245675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.245717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.245853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.245977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.246017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.246145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.246268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.246292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.246436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.246556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.246580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.246729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.246841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.246868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.246979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.247122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.247145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.247247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.247370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.987 [2024-11-28 01:25:16.247394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.987 qpair failed and we were unable to recover it. 00:31:01.987 [2024-11-28 01:25:16.247517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.247680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.247704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.247855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.247995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.248022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.248136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.248302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.248326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.248479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.248607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.248632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.248785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.248922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.248948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.249056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.249194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.249221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.249354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.249512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.249545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.249718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.249846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.249871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.250042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.250175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.250200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.250372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.250540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.250567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.250704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.250863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.250890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.251039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.251142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.251165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.251329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.251462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.251489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.251663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.251828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.251855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.252005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.252107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.252131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.252250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.252399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.252423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.252620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.252717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.252742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.252886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.252999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.253031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.253139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.253292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.253317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.253437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.253561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.253587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.253692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.253818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.253842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.253991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.254133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.254160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.254320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.254467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.254494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.254639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.254764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.254788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.254962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.255114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.255138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.255288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.255431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.255456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.255611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.255789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.255815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.255967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.256092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.256117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.988 qpair failed and we were unable to recover it. 00:31:01.988 [2024-11-28 01:25:16.256265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.256410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.988 [2024-11-28 01:25:16.256434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.256552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.256679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.256704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.256804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.256902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.256928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.257080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.257202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.257227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.257351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.257534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.257560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.257680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.257792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.257816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.257934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.258117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.258141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.258244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.258366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.258407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.258534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.258682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.258705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.258846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.258953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.258994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.259106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.259272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.259299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.259439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.259564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.259589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.259708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.259846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.259872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.260011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.260147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.260174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.260313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.260454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.260481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.260601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.260755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.260779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.260929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.261068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.261097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.261209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.261349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.261377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.261488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.261630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.261659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.261808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.261936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.261960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.262139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.262241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.262280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.262383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.262537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.262562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.262715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.262854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.262880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.263025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.263180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.263205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.263389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.263496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.263521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.263640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.263774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.263800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.263904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.264038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.264064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.264195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.264280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.264304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.989 [2024-11-28 01:25:16.264388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.264514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.989 [2024-11-28 01:25:16.264545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.989 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.264646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.264771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.264798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.264931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.265114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.265138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.265258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.265358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.265382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.265509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.265649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.265677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.265822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.265926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.265952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.266061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.266172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.266212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.266341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.266443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.266468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.266617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.266734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.266761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.266896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.267032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.267059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.267210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.267340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.267364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.267511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.267661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.267685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.267788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.267942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.267973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.268115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.268268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.268293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.268449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.268569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.268598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.268722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.268883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.268908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.269054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.269218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.269244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.269356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.269530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.269558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.269711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.269834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.269858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.269959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.270058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.270083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.270257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.270430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.270457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.270605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.270746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.270773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.270941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.271043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.271069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.271196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.271290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.271315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.271415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.271521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.271552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.271649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.271772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.271796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.271894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.272021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.272045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.272170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.272257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.272282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.272407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.272560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.272585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.990 qpair failed and we were unable to recover it. 00:31:01.990 [2024-11-28 01:25:16.272751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.272898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.990 [2024-11-28 01:25:16.272925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.274219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.274395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.274425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.274578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.274683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.274708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.274848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.275000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.275028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.275151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.275278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.275302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.275403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.275504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.275535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.275634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.275761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.275786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.275936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.276089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.276114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.276295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.276444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.276486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.276625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.276766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.276791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.276947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.277049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.277074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.277201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.277353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.277378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.277519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.277633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.277660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.277757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.277897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.277924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.278069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.278173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.278198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.278323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.278463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.278491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.278633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.278735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.278763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.278912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.279042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.279069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.279182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.279307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.279331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.279438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.279537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.279562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.279655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.279803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.279831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.279944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.280059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.280086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.280253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.280350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.280375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.280496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.280598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.280623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.991 [2024-11-28 01:25:16.280752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.280907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.991 [2024-11-28 01:25:16.280935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.991 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.281049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.281156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.281184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.281367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.281490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.281513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.281729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.281864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.281889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.282018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.282167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.282193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.282321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.282439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.282463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.282598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.282724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.282748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.282889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.282989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.283031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.283165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.283275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.283299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.283399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.283522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.283571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.283697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.283856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.283884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.284025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.284198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.284225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.284369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.284484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.284512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.284633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.284742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.284784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.284919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.285016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.285041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.285165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.285313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.285354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.285518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.285635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.285659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.285812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.285961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.285987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.286157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.286254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.286278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.286436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.286572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.286601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.286739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.286876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.286922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.287071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.287223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.287246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.287349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.287471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.287494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.287604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.287732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.287755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.287883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.287987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.288013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.288170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.288318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.288342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.288464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.288572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.288596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.288687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.288786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.288810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.288910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.289008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.992 [2024-11-28 01:25:16.289032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.992 qpair failed and we were unable to recover it. 00:31:01.992 [2024-11-28 01:25:16.289187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.289283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.289310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.289425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.289545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.289572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.289734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.289844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.289885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.290015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.290135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.290163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.290278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.290416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.290444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.290569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.290663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.290688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.290830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.290943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.290971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.291083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.291263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.291288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.291388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.291564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.291592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.291717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.291843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.291867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.291991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.292087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.292112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.292205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.292291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.292315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.292410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.292511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.292543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.292638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.292737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.292762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.292864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.292992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.293017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.293121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.293234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.293262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.293406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.293538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.293583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.293690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.293787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.293812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.293907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.294006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.294049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.294181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.294277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.294302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.294441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.294571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.294595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.294694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.294826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.294849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.294984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.295077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.295106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.295214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.295338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.295362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.295507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.295653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.295680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.295803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.295899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.295923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.296020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.296171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.296195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.296346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.296450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.296473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.993 qpair failed and we were unable to recover it. 00:31:01.993 [2024-11-28 01:25:16.296578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.993 [2024-11-28 01:25:16.296674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.296698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.296840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.296946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.296970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.297124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.297233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.297259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.297395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.297507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.297551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.297693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.297833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.297860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.297988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.298085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.298110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.298222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.298383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.298408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.298537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.298659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.298687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.298802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.298906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.298934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.299057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.299189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.299214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.299325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.299461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.299504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.299662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.299762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.299786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.299905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.300066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.300093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.300238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.300365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.300389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.300517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.300650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.300675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.300844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.300967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.300992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.301095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.301185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.301211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.301312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.301473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.301498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.301602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.301707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.301732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.301827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.301950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.301974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.302099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.302196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.302220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.302344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.302469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.302494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.302634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.302732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.302757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.302873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.302991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.303019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.303158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.303261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.303287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.303414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.303530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.303556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.303695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.303829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.303853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.303959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.304066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.304108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.304292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.304389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.304414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.994 qpair failed and we were unable to recover it. 00:31:01.994 [2024-11-28 01:25:16.304515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.994 [2024-11-28 01:25:16.304654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.304678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.304785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.304934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.304963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.305070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.305170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.305198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.305349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.305474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.305498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.305639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.305737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.305761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.305894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.306034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.306061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.306192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.306310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.306338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.306475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.306590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.306619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.306769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.306903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.306928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.307079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.307186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.307215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.307321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.307435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.307462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.307611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.307789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.307814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.307944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.308040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.308063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.308171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.308320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.308347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.308460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.308602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.308630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.308737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.308882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.308907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.309006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.309103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.309133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.309288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.309424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.309451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.309583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.309693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.309719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.309831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.309965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.309993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.310131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.310233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.310257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.310432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.310539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.310566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.310688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.310798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.310825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.310959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.311064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.311091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.311225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.311327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.311351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.311495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.311633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.311661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.311773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.311879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.311906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.312019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.312124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.312152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.312268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.312359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.995 [2024-11-28 01:25:16.312383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.995 qpair failed and we were unable to recover it. 00:31:01.995 [2024-11-28 01:25:16.312512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.312654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.312681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.312780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.312930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.312954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.313050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.313173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.313197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.313348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.313509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.313543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.313690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.313787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.313833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.313983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.314108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.314133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.314246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.314370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.314395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.314519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.314624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.314649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.314775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.314929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.314958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.315070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.315184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.315211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.315323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.315433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.315461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.315573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.315681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.315705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.315856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.315975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.316002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.316169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.316301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.316327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.316463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.316581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.316609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.316738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.316824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.316848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.316940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.317054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.317081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.317187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.317300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.317325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.317421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.317603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.317630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.317783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.317884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.317907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.318025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.318177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.318201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.318326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.318441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.318469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.318580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.318702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.318727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.318879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.319032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.319074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.319183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.319323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.996 [2024-11-28 01:25:16.319348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.996 qpair failed and we were unable to recover it. 00:31:01.996 [2024-11-28 01:25:16.319476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.319578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.319604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.319710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.319872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.319899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.320017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.320118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.320144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.320246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.320362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.320390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.320501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.320629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.320654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.320753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.320929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.320956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.321102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.321251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.321292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.321405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.321531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.321556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.321685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.321781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.321805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.321899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.322001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.322025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.322121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.322246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.322270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.322377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.322499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.322533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.322700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.322812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.322839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.322940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.323075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.323108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.323236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.323368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.323392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.323556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.323732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.323756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.323913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.324076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.324100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.324247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.324365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.324391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.324530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.324682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.324706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.324827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.324969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.324993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.325107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.325241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.325281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.325382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.325508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.325540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.325648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.325771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.325796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.325904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.326041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.326071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.326255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.326370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.326410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.326567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.326710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.326735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.326860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.326985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.327009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.327122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.327253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.327279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.997 [2024-11-28 01:25:16.327423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.327522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.997 [2024-11-28 01:25:16.327565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.997 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.327674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.327778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.327805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.327927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.328046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.328070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.328162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.328314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.328341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.328483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.328581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.328605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.328706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.328831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.328857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.328986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.329081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.329105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.329261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.329367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.329393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.329501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.329612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.329640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.329759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.329865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.329892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.330011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.330108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.330133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.330258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.330390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.330417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.330551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.330668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.330695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.330793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.330894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.330921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.331030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.331136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.331159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.331255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.331357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.331381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.331511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.331625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.331650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.331765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.331906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.331934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.332105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.332230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.332254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.332386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.332530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.332558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.332667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.332774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.332802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.332950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.333113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.333137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.333237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.333339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.333364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.333490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.333669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.333697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.333808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.333955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.333978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.334099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.334213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.334239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.334399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.334501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.334541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.334716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.334831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.334858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.334965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.335076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.335118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.998 qpair failed and we were unable to recover it. 00:31:01.998 [2024-11-28 01:25:16.335222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.335366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.998 [2024-11-28 01:25:16.335393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.335512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.335675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.335700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.335821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.335963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.335991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.336134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.336272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.336296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.336444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.336547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.336575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.336686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.336811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.336835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.336934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.337060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.337083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.337192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.337303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.337330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.337510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.337639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.337663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.337788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.337880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.337904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.338008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.338105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.338128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.338253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.338382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.338409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.338556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.338679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.338703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.338803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.338927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.338951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.339127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.339223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.339251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.339421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.339546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.339571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.339669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.339770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.339794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.339935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.340059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.340082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.340211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.340310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.340336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.340495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.340671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.340695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.340791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.340940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.340968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.341117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.341221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.341246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.341390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.341498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.341534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.341660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.341762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.341786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.341903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.342050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.342076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.342203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.342329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.342352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.342479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.342572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.342596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.342697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.342788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.342813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.342945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.343049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.343092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:01.999 qpair failed and we were unable to recover it. 00:31:01.999 [2024-11-28 01:25:16.343233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:01.999 [2024-11-28 01:25:16.343358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.343383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.343501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.343631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.343659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.343815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.343918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.343942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.344084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.344187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.344228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.344353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.344457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.344482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.344602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.344752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.344777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.344902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.345057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.345084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.345187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.345320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.345347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.345477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.345630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.345656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.345763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.345942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.345967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.346062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.346158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.346183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.346282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.346388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.346431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.346582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.346680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.346705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.346845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.346992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.347017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.347157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.347273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.347301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.347437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.347595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.347621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.347747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.347875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.347901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.348071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.348195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.348220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.348380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.348481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.348506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.348634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.348724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.348771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.348891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.349013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.349038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.349181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.349283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.349310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.349451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.349603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.349628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.349755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.349877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.349919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.350020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.350145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.350170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.000 [2024-11-28 01:25:16.350296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.350406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.000 [2024-11-28 01:25:16.350434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.000 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.350584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.350705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.350729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.350856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.350977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.351006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.351130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.351221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.351246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.351382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.351568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.351594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.351718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.351861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.351888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.352036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.352168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.352194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.352338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.352460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.352485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.352625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.352733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.352758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.352908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.353012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.353037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.353156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.353289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.353316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.353446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.353602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.353628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.353722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.353877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.353900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.354022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.354145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.354169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.354271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.354452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.354479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.354616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.354721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.354744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.354845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.354944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.354968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.355149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.355274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.355300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.355460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.355560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.355586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.355688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.355791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.355815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.355964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.356078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.356106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.356221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.356370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.356398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.356498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.356683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.356709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.356806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.356930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.356954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.357054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.357149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.357173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.357301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.357428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.357456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.357603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.357705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.357729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.357856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.357953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.357978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.358161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.358259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.358282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.001 qpair failed and we were unable to recover it. 00:31:02.001 [2024-11-28 01:25:16.358402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.001 [2024-11-28 01:25:16.358589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.358614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.358716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.358814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.358839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.358986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.359084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.359109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.359207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.359337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.359361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.359457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.359563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.359588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.359715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.359806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.359830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.359927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.360026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.360051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.360223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.360356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.360384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.360491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.360603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.360631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.360741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.360859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.360886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.361030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.361132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.361156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.361273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.361390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.361417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.361550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.361660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.361684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.361805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.361926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.361952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.362067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.362163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.362186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.362339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.362483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.362510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.362693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.362795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.362824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.362975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.363109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.363135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.363274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.363371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.363395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.363519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.363683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.363710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.363822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.363933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.363972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.364135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.364274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.364301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.364416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.364548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.364573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.364728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.364822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.364845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.364938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.365058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.365101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.365211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.365350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.365378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.365532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.365657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.365682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.365782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.365895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.365922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.366036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.366151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.002 [2024-11-28 01:25:16.366180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.002 qpair failed and we were unable to recover it. 00:31:02.002 [2024-11-28 01:25:16.366312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.366415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.366443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.366561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.366693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.366718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.366823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.366947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.366971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.367072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.367195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.367219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.367349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.367458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.367486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.367609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.367704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.367729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.367825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.367956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.367981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.368132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.368244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.368270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.368412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.368521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.368558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.368717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.368844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.368868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.368962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.369089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.369112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.369215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.369339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.369366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.369538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.369644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.369668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.369762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.369855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.369880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.369994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.370159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.370186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.370295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.370401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.370441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.370543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.370642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.370666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.370798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.370929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.370952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.371102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.371236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.371260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.371369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.371515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.371551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.371659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.371779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.371806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.371931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.372031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.372055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.372201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.372343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.372367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.372492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.372649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.372675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.372778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.372918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.372946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.373059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.373156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.373181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.373279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.373373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.373397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.373555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.373672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.373697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.003 [2024-11-28 01:25:16.373796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.373916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.003 [2024-11-28 01:25:16.373962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.003 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.374066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.374190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.374215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.374339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.374462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.374488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.374593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.374750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.374775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.374891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.375037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.375062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.375165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.375320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.375344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.375475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.375619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.375646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.375785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.375903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.375930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.376114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.376209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.376234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.376362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.376451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.376475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.376579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.376701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.376726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.376849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.376953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.376981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.377088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.377195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.377221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.377349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.377447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.377472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.377604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.377702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.377726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.377818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.377914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.377938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.378062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.378186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.378210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.378348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.378460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.378487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.378618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.378768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.378793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.378910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.379048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.379075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.379214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.379387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.379414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.379561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.379713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.379738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.379860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.379967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.379994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.380099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.380230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.380257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.380366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.380504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.380537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.380690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.380787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.380811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.380922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.381012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.381037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.381146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.381244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.381268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.381393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.381514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.381550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.004 [2024-11-28 01:25:16.381697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.381847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.004 [2024-11-28 01:25:16.381871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.004 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.382025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.382170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.382194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.382298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.382392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.382416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.382546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.382654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.382681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.382810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.382939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.382963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.383110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.383235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.383262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.383376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.383556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.383583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.383686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.383803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.383830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.383966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.384087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.384112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.384230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.384346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.384373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.384530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.384656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.384681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.384797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.384907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.384936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.385064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.385195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.385220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.385415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.385539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.385564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.385698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.385797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.385821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.385997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.386102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.386128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.386244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.386400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.386426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.386545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.386688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.386713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.386836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.386943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.386971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.387077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.387220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.387247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.387396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.387542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.387567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.387733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.387859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.387883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.387979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.388130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.388161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.388299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.388470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.388497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.388635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.388737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.388762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.388904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.389040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.005 [2024-11-28 01:25:16.389068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.005 qpair failed and we were unable to recover it. 00:31:02.005 [2024-11-28 01:25:16.389232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.389371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.389398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.389539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.389657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.389682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.389806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.389932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.389956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.390076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.390219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.390246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.390353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.390489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.390516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.390641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.390752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.390779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.390893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.391017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.391041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.391139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.391260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.391301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.391440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.391545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.391570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.391670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.391816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.391844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.391993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.392108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.392133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.392298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.392425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.392450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.392554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.392677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.392704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.392807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.392952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.392980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.393107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.393231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.393256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.393362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.393467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.393492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.393601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.393696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.393720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.393821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.393920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.393945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.394100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.394187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.394212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.394337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.394487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.394514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.394673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.394771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.394796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.394947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.395066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.395093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.395204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.395307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.395332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.395437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.395572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.395599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.395713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.395859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.395883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.396008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.396112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.396136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.396261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.396361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.396384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.396502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.396624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.396651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.006 [2024-11-28 01:25:16.396792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.396951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.006 [2024-11-28 01:25:16.396975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.006 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.397093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.397217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.397241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.397374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.397473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.397496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.397627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.397717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.397741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.397897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.398061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.398088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.398251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.398380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.398405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.398496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.398603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.398627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.398751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.398892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.398920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.399032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.399143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.399170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.399309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.399429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.399457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.399616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.399718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.399743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.399845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.399943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.399968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.400110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.400240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.400268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.400380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.400543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.400569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.400692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.400820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.400845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.401032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.401129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.401154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.401275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.401369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.401410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.401560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.401664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.401689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.401782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.401875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.401900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.402029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.402148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.402179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.402334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.402427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.402451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.402577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.402731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.402758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.402909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.403011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.403036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.403157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.403267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.403294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.403406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.403555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.403581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.403708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.403806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.403831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.403935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.404036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.404060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.404206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.404311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.404352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.404450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.404555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.404598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.007 qpair failed and we were unable to recover it. 00:31:02.007 [2024-11-28 01:25:16.404751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.404876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.007 [2024-11-28 01:25:16.404900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.405028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.405124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.405149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.405252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.405370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.405395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.405504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.405600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.405625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.405745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.405843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.405867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.405986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.406105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.406129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.406301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.406446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.406473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.406655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.406760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.406786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.406960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.407083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.407108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.407208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.407330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.407356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.407507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.407698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.407726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.407860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.407980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.408004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.408124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.408223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.408250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.408368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.408464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.408489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.408658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.408765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.408792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.408924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.409053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.409080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.409237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.409335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.409359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.409503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.409639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.409679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.409786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.409924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.409950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.410114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.410217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.410243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.410360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.410465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.410491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.410619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.410725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.410750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.410876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.410968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.410992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.411091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.411191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.411214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.411316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.411485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.411512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.411653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.411761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.411786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.411905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.412047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.412074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.412184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.412334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.412359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.412482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.412589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.412614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.008 qpair failed and we were unable to recover it. 00:31:02.008 [2024-11-28 01:25:16.412711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.008 [2024-11-28 01:25:16.412811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.412836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.412938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.413054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.413095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.413231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.413340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.413371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.413480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.413594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.413622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.413748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.413865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.413889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.414010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.414119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.414146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.414282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.414383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.414410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.414517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.414661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.414688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.414836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.414959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.414983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.415124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.415230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.415272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.415404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.415516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.415571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.415675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.415785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.415811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.415933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.416027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.416052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.416223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.416344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.416367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.416496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.416623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.416666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.416776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.416886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.416914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.417063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.417209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.417234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.417359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.417505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.417540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.417684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.417796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.417824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.417942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.418073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.418099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.418219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.418347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.418371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.418469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.418600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.418625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.418745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.418854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.418881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.419026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.419157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.419183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.009 qpair failed and we were unable to recover it. 00:31:02.009 [2024-11-28 01:25:16.419317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.419408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.009 [2024-11-28 01:25:16.419432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.419575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.419678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.419721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.419824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.419973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.419997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.420094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.420221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.420244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.420350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.420482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.420507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.420630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.420743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.420769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.420905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.421044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.421071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.421227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.421371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.421398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.421516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.421653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.421678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.421809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.421910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.421934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.422026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.422185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.422210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.422308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.422457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.422484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.422627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.422748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.422771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.422941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.423043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.423070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.423199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.423294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.423317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.423468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.423589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.423617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.423732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.423822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.423846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.423942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.424114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.424138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.424236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.424362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.424388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.424519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.424649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.424673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.424775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.424866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.424889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.425037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.425180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.425207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.425310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.425424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.425447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.425574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.425670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.425694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.425791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.425887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.425911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.426058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.426181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.426208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.426354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.426447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.426472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.426598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.426748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.426775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.426902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.427023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.010 [2024-11-28 01:25:16.427046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.010 qpair failed and we were unable to recover it. 00:31:02.010 [2024-11-28 01:25:16.427187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.427331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.427359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.427455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.427582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.427625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.427745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.427847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.427873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.428016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.428168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.428193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.428313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.428490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.428515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.428622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.428772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.428795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.428909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.429027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.429051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.429155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.429252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.429276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.429392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.429506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.429540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.429677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.429793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.429819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.429947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.430063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.430087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.430192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.430292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.430316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.430430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.430539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.430581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.430683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.430814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.430838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.430930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.431019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.431043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.431136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.431236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.431260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.431360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.431463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.431488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.431622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.431746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.431771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.431894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.431988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.432031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.432180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.432299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.432324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.432424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.432547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.432573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.432678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.432775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.432799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.432890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.432984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.433008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.433156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.433275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.433299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.433459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.433593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.433623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.433790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.433936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.433982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.434104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.434230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.434256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.434409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.434552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.434578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.011 qpair failed and we were unable to recover it. 00:31:02.011 [2024-11-28 01:25:16.434695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.011 [2024-11-28 01:25:16.434828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.434855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.434964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.435073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.435116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.435239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.435335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.435359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.435481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.435635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.435661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.435758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.435890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.435918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.436055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.436220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.436247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.436411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.436544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.436572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.436716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.436818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.436842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.436936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.437074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.437102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.437221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.437350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.437374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.437469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.437575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.437618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.437734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.437860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.437885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.438018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.438153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.438180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.438321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.438441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.438470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.438615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.438728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.438755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.438872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.438961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.438985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.439134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.439263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.439290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.439389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.439532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.439560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.439667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.439795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.439822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.439942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.440063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.440087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.440206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.440322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.440346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.440487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.440619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.440648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.440751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.440890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.440917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.441032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.441162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.441194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.441309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.441467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.441494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.441652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.441774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.441798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.441907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.442031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.442056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.442151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.442243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.442268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.442395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.442511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.442549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.012 qpair failed and we were unable to recover it. 00:31:02.012 [2024-11-28 01:25:16.442670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.012 [2024-11-28 01:25:16.442783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.442811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.442935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.443088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.443112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.443235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.443353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.443378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.443500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.443645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.443673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.443790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.443888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.443913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.444051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.444203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.444230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.444351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.444468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.444495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.444675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.444804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.444828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.444978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.445125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.445149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.445251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.445341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.445366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.445494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.445600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.445626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.445750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.445859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.445887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.446046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.446170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.446194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.446347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.446449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.446474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.446603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.446704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.446728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.446852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.446985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.447013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.447146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.447295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.447322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.447455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.447570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.447616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.447734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.447834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.447858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.447981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.448149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.448176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.448327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.448428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.448454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.448602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.448717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.448744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.448891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.449014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.449039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.449154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.449258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.449285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.449435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.449619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.449644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.449763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.449871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.449898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.450010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.450134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.450159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.450278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.450447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.450474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.450598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.450727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.013 [2024-11-28 01:25:16.450751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.013 qpair failed and we were unable to recover it. 00:31:02.013 [2024-11-28 01:25:16.450849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.450938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.450963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.451061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.451161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.451185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.451281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.451412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.451454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.451586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.451688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.451713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.451841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.451963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.451987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.452093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.452216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.452240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.452366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.452460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.452488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.452626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.452742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.452771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.452887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.452990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.453032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.453161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.453284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.453308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.453431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.453568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.453596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.453697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.453831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.453859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.454003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.454123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.454148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.454239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.454336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.454360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.454486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.454590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.454634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.454751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.454859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.454886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.455021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.455128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.455156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.455315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.455418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.455459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.455613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.455712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.455736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.455851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.456008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.456032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.456173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.456297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.456321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.456424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.456545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.456570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.456666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.456774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.456801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.456915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.457068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.457092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.457214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.457312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.014 [2024-11-28 01:25:16.457336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.014 qpair failed and we were unable to recover it. 00:31:02.014 [2024-11-28 01:25:16.457439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.457585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.457610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.457708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.457794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.457818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.457950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.458098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.458125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.458276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.458398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.458423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.458548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.458641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.458667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.458783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.458927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.458956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.459064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.459213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.459237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.459335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.459434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.459475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.459608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.459706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.459730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.459867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.460022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.460049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.460163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.460273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.460300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.460413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.460552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.460580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.460713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.460801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.460825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.461000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.461105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.461133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.461270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.461377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.461419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.461554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.461668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.461695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.461845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.461942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.461966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.462103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.462203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.462229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.462400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.462504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.462550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.462654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.462742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.462766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.462895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.463016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.463040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.463154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.463268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.463308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.463440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.463575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.463603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.463758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.463859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.463883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.464010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.464109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.464133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.464266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.464436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.464464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.464581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.464687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.464714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.464846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.464942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.464969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.015 [2024-11-28 01:25:16.465091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.465192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.015 [2024-11-28 01:25:16.465216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.015 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.465309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.465433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.465457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.465563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.465730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.465755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.465850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.465974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.466015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.466131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.466231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.466261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.466410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.466562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.466588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.466693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.466907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.466931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.467077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.467288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.467315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.467436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.467537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.467563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.467675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.467788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.467815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.467923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.468054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.468081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.468214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.468348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.468375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.468550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.468670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.468694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.468812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.468981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.469005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.469229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.469356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.469384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.469538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.469676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.469704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.469822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.469949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.469974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.470104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.470256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.470283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.470447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.470555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.470583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.470693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.470802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.470843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.470944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.471047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.471071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.471186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.471338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.471362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.471489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.471595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.471619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.471770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.471897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.471921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.472021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.472117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.472142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.472246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.472341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.472367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.472488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.472651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.472678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.472783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.472883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.472910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.473024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.473110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.473135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.016 qpair failed and we were unable to recover it. 00:31:02.016 [2024-11-28 01:25:16.473264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.473386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.016 [2024-11-28 01:25:16.473413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.473548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.473669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.473694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.473787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.473909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.473936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.474058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.474160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.474185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.474312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.474416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.474459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.474599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.474697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.474722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.474861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.474999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.475027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.475227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.475334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.475361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.475555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.475700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.475726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.475829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.475959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.475984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.476099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.476236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.476263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.476427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.476598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.476623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.476715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.476819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.476844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.476942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.477066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.477089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.477191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.477305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.477332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.477471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.477593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.477618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.477739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.477847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.477875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.478056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.478171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.478196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.478333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.478438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.478464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.478587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.478688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.478712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.478862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.478973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.478999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.479143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.479286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.479313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.479447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.479554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.479583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.479727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.479830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.479854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.479981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.480092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.480135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.480238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.480338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.480363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.480488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.480632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.480680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.480799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.480900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.480925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.481030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.481132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.481157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.017 qpair failed and we were unable to recover it. 00:31:02.017 [2024-11-28 01:25:16.481286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.017 [2024-11-28 01:25:16.481432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.481457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.481585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.481730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.481757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.481883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.482014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.482039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.482146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.482241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.482266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.482440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.482572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.482597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.482751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.482866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.482909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.483006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.483128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.483152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.483288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.483421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.483445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.483579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.483705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.483729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.483827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.484000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.484028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.484155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.484277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.484303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.484405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.484522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.484557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.484680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.484822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.484848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.484968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.485065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.485090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.485181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.485305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.485330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.485439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.485574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.485602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.485762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.485905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.485933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.486047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.486152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.486179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.486334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.486428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.486453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.486600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.486736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.486764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.486863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.486974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.487003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.487115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.487270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.487295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.487441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.487554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.487597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.487694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.487840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.487866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.487989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.488149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.488174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.488323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.488435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.488462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.488581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.488682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.488707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.488853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.488997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.489026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.489163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.489338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.018 [2024-11-28 01:25:16.489363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.018 qpair failed and we were unable to recover it. 00:31:02.018 [2024-11-28 01:25:16.489501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.489627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.489671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.489777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.489907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.489932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.490038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.490156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.490199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.490353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.490509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.490541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.490736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.490833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.490857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.491016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.491114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.491139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.491296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.491397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.491425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.491595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.491728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.491753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.491867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.491971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.491997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.492180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.492303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.492346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.492461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.492602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.492630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.492734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.492876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.492900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.493002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.493141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.493169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.493303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.493427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.493452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.493592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.493716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.493741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.493882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.493990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.494017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.494156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.494306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.494331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.494486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.494619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.494643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.494763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.494871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.494899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.495028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.495150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.495177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.495335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.495433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.495457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.495600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.495698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.495722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.495844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.495950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.495977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.496082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.496178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.496204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.496339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.496442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.496468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.019 [2024-11-28 01:25:16.496585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.496709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.019 [2024-11-28 01:25:16.496733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.019 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.496851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.496984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.497011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.497122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.497233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.497260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.497362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.497502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.497536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.497672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.497799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.497822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.497954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.498059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.498086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.498223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.498326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.498353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.498454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.498574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.498601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.498735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.498830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.498854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.499023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.499187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.499212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.499342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.499480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.499507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.499677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.499774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.499798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.499920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.500013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.500037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.500152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.500260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.500287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.500422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.500580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.500606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.500708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.500810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.500834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.501018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.501110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.501153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.501287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.501394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.501421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.501578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.501672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.501696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.501793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.501959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.501986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.502137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.502287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.502311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.502476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.502574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.502598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.502701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.502802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.502826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.502931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.503075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.503103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.503264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.503398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.503423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.503549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.503668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.503692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.503791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.503937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.503979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.504129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.504249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.504276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.504500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.504648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.504691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.020 qpair failed and we were unable to recover it. 00:31:02.020 [2024-11-28 01:25:16.504815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.020 [2024-11-28 01:25:16.504929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.504956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.505096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.505204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.505245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.505339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.505466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.505490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.505624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.505753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.505778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.505917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.506082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.506109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.506215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.506314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.506341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.506474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.506635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.506664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.506794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.506918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.506943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.507070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.507204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.507231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.507379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.507550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.507592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.507719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.507861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.507888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.508040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.508165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.508189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.508319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.508459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.508485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.508618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.508707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.508731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.508841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.508937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.508964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.509084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.509233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.509256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.509355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.509460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.509486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.509640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.509767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.509791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.509911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.510047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.510075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.510256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.510400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.510425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.510535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.510641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.510665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.510818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.510950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.510977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.511084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.511244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.511270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.511415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.511552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.511577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.511673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.511811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.511839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.511938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.512039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.512068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.512178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.512351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.512376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.512481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.512575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.512600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.512720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.512836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.021 [2024-11-28 01:25:16.512863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.021 qpair failed and we were unable to recover it. 00:31:02.021 [2024-11-28 01:25:16.513023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.513173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.513197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.513368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.513504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.513538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.513657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.513761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.513785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.513914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.514014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.514039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.514157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.514313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.514337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.514463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.514570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.514595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.514759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.514930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.514957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.515142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.515269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.515296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.515402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.515532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.515560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.515673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.515783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.515809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.515958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.516084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.516108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.516249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.516361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.516388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.516492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.516641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.516667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.516788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.516913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.516937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.517037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.517162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.517187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.517332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.517435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.517463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.517581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.517704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.517730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.517825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.518009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.518037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.518146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.518275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.518300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.518410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.518502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.518534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.518640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.518731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.518756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.518861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.518987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.519013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.519138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.519298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.519324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.519500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.519651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.519679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.519816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.519965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.519988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.520108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.520231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.520255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.520380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.520536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.520561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.520682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.520783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.520811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.022 [2024-11-28 01:25:16.520957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.521082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.022 [2024-11-28 01:25:16.521111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.022 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.521234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.521369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.521396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.521537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.521663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.521689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.521817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.521947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.521974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.522115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.522212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.522240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.522340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.522441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.522469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.522627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.522754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.522779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.522930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.523099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.523126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.523264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.523379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.523403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.523535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.523675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.523703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.523827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.523952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.523976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.524084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.524256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.524283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.524396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.524510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.524544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.524684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.524793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.524838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.524962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.525079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.525104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.525226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.525341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.525366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.525542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.525696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.525721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.525844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.526032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.526056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.526211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.526310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.526334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.526452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.526623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.526652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.526764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.526946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.526971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.527114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.527246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.527271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.527386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.527515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.527553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.527673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.527815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.527842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.527948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.528061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.528088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.023 [2024-11-28 01:25:16.528195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.528314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.023 [2024-11-28 01:25:16.528339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.023 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.528461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.528565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.528590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.528720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.528881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.528905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.528998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.529113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.529140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.529253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.529399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.529423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.529562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.529691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.529715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.529870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.530052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.530077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.530205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.530322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.530350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.530461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.530602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.530630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.530796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.530920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.530945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.531120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.531254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.531282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.531428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.531574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.531599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.531725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.531854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.531877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.532003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.532133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.532157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.532305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.532413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.532439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.532562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.532672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.532698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.532803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.532968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.532999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.533150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.533300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.533326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.533454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.533602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.533631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.533741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.533849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.533891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.533998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.534093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.534118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.534290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.534417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.534440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.534547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.534690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.534717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.534858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.534994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.535021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.535142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.535228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.535252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.535347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.535474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.535498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.535648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.535752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.535776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.535948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.536100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.536125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.536228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.536362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.536387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.024 qpair failed and we were unable to recover it. 00:31:02.024 [2024-11-28 01:25:16.536523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.536656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.024 [2024-11-28 01:25:16.536681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.536777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.536873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.536897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.537026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.537141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.537170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.537284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.537425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.537450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.537555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.537681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.537707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.537845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.537953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.537981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.538096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.538225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.538253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.538391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.538494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.538522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.538666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.538763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.538788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.538891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.538990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.539016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.539121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.539244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.539272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.539381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.539487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.539516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.539647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.539778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.539803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.539945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.540117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.540143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.540276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.540445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.540469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.540619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.540736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.540763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.540914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.541007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.541031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.541139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.541256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.541282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.541439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.541536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.541561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.541666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.541785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.541813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.541933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.542058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.542082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.542181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.542284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.542308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.542454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.542568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.542595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.542706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.542812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.542841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.542968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.543073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.543098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.543224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.543345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.543369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.543474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.543624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.543653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.543767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.543873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.543900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.544050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.544178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.025 [2024-11-28 01:25:16.544204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.025 qpair failed and we were unable to recover it. 00:31:02.025 [2024-11-28 01:25:16.544390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.544495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.544520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.544678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.544850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.544877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.544980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.545110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.545136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.545288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.545413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.545438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.545583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.545690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.545719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.545862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.545969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.545996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.546170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.546295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.546323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.546441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.546597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.546623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.546789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.546952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.546980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.547096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.547204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.547249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.547375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.547491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.547518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.547638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.547740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.547767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.547909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.548017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.548061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.548197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.548312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.548339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.548450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.548618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.548644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.548741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.548842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.548865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.548989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.549131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.549158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.549294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.549401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.549428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.549542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.549678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.549704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.549834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.549931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.549955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.550135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.550239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.550266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.550373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.550487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.550513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.550668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.550774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.550801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.550948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.551075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.551099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.551252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.551381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.551407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.551538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.551647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.551675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.551815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.551952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.551978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.552085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.552209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.552233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.026 [2024-11-28 01:25:16.552352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.552504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.026 [2024-11-28 01:25:16.552564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.026 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.552671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.552773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.552798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.552953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.553108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.553132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.553263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.553392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.553416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.553517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.553635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.553659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.553760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.553887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.553910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.554051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.554158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.554186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.554304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.554429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.554453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.554563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.554681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.554708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.554835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.554923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.554948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.555071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.555196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.555222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.555340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.555436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.555461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.555596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.555688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.555713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.555803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.555921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.555945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.556054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.556180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.556205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.556300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.556405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.556430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.556542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.556665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.556690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.556790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.556878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.556902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.556992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.557093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.557117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.557242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.557365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.557389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.557536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.557700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.557727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.027 [2024-11-28 01:25:16.557840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.557966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.027 [2024-11-28 01:25:16.557993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.027 qpair failed and we were unable to recover it. 00:31:02.310 [2024-11-28 01:25:16.558102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.558223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.558250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.310 qpair failed and we were unable to recover it. 00:31:02.310 [2024-11-28 01:25:16.558379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.558483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.558508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.310 qpair failed and we were unable to recover it. 00:31:02.310 [2024-11-28 01:25:16.558621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.558722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.558747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.310 qpair failed and we were unable to recover it. 00:31:02.310 [2024-11-28 01:25:16.558851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.558956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.558980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.310 qpair failed and we were unable to recover it. 00:31:02.310 [2024-11-28 01:25:16.559089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.559191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.559216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.310 qpair failed and we were unable to recover it. 00:31:02.310 [2024-11-28 01:25:16.559323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.559428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.559452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.310 qpair failed and we were unable to recover it. 00:31:02.310 [2024-11-28 01:25:16.559558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.559655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.559681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.310 qpair failed and we were unable to recover it. 00:31:02.310 [2024-11-28 01:25:16.559774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.559917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.559941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.310 qpair failed and we were unable to recover it. 00:31:02.310 [2024-11-28 01:25:16.560071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.560193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.560216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.310 qpair failed and we were unable to recover it. 00:31:02.310 [2024-11-28 01:25:16.560342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.560440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.560465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.310 qpair failed and we were unable to recover it. 00:31:02.310 [2024-11-28 01:25:16.560568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.560664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.560692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.310 qpair failed and we were unable to recover it. 00:31:02.310 [2024-11-28 01:25:16.560793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.310 [2024-11-28 01:25:16.560893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.560919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.561024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.561122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.561146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.561238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.561333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.561358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.561459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.561600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.561643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.561752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.561880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.561906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.562030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.562177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.562202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.562328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.562433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.562457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.562566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.562665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.562690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.562809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.562928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.562971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.563089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.563221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.563246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.563354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.563455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.563480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.563583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.563677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.563702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.563824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.563954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.563979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.564082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.564201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.564226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.564326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.564413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.564438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.564547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.564675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.564700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.564843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.564986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.565011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.565114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.565215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.565240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.565338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.565430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.565454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.565559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.565689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.565713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.565809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.565981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.566025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.566133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.566224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.566249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.566354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.566451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.566475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.566623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.566729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.566757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.566879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.567025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.567052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.567176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.567306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.567331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.567459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.567603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.567632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.567743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.567879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.567907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.311 [2024-11-28 01:25:16.568042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.568185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.311 [2024-11-28 01:25:16.568209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.311 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.568318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.568417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.568443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.568582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.568757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.568782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.568934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.569053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.569077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.569205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.569300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.569325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.569432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.569571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.569596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.569723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.569819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.569844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.569946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.570036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.570060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.570180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.570267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.570292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.570382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.570503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.570534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.570636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.570776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.570802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.570968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.571065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.571092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.571202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.571342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.571375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.571497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.571625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.571650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.571771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.571908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.571935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.572073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.572174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.572201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.572310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.572416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.572443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.572564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.572694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.572722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.572837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.572947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.572974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.573115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.573246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.573288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.573390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.573496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.573521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.573637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.573749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.573776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.573917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.574052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.574081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.574234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.574361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.574385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.574492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.574596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.574621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.574721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.574872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.574899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.575022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.575135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.575162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.575292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.575428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.575455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.575582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.575674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.575698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.312 qpair failed and we were unable to recover it. 00:31:02.312 [2024-11-28 01:25:16.575865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.312 [2024-11-28 01:25:16.576028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.576055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.313 qpair failed and we were unable to recover it. 00:31:02.313 [2024-11-28 01:25:16.576195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.576324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.576352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.313 qpair failed and we were unable to recover it. 00:31:02.313 [2024-11-28 01:25:16.576453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.576568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.576612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.313 qpair failed and we were unable to recover it. 00:31:02.313 [2024-11-28 01:25:16.576716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.576874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.576902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.313 qpair failed and we were unable to recover it. 00:31:02.313 [2024-11-28 01:25:16.577083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.577202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.577229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.313 qpair failed and we were unable to recover it. 00:31:02.313 [2024-11-28 01:25:16.577431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.577586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.577612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.313 qpair failed and we were unable to recover it. 00:31:02.313 [2024-11-28 01:25:16.577705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.577831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.577855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.313 qpair failed and we were unable to recover it. 00:31:02.313 [2024-11-28 01:25:16.577979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.578126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.578154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.313 qpair failed and we were unable to recover it. 00:31:02.313 [2024-11-28 01:25:16.578306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.578440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.578467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.313 qpair failed and we were unable to recover it. 00:31:02.313 [2024-11-28 01:25:16.578608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.578726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.578750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.313 qpair failed and we were unable to recover it. 00:31:02.313 [2024-11-28 01:25:16.578892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.579060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.579087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.313 qpair failed and we were unable to recover it. 00:31:02.313 [2024-11-28 01:25:16.579228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.579334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.579361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.313 qpair failed and we were unable to recover it. 00:31:02.313 [2024-11-28 01:25:16.579536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.579664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.579688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.313 qpair failed and we were unable to recover it. 00:31:02.313 [2024-11-28 01:25:16.579797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.579918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.579943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.313 qpair failed and we were unable to recover it. 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Write completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Write completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Write completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Write completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Write completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Write completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Write completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Read completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 Write completed with error (sct=0, sc=8) 00:31:02.313 starting I/O failed 00:31:02.313 [2024-11-28 01:25:16.580345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:02.313 [2024-11-28 01:25:16.580588] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x653980 is same with the state(5) to be set 00:31:02.313 [2024-11-28 01:25:16.580738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.580898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.580928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.313 qpair failed and we were unable to recover it. 00:31:02.313 [2024-11-28 01:25:16.581064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.581219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.581271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.313 qpair failed and we were unable to recover it. 00:31:02.313 [2024-11-28 01:25:16.581445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.581599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.581625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.313 qpair failed and we were unable to recover it. 00:31:02.313 [2024-11-28 01:25:16.581760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.581863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.581889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.313 qpair failed and we were unable to recover it. 00:31:02.313 [2024-11-28 01:25:16.582055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.582228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.582257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.313 qpair failed and we were unable to recover it. 00:31:02.313 [2024-11-28 01:25:16.582367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.582481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.582510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.313 qpair failed and we were unable to recover it. 00:31:02.313 [2024-11-28 01:25:16.582666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.313 [2024-11-28 01:25:16.582797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.582822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.582954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.583073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.583098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.583228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.583378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.583408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.583515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.583674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.583699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.583858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.583959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.583985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.584137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.584291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.584316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.584470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.584639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.584665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.584758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.584878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.584904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.585055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.585153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.585178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.585289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.585421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.585449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.585570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.585672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.585699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.585806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.585953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.585983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.586116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.586253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.586280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.586414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.586579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.586605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.586708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.586831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.586856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.587013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.587136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.587163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.587312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.587438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.587464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.587569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.587699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.587725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.587854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.587976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.588001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.588188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.588359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.588387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.588543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.588663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.588688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.588823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.588930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.588955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.589112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.589236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.589262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.589389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.589520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.589570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.589703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.589826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.589852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.589953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.590109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.590134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.590298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.590426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.590477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.590621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.590725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.590751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.314 qpair failed and we were unable to recover it. 00:31:02.314 [2024-11-28 01:25:16.590875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.590997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.314 [2024-11-28 01:25:16.591023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.591130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.591260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.591285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.591415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.591529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.591556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.591689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.591788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.591812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.591900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.592052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.592078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.592198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.592343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.592372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.592509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.592643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.592669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.592797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.592925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.592950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.593093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.593245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.593270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.593399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.593559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.593602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.593726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.593851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.593880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.594043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.594169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.594194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.594329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.594483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.594516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.594699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.594806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.594834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.594966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.595075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.595105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.595255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.595386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.595411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.595548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.595691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.595720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.595880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.596002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.596027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.596153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.596274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.596299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.596454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.596582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.596609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.596754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.596906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.596931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.597063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.597155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.597181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.597311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.597479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.597508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.597665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.597845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.597885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.315 qpair failed and we were unable to recover it. 00:31:02.315 [2024-11-28 01:25:16.598054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.315 [2024-11-28 01:25:16.598207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.598233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.598356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.598496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.598532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.598708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.598835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.598860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.598955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.599081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.599106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.599278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.599406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.599431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.599559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.599682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.599707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.599805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.599930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.599954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.600080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.600204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.600230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.600318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.600442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.600467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.600586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.600741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.600767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.600904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.601022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.601065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.601203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.601309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.601338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.601512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.601647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.601673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.601799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.601946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.601973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.602070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.602195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.602222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.602370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.602536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.602565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.602689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.602790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.602816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.602952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.603080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.603107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.603209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.603332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.603358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.603484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.603616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.603643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.603767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.603923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.603949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.604076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.604184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.604209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.604343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.604466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.604491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.604631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.604783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.604809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.604951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.605049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.605074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.605203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.605362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.605389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.605498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.605595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.605621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.605746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.605879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.605904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.316 qpair failed and we were unable to recover it. 00:31:02.316 [2024-11-28 01:25:16.606029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.316 [2024-11-28 01:25:16.606157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.606184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.606309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.606455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.606481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.606657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.606762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.606788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.606891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.607044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.607070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.607171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.607295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.607321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.607480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.607640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.607666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.607795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.607935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.607960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.608061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.608163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.608188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.608315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.608469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.608495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.608641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.608752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.608779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.608923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.609048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.609074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.609200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.609327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.609352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.609478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.609621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.609647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.609778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.609915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.609942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.610148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.610274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.610300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.610427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.610552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.610579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.610681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.610808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.610838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.610992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.611092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.611116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.611270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.611431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.611456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.611569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.611708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.611733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.611829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.611988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.612013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.612189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.612313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.612339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.612440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.612576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.612602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.612753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.612882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.612910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.613036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.613183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.613208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.613338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.613494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.613519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.613654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.613751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.613776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.613955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.614095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.614124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.317 [2024-11-28 01:25:16.614267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.614432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.317 [2024-11-28 01:25:16.614461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.317 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.614617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.614750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.614775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.614887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.615030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.615055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.615162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.615291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.615316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.615546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.615666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.615691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.615786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.615952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.615978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.616137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.616278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.616303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.616432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.616557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.616583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.616712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.616837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.616862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.617017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.617110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.617137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.617260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.617363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.617389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.617572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.617729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.617760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.617880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.618030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.618058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.618207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.618335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.618360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.618489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.618646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.618675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.618829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.618949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.618974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.619070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.619194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.619219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.619325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.619480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.619505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.619664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.619819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.619845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.619995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.620126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.620151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.620280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.620460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.620488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.620664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.620789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.620836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.620977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.621128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.621154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.621292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.621439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.621467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.621600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.621737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.621762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.621897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.622026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.622051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.622149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.622320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.622348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.622522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.622706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.622731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.622854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.622977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.318 [2024-11-28 01:25:16.623003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.318 qpair failed and we were unable to recover it. 00:31:02.318 [2024-11-28 01:25:16.623127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.623301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.623329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.623497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.623674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.623700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.623801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.623936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.623969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.624101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.624257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.624281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.624446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.624552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.624579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.624685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.624808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.624833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.624984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.625091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.625116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.625267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.625360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.625404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.625555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.625651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.625677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.625807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.625925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.625955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.626064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.626196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.626225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.626337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.626493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.626517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.626667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.626790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.626820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.626944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.627044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.627070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.627198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.627324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.627348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.627492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.627625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.627668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.627805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.627924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.627952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.628091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.628190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.628216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.628318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.628446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.628486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.628685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.628817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.628841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.629003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.629129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.629154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.629282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.629424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.629452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.629606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.629709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.629734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.629839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.629966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.629991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.319 [2024-11-28 01:25:16.630116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.630255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.319 [2024-11-28 01:25:16.630280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.319 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.630404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.630533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.630558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.630650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.630798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.630823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.630921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.631026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.631053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.631184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.631314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.631339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.631504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.631637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.631663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.631790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.631890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.631915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.632040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.632145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.632170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.632305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.632410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.632436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.632578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.632708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.632733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.632890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.633015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.633041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.633145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.633253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.633279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.633384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.633491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.633517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.633649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.633748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.633773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.633901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.634025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.634050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.634151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.634252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.634278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.634434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.634541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.634567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.634700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.634831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.634857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.634954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.635046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.635071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.635204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.635342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.635369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.635485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.635593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.635619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.635722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.635816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.635842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.636010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.636146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.636171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.636299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.636425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.636450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.636550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.636673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.636697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.636800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.636918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.636947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.637124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.637221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.637245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.637349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.637475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.637499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.637603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.637701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.637727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.320 qpair failed and we were unable to recover it. 00:31:02.320 [2024-11-28 01:25:16.637855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.320 [2024-11-28 01:25:16.637954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.637979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.638101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.638200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.638226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.638352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.638470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.638500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.638670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.638797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.638822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.638950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.639084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.639112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.639223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.639327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.639355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.639534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.639632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.639658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.639763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.639866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.639893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.640068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.640183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.640211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.640350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.640484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.640513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.640682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.640791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.640816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.640944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.641053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.641080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.641228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.641327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.641352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.641449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.641546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.641572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.641674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.641761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.641786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.641917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.642043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.642069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.642157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.642242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.642286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.642442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.642569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.642606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.642708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.642833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.642858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.643009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.643134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.643159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.643267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.643395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.643422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.643553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.643648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.643673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.643798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.643923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.643949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.644070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.644202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.644227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.644325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.644449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.644475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.644600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.644700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.644725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.644826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.644952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.644978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.645102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.645226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.645252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.321 [2024-11-28 01:25:16.645404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.645537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.321 [2024-11-28 01:25:16.645564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.321 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.645667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.645766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.645791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.645912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.646050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.646098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.646275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.646420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.646446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.646551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.646676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.646702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.646840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.647010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.647053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.647170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.647378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.647404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.647509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.647644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.647670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.647769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.647868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.647894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.648014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.648116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.648142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.648249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.648351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.648377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.648499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.648659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.648685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.648786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.648920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.648945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.649075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.649203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.649228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.649356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.649483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.649507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.649633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.649823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.649852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.650021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.650161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.650186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.650295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.650446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.650470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.650606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.650774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.650820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.650964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.651136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.651162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.651265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.651384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.651410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.651541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.651698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.651723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.651829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.651931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.651956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.652087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.652187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.652213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.652365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.652504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.652543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.652664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.652829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.652857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.653033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.653199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.653225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.653380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.653478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.653503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.653618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.653713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.653737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.322 qpair failed and we were unable to recover it. 00:31:02.322 [2024-11-28 01:25:16.653864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.322 [2024-11-28 01:25:16.653991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.654015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.654109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.654229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.654254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.654382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.654535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.654561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.654680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.654861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.654890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.654993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.655146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.655172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.655299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.655420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.655446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.655608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.655750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.655779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.655941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.656045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.656073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.656203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.656348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.656376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.656554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.656681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.656707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.656811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.656924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.656952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.657121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.657272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.657300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.657466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.657641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.657667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.657799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.657931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.657964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.658066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.658227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.658253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.658369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.658517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.658552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.658698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.658821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.658847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.659002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.659105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.659131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.659254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.659427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.659457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.659613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.659713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.659739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.659837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.659928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.659969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.660104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.660257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.660285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.660427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.660562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.660588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.660713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.660843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.660867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.661009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.661140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.661166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.661321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.661485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.661516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.661697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.661804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.661836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.662041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.662210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.662237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.323 qpair failed and we were unable to recover it. 00:31:02.323 [2024-11-28 01:25:16.662345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.662470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.323 [2024-11-28 01:25:16.662499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.662659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.662756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.662782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.662878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.663029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.663055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.663160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.663254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.663280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.663378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.663511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.663549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.663678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.663780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.663811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.663936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.664073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.664101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.664225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.664411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.664439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.664562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.664689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.664714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.664850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.664968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.664997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.665103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.665246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.665275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.665453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.665618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.665643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.665741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.665894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.665918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.666062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.666204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.666233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.666407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.666520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.666554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.666693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.666793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.666832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.666964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.667097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.667123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.667316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.667452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.667479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.667614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.667708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.667734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.667889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.667987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.668030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.668240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.668380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.668423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.668570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.668670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.668695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.668827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.668982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.669010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.669183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.669318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.669347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.669490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.669649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.669675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.324 qpair failed and we were unable to recover it. 00:31:02.324 [2024-11-28 01:25:16.669799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.324 [2024-11-28 01:25:16.669917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.669950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.670091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.670229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.670257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.670398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.670539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.670582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.670712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.670865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.670890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.671038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.671172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.671200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.671341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.671497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.671523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.671660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.671757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.671784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.671894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.672031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.672060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.672189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.672326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.672354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.672493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.672655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.672682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.672823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.672947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.672972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.673122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.673226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.673255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.673405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.673598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.673624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.673725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.673851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.673876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.674003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.674170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.674198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.674313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.674454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.674483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.674641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.674773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.674799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.674928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.675080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.675106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.675230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.675330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.675356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.675480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.675577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.675604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.675759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.675897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.675922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.676079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.676182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.676208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.676304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.676399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.676426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.676564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.676691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.676717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.676868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.677031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.677056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.677216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.677363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.677388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.677531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.677685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.677710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.677863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.678037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.678066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.325 [2024-11-28 01:25:16.678189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.678339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.325 [2024-11-28 01:25:16.678364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.325 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.678516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.678664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.678689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.678813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.678943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.678967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.679093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.679209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.679234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.679374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.679504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.679547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.679673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.679802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.679838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.679938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.680058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.680084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.680210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.680320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.680350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.680501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.680623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.680649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.680777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.680913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.680938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.681067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.681240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.681267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.681431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.681586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.681613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.681768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.681899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.681926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.682097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.682277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.682305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.682452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.682607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.682635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.682754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.682865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.682892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.682999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.683126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.683167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.683306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.683445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.683474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.683583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.683753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.683778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.683880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.684067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.684092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.684242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.684338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.684362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.684486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.684652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.684678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.684817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.684976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.685001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.685134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.685258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.685283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.685406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.685563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.685589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.685731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.685891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.685917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.686043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.686146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.686173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.686323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.686459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.686489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.686657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.686748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.326 [2024-11-28 01:25:16.686774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.326 qpair failed and we were unable to recover it. 00:31:02.326 [2024-11-28 01:25:16.686898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.687029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.687054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.687155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.687305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.687330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.687426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.687581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.687606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.687734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.687895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.687920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.688024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.688149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.688174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.688272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.688424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.688449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.688571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.688684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.688713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.688892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.689014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.689039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.689213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.689374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.689399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.689533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.689653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.689678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.689809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.689937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.689963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.690063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.690190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.690214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.690318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.690418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.690442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.690572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.690679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.690705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.690873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.691004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.691029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.691163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.691252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.691276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.691432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.691565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.691591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.691720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.691892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.691921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.692028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.692152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.692181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.692363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.692484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.692508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.692645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.692773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.692798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.692919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.693046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.693071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.693168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.693260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.693285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.693432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.693613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.693642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.693787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.693923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.693950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.694130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.694257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.694283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.694392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.694529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.694555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.694691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.694794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.694822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.327 qpair failed and we were unable to recover it. 00:31:02.327 [2024-11-28 01:25:16.694980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.695132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.327 [2024-11-28 01:25:16.695157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.695280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.695432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.695457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.695596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.695766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.695795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.695938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.696035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.696062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.696196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.696348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.696374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.696500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.696705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.696730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.696902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.697011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.697056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.697203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.697341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.697370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.697504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.697634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.697663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.697821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.697946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.697973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.698123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.698278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.698303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.698406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.698512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.698542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.698671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.698799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.698824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.698957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.699083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.699109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.699236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.699358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.699383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.699504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.699676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.699702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.699803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.699901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.699928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.700057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.700170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.700198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.700332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.700462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.700490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.700649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.700747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.700772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.700866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.701014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.701039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.701126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.701283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.701307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.701432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.701575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.701601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.701729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.701827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.701852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.701956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.702084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.702109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.702262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.702383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.702408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.702555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.702697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.702722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.702858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.702957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.702982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.328 qpair failed and we were unable to recover it. 00:31:02.328 [2024-11-28 01:25:16.703112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.703259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.328 [2024-11-28 01:25:16.703289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.703445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.703547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.703574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.703701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.703803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.703828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.703954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.704104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.704133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.704280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.704419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.704446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.704585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.704734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.704759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.704886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.705017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.705044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.705207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.705360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.705385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.705511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.705628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.705654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.705782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.705906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.705932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.706083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.706258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.706286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.706437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.706597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.706623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.706723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.706856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.706881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.706987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.707113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.707137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.707234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.707335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.707359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.707486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.707606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.707632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.707755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.707851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.707876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.708004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.708135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.708162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.708269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.708424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.708454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.708610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.708738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.708764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.708867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.708990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.709015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.709146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.709268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.709294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.709397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.709556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.709583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.709711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.709812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.709839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.709969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.710069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.710095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.329 qpair failed and we were unable to recover it. 00:31:02.329 [2024-11-28 01:25:16.710185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.710284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.329 [2024-11-28 01:25:16.710310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.710456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.710630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.710657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.710757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.710877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.710902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.711003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.711139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.711168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.711295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.711422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.711447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.711578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.711706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.711732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.711830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.711959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.711985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.712082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.712171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.712197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.712313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.712418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.712443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.712535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.712637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.712661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.712785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.712938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.712964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.713061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.713186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.713213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.713366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.713492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.713518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.713641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.713747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.713777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.713874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.713970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.713995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.714092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.714225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.714251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.714402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.714505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.714540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.714647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.714778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.714804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.714956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.715113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.715138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.715242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.715370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.715396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.715493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.715601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.715627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.715754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.715858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.715885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.716038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.716168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.716194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.716293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.716387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.716419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.716552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.716719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.716745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.716869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.717002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.717027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.717133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.717228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.717254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.717375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.717470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.717495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.330 [2024-11-28 01:25:16.717607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.717736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.330 [2024-11-28 01:25:16.717761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.330 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.717862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.717984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.718010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.718106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.718230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.718255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.718368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.718476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.718506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.718653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.718782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.718807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.718960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.719087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.719112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.719269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.719398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.719423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.719582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.719708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.719734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.719830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.719936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.719961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.720075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.720206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.720231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.720333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.720460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.720486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.720614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.720747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.720772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.720899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.721018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.721044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.721142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.721265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.721290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.721392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.721523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.721557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.721660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.721759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.721784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.721920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.722045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.722070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.722163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.722257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.722284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.722439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.722604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.722631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.722736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.722890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.722916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.723021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.723114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.723160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.723325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.723457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.723485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.723616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.723749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.723775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.723899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.724053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.724078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.724177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.724305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.724330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.724459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.724584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.724610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.724709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.724837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.724864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.725014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.725162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.725188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.725344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.725470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.725497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.331 qpair failed and we were unable to recover it. 00:31:02.331 [2024-11-28 01:25:16.725634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.331 [2024-11-28 01:25:16.725736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.725762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.725925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.726050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.726075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.726204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.726337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.726363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.726493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.726661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.726689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.726790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.726945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.726970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.727067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.727197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.727222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.727349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.727447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.727472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.727578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.727712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.727738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.727838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.727966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.727993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.728094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.728227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.728252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.728415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.728567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.728594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.728684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.728835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.728860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.728962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.729092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.729119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.729246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.729366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.729392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.729499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.729608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.729635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.729742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.729902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.729928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.730054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.730189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.730214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.730343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.730448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.730475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.730570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.730658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.730684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.730779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.730906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.730933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.731055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.731181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.731207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.731337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.731441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.731466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.731620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.731746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.731772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.731887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.731986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.732012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.732140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.732266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.732292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.732416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.732518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.732553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.732659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.732767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.732794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.732897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.733027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.733052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.332 [2024-11-28 01:25:16.733165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.733293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.332 [2024-11-28 01:25:16.733318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.332 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.733440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.733582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.733609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.733744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.733875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.733903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.734004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.734125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.734151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.734284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.734435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.734461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.734557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.734659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.734685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.734787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.734942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.734967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.735063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.735163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.735191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.735320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.735423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.735448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.735590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.735731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.735760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.735921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.736044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.736086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.736216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.736338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.736364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.736459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.736583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.736609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.736711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.736817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.736843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.736946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.737041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.737066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.737181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.737269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.737294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.737424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.737555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.737581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.737732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.737851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.737876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.738003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.738152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.738177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.738313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.738445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.738470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.738588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.738750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.738794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.738930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.739077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.739102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.739258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.739383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.739409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.333 qpair failed and we were unable to recover it. 00:31:02.333 [2024-11-28 01:25:16.739539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.739653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.333 [2024-11-28 01:25:16.739682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.739840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.739972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.739998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.740161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.740264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.740289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.740416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.740569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.740598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.740741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.740844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.740869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.740989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.741118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.741142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.741249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.741410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.741435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.741579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.741674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.741699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.741821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.741948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.741972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.742126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.742291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.742317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.742447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.742552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.742588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.742689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.742801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.742843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.743020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.743167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.743192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.743347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.743449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.743475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.743629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.743788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.743829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.744003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.744144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.744169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.744292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.744394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.744419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.744543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.744722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.744751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.744883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.745053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.745078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.745203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.745355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.745380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.745483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.745646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.745689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.745802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.745968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.746010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.746131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.746258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.746284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.746441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.746565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.746624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.746721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.746877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.746904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.747081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.747228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.747253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.747358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.747488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.747513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.334 qpair failed and we were unable to recover it. 00:31:02.334 [2024-11-28 01:25:16.747684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.334 [2024-11-28 01:25:16.747846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.747889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.748069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.748237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.748262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.748360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.748462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.748487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.748619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.748771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.748795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.748915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.749069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.749094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.749233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.749391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.749416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.749569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.749712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.749756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.749896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.750050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.750092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.750218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.750346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.750371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.750489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.750593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.750619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.750767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.750953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.751013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.751166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.751272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.751296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.751397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.751522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.751552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.751715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.751842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.751867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.752003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.752122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.752147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.752245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.752367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.752392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.752521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.752654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.752679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.752776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.752877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.752903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.753061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.753154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.753179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.753281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.753408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.753438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.753537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.753642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.753668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.753794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.753890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.753915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.754035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.754130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.754157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.754259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.754367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.754392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.754520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.754688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.754713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.754822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.754947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.754973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.755098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.755220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.755245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.335 qpair failed and we were unable to recover it. 00:31:02.335 [2024-11-28 01:25:16.755394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.335 [2024-11-28 01:25:16.755499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.755530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.755635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.755735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.755761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.755915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.756018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.756049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.756148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.756271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.756296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.756403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.756569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.756594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.756725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.756856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.756881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.756977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.757102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.757127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.757254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.757379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.757405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.757532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.757697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.757722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.757851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.757980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.758005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.758138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.758266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.758292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.758414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.758538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.758565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.758683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.758848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.758894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.759019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.759130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.759156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.759281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.759432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.759458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.759600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.759749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.759774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.759909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.760030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.760055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.760148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.760273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.760299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.760432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.760536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.760562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.760684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.760832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.760857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.760960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.761113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.761138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.761268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.761421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.761446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.761542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.761688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.761734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.761907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.762064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.762107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.762235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.762330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.762356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.762459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.762575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.762605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.762753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.762872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.762897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.336 qpair failed and we were unable to recover it. 00:31:02.336 [2024-11-28 01:25:16.762993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.763112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.336 [2024-11-28 01:25:16.763138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.763264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.763387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.763413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.763539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.763689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.763733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.763903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.764054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.764079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.764171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.764303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.764328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.764420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.764565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.764594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.764764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.764936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.764963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.765084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.765212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.765237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.765367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.765492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.765519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.765676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.765799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.765825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.765966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.766123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.766148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.766244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.766343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.766368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.766494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.766597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.766623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.766764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.766890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.766916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.767070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.767165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.767190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.767294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.767443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.767469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.767603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.767727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.767752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.767899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.768041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.768066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.768201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.768324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.768349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.768449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.768592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.768620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.768806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.768935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.768960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.769093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.769223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.769248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.769375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.769499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.769529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.769649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.769810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.769854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.770004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.770170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.770195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.770325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.770451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.770476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.770675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.770812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.770842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.337 [2024-11-28 01:25:16.771007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.771146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.337 [2024-11-28 01:25:16.771171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.337 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.771333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.771437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.771462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.771605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.771771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.771813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.771967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.772108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.772150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.772278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.772377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.772402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.772531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.772670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.772712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.772834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.772997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.773040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.773168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.773263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.773288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.773418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.773566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.773592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.773731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.773862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.773888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.773987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.774084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.774109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.774229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.774388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.774413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.774508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.774615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.774640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.774736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.774866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.774892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.775042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.775145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.775169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.775293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.775449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.775474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.775647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.775842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.775884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.776035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.776184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.776209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.776339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.776441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.776467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.776589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.776761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.776805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.776926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.777052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.777077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.777196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.777325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.777350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.777476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.777604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.338 [2024-11-28 01:25:16.777629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.338 qpair failed and we were unable to recover it. 00:31:02.338 [2024-11-28 01:25:16.777758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.777890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.777915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.778121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.778269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.778294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.778417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.778553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.778580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.778725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.778887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.778929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.779079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.779249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.779275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.779397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.779530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.779556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.779705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.779888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.779913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.780038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.780164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.780189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.780295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.780448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.780473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.780596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.780724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.780749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.780959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.781075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.781101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.781264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.781393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.781418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.781541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.781755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.781802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.781998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.782157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.782182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.782310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.782459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.782484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.782637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.782806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.782849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.783008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.783157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.783191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.783346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.783454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.783482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.783634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.783748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.783776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.783920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.784062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.784091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.784227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.784347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.784372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.784498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.784610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.784636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.784781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.784890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.784919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.785031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.785175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.785203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.785321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.785432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.785460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.785648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.785771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.785815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.785943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.786108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.786152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.786279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.786388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.786414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.339 qpair failed and we were unable to recover it. 00:31:02.339 [2024-11-28 01:25:16.786571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.339 [2024-11-28 01:25:16.786693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.786739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.786846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.787003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.787028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.787132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.787225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.787250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.787404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.787537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.787564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.787671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.787791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.787819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.787934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.788041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.788066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.788159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.788281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.788306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.788394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.788520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.788553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.788652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.788781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.788806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.788907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.789000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.789025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.789117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.789222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.789249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.789337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.789469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.789494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.789604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.789705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.789731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.789860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.789963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.789989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.790121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.790240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.790265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.790368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.790500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.790533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.790662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.790790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.790834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.790969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.791075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.791105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.791312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.791473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.791499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.791610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.791742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.791768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.791921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.792026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.792053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.792175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.792325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.792354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.792465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.792614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.792641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.792753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.792890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.792919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.793022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.793126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.793155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.793264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.793394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.340 [2024-11-28 01:25:16.793419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.340 qpair failed and we were unable to recover it. 00:31:02.340 [2024-11-28 01:25:16.793547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.793643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.793668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.793789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.793887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.793928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.794046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.794164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.794193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.794335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.794483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.794508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.794642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.794740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.794766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.794958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.795109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.795138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.795273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.795425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.795450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.795548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.795676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.795700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.795821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.795971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.796014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.796118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.796235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.796263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.796380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.796469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.796494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.796629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.796733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.796758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.796914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.797082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.797110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.797298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.797461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.797489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.797624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.797750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.797775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.797867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.798012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.798040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.798177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.798328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.798356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.798549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.798673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.798699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.798825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.798973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.799001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.799116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.799250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.799278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.799423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.799516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.799549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.799660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.799789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.799832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.800000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.800132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.800161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.800316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.800454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.800482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.800610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.800763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.800788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.800940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.801050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.801079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.801200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.801343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.801371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.801509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.801638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.801663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.341 qpair failed and we were unable to recover it. 00:31:02.341 [2024-11-28 01:25:16.801779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.341 [2024-11-28 01:25:16.801949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.801977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.802095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.802238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.802266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.802389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.802513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.802552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.802656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.802751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.802777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.802939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.803098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.803128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.803282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.803422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.803449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.803628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.803734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.803761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.803904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.804016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.804045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.804141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.804253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.804281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.804401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.804513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.804543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.804639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.804739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.804764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.804892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.804986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.805011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.805117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.805240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.805265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.805391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.805533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.805561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.805692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.805867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.805900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.806016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.806141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.806166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.806262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.806396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.806424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.806547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.806682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.806710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.806864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.806988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.807013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.807132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.807273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.807301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.807447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.807548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.807575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.807701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.807827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.807852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.807977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.808101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.808129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.808235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.808366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.808391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.808555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.808659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.808685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.808793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.808935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.808964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.809106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.809251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.809276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.809400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.809499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.809545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.342 [2024-11-28 01:25:16.809657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.809763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.342 [2024-11-28 01:25:16.809788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.342 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.809887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.809987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.810012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.810142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.810247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.810272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.810375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.810468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.810511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.810638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.810731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.810756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.810862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.810967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.810992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.811095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.811195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.811219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.811333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.811478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.811505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.811665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.811767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.811792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.811891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.811991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.812017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.812119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.812242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.812267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.812449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.812612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.812638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.812768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.812887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.812915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.813071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.813191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.813217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.813311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.813400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.813425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.813542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.813639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.813665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.813818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.813948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.813977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.814089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.814196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.814223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.814375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.814502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.814534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.814690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.814795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.814837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.814966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.815089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.815114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.815237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.815390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.815415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.815538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.815676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.815703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.815847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.815965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.815990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.816114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.816237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.816262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.343 [2024-11-28 01:25:16.816387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.816504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.343 [2024-11-28 01:25:16.816541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.343 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.816698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.816803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.816830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.816934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.817062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.817088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.817237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.817342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.817370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.817555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.817671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.817697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.817800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.817924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.817950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.818064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.818174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.818202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.818350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.818488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.818515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.818666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.818767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.818793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.818942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.819046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.819073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.819220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.819355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.819384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.819533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.819628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.819654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.819767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.819890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.819915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.820028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.820170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.820199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.820318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.820468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.820496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.820623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.820722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.820747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.820900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.821094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.821119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.821218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.821342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.821367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.821507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.821633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.821661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.821796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.821901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.821926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.822031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.822129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.822154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.822301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.822411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.822439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.822597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.822724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.822750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.822843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.822991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.823015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.823169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.823284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.823311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.823443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.823546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.823586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.823720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.823811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.823837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.823938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.824038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.824063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.824181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.824344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.344 [2024-11-28 01:25:16.824372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.344 qpair failed and we were unable to recover it. 00:31:02.344 [2024-11-28 01:25:16.824501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.824608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.824635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.824740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.824868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.824893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.824994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.825139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.825167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.825290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.825394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.825419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.825539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.825674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.825700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.825826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.825926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.825956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.826105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.826213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.826239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.826384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.826513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.826551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.826692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.826804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.826832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.826985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.827111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.827136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.827257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.827372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.827399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.827511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.827633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.827658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.827819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.827942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.827984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.828102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.828208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.828235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.828343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.828503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.828536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.828642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.828772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.828797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.828926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.829022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.829049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.829193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.829294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.829322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.829489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.829632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.829658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.829789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.829898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.829926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.830069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.830174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.830201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.830330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.830460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.830485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.830589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.830730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.830758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.830896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.831069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.831098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.831246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.831375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.831400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.831504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.831669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.831695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.831812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.831915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.831943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.832059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.832152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.832178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.345 qpair failed and we were unable to recover it. 00:31:02.345 [2024-11-28 01:25:16.832283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.832410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.345 [2024-11-28 01:25:16.832435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.832571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.832726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.832754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.832877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.833005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.833031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.833154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.833278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.833304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.833424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.833560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.833600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.833712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.833817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.833845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.833968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.834113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.834141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.834240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.834372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.834400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.834530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.834652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.834677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.834804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.834951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.834976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.835130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.835260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.835286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.835441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.835592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.835618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.835719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.835830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.835855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.835957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.836085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.836110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.836198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.836299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.836323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.836427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.836537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.836564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.836717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.836882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.836911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.837061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.837166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.837196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.837317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.837456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.837484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.837610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.837724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.837753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.837880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.838004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.838029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.838196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.838317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.838342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.838491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.838610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.838636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.838775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.838868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.838892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.838996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.839093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.839119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.839247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.839386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.839414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.839567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.839695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.839720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.839871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.839977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.840004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.840145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.840261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.346 [2024-11-28 01:25:16.840285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.346 qpair failed and we were unable to recover it. 00:31:02.346 [2024-11-28 01:25:16.840456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.840600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.840627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.840757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.840883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.840912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.841013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.841150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.841178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.841324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.841452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.841477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.841614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.841742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.841768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.841911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.842012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.842037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.842165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.842284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.842314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.842432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.842579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.842607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.842745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.842883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.842913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.843055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.843150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.843175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.843331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.843452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.843480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.843598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.843738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.843767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.843939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.844046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.844071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.844176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.844296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.844321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.844418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.844512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.844544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.844654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.844757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.844782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.844908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.845017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.845050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.845227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.845350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.845376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.845498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.845668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.845694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.845820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.845937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.845966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.846112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.846244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.846269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.846368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.846489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.846514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.846636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.846732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.846773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.846884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.846987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.847016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.347 qpair failed and we were unable to recover it. 00:31:02.347 [2024-11-28 01:25:16.847128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.347 [2024-11-28 01:25:16.847226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.847253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.847356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.847484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.847510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.847696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.847840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.847870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.847966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.848091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.848117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.848238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.848346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.848387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.848488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.848591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.848633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.848763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.848866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.848891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.849015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.849139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.849169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.849339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.849438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.849463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.849619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.849749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.849775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.849916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.850053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.850081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.850218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.850379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.850407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.850536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.850654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.850684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.850840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.850946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.850971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.851066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.851194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.851220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.851348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.851454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.851478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.851626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.851765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.851794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.851938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.852046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.852074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.852209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.852361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.852386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.852511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.852665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.852691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.852869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.852984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.853009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.853158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.853309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.853335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.853497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.853612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.853638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.853786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.853938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.853966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.854094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.854253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.854279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.854394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.854538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.854582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.854716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.854816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.854841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.854968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.855072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.855098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.348 qpair failed and we were unable to recover it. 00:31:02.348 [2024-11-28 01:25:16.855212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.855353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.348 [2024-11-28 01:25:16.855378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.855519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.855638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.855668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.855791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.855898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.855923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.856027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.856181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.856206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.856333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.856431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.856457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.856593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.856688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.856713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.856878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.856991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.857019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.857155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.857335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.857363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.857484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.857666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.857692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.857864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.858003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.858045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.858142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.858296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.858321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.858447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.858556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.858585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.858761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.858875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.858903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.859059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.859184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.859209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.859301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.859399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.859425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.859534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.859645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.859670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.859824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.859939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.859966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.860109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.860221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.860246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.860369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.860488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.860515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.860675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.860769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.860793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.860982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.861109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.861133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.861261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.861367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.861409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.861562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.861688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.861715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.861837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.861963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.861989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.862102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.862264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.862292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.862439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.862564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.862596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.862771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.862900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.862941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.863049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.863190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.863215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.863357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.863470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.349 [2024-11-28 01:25:16.863499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.349 qpair failed and we were unable to recover it. 00:31:02.349 [2024-11-28 01:25:16.863659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.863814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.863856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.863999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.864141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.864166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.864290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.864432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.864460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.864610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.864738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.864763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.864858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.864950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.864975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.865099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.865248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.865277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.865406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.865512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.865546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.865676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.865829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.865854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.866007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.866129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.866154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.866311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.866417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.866447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.866583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.866681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.866707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.866852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.866985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.867014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.867159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.867262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.867287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.867406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.867548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.867588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.867713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.867823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.867850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.867998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.868096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.868121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.868225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.868347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.868374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.868519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.868691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.868720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.868847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.868978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.869003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.869172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.869273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.869301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.869408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.869569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.869595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.869752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.869854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.869879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.870057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.870172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.870200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.870339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.870446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.870474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.870626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.870731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.870756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.870861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.871006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.871031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.871215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.871360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.871389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.871482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.871593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.871620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.350 qpair failed and we were unable to recover it. 00:31:02.350 [2024-11-28 01:25:16.871715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.871804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.350 [2024-11-28 01:25:16.871828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.871983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.872090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.872118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.872236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.872334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.872359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.872475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.872628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.872653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.872785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.872939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.872963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.873067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.873216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.873244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.873355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.873456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.873498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.873631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.873734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.873760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.873890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.873995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.874022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.874126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.874277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.874305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.874413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.874518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.874554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.874700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.874799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.874824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.874933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.875074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.875101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.875217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.875336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.875361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.875485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.875648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.875674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.875779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.875876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.875902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.876005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.876157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.876181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.876310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.876414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.876439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.876537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.876697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.876722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.876820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.876946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.876972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.877074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.877175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.877200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.877345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.877472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.877500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.877662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.877766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.877792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.877947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.878048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.878073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.878204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.878298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.878323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.878467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.878593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.878619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.878773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.878873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.878896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.878989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.879089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.879114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.879240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.879369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.351 [2024-11-28 01:25:16.879401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.351 qpair failed and we were unable to recover it. 00:31:02.351 [2024-11-28 01:25:16.879556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.879688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.879711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.879836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.880007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.880034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.880140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.880242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.880270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.880395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.880550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.880576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.880673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.880777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.880801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.880972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.881088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.881116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.881243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.881369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.881397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.881545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.881688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.881713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.881805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.881961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.881988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.882129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.882258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.882281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.882431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.882574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.882598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.882726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.882826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.882868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.883044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.883214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.883241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.883357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.883506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.883537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.883666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.883766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.883791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.883912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.884034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.884057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.884204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.884315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.884341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.884482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.884642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.884667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.884772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.884888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.884912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.885034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.885173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.885199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.885339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.885474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.885500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.885631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.885734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.885759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.885875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.885986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.886012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.886150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.886283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.886312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.886433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.886540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.886565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.352 qpair failed and we were unable to recover it. 00:31:02.352 [2024-11-28 01:25:16.886692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.352 [2024-11-28 01:25:16.886790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.353 [2024-11-28 01:25:16.886815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.353 qpair failed and we were unable to recover it. 00:31:02.353 [2024-11-28 01:25:16.886914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.353 [2024-11-28 01:25:16.887011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.353 [2024-11-28 01:25:16.887052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.353 qpair failed and we were unable to recover it. 00:31:02.353 [2024-11-28 01:25:16.887203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.353 [2024-11-28 01:25:16.887331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.353 [2024-11-28 01:25:16.887355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.353 qpair failed and we were unable to recover it. 00:31:02.353 [2024-11-28 01:25:16.887507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.353 [2024-11-28 01:25:16.887654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.353 [2024-11-28 01:25:16.887678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.353 qpair failed and we were unable to recover it. 00:31:02.353 [2024-11-28 01:25:16.887785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.353 [2024-11-28 01:25:16.887913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.353 [2024-11-28 01:25:16.887937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.353 qpair failed and we were unable to recover it. 00:31:02.353 [2024-11-28 01:25:16.888039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.353 [2024-11-28 01:25:16.888172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.353 [2024-11-28 01:25:16.888196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.353 qpair failed and we were unable to recover it. 00:31:02.353 [2024-11-28 01:25:16.888316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.888466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.888489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.888622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.888723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.888747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.888846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.888946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.888969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.889061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.889159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.889184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.889323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.889455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.889483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.889607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.889712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.889737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.889890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.889998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.890045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.890165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.890265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.890290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.890416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.890519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.890570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.890674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.890780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.890806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.890923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.891031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.891059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.891219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.891313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.891337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.891457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.891588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.891613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.891739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.891909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.891935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.892088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.892192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.892217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.892318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.892422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.892463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.892598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.892718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.892741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.892846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.892969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.892992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.893111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.893223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.893250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.893373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.893489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.893520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.893650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.893783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.893807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.893960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.894106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.894130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.894231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.894354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.894378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.894534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.894660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.894685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.631 qpair failed and we were unable to recover it. 00:31:02.631 [2024-11-28 01:25:16.894781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.894907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.631 [2024-11-28 01:25:16.894933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.895074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.895208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.895235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.895380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.895480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.895504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.895608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.895711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.895736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.895885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.896004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.896028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.896182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.896301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.896325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.896454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.896591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.896618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.896728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.896908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.896931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.897058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.897178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.897203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.897346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.897453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.897480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.897591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.897699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.897726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.897843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.897966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.897991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.898118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.898256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.898284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.898437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.898541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.898566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.898701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.898795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.898819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.898925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.899026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.899051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.899157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.899275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.899302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.899401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.899495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.899522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.899649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.899741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.899765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.899873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.900011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.900038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.900189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.900285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.900309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.900427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.900556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.900582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.900707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.900819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.900847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.900962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.901060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.901084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.901187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.901283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.901307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.901434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.901539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.901565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.901693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.901828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.901853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.902003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.902113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.902141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.902246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.902380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.902408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.632 qpair failed and we were unable to recover it. 00:31:02.632 [2024-11-28 01:25:16.902551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.632 [2024-11-28 01:25:16.902683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.902707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.902826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.902969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.902996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.903133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.903234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.903260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.903381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.903508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.903538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.903687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.903801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.903827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.903963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.904095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.904122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.904269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.904414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.904441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.904622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.904722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.904750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.904876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.905010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.905036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.905187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.905316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.905340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.905438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.905572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.905617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.905788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.905910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.905935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.906065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.906183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.906207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.906361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.906544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.906570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.906695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.906823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.906847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.906979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.907118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.907142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.907296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.907455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.907480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.907589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.907688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.907721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.907848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.907971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.907995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.908141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.908323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.908346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.908478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.908631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.908656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.908781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.908884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.908909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.909042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.909153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.909195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.909298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.909420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.909445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.909549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.909673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.909699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.909828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.909986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.910011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.910121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.910268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.910295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.910448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.910577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.910601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.910784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.910915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.633 [2024-11-28 01:25:16.910943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.633 qpair failed and we were unable to recover it. 00:31:02.633 [2024-11-28 01:25:16.911130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.911226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.911250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.911374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.911473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.911500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.911635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.911732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.911756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.911882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.911993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.912020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.912150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.912276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.912301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.912412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.912554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.912582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.912702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.912819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.912843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.912963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.913057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.913082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.913184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.913285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.913310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.913411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.913507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.913540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.913640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.913765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.913789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.913909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.914025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.914052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.914206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.914331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.914356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.914483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.914624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.914649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.914747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.914855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.914882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.914987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.915121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.915150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.915294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.915413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.915438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.915602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.915699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.915723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.915896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.916024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.916051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.916195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.916295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.916320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.916412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.916566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.916591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.916762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.916876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.916903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.917047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.917139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.917164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.917283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.917466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.917491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.917636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.917737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.917761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.917855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.917948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.917973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.918076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.918228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.918252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.918381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.918487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.918514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.634 qpair failed and we were unable to recover it. 00:31:02.634 [2024-11-28 01:25:16.918658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.634 [2024-11-28 01:25:16.918802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.918826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.918958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.919109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.919138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.919239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.919371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.919395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.919496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.919634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.919658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.919756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.919906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.919931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.920030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.920179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.920203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.920321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.920451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.920478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.920601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.920725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.920749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.920893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.921033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.921059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.921176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.921272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.921312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.921416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.921535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.921577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.921714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.921857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.921885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.922041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.922194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.922219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.922337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.922497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.922533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.922711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.922826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.922852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.922987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.923079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.923103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.923254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.923356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.923383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.923499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.923610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.923637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.923752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.923851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.923875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.923976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.924064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.924087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.924188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.924333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.924360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.924537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.924661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.924686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.924880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.924997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.925023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.925166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.925322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.635 [2024-11-28 01:25:16.925347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.635 qpair failed and we were unable to recover it. 00:31:02.635 [2024-11-28 01:25:16.925474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.925593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.925618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.925735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.925846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.925871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.925977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.926069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.926094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.926195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.926294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.926318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.926443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.926548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.926591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.926719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.926848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.926872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.926998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.927122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.927146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.927247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.927373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.927398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.927568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.927696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.927721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.927822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.927918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.927942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.928046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.928170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.928197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.928363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.928501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.928536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.928661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.928768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.928792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.928894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.929040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.929067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.929201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.929308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.929347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.929451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.929549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.929574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.929694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.929834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.929860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.930008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.930161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.930185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.930281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.930412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.930437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.930577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.930696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.930722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.930821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.930977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.931017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.931113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.931204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.931229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.931352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.931487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.931514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.931637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.931781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.931805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.931957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.932084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.932107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.932260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.932366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.932392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.932511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.932618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.932646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.932755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.932881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.932904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.636 [2024-11-28 01:25:16.933051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.933154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.636 [2024-11-28 01:25:16.933186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.636 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.933329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.933447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.933473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.933593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.933691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.933716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.933861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.933999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.934023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.934126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.934223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.934247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.934405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.934519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.934554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.934702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.934788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.934830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.934981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.935108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.935133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.935227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.935356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.935380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.935502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.935630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.935656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.935770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.935900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.935926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.936044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.936144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.936169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.936269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.936368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.936392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.936490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.936671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.936699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.936818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.936948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.936972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.937073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.937192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.937216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.937367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.937480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.937506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.937640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.937744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.937769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.937883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.938008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.938032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.938159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.938255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.938278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.938390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.938565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.938590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.938745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.938862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.938889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.939022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.939135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.939162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.939303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.939410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.939434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.939535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.939642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.939666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.939770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.939860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.939884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.939978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.940074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.940099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.940193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.940285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.940310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.940406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.940504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.940553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.637 qpair failed and we were unable to recover it. 00:31:02.637 [2024-11-28 01:25:16.940698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.637 [2024-11-28 01:25:16.940796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.940821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.940942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.941083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.941110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.941243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.941403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.941427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.941559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.941682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.941706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.941837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.941937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.941979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.942094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.942238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.942266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.942414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.942572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.942613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.942753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.942899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.942923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.943024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.943147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.943174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.943351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.943480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.943506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.943638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.943739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.943763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.943908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.944019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.944046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.944203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.944331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.944360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.944491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.944605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.944632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.944783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.944883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.944907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.945066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.945167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.945190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.945284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.945408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.945432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.945531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.945626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.945650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.945751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.945845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.945869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.946018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.946158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.946185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.946366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.946467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.946491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.946622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.946715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.946739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.946842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.946966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.946998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.947128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.947267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.947294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.947414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.947583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.947609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.947718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.947822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.947850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.947955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.948116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.948143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.948264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.948390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.948414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.948506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.948663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.638 [2024-11-28 01:25:16.948692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.638 qpair failed and we were unable to recover it. 00:31:02.638 [2024-11-28 01:25:16.948831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.948945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.948972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.949101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.949219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.949243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.949360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.949465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.949493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.949640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.949747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.949772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.949881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.949981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.950005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.950113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.950237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.950262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.950381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.950492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.950521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.950681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.950781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.950806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.950916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.951072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.951097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.951207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.951313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.951341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.951511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.951626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.951652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.951746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.951841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.951885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.952025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.952180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.952205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.952348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.952476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.952501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.952610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.952713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.952738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.952840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.952992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.953016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.953113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.953209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.953233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.953372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.953512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.953547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.953698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.953819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.953844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.953944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.954037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.954062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.954163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.954318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.954347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.954458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.954607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.954633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.954759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.954882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.954906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.955005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.955127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.955152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.955264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.955411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.955440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.955556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.955714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.955739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.955869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.955960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.955985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.956089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.956213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.956237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.639 [2024-11-28 01:25:16.956364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.956486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.639 [2024-11-28 01:25:16.956510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.639 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.956661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.956828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.956856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.956973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.957095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.957119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.957250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.957353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.957377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.957510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.957615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.957642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.957740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.957841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.957883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.957995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.958097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.958125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.958225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.958373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.958399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.958538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.958683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.958707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.958838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.958939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.958963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.959122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.959245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.959270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.959362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.959554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.959580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.959703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.959808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.959832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.959996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.960125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.960150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.960263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.960377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.960418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.960549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.960652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.960677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.960776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.960901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.960927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.961073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.961221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.961245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.961343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.961437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.961461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.961552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.961676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.961700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.961802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.961905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.961930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.962031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.962131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.962155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.962253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.962384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.962409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.962510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.962660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.962685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.962788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.962917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.962941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.963089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.963242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.640 [2024-11-28 01:25:16.963266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.640 qpair failed and we were unable to recover it. 00:31:02.640 [2024-11-28 01:25:16.963362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.963490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.963513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.963646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.963748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.963772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.963872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.963965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.963989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.964092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.964186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.964210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.964337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.964436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.964461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.964562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.964689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.964714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.964812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.964933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.964958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.965060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.965181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.965206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.965336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.965477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.965501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.965613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.965716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.965741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.965868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.965989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.966014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.966143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.966251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.966293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.966446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.966575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.966601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.966733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.966831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.966855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.967015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.967165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.967189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.967287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.967409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.967436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.967584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.967709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.967733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.967885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.968017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.968044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.968180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.968348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.968373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.968497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.968603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.968627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.968816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.968944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.968970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.969063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.969219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.969247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.969411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.969544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.969571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.969679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.969807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.969849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.969967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.970076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.970104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.970273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.970376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.970400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.970557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.970650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.970675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.970807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.970970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.970993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.641 [2024-11-28 01:25:16.971154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.971251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.641 [2024-11-28 01:25:16.971292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.641 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.971434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.971537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.971580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.971676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.971819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.971845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.971972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.972109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.972137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.972252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.972363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.972390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.972536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.972656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.972682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.972787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.972929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.972956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.973079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.973206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.973229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.973379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.973547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.973592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.973726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.973860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.973901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.974002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.974095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.974120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.974239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.974374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.974399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.974498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.974655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.974681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.974783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.974907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.974931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.975123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.975249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.975273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.975402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.975498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.975521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.975657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.975822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.975848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.975986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.976095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.976143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.976274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.976371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.976396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.976516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.976652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.976680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.976786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.976918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.976945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.977095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.977244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.977269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.977412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.977522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.977556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.977664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.977769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.977797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.977976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.978078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.978102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.978224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.978364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.978388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.978487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.978621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.978646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.978742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.978852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.978876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.978989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.979137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.979161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.642 qpair failed and we were unable to recover it. 00:31:02.642 [2024-11-28 01:25:16.979270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.642 [2024-11-28 01:25:16.979369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.979392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.979533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.979659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.979682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.979788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.979890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.979915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.980036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.980173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.980200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.980324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.980448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.980472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.980622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.980768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.980796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.980913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.981078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.981103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.981230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.981328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.981352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.981473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.981572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.981596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.981700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.981845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.981872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.981998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.982101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.982125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.982227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.982328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.982369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.982477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.982666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.982692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.982821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.982970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.982994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.983143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.983286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.983311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.983413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.983545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.983575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.983703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.983828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.983851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.983975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.984120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.984144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.984264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.984367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.984407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.984516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.984616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.984640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.984769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.984932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.984956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.985088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.985197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.985221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.985346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.985499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.985547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.985651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.985803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.985827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.985929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.986052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.986077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.986179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.986297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.986326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.986427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.986581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.986610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.986722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.986849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.986877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.987019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.987119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.987142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.643 qpair failed and we were unable to recover it. 00:31:02.643 [2024-11-28 01:25:16.987244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.643 [2024-11-28 01:25:16.987374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.987399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.987498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.987606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.987632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.987729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.987831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.987855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.987951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.988110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.988135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.988288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.988401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.988427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.988546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.988644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.988668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.988793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.988960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.988987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.989115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.989259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.989283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.989383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.989488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.989512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.989645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.989791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.989817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.989934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.990045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.990086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.990214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.990338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.990362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.990477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.990605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.990633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.990742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.990845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.990872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.991016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.991113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.991138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.991242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.991380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.991407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.991511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.991656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.991683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.991814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.991914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.991939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.992092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.992214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.992241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.992381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.992502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.992536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.992670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.992762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.992786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.992960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.993069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.993096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.993198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.993331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.993358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.993506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.993614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.993639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.993755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.993867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.993895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.994004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.994144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.994172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.644 qpair failed and we were unable to recover it. 00:31:02.644 [2024-11-28 01:25:16.994304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.644 [2024-11-28 01:25:16.994441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.994468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:16.994619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.994725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.994750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:16.994907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.995052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.995079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:16.995211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.995312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.995336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:16.995463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.995621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.995646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:16.995773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.995882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.995909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:16.996027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.996146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.996170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:16.996276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.996380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.996409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:16.996554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.996693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.996721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:16.996870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.996964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.996989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:16.997092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.997185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.997225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:16.997339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.997463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.997495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:16.997644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.997741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.997765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:16.997919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.998029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.998071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:16.998169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.998315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.998342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:16.998468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.998564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.998589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:16.998713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.998888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.998915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:16.999041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.999166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.999191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:16.999344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.999485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.999512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:16.999638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.999729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.999754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:16.999877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:16.999967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:17.000006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:17.000130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:17.000261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:17.000286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:17.000391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:17.000507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:17.000542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:17.000657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:17.000800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:17.000828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:17.000971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:17.001087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:17.001112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:17.001292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:17.001447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:17.001472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:17.001577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:17.001753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:17.001780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:17.001906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:17.002005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:17.002030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.645 qpair failed and we were unable to recover it. 00:31:02.645 [2024-11-28 01:25:17.002153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.645 [2024-11-28 01:25:17.002321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.002346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.002470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.002592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.002621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.002753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.002885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.002910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.003060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.003202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.003229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.003390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.003517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.003547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.003649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.003741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.003767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.003896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.004014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.004042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.004141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.004243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.004270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.004391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.004536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.004584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.004718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.004815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.004840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.004940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.005076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.005103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.005230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.005354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.005379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.005498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.005661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.005690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.005851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.005990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.006016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.006164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.006292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.006317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.006440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.006538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.006563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.006669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.006818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.006845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.006993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.007122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.007147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.007266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.007384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.007427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.007537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.007641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.007683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.007838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.007961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.007988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.008176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.008304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.008329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.008456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.008574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.008599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.008721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.008817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.008841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.008970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.009066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.009109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.009273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.009403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.009429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.009559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.009659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.009684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.009818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.009962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.009989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.646 qpair failed and we were unable to recover it. 00:31:02.646 [2024-11-28 01:25:17.010101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.646 [2024-11-28 01:25:17.010230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.010257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.010429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.010588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.010614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.010748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.010892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.010917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.011062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.011208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.011235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.011367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.011512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.011555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.011710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.011843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.011869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.011975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.012100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.012131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.012233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.012795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.012829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.012975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.013115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.013145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.013320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.013450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.013475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.013601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.013712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.013738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.013842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.013944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.013970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.014090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.014221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.014247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.014353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.014475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.014501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.014636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.014731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.014757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.014862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.014958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.014985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.015115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.015238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.015270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.015375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.015499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.015531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.015641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.015752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.015779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.015878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.016008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.016033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.016131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.016234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.016265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.016383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.016489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.016518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.016658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.016787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.016814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.016946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.017048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.017074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.017203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.017303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.017328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.017454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.017648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.017675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.017772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.017874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.017899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.018004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.018096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.018122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.647 [2024-11-28 01:25:17.018274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.018396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.647 [2024-11-28 01:25:17.018421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.647 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.018551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.018728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.018754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.018847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.018951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.018978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.019080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.019201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.019226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.019384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.019492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.019521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.019682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.019787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.019813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.019946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.020136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.020162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.020263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.020396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.020421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.020554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.020651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.020677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.020780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.020885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.020910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.021058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.021202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.021229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.021376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.021514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.021573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.021708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.021857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.021887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.021997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.022179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.022204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.022330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.022465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.022493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.022631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.022734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.022761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.022921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.023019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.023045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.023150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.023294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.023323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.023482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.023592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.023622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.023735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.023884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.023912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.024054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.024146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.024172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.024276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.024427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.024455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.024590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.024764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.024790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.024896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.024996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.025023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.025125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.025250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.025276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.025404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.025534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.025559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.025657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.025809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.025834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.025953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.026058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.026087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.026218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.026341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.026367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.648 qpair failed and we were unable to recover it. 00:31:02.648 [2024-11-28 01:25:17.026506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.648 [2024-11-28 01:25:17.026639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.026665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.026783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.026938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.026966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.027099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.027197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.027243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.027387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.027485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.027512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.027615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.027766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.027795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.027920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.028011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.028037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.028140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.028234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.028262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.028356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.028474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.028500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.028614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.028744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.028769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.028921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.029016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.029042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.029173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.029296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.029326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.029468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.030167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.030201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.030391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.030517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.030557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.030664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.030758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.030783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.030883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.030982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.031006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.031114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.031212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.031238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.031389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.031532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.031561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.031681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.031822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.031851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.031969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.032060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.032085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.032214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.032320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.032345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.032466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.032596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.032622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.032745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.032850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.032875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.032982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.033098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.033127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.033246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.033387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.033417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.649 [2024-11-28 01:25:17.033542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.033683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.649 [2024-11-28 01:25:17.033709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.649 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.033862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.034004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.034031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.034162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.034271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.034300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.034452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.034558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.034592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.034730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.034830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.034855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.034957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.035129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.035171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.035300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.035427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.035463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.035631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.035781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.035808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.035919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.036053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.036082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.036232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.036329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.036355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.036487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.036654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.036697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.036814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.036929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.036959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.037105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.037265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.037290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.037429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.037562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.037591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.037721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.037822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.037847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.038000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.038098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.038123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.038273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.038402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.038430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.038536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.038654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.038679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.038785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.038939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.038964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.039089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.039197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.039226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.039367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.039487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.039514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.039675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.039803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.039829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.039934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.040065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.040091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.040196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.040330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.040359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.040509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.040608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.040634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.040728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.040854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.040881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.041005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.041118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.041143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.041292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.041390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.041416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.041521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.041653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.650 [2024-11-28 01:25:17.041678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.650 qpair failed and we were unable to recover it. 00:31:02.650 [2024-11-28 01:25:17.041830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.041944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.041972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.042095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.042212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.042237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.042385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.042535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.042564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.042682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.042822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.042851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.042994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.043126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.043151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.043252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.043359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.043384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.043492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.043623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.043649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.043748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.043880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.043906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.044026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.044125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.044151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.044306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.044421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.044449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.044586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.044716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.044741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.044874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.045000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.045029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.045198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.045317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.045345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.045469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.045581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.045608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.045741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.045853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.045883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.046013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.046128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.046154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.046251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.046382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.046407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.046548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.046677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.046704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.046837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.046966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.046992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.047090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.047194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.047218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.047320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.047419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.047445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.047568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.047721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.047747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.047900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.048037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.048063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.048161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.048285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.048311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.048442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.048539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.048566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.048693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.048783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.048808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.048931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.049032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.049059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.651 [2024-11-28 01:25:17.049194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.049298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.651 [2024-11-28 01:25:17.049325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.651 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.049448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.049602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.049628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.049763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.049920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.049946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.050049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.050178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.050204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.050332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.050439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.050466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.050569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.050692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.050718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.050841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.050942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.050968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.051062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.051160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.051186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.051283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.051407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.051433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.051552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.051678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.051704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.051826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.051928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.051960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.052070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.052174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.052199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.052322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.052427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.052454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.052626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.052734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.052760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.052870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.052975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.053001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.053105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.053204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.053230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.053353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.053491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.053517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.053673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.053772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.053798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.053902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.054000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.054025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.054147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.054279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.054307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.054426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.054530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.054562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.054686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.054793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.054819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.054912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.055039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.055066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.055197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.055288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.055331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.055447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.055601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.055628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.055753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.055875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.055901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.056030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.056158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.056184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.056288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.056386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.056412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.056515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.056679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.056704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.652 qpair failed and we were unable to recover it. 00:31:02.652 [2024-11-28 01:25:17.056796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.652 [2024-11-28 01:25:17.056896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.056922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.057019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.057119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.057149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.057246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.057349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.057375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.057503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.057612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.057638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.057794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.057946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.057975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.058090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.058215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.058240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.058361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.058521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.058580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.058679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.058782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.058807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.058938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.059075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.059101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.059215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.059367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.059409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.059565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.059659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.059685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.059839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.059933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.059962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.060103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.060232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.060261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.060440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.060555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.060584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.060732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.060855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.060880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.060987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.061081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.061106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.061259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.061375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.061404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.061553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.061654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.061680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.061809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.061912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.061936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.062076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.062205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.062231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.062356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.062474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.062499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.062602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.062706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.062731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.062859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.062993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.063022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.063174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.063307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.063332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.063434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.063543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.063570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.063723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.063863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.063893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.064039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.064192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.064218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.064343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.064482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.653 [2024-11-28 01:25:17.064507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.653 qpair failed and we were unable to recover it. 00:31:02.653 [2024-11-28 01:25:17.064613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.064712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.064739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.064841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.064967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.064992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.065083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.065190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.065216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.065321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.065458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.065487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.065654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.065758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.065784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.065887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.066007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.066036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.066186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.066326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.066355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.066481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.066597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.066624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.066728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.066859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.066884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.066982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.067107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.067133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.067233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.067326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.067352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.067478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.067601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.067627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.067770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.067870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.067894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.068020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.068114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.068138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.068271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.068367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.068392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.068492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.068623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.068650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.068750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.068846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.068879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.068973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.069097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.069122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.069231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.069363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.069388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.069560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.069731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.069757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.069886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.070061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.070091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.070209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.070336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.070363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.070565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.070690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.070716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.070817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.070917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.070942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.071102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.071208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.654 [2024-11-28 01:25:17.071234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.654 qpair failed and we were unable to recover it. 00:31:02.654 [2024-11-28 01:25:17.071348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.071481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.071510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.071661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.071762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.071788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.071916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.072041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.072082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.072215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.072343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.072368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.072462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.072602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.072628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.072723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.072848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.072874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.072968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.073073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.073098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.073226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.073348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.073377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.073536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.073659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.073689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.073828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.073980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.074005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.074133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.074235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.074260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.074372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.074504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.074539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.074679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.074807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.074833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.074933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.075029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.075055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.075223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.075332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.075360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.075503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.075617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.075644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.075774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.075891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.075920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.076033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.076159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.076184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.076285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.076387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.076413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.076541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.076661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.076690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.076800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.076935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.076965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.077151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.077277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.077302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.077466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.077610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.077639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.077755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.077892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.077921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.078071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.078174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.078200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.078357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.078486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.078515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.078638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.078770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.078796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.078927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.079055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.079081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.655 qpair failed and we were unable to recover it. 00:31:02.655 [2024-11-28 01:25:17.079208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.655 [2024-11-28 01:25:17.079347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.079374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.079523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.079689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.079715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.079810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.079930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.079956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.080115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.080238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.080269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.080387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.080505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.080537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.080642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.080736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.080761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.080858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.080963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.080988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.081096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.081227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.081256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.081396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.081562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.081588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.081744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.081844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.081869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.082009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.082124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.082153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.082311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.082464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.082489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.082590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.082739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.082781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.082913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.083052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.083084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.083212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.083337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.083362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.083515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.083645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.083670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.083799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.083948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.083976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.084132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.084260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.084285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.084386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.084492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.084519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.084647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.084774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.084799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.084903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.085018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.085045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.085158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.085356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.085388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.085498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.085622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.085647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.085748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.085909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.085934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.086059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.086169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.086194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.086295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.086397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.086440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.086562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.086684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.086709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.086818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.086986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.087011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.656 qpair failed and we were unable to recover it. 00:31:02.656 [2024-11-28 01:25:17.087119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.087270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.656 [2024-11-28 01:25:17.087313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.087457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.087563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.087590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.087695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.087861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.087887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.087992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.088123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.088149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.088239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.088375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.088402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.088510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.088620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.088646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.088795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.088943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.088978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.089077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.089204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.089230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.089357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.089461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.089486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.089626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.089752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.089778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.089894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.090011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.090037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.090143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.090233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.090259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.090359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.090453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.090477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.090584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.090689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.090716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.090845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.090979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.091005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.091102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.091198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.091223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.091375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.091507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.091542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.091661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.091750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.091775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.091910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.092037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.092063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.092159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.092278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.092303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.092407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.092509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.092541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.092642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.092768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.092793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.092935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.093057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.093083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.093174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.093328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.093355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.093482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.093590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.093619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.093747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.093872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.093897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.093997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.094151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.094177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.094329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.094483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.094509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.094649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.094748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.094775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.657 qpair failed and we were unable to recover it. 00:31:02.657 [2024-11-28 01:25:17.094871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.657 [2024-11-28 01:25:17.095001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.095027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.095167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.095293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.095319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.095474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.095624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.095651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.095746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.095881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.095913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.096019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.096144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.096183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.096285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.096420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.096445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.096603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.096703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.096729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.096860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.096961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.096986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.097144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.097272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.097299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.097419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.097516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.097546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.097697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.097802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.097828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.097966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.098072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.098097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.098188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.098315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.098341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.098434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.098560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.098587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.098684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.098813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.098844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.098950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.099125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.099161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.099296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.099429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.099454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.099580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.099713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.099738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.099833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.099953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.099979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.100098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.100203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.100231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.100352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.100487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.100512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.100647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.100772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.100797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.100926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.101058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.101083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.101212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.101367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.101408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.101518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.101714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.101748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.658 qpair failed and we were unable to recover it. 00:31:02.658 [2024-11-28 01:25:17.101874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.102004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.658 [2024-11-28 01:25:17.102028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.102150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.102306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.102331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.102496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.102633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.102658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.102784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.102891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.102917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.103087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.103239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.103274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.103399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.103510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.103548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.103697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.103834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.103862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.104010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.104149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.104173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.104294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.104407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.104435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.104618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.104713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.104745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.104901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.105002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.105029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.105154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.105280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.105305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.105459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.105614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.105640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.105747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.105918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.105943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.106087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.106231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.106258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.106396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.106507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.106542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.106663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.106780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.106805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.106961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.107127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.107152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.107259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.107401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.107430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.107599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.107716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.107741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.107903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.108091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.108117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.108242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.108344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.108370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.108493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.108652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.108679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.108808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.108979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.109004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.109100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.109199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.109224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.109359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.109503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.109545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.109693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.109831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.109859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.110038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.110161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.110186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.110315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.110418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.659 [2024-11-28 01:25:17.110444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.659 qpair failed and we were unable to recover it. 00:31:02.659 [2024-11-28 01:25:17.110566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.110707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.110736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.110855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.110983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.111010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.111113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.111213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.111239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.111373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.111498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.111530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.111659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.111781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.111806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.111940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.112067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.112093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.112198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.112321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.112354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.112491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.112631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.112661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.112834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.112974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.113000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.113118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.113241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.113270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.113382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.113555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.113585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.113724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.113893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.113918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.114017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.114144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.114170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.114293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.114406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.114432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.114536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.114638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.114664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.114795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.114945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.114972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.115131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.115248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.115274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.115431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.115558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.115585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.115717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.115814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.115839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.115942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.116043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.116069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.116224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.116375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.116400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.116529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.116681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.116708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.116845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.116973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.116999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.117127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.117224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.117249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.117347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.117467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.117493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.117603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.117737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.117763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.117887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.118004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.118029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.118130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.118219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.118244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.660 qpair failed and we were unable to recover it. 00:31:02.660 [2024-11-28 01:25:17.118355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.660 [2024-11-28 01:25:17.118519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.118551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.118682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.118809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.118835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.118975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.119108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.119136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.119286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.119415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.119456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.119660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.119786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.119811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.119952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.120060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.120086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.120203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.120331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.120356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.120500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.120662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.120688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.120818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.120921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.120948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.121077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.121190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.121223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.121363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.121542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.121592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.121715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.121813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.121849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.122000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.122155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.122180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.122284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.122433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.122462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.122582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.122695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.122721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.122831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.122995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.123020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.123161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.123339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.123367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.123487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.123618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.123649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.123792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.123933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.123962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.124092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.124195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.124220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.124352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.124503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.124537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.124683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.124819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.124855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.124981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.125084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.125109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.125248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.125376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.125402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.125508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.125620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.125646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.125776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.125885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.125909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.126024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.126184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.126212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.126366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.126469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.126494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.126634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.126761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.661 [2024-11-28 01:25:17.126786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.661 qpair failed and we were unable to recover it. 00:31:02.661 [2024-11-28 01:25:17.126924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.127023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.127049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.127152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.127250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.127275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.127451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.127600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.127626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.127729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.127856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.127882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.127986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.128141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.128167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.128303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.128430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.128454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.128551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.128643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.128668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.128796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.128955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.128979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.129136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.129288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.129313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.129416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.129558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.129585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.129679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.129767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.129791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.129887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.130008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.130033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.130185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.130299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.130326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.130485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.130618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.130645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.130777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.130913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.130940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.131040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.131135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.131161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.131296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.131448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.131473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.131597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.131752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.131786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.131886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.131987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.132017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.132121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.132272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.132300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.132467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.132588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.132613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.132764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.132892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.132917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.133043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.133152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.133176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.133335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.133484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.133561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.133682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.133797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.133826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.133974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.134141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.134169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.134293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.134441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.134465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.134622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.134749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.662 [2024-11-28 01:25:17.134774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.662 qpair failed and we were unable to recover it. 00:31:02.662 [2024-11-28 01:25:17.134877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.134973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.134998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.135125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.135244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.135268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.135426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.135542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.135584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.135723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.135870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.135903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.136018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.136140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.136165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.136291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.136397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.136422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.136575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.136730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.136758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.136900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.137028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.137053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.137151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.137274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.137308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.137453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.137600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.137629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.137744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.137841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.137866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.137996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.138124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.138155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.138301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.138453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.138479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.138581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.138735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.138762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.138894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.139046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.139073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.139218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.139331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.139356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.139495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.139612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.139639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.139763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.139882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.139908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.140067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.140197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.140227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.140387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.140553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.140579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.140681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.140803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.140829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.140990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.141118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.141142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.141296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.141390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.141415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.663 [2024-11-28 01:25:17.141554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.141650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.663 [2024-11-28 01:25:17.141677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.663 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.141780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.141931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.141957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.142063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.142194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.142219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.142348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.142483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.142516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.142677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.142788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.142822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.142978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.143101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.143126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.143256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.143404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.143432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.143565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.143691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.143717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.143875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.144004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.144031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.144158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.144284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.144313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.144450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.144608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.144634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.144800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.144927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.144952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.145075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.145184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.145213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.145348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.145481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.145511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.145653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.145808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.145834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.145936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.146050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.146079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.146210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.146352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.146377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.146481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.146631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.146657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.146787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.146889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.146914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.147042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.147210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.147238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.147387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.147505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.147537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.147642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.147796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.147822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.147952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.148114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.148139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.148292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.148421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.148450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.148582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.148720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.148745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.148897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.149024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.149066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.149210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.149332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.149358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.149487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.149602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.149628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.149729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.149854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.149880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.664 qpair failed and we were unable to recover it. 00:31:02.664 [2024-11-28 01:25:17.150006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.664 [2024-11-28 01:25:17.150130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.150156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.150248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.150374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.150418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.150561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.150728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.150756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.150876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.151005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.151029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.151175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.151284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.151309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.151418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.151542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.151568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.151667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.151767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.151794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.151926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.152049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.152075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.152227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.152367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.152394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.152518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.152675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.152701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.152823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.152912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.152937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.153039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.153133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.153159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.153300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.153437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.153465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.153644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.153773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.153799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.153914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.154028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.154058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.154238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.154403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.154428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.154536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.154670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.154696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.154823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.154925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.154951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.155081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.155206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.155233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.155362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.155513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.155545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.155687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.155843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.155868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.155991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.156085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.156110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.156233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.156330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.156355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.665 [2024-11-28 01:25:17.156479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.156579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.665 [2024-11-28 01:25:17.156607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.665 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.156738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.156831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.156857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.156990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.157118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.157143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.157273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.157386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.157415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.157569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.157701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.157727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.157828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.157933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.157958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.158086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.158187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.158214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.158312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.158409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.158434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.158600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.158702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.158728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.158828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.158915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.158939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.159092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.159200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.159225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.159357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.159478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.159504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.159627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.159747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.159778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.159914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.160045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.160072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.160203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.160335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.160361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.160486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.160597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.160624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.160748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.160839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.160864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.160990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.161142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.161168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.161269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.161369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.161395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.161554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.161675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.161701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.161799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.161938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.161964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.162068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.162222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.162247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.162378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.162507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.162541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.162675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.162799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.162825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.162961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.163087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.163112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.163219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.163368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.163393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.163517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.163661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.163687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.163813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.163941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.163968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.164088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.164211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.164237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.666 qpair failed and we were unable to recover it. 00:31:02.666 [2024-11-28 01:25:17.164359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.666 [2024-11-28 01:25:17.164479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.164504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.164669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.164767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.164793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.164927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.165060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.165085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.165196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.165359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.165384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.165508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.165645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.165672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.165802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.165901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.165926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.166022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.166112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.166138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.166288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.166411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.166436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.166542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.166639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.166665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.166764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.166869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.166894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.166997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.167151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.167176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.167333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.167431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.167456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.167601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.167755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.167780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.167946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.168074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.168099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.168199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.168324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.168350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.168477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.168608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.168634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.168791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.168958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.168984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.169109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.169234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.169260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.169353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.169502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.169552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.169677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.169803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.169827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.169956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.170083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.170110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.170263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.170396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.170421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.170551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.170645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.170671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a4000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.170813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.171047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.171076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.171198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.171397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.171441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.171542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.171703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.171727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.171911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.172070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.172114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.172263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.172409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.172434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.667 [2024-11-28 01:25:17.172539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.172698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.667 [2024-11-28 01:25:17.172742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.667 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.172836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.172981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.173024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.173170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.173310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.173336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.173540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.173694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.173737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.173911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.174081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.174107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.174253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.174434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.174460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.174603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.174772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.174814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.174958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.175149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.175192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.175313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.175444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.175469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.175568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.175742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.175785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.175936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.176096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.176139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.176266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.176415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.176440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.176541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.176689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.176733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.176880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.177054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.177097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.177195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.177319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.177345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.177436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.177539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.177566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.177716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.177884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.177926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.178079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.178203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.178227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.178353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.178470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.178495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.178627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.178761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.178791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.178950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.179093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.179118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.179250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.179374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.179399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.179492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.179604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.179629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.179749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.179851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.179875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.179978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.180132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.180157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.668 qpair failed and we were unable to recover it. 00:31:02.668 [2024-11-28 01:25:17.180293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.180420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.668 [2024-11-28 01:25:17.180445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.180556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.180655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.180680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.180808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.180936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.180963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.181106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.181236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.181261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.181413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.181514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.181546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.181664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.181779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.181804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.181957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.182085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.182110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.182238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.182397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.182422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.182515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.182657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.182682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.182822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.182996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.183037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.183138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.183271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.183298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.183424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.183514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.183545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.183649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.183748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.183774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.183902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.183999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.184024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.184174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.184338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.184363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.184514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.184682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.184707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.184854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.184995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.185037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.185163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.185316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.185341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.185499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.185601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.185627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.185792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.185928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.185957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.186118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.186260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.186289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.186445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.186586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.186614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.186752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.186871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.186896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.186989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.187119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.187143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.187307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.187434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.187458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.187560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.187655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.187680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.187799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.187962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.188005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.188136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.188244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.188270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.188394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.188532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.188558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.669 qpair failed and we were unable to recover it. 00:31:02.669 [2024-11-28 01:25:17.188688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.669 [2024-11-28 01:25:17.188790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.188815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.188908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.189069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.189100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.189229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.189355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.189380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.189479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.189598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.189627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.189748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.189874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.189899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.190001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.190132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.190157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.190322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.190453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.190477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.190663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.190803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.190845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.190996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.191122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.191147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.191284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.191387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.191414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.191518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.191624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.191650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.191778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.191906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.191936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.192095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.192222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.192247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.192373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.192469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.192494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.192629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.192732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.192758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.192907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.193046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.193070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.193201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.193310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.193335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.193459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.193609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.193652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.193778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.193913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.193941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.194082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.194179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.194204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.194357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.194482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.194508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.194615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.194717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.194747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.194873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.194993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.195018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.195166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.195256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.195280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.195405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.195537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.195563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.195717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.195889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.195931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.196056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.196178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.196203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.196326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.196450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.196476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.670 [2024-11-28 01:25:17.196633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.196769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.670 [2024-11-28 01:25:17.196814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.670 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.196983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.197100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.197125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.197232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.197326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.197351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.197453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.197570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.197596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.197739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.197842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.197868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.197965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.198116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.198141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.198239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.198336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.198362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.198489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.198656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.198682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.198836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.198987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.199012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.199168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.199296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.199320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.199446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.199589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.199632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.199794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.199887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.199913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.200039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.200190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.200216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.200370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.200496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.200521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.200683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.200869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.200895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.201023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.201150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.201176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.201302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.201402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.201427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.201521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.201659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.201685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.201785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.201911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.201937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.202045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.202174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.202200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.202329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.202426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.202451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.202558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.202709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.202752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.202924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.203071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.203096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.203193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.203286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.203311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.203467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.203574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.203600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.203700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.203825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.203850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.204006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.204104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.204131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.204249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.204372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.204398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.204531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.204711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.204756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.671 qpair failed and we were unable to recover it. 00:31:02.671 [2024-11-28 01:25:17.204902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.671 [2024-11-28 01:25:17.205024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.205050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.205182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.205333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.205359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.205483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.205605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.205631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.205785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.205903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.205927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.206058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.206210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.206236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.206364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.206467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.206492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.206620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.206768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.206794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.206895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.207020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.207045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.207198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.207351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.207376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.207503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.207617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.207644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.207772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.207892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.207917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.208014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.208108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.208134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.208264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.208365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.208390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.208538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.208666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.208690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.208816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.208926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.208958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.209125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.209297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.209334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.209469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.209621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.209647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.209772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.209924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.209950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.210048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.210174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.210199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.210298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.210423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.210449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.210584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.210752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.210779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.210906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.211048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.211086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.211238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.211375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.211401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.211536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.211658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.211701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.211855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.211951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.211978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.672 qpair failed and we were unable to recover it. 00:31:02.672 [2024-11-28 01:25:17.212115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.672 [2024-11-28 01:25:17.212242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.673 [2024-11-28 01:25:17.212268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.673 qpair failed and we were unable to recover it. 00:31:02.673 [2024-11-28 01:25:17.212397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.673 [2024-11-28 01:25:17.212539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.673 [2024-11-28 01:25:17.212567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.673 qpair failed and we were unable to recover it. 00:31:02.673 [2024-11-28 01:25:17.212694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.673 [2024-11-28 01:25:17.212836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.673 [2024-11-28 01:25:17.212891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.673 qpair failed and we were unable to recover it. 00:31:02.673 [2024-11-28 01:25:17.213024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.673 [2024-11-28 01:25:17.213173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.952 [2024-11-28 01:25:17.213201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.952 qpair failed and we were unable to recover it. 00:31:02.952 [2024-11-28 01:25:17.213333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.952 [2024-11-28 01:25:17.213473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.952 [2024-11-28 01:25:17.213499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.952 qpair failed and we were unable to recover it. 00:31:02.952 [2024-11-28 01:25:17.213622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.952 [2024-11-28 01:25:17.213715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.952 [2024-11-28 01:25:17.213741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.952 qpair failed and we were unable to recover it. 00:31:02.952 [2024-11-28 01:25:17.213868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.952 [2024-11-28 01:25:17.213970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.952 [2024-11-28 01:25:17.213995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.952 qpair failed and we were unable to recover it. 00:31:02.952 [2024-11-28 01:25:17.214101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.952 [2024-11-28 01:25:17.214225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.952 [2024-11-28 01:25:17.214251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.952 qpair failed and we were unable to recover it. 00:31:02.952 [2024-11-28 01:25:17.214379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.952 [2024-11-28 01:25:17.214511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.952 [2024-11-28 01:25:17.214545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.952 qpair failed and we were unable to recover it. 00:31:02.952 [2024-11-28 01:25:17.214688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.952 [2024-11-28 01:25:17.214834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.952 [2024-11-28 01:25:17.214879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.952 qpair failed and we were unable to recover it. 00:31:02.952 [2024-11-28 01:25:17.215036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.952 [2024-11-28 01:25:17.215138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.215164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.215268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.215402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.215428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.215533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.215694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.215742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.215860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.216003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.216030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.216160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.216257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.216282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.216410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.216538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.216564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.216715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.216820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.216845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.216940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.217066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.217093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.217225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.217385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.217410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.217507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.217653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.217679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.217794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.217923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.217955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.218073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.218170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.218195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.218348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.218478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.218503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.218621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.218811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.218854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.219003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.219141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.219184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.219290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.219385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.219409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.219585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.219737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.219762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.219889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.220017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.220042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.220170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.220295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.220320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.220424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.220549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.220575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.220751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.220913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.220955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.221061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.221181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.221205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.221325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.221448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.221474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.221577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.221702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.221728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.221834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.221932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.221958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.222113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.222208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.222234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.222363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.222461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.222486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.222589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.222717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.222743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.953 qpair failed and we were unable to recover it. 00:31:02.953 [2024-11-28 01:25:17.222870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.953 [2024-11-28 01:25:17.223013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.223058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.223187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.223316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.223341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.223448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.223576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.223602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.223707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.223806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.223830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.223993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.224090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.224114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.224242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.224344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.224369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.224498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.224601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.224627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.224836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.224998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.225025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.225146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.225274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.225301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.225457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.225632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.225676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.225851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.225997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.226023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.226177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.226312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.226337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.226493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.226659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.226685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.226825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.226995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.227042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.227174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.227271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.227295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.227424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.227543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.227568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.227685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.227823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.227865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.227959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.228094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.228119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.228242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.228372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.228397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.228530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.228664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.228690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.228812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.228992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.229018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.229147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.229278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.229302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.229425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.229552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.229577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.229730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.229860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.229888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.230008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.230133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.230158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.230286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.230388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.230413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.230541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.230662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.230688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.230866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.231008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.231034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.954 [2024-11-28 01:25:17.231162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.231291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.954 [2024-11-28 01:25:17.231315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.954 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.231449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.231550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.231576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.231690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.231848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.231890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.232026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.232194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.232220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.232344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.232473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.232504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.232603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.232728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.232771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.232896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.233004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.233033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.233181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.233302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.233327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.233447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.233618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.233662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.233763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.233904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.233931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.234099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.234230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.234255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.234415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.234516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.234550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.234703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.234904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.234947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.235101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.235282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.235308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.235413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.235539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.235569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.235721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.235854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.235898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.236048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.236164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.236190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.236316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.236472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.236497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.236658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.236829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.236872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.236987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.237166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.237192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.237319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.237438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.237463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.237571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.237745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.237773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.237934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.238096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.238142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.238249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.238401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.238425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.238571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.238687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.238716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.238843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.238961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.238985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.239083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.239206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.239230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.239384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.239539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.239566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.239688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.239863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.955 [2024-11-28 01:25:17.239891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.955 qpair failed and we were unable to recover it. 00:31:02.955 [2024-11-28 01:25:17.240060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.240189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.240213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.240316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.240436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.240460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.240611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.240778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.240806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.240970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.241138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.241163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.241292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.241421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.241446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.241595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.241763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.241811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.241907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.242087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.242130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.242253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.242347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.242371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.242472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.242618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.242663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.242790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.242950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.242993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.243127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.243215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.243240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.243338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.243439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.243463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.243639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.243801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.243843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.243936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.244064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.244090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.244195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.244295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.244321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.244474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.244655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.244682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.244815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.244920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.244945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.245101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.245223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.245248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.245372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.245502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.245539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.245668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.245799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.245824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.245942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.246063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.246087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.246212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.246337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.246363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.246517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.246624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.246649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.246752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.246877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.246902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.247026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.247124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.247150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.247248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.247376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.247401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.247538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.247685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.247728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.247882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.247983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.248008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.956 qpair failed and we were unable to recover it. 00:31:02.956 [2024-11-28 01:25:17.248135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.956 [2024-11-28 01:25:17.248285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.248310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.248436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.248561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.248587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.248709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.248813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.248837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.248955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.249107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.249131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.249260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.249377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.249402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.249551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.249725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.249771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.249948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.250090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.250115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.250240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.250371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.250396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.250558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.250686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.250711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.250890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.251043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.251068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.251219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.251349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.251373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.251503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.251639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.251667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.251820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.251922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.251947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.252046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.252165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.252190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.252316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.252446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.252472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.252603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.252734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.252760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.252939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.253068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.253096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.253234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.253387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.253412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.253509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.253643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.253686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.253789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.253919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.253944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.254046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.254170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.254195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.254328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.254458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.254484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.254585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.254684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.254709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.254853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.255022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.957 [2024-11-28 01:25:17.255047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.957 qpair failed and we were unable to recover it. 00:31:02.957 [2024-11-28 01:25:17.255198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.255321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.255346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.255478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.255595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.255639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.255768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.255867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.255893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.256046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.256173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.256198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.256327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.256452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.256478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.256631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.256795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.256824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.257017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.257157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.257182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.257334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.257428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.257452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.257555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.257651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.257677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.257790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.257939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.257966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.258097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.258192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.258217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.258343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.258494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.258520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.258628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.258720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.258745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.258868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.259021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.259046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.259185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.259308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.259334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.259430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.259565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.259591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.259723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.259821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.259846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.260000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.260127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.260153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.260282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.260382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.260408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.260535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.260641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.260666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.260793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.260924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.260949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.261075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.261178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.261204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.261356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.261456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.261481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.261621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.261716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.261741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.261855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.261986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.262013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.262167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.262320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.262345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.262497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.262633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.262659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.262767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.262873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.262898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.958 qpair failed and we were unable to recover it. 00:31:02.958 [2024-11-28 01:25:17.262996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.263153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.958 [2024-11-28 01:25:17.263178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.263296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.263423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.263448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.263548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.263667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.263692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.263817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.263933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.263962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.264105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.264259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.264285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.264407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.264508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.264539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.264662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.264793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.264821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.264963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.265092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.265117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.265216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.265348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.265375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.265510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.265708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.265737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.265892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.266030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.266056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.266160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.266311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.266337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.266435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.266604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.266630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.266727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.266876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.266902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.266998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.267099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.267124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.267251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.267349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.267374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.267536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.267641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.267666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.267796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.267885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.267911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.268013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.268167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.268192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.268341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.268460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.268485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.268586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.268682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.268708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.268826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.268946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.268972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.269097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.269229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.269254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.269350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.269503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.269536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.269661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.269790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.269815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.269921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.270073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.270098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.270256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.270356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.270381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.270486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.270595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.270620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.959 [2024-11-28 01:25:17.270718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.270816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.959 [2024-11-28 01:25:17.270842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.959 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.270958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.271061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.271087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.271216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.271313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.271338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.271434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.271583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.271610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.271711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.271839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.271864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.271984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.272085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.272110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.272207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.272327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.272352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.272477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.272608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.272634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.272730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.272840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.272865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.272960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.273056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.273082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.273206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.273345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.273370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.273498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.273640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.273665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.273823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.273946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.273970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.274123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.274219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.274244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.274350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.274472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.274498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.274634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.274752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.274777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.274876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.274977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.275004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.275139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.275244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.275269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.275371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.275474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.275499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.275639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.275774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.275800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.275928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.276081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.276107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.276235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.276374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.276401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.276507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.276636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.276680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.276779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.276919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.276946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.277093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.277226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.277264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.277372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.277499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.277533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.277682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.277823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.277866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.277965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.278118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.278144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.278245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.278351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.278381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.960 qpair failed and we were unable to recover it. 00:31:02.960 [2024-11-28 01:25:17.278511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.960 [2024-11-28 01:25:17.278644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.278669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.278765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.278894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.278919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.279044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.279137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.279163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.279262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.279410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.279435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.279562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.279690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.279715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.279814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.279904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.279930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.280061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.280186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.280211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.280367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.280491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.280517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.280645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.280813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.280838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.280945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.281039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.281069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.281171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.281299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.281324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.281481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.281637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.281681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.281833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.281988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.282031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.282181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.282312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.282338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.282441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.282542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.282568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.282693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.282815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.282840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.282962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.283095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.283120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.283216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.283345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.283370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.283497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.283607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.283634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.283731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.283860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.283890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.284017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.284146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.284171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.284303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.284401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.284426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.284522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.284661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.284687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.284789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.284909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.284935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.285039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.285136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.285161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.961 qpair failed and we were unable to recover it. 00:31:02.961 [2024-11-28 01:25:17.285256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.285385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.961 [2024-11-28 01:25:17.285410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.285542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.285668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.285694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.285820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.285923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.285949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.286074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.286201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.286226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.286323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.286427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.286453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.286566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.286658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.286684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.286780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.286906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.286932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.287057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.287182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.287207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.287304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.287433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.287459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.287590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.287692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.287718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.287849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.288001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.288027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.288128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.288229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.288256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.288378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.288476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.288501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.288624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.288769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.288794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.288890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.289014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.289039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.289170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.289296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.289321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.289421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.289523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.289575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.289698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.289787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.289813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.289917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.290019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.290044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.290148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.290249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.290273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.290398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.290497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.290522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.290635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.290764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.290789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.290889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.291004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.291029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.291154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.291256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.291281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.291379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.291500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.291535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.291637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.291739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.291765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.291865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.291968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.291994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.962 [2024-11-28 01:25:17.292088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.292215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.962 [2024-11-28 01:25:17.292240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.962 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.292376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.292502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.292535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.292631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.292734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.292760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.292858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.292962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.292987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.293092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.293189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.293214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.293322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.293420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.293445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.293569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.293694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.293719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.293849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.293973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.293997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.294126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.294225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.294251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.294352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.294481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.294506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.294671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.294833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.294875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.294993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.295139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.295166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.295295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.295398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.295424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.295532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.295646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.295674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.295812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.295961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.295986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.296115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.296241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.296266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.296366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.296469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.296494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.296602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.296741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.296766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.296871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.296992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.297017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.297144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.297245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.297271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.297371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.297461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.297486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.297609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.297705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.297732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.297854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.297954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.297980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.298111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.298240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.298265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.298366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.298471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.298497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.298598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.298726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.298751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.298844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.298938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.298963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.299092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.299187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.299213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.299314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.299410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.299436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.963 qpair failed and we were unable to recover it. 00:31:02.963 [2024-11-28 01:25:17.299551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.963 [2024-11-28 01:25:17.299657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.299683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.299809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.299907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.299934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.300028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.300131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.300157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.300284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.300370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.300395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.300529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.300630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.300655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.300753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.300848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.300874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.300969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.301091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.301118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.301219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.301342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.301367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.301465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.301567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.301593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.301703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.301800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.301826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.301953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.302051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.302076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.302182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.302312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.302337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.302441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.302568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.302594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.302695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.302795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.302821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.302925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.303021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.303046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.303173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.303271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.303295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.303386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.303482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.303508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.303619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.303753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.303778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.303872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.303974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.304001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.304146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.304315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.304344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.304448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.304598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.304629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.304799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.304939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.304966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.305159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.305263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.305290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.305408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.305517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.305568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.305724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.305841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.305869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.305987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.306124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.306149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.306311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.306415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.306443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.306566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.306692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.306717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.964 [2024-11-28 01:25:17.306839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.306952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.964 [2024-11-28 01:25:17.306980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.964 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.307104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.307253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.307282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.307389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.307499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.307529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.307624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.307747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.307772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.307921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.308062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.308091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.308208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.308352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.308380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.308500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.308603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.308630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.308737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.308884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.308912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.309024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.309159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.309187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.309337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.309445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.309473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.309631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.309733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.309758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.309856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.310048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.310077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.310193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.310313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.310341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.310483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.310626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.310652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.310750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.310890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.310918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.311079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.311235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.311264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.311385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.311535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.311578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.311711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.311856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.311897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.312017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.312132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.312160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.312284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.312438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.312466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.312589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.312694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.312720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.312869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.312981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.313010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.313145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.313282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.313309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.313434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.313579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.313606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.313735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.313867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.313908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.314008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.314158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.314200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.314305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.314456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.314484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.314606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.314707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.314732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.314827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.314978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.965 [2024-11-28 01:25:17.315005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.965 qpair failed and we were unable to recover it. 00:31:02.965 [2024-11-28 01:25:17.315151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.315285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.315313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.315437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.315535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.315560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.315692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.315790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.315832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.315969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.316107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.316135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.316254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.316383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.316412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.316535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.316635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.316660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.316761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.316906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.316947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.317093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.317215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.317240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.317365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.317468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.317496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.317625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.317724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.317749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.317871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.317985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.318013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.318153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.318254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.318281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.318393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.318512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.318552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.318701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.318804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.318829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.318945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.319082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.319110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.319223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.319337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.319366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.319489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.319622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.319648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.319774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.319868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.319911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.320047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.320184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.320212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.320316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.320448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.320490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.320619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.320720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.320745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.320837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.320936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.320963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.321087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.321196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.321231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.321341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.321449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.321477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.321657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.321775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.321800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.966 qpair failed and we were unable to recover it. 00:31:02.966 [2024-11-28 01:25:17.321945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.966 [2024-11-28 01:25:17.322099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.322125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.322280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.322414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.322439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.322571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.322744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.322772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.322895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.322993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.323019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.323158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.323283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.323308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.323435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.323539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.323566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.323677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.323772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.323797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.323911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.324039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.324071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.324221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.324328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.324358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.324486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.324617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.324642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.324740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.324868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.324896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.325036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.325171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.325213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.325310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.325405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.325430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.325534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.325646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.325671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.325819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.325927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.325952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.326055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.326153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.326178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.326278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.326378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.326403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.326495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.326633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.326665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.326764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.326857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.326883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.326997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.327127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.327155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.327256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.327405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.327433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.327562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.327696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.327721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.327840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.327988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.328013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.328137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.328263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.328291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.328413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.328516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.328547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.328655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.328759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.328784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.328975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.329069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.329094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.329223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.329359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.329385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.967 [2024-11-28 01:25:17.329519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.329675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.967 [2024-11-28 01:25:17.329704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.967 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.329853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.329989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.330019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.330171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.330300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.330325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.330422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.330542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.330570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.330672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.330812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.330837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.330962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.331088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.331112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.331252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.331391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.331418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.331572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.331699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.331724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.331828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.331960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.331985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.332100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.332240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.332269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.332391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.332536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.332565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.332683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.332838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.332863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.333029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.333127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.333152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.333288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.333395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.333423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.333548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.333676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.333700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.333801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.333924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.333953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.334098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.334240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.334267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.334382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.334488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.334513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.334625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.334730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.334755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.334871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.334982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.335010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.335165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.335296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.335321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.335493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.335602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.335628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.335755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.335853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.335879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.335977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.336075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.336101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.336197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.336316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.336341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.336437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.336560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.336586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.336708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.336800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.336825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.336921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.337021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.337064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.337170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.337307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.968 [2024-11-28 01:25:17.337336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.968 qpair failed and we were unable to recover it. 00:31:02.968 [2024-11-28 01:25:17.337453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.337562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.337588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.337700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.337795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.337820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.337919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.338048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.338073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.338174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.338270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.338294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.338409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.338545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.338575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.338717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.338827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.338856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.338992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.339089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.339113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.339255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.339365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.339393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.339533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.339683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.339707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.339834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.339933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.339959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.340113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.340267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.340296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.340472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.340663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.340689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.340788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.340886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.340912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.341053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.341161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.341188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.341301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.341407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.341435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.341588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.341693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.341718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.341819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.341916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.341940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.342039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.342166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.342191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.342289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.342381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.342406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.342512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.342690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.342718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.342858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.342999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.343027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.343178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.343277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.343301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.343399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.343575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.343604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.343740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.343856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.343882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.344012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.344139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.344164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.344261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.344358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.344383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.344517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.344682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.344710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.344863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.344962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.344987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.969 qpair failed and we were unable to recover it. 00:31:02.969 [2024-11-28 01:25:17.345113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.345248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.969 [2024-11-28 01:25:17.345276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.345405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.345515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.345550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.345675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.345778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.345803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.345912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.346035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.346063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.346208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.346306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.346332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.346458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.346588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.346614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.346769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.346869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.346896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.347027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.347160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.347186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.347323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.347424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.347449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.347571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.347678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.347707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.347843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.347952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.347980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.348098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.348226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.348251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.348391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.348509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.348543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.348704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.348871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.348900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.349037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.349152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.349176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.349283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.349438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.349465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.349598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.349778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.349803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.349930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.350024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.350048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.350199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.350310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.350335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.350437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.350564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.350590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.350716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.350840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.350865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.351015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.351154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.351181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.351318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.351467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.351491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.351625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.351728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.351752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.351896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.352038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.352065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.352183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.352353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.352380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.352502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.352633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.352658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.352759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.352943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.352968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.353061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.353211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.353235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.970 qpair failed and we were unable to recover it. 00:31:02.970 [2024-11-28 01:25:17.353340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.970 [2024-11-28 01:25:17.353466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.353490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.353629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.353736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.353760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.353857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.353974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.354001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.354124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.354218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.354241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.354382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.354538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.354567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.354698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.354799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.354822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.354922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.355028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.355052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.355172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.355317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.355342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.355445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.355552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.355578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.355671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.355791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.355815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.355970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.356109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.356137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.356292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.356433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.356458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.356586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.356677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.356701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.356820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.356952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.356980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.357085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.357223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.357252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.357377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.357476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.357501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.357610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.357739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.357764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.357882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.358013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.358040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.358191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.358315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.358340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.358486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.358629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.358653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.358808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.358925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.358952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.359067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.359164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.359187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.359325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.359475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.359498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.359660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.359762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.359805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.359985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.360082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.360107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.971 qpair failed and we were unable to recover it. 00:31:02.971 [2024-11-28 01:25:17.360235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.971 [2024-11-28 01:25:17.360335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.360363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.360475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.360630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.360655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.360784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.360905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.360929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.361051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.361159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.361187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.361329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.361438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.361464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.361637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.361732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.361755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.361883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.361977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.362001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.362094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.362243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.362270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.362417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.362544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.362570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.362670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.362766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.362791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.362915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.363068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.363093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.363220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.363341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.363365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.363504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.363638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.363663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.363766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.363859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.363885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.364017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.364119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.364143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.364253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.364429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.364453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.364552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.364676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.364701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.364797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.364925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.364950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.365053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.365154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.365198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.365340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.365480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.365508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.365638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.365732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.365761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.365852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.365982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.366007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.366131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.366282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.366306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.366408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.366550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.366575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.366738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.366835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.366859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.366981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.367100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.367129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.367307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.367437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.367461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.367563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.367663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.367687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.367792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.367890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.972 [2024-11-28 01:25:17.367933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.972 qpair failed and we were unable to recover it. 00:31:02.972 [2024-11-28 01:25:17.368081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.368181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.368205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.368330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.368490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.368522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.368666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.368774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.368800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.368921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.369046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.369070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.369194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.369316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.369343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.369450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.369556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.369584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.369710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.369808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.369832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.369975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.370078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.370105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.370259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.370363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.370388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.370517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.370657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.370682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.370805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.370951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.370975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.371104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.371198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.371222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.371322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.371443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.371467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.371558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.371678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.371703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.371807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.371928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.371955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.372081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.372212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.372238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.372412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.372534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.372562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.372659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.372818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.372845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.373016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.373165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.373190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.373342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.373475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.373502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.373663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.373787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.373811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.373928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.374051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.374075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.374230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.374363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.374390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.374555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.374695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.374723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.374857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.374961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.374987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.375137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.375240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.375268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.375409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.375518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.375553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.375708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.375808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.375834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.375975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.376088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.973 [2024-11-28 01:25:17.376130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.973 qpair failed and we were unable to recover it. 00:31:02.973 [2024-11-28 01:25:17.376231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.376370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.376398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.376518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.376675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.376700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.376849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.376956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.376983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.377095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.377252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.377276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.377372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.377498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.377523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.377655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.377749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.377774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.377866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.377964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.377989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.378083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.378207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.378230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.378355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.378499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.378534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.378674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.378793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.378818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.378922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.379049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.379074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.379194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.379302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.379344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.379450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.379598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.379627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.379781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.379877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.379906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.380046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.380202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.380229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.380338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.380519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.380549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.380652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.380749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.380774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.380875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.381034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.381059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.381163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.381313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.381341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.381493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.381628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.381653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.381799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.381971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.381996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.382123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.382212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.382237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.382367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.382465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.382490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.382624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.382730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.382758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.382911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.383034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.383059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.383154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.383252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.383276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.383447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.383577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.383606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.383715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.383826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.383853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.974 [2024-11-28 01:25:17.383966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.384067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.974 [2024-11-28 01:25:17.384091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.974 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.384237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.384377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.384401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.384552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.384713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.384741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.384856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.384992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.385015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.385153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.385264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.385290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.385393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.385506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.385538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.385695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.385820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.385844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.385945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.386046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.386086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.386202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.386335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.386377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.386500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.386628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.386654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.386818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.386945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.386971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.387075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.387169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.387194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.387317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.387421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.387445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.387584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.387726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.387754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.387893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.388033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.388063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.388190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.388313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.388337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.388440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.388562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.388587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.388726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.388841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.388867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.389017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.389141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.389165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.389262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.389360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.389385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.389490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.389587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.389612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.389741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.389869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.389892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.390019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.390130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.390157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.390308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.390405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.390429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.390521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.390645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.390670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.390795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.390930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.390956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.975 qpair failed and we were unable to recover it. 00:31:02.975 [2024-11-28 01:25:17.391121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.975 [2024-11-28 01:25:17.391295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.391323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.391465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.391564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.391590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.391705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.391844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.391883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.391977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.392076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.392102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.392207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.392335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.392359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.392477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.392611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.392639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.392777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.392911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.392938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.393080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.393179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.393203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.393389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.393482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.393507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.393665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.393789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.393816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.393973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.394073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.394101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.394219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.394337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.394363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.394500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.394616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.394644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.394767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.394875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.394899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.394993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.395081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.395105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.395195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.395358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.395381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.395485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.395619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.395644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.395740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.395859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.395883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.396071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.396203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.396247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.396371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.396504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.396535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.396659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.396769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.396797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.396901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.397015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.397042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.397162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.397267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.397292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.397392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.397538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.397567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.397712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.397813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.397838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.397987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.398108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.398133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.398284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.398419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.398446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.398584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.398707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.398732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.398834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.398940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.976 [2024-11-28 01:25:17.398964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.976 qpair failed and we were unable to recover it. 00:31:02.976 [2024-11-28 01:25:17.399088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.399210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.399234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.399374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.399479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.399506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.399657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.399747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.399771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.399867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.399999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.400026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.400139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.400269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.400295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.400413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.400520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.400549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.400653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.400778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.400817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.400930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.401042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.401068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.401215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.401338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.401362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.401482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.401637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.401664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.401788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.401904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.401931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.402060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.402180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.402204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.402320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.402441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.402469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.402609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.402731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.402756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.402857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.402956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.402980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.403087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.403207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.403232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.403357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.403459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.403502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.403631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.403758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.403783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.403905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.404046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.404073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.404246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.404370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.404394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.404493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.404589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.404614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.404744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.404860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.404887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.405034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.405167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.405195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.405321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.405421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.405445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.405558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.405677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.405701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.405850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.405972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.405995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.406131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.406223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.406248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.406356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.406448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.406489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.977 [2024-11-28 01:25:17.406654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.406763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.977 [2024-11-28 01:25:17.406786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.977 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.406887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.406985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.407008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.407128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.407269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.407294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.407411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.407579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.407607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.407728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.407830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.407866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.407970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.408101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.408125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.408271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.408439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.408467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.408589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.408689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.408714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.408810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.408936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.408960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.409109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.409248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.409275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.409400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.409529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.409555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.409653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.409750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.409792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.409940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.410069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.410094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.410219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.410322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.410346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.410466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.410607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.410634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.410750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.410859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.410886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.411005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.411128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.411153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.411268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.411405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.411428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.411547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.411655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.411682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.411804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.411905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.411930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.412036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.412181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.412207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.412359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.412481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.412505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.412618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.412745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.412770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.412887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.413017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.413043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.413158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.413282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.413307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.413405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.413557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.413583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.413687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.413787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.413830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.413982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.414074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.414098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.414228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.414328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.414353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.978 qpair failed and we were unable to recover it. 00:31:02.978 [2024-11-28 01:25:17.414474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.414632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.978 [2024-11-28 01:25:17.414660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.414814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.414939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.414964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.415065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.415168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.415194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.415341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.415460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.415486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.415636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.415795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.415822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.415970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.416071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.416096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.416194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.416314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.416339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.416442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.416602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.416627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.416735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.416862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.416887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.417055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.417203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.417227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.417330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.417453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.417478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.417578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.417680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.417705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.417855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.417960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.417987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.418119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.418226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.418253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.418367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.418496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.418521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.418633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.418751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.418778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.418928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.419026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.419055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.419183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.419310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.419335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.419488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.419612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.419640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.419741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.419845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.419873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.420051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.420153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.420177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.420298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.420397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.420421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.420520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.420671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.420699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.420829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.420920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.420945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.421089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.421189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.421216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.421364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.421465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.421490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.421621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.421775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.421800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.421960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.422098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.422126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.422265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.422394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.422421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.979 qpair failed and we were unable to recover it. 00:31:02.979 [2024-11-28 01:25:17.422537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.979 [2024-11-28 01:25:17.422633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.422658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.422756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.422880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.422905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.423008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.423138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.423163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.423257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.423355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.423379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.423520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.423676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.423700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.423796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.423926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.423951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.424102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.424201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.424225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.424397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.424545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.424571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.424728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.424831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.424855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.424974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.425102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.425127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.425254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.425366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.425393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.425541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.425696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.425720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.425844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.425946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.425970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.426103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.426252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.426276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.426434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.426582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.426610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.426731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.426825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.426849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.427022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.427122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.427146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.427275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.427404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.427428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.427559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.427668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.427693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.427810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.427915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.427944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.428086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.428221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.428247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.428393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.428544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.428569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.428723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.428858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.428883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.428980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.429069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.429094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.429195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.429324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.429349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.980 [2024-11-28 01:25:17.429464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.429587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.980 [2024-11-28 01:25:17.429613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.980 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.429716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.429813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.429855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.429979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.430102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.430127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.430227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.430375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.430402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.430560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.430662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.430687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.430811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.430904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.430929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.431057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.431152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.431177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.431319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.431435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.431462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.431587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.431681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.431706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.431817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.431918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.431941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.432089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.432249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.432277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.432429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.432535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.432560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.432656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.432748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.432772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.432898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.433023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.433054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.433173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.433325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.433349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.433465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.433614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.433642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.433782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.433889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.433916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.434036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.434157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.434181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.434306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.434442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.434469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.434595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.434721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.434745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.434869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.434963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.434988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.435089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.435238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.435262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.435383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.435531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.435559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.435677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.435769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.435793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.435902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.436026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.436051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.436146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.436304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.436328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.436480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.436581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.436606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.436704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.436797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.436821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.436924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.437017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.437040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.981 qpair failed and we were unable to recover it. 00:31:02.981 [2024-11-28 01:25:17.437139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.437240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.981 [2024-11-28 01:25:17.437264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.437395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.437495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.437519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.437626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.437776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.437805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.437928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.438031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.438056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.438182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.438305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.438330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.438472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.438585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.438613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.438766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.438873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.438897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.438991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.439111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.439135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.439259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.439397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.439424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.439577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.439705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.439729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.439847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.439996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.440020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.440116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.440283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.440310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.440436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.440555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.440580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.440731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.440851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.440877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.440987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.441096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.441123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.441284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.441415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.441439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.441542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.441638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.441663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.441758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.441875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.441903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.442011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.442102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.442126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.442228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.442369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.442396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.442568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.442662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.442686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.442788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.442880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.442904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.443045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.443158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.443186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.443332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.443484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.443508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.443615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.443713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.443738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.443891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.443991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.444019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.444167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.444314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.444341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.444481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.444616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.444641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.444743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.444834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.444873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.982 qpair failed and we were unable to recover it. 00:31:02.982 [2024-11-28 01:25:17.444983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.982 [2024-11-28 01:25:17.445117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.445143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.445270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.445389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.445413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.445512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.445620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.445644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.445760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.445906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.445947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.446043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.446167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.446192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.446339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.446476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.446503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.446652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.446794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.446828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.446998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.447107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.447132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.447275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.447440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.447468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.447582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.447716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.447742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.447837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.447937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.447962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.448067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.448172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.448197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.448298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.448462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.448488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.448598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.448698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.448724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.448888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.449061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.449089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.449231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.449385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.449410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.449514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.449651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.449676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.449786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.449879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.449903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3b0000b90 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.450032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.450178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.450203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.450351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.450477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.450501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.450624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.450746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.450771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.450867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.450989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.451014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.451113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.451237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.451261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.451378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.451483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.451511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.451666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.451790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.451815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.451949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.452046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.452071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.452196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.452354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.452379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.452510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.452607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.452631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.452758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.452855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.983 [2024-11-28 01:25:17.452880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.983 qpair failed and we were unable to recover it. 00:31:02.983 [2024-11-28 01:25:17.453023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.453163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.453190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.453326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.453464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.453491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.453650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.453750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.453775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.453969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.454102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.454126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.454283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.454390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.454414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.454512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.454619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.454644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.454746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.454873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.454915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.455020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.455131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.455159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.455288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.455412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.455436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.455560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.455680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.455705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.455811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.455915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.455940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.456037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.456160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.456185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.456322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.456434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.456461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.456641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.456777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.456801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.456928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.457056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.457080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.457169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.457267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.457292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.457392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.457518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.457550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.457692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.457820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.457845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.458018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.458128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.458152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.458272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.458378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.458404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.458578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.458705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.458729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.458851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.458948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.458975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.459113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.459263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.459287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.459391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.459490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.459515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.459657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.459777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.459801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.984 [2024-11-28 01:25:17.459898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.460026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.984 [2024-11-28 01:25:17.460068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.984 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.460244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.460346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.460372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.460487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.460625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.460650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.460754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.460871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.460917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.461085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.461176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.461200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.461331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.461435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.461463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.461621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.461711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.461735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.461889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.462011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.462035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.462150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.462291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.462315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.462460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.462610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.462635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.462744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.462879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.462903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.463059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.463240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.463265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.463361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.463458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.463482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.463642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.463739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.463764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.463891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.464037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.464065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.464206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.464311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.464339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.464488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.464585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.464611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.464720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.464813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.464838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.464987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.465107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.465131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.465226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.465354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.465378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.465536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.465655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.465680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.465779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.465926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.465951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.466048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.466172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.466197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.466308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.466446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.466473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.466639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.466743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.466768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.466892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.467010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.467035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.467145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.467259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.467287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.467393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.467536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.467562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.467714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.467811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.467837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.985 qpair failed and we were unable to recover it. 00:31:02.985 [2024-11-28 01:25:17.467956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.985 [2024-11-28 01:25:17.468095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.468123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.468264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.468369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.468396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.468551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.468642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.468667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.468787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.468906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.468931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.469033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.469185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.469226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.469383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.469489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.469514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.469622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.469744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.469771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.469920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.470072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.470097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.470196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.470297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.470322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.470435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.470535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.470560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.470662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.470818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.470843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.470965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.471083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.471108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.471225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.471370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.471411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.471538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.471656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.471684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.471837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.471968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.471993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.472095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.472194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.472220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.472317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.472467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.472494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.472620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.472746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.472771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.472883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.473015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.473043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.473155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.473266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.473293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.473421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.473547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.473572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.473707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.473821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.473845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.473971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.474108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.474135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.474268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.474391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.474416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.474547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.474671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.474699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.474814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.474951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.474983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.475154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.475275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.475300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.475447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.475596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.475621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.475795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.475943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.986 [2024-11-28 01:25:17.475970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.986 qpair failed and we were unable to recover it. 00:31:02.986 [2024-11-28 01:25:17.476117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.476217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.476242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.476345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.476490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.476519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.476668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.476808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.476836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.476982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.477081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.477105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.477224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.477365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.477392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.477493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.477600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.477627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.477780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.477904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.477929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.478063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.478166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.478192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.478340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.478483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.478507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.478665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.478767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.478791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.478916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.479024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.479052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.479166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.479296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.479337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.479441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.479598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.479623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.479746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.479849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.479877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.480034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.480128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.480152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.480281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.480404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.480428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.480530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.480682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.480709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.480867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.480996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.481020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.481117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.481247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.481272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.481403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.481546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.481572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.481691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.481826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.481854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.482029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.482135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.482159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.482284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.482399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.482426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.482535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.482642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.482670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.482816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.482914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.482938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.483054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.483163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.483192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.483300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.483399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.483427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.483554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.483688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.483714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.483836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.483938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.987 [2024-11-28 01:25:17.483966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.987 qpair failed and we were unable to recover it. 00:31:02.987 [2024-11-28 01:25:17.484071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.484201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.484229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.484404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.484535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.484560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.484713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.484835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.484862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.484964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.485065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.485093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.485239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.485333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.485357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.485473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.485622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.485647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.485751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.485853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.485877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.486006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.486125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.486150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.486297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.486446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.486478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.486625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.486745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.486772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.486895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.487021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.487045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.487159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.487272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.487315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.487410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.487574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.487602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.487729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.487828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.487853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.487961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.488088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.488113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.488245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.488368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.488395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.488545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.488648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.488673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.488799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.488913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.488941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.489054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.489189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.489232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.489396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.489490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.489515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.489646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.489778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.489805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.489937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.490053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.490093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.490216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.490320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.490345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.490446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.490545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.490571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.490699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.490796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.490840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.490973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.491100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.491124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.491243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.491356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.491400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.491503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.491618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.491643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.988 [2024-11-28 01:25:17.491747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.491845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.988 [2024-11-28 01:25:17.491870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.988 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.491965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.492082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.492112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.492226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.492360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.492388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.492533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.492623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.492648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.492757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.492876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.492900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.492998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.493121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.493145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.493275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.493376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.493401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.493541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.493653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.493694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.493852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.494002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.494029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.494155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.494310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.494334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.494454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.494593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.494622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.494762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.494874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.494901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.495030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.495134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.495158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.495254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.495431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.495459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.495602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.495705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.495729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.495826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.495975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.496000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.496146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.496288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.496316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.496424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.496534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.496562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.496675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.496802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.496826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.496962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.497079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.497106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.497244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.497345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.497390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.497516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.497659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.497685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.497816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.497945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.497970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.498060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.498149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.498174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.498300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.498396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.498420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.498562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.498714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.498738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.989 qpair failed and we were unable to recover it. 00:31:02.989 [2024-11-28 01:25:17.498865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.989 [2024-11-28 01:25:17.498994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.499019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.499143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.499232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.499258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.499383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.499474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.499499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.499631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.499723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.499748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.499844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.499944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.499969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.500066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.500167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.500196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.500302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.500420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.500462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.500561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.500663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.500688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.500792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.500900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.500924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.501046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.501180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.501208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.501329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.501432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.501456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.501550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.501675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.501699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.501803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.501928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.501952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.502045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.502169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.502193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.502333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.502450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.502476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.502604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.502708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.502733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.502837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.502989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.503013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.503159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.503305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.503331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.503444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.503574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.503602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.503756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.503849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.503874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.503971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.504064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.504089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.504214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.504338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.504363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.504464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.504575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.504600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.504716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.504834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.504861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.504996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.505105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.505132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.505248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.505374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.505398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.505534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.505631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.505674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.505810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.505920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.505944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.506042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.506138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.990 [2024-11-28 01:25:17.506163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.990 qpair failed and we were unable to recover it. 00:31:02.990 [2024-11-28 01:25:17.506314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.506446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.506474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.506575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.506716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.506741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.506848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.507000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.507025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.507123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.507268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.507295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.507443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.507568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.507593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.507730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.507822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.507846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.507940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.508064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.508090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.508265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.508406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.508433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.508546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.508647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.508672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.508760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.508923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.508948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.509066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.509215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.509242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.509358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.509482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.509508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.509640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.509793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.509818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.509940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.510036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.510076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.510192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.510284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.510308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.510475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.510601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.510627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.510754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.510903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.510931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.511058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.511196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.511221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.511323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.511471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.511498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.511652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.511783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.511808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.511909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.512003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.512027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.512160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.512273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.512300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.512467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.512601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.512629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.512752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.512850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.512874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.512983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.513088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.513115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.513217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.513378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.513405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.513564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.513664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.513689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.513813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.513987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.514019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.991 [2024-11-28 01:25:17.514137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.514246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.991 [2024-11-28 01:25:17.514273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.991 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.514387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.514512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.514561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.514745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.514856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.514883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.514999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.515130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.515156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.515302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.515403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.515427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.515592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.515688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.515712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.515814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.515917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.515960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.516076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.516179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.516204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.516303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.516428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.516456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.516593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.516735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.516762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.516913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.517054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.517079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.517226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.517330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.517357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.517479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.517581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.517606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.517712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.517815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.517840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.517967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.518106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.518133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.518272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.518381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.518408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.518534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.518659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.518683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.518785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.518903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.518932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.519044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.519159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.519187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.519295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.519419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.519443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.519554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.519707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.519735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.519883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.520006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.520030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.520155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.520279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.520304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.520457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.520594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.520638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.520738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.520840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.520881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.521012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.521147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.521172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.521297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.521393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.521435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.521570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.521710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.521737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.521886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.521972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.992 [2024-11-28 01:25:17.521997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.992 qpair failed and we were unable to recover it. 00:31:02.992 [2024-11-28 01:25:17.522136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.522248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.522275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.522414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.522561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.522587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.522716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.522807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.522831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.522970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.523078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.523105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.523209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.523336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.523363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.523536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.523645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.523669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.523795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.523896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.523938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.524082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.524219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.524246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 2168700 Killed "${NVMF_APP[@]}" "$@" 00:31:02.993 [2024-11-28 01:25:17.524364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.524458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.524482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.524592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 01:25:17 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:31:02.993 [2024-11-28 01:25:17.524757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.524782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 01:25:17 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:31:02.993 [2024-11-28 01:25:17.524913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.525035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.525062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with 01:25:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:02.993 addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 01:25:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:02.993 [2024-11-28 01:25:17.525218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.525319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 01:25:17 -- common/autotest_common.sh@10 -- # set +x 00:31:02.993 [2024-11-28 01:25:17.525344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.525447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.525542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.525568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.525725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.525847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.525874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.525993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.526121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.526145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.526246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.526346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.526370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.526471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.526594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.526620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.526739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.526836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.526861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.526988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.527122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.527164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.527264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.527363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.527388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.527495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.527623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.527653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.527780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.527920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.527948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.528055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.528238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.528264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.528386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.528484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.528508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.528664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.528773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.528801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.528931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.529071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.529096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.529200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.529308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.529332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.993 qpair failed and we were unable to recover it. 00:31:02.993 [2024-11-28 01:25:17.529438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.529541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.993 [2024-11-28 01:25:17.529566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.994 qpair failed and we were unable to recover it. 00:31:02.994 [2024-11-28 01:25:17.529666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.529774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.529799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.994 qpair failed and we were unable to recover it. 00:31:02.994 01:25:17 -- nvmf/common.sh@469 -- # nvmfpid=2169394 00:31:02.994 [2024-11-28 01:25:17.529926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.530021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.530048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.994 qpair failed and we were unable to recover it. 00:31:02.994 01:25:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:31:02.994 01:25:17 -- nvmf/common.sh@470 -- # waitforlisten 2169394 00:31:02.994 [2024-11-28 01:25:17.530240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 01:25:17 -- common/autotest_common.sh@829 -- # '[' -z 2169394 ']' 00:31:02.994 [2024-11-28 01:25:17.530339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.530366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.994 qpair failed and we were unable to recover it. 00:31:02.994 01:25:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:02.994 [2024-11-28 01:25:17.530514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.530645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.530673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.994 01:25:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:02.994 qpair failed and we were unable to recover it. 00:31:02.994 [2024-11-28 01:25:17.530796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 01:25:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:02.994 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:02.994 [2024-11-28 01:25:17.530902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.530927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.994 qpair failed and we were unable to recover it. 00:31:02.994 01:25:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:02.994 [2024-11-28 01:25:17.531032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 01:25:17 -- common/autotest_common.sh@10 -- # set +x 00:31:02.994 [2024-11-28 01:25:17.531140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.531166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.994 qpair failed and we were unable to recover it. 00:31:02.994 [2024-11-28 01:25:17.531284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.531387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.531411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.994 qpair failed and we were unable to recover it. 00:31:02.994 [2024-11-28 01:25:17.531511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.531637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.531661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.994 qpair failed and we were unable to recover it. 00:31:02.994 [2024-11-28 01:25:17.531807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.531916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.531942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.994 qpair failed and we were unable to recover it. 00:31:02.994 [2024-11-28 01:25:17.532078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.532188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.532218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.994 qpair failed and we were unable to recover it. 00:31:02.994 [2024-11-28 01:25:17.532344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.532451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.532477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.994 qpair failed and we were unable to recover it. 00:31:02.994 [2024-11-28 01:25:17.532583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.532670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.532696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.994 qpair failed and we were unable to recover it. 00:31:02.994 [2024-11-28 01:25:17.532801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.532907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:02.994 [2024-11-28 01:25:17.532933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:02.994 qpair failed and we were unable to recover it. 00:31:03.275 [2024-11-28 01:25:17.533062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.275 [2024-11-28 01:25:17.533182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.275 [2024-11-28 01:25:17.533207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.275 qpair failed and we were unable to recover it. 00:31:03.275 [2024-11-28 01:25:17.533315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.275 [2024-11-28 01:25:17.533501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.275 [2024-11-28 01:25:17.533536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.275 qpair failed and we were unable to recover it. 00:31:03.275 [2024-11-28 01:25:17.533679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.275 [2024-11-28 01:25:17.533781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.275 [2024-11-28 01:25:17.533809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.275 qpair failed and we were unable to recover it. 00:31:03.275 [2024-11-28 01:25:17.533957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.275 [2024-11-28 01:25:17.534063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.275 [2024-11-28 01:25:17.534088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.275 qpair failed and we were unable to recover it. 00:31:03.275 [2024-11-28 01:25:17.534214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.275 [2024-11-28 01:25:17.534327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.534356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.534513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.534626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.534652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.534748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.534847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.534872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.534976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.535072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.535116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.535272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.535367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.535391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.535490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.535594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.535619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.535725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.535816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.535841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.535930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.536028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.536054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.536176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.536278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.536303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.536396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.536560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.536586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.536710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.536831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.536860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.536980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.537077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.537103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.537207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.537332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.537357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.537471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.537589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.537617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.537736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.537872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.537897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.537998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.538120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.538144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.538255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.538395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.538422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.538554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.538654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.538679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.538823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.538961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.538988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.539128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.539275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.539299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.539424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.539543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.539568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.539688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.539787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.539813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.539914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.540071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.540099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.540221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.540316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.540341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.540435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.540532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.540562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.540664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.540815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.540840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.540940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.541036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.541061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.541185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.541282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.541306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.276 [2024-11-28 01:25:17.541432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.541590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.276 [2024-11-28 01:25:17.541618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.276 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.541770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.541926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.541950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.542073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.542210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.542239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.542378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.542487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.542516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.542648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.542745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.542770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.542864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.542962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.542987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.543154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.543266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.543293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.543444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.543539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.543573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.543676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.543824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.543852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.543985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.544120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.544146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.544279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.544402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.544426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.544548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.544684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.544712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.544851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.544958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.544985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.545109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.545264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.545289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.545381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.545540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.545568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.545682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.545818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.545845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.545991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.546144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.546169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.546297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.546406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.546435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.546579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.546715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.546742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.546916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.547013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.547038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.547162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.547374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.547401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.547539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.547648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.547690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.547788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.547914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.547939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.548038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.548164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.548190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.548286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.548380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.548405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.548512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.548615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.548640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.548790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.548901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.548928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.549042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.549254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.549282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.549416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.549547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.549573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.277 qpair failed and we were unable to recover it. 00:31:03.277 [2024-11-28 01:25:17.549694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.277 [2024-11-28 01:25:17.549837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.549861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.549989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.550088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.550112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.550211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.550310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.550334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.550480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.550619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.550661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.550782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.550887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.550912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.551030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.551148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.551173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.551291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.551398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.551425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.551535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.551666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.551693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.551817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.551916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.551942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.552044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.552164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.552189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.552306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.552410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.552439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.552560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.552663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.552687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.552786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.552932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.552973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.553062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.553180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.553205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.553325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.553425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.553450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.553592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.553712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.553742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.553894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.554018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.554042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.554168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.554270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.554294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.554412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.554507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.554563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.554664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.554759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.554784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.554913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.555015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.555039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.555167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.555279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.555306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.555443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.555595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.555623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.555770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.555861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.555886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.555985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.556085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.556109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.556236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.556338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.556366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.556519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.556621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.556646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.556773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.556929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.556954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.557053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.557226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.278 [2024-11-28 01:25:17.557253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.278 qpair failed and we were unable to recover it. 00:31:03.278 [2024-11-28 01:25:17.557403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.557502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.557538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.557701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.557804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.557829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.557933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.558028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.558052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.558176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.558302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.558327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.558469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.558640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.558665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.558863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.558987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.559012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.559116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.559255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.559280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.559448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.559585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.559613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.559756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.559875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.559902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.560021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.560125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.560151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.560296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.560425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.560450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.560560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.560708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.560735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.560876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.561013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.561037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.561166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.561318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.561343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.561466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.561578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.561604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.561699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.561832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.561856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.562035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.562154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.562179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.562315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.562438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.562462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.562569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.562670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.562695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.562845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.562995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.563020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.563150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.563307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.563331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.563464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.563559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.563584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.563711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.563829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.563854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.563947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.564083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.564108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.564226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.564378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.564402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.564584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.564701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.564729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.564891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.565058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.565085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.565228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.565354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.279 [2024-11-28 01:25:17.565378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.279 qpair failed and we were unable to recover it. 00:31:03.279 [2024-11-28 01:25:17.565533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.565649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.565676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.565817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.565946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.565973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.566116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.566275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.566319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.566501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.566624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.566651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.566779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.566923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.566950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.567075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.567192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.567217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.567358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.567509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.567541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.567643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.567760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.567784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.567900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.568053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.568078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.568180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.568330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.568357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.568494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.568671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.568699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.568824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.568932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.568956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.569084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.569264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.569296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.569409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.569544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.569572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.569733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.569859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.569884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.570037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.570166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.570193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.570338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.570518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.570548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.570641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.570769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.570794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.570914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.571056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.571083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.571225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.571370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.571395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.571521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.571629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.571655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.571780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.571915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.571940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.572056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.572159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.572185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.572300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.572420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.280 [2024-11-28 01:25:17.572444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.280 qpair failed and we were unable to recover it. 00:31:03.280 [2024-11-28 01:25:17.572637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.572762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.572787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.572938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.573037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.573064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.573214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.573341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.573366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.573462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.573550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.573594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.573770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.573867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.573892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.574017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.574142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.574167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.574266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.574407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.574434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.574555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.574660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.574688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.574851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.574976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.575001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.575078] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:31:03.281 [2024-11-28 01:25:17.575125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.575153] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:03.281 [2024-11-28 01:25:17.575258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.575285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.575429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.575557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.575581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.575707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.575808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.575833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.575959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.576111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.576139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.576252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.576395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.576423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.576544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.576645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.576670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.576789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.576951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.576979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.577121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.577253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.577281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.577423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.577552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.577578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.577726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.577878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.577906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.578081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.578207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.578232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.578357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.578451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.578475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.578572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.578670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.578694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.578823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.578971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.578999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.579151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.579252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.579278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.579412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.579549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.579578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.579685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.579839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.579864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.579961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.580083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.580109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.580286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.580421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.281 [2024-11-28 01:25:17.580448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.281 qpair failed and we were unable to recover it. 00:31:03.281 [2024-11-28 01:25:17.580577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.580677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.580706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.580830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.580957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.580982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.581074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.581220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.581247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.581394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.581546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.581572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.581741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.581842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.581867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.582023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.582120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.582145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.582292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.582453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.582480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.582617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.582753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.582778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.582887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.583007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.583050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.583201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.583330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.583355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.583509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.583623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.583664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.583800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.583946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.583975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.584141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.584280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.584309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.584466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.584597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.584622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.584789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.584946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.584979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.585104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.585239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.585264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.585382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.585518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.585554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.585683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.585790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.585815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.585965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.586076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.586104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.586218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.586352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.586381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.586489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.586637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.586664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.586796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.586954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.586978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.587145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.587296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.587320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.587455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.587598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.587626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.587764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.587924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.587975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.588146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.588236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.588262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.588406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.588545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.588573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.588737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.588883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.588911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.282 qpair failed and we were unable to recover it. 00:31:03.282 [2024-11-28 01:25:17.589061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.282 [2024-11-28 01:25:17.589181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.589206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.589332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.589486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.589532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.589676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.589777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.589805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.589947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.590072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.590096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.590243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.590389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.590414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.590549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.590675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.590700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.590803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.590895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.590920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.591037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.591140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.591168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.591275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.591405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.591433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.591577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.591703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.591728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.591918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.592073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.592097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.592243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.592394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.592419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.592593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.592689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.592714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.592840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.592963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.593007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.593162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.593307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.593332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.593469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.593586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.593614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.593717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.593894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.593919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.594026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.594115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.594140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.594346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.594511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.594544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.594680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.594792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.594820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.594938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.595062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.595087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.595216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.595369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.595410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.595522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.595673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.595700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.595864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.596028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.596056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.596178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.596329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.596354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.596478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.596582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.596608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.596737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.596947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.596974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.597110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.597242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.597267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.597395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.597515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.597549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.283 qpair failed and we were unable to recover it. 00:31:03.283 [2024-11-28 01:25:17.597723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.283 [2024-11-28 01:25:17.597851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.597876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.597978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.598079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.598103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.598252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.598387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.598414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.598517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.598752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.598780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.598952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.599085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.599109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.599227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.599361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.599402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.599495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.599626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.599652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.599794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.599933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.599958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.600062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.600155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.600179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.600286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.600377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.600401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.600531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.600683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.600708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.600863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.600999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.601027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.601201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.601325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.601349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.601474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.601598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.601623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.601811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.601962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.601985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.602140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.602239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.602265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.602380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.602510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.602551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.602678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.602830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.602854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.602998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.603137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.603163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.603386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.603516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.603548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.603726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.603848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.603873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.604003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.604111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.604139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.604253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.604401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.604425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.604586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.604706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.604750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.604903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.605019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.605044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.605194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.605374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.605399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.605533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.605655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.605683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.605792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.605926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.605953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.606076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.606221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.284 [2024-11-28 01:25:17.606249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.284 qpair failed and we were unable to recover it. 00:31:03.284 [2024-11-28 01:25:17.606472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.606601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.606627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.606757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.606894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.606921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.607049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.607157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.607184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.607338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.607490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.607514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.607652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.607759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.607787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.607956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.608104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.608130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.608229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.608348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.608381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.608534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.608661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.608686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.608814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.608927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.608955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.609131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.609255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.609280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.609424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.609568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.609593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.609693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.609793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.609818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.609915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.610007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.610047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.610162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.610292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.610334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 EAL: No free 2048 kB hugepages reported on node 1 00:31:03.285 [2024-11-28 01:25:17.610441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.610552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.610595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.610710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.610808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.610833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.610935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.611037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.611066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.611211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.611321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.611348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.611482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.611644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.611669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.611780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.611876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.611901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.612053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.612164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.612191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.612335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.612463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.612491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.612622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.612731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.612771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.612867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.612970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.612995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.285 [2024-11-28 01:25:17.613112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.613232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.285 [2024-11-28 01:25:17.613265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.285 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.613392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.613498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.613530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.613663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.613774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.613799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.613914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.614009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.614033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.614154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.614249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.614273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.614399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.614502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.614531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.614624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.614726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.614751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.614857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.614976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.615000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.615139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.615232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.615256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.615364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.615484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.615508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.615650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.615745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.615769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.615900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.615994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.616018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.616142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.616243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.616267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.616394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.616490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.616515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.616649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.616776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.616801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.616908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.617006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.617031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.617148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.617239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.617263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.617389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.617488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.617512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.617620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.617740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.617764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.617866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.617987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.618011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.618107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.618266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.618290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.618394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.618487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.618511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.618614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.618717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.618741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.618840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.618942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.618967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.619088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.619206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.619230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.619331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.619457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.619481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.619610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.619707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.619731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.619839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.619964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.619989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.620090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.620191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.620217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.286 qpair failed and we were unable to recover it. 00:31:03.286 [2024-11-28 01:25:17.620317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.286 [2024-11-28 01:25:17.620446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.620471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.620580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.620677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.620702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.620829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.620919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.620944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.621047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.621144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.621169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.621295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.621395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.621425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.621555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.621664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.621688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.621790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.621881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.621906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.622004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.622124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.622149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.622250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.622356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.622380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.622490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.622614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.622638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.622737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.622887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.622912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.623015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.623107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.623131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.623225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.623313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.623338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.623466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.623593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.623618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.623722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.623809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.623834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.623950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.624051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.624077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.624204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.624330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.624354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.624451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.624561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.624587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.624714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.624926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.624951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.625045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.625139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.625165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.625317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.625440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.625465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.625570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.625703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.625727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.625861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.625956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.625980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.626089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.626237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.626263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.626391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.626485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.626509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.626663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.626788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.626813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.626914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.627036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.627061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.627160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.627260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.627284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.627407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.627507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.627539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.287 qpair failed and we were unable to recover it. 00:31:03.287 [2024-11-28 01:25:17.627638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.287 [2024-11-28 01:25:17.627765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.627790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.627895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.628022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.628046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.628143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.628267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.628291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.628406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.628508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.628541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.628669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.628802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.628827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.628955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.629093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.629118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.629219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.629348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.629374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.629503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.629605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.629631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.629752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.629861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.629885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.629979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.630076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.630101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.630193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.630288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.630313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.630410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.630536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.630561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.630667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.630763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.630789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.630890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.630996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.631022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.631127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.631219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.631243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.631369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.631470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.631495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.631599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.631706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.631731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.631831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.631932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.631958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.632053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.632154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.632179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.632330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.632431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.632455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.632567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.632690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.632714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.632815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.632916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.632942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.633038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.633174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.633199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.633326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.633423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.633448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.633557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.633653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.633678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.633891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.633996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.634020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.634171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.634273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.634304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.634414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.634512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.634541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.634673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.634759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.288 [2024-11-28 01:25:17.634783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.288 qpair failed and we were unable to recover it. 00:31:03.288 [2024-11-28 01:25:17.634887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.635047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.635071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.635168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.635264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.635289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.635391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.635480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.635505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.635550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x653980 (9): Bad file descriptor 00:31:03.289 [2024-11-28 01:25:17.635721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.635867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.635896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.636035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.636143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.636169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.636275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.636381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.636408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.636512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.636624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.636650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.636781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.636916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.636943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.637070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.637206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.637232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.637363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.637491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.637516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.637626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.637718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.637743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.637850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.637972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.637997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.638094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.638216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.638240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.638333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.638433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.638458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.638563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.638667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.638691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.638783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.638871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.638895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.638990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.639114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.639138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.639241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.639339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.639368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.639476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.639572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.639598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.639687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.639788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.639814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.639909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.640010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.640034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.640239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.640361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.640385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.640488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.640589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.640614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.640743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.640846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.640870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.640969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.641122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.289 [2024-11-28 01:25:17.641146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.289 qpair failed and we were unable to recover it. 00:31:03.289 [2024-11-28 01:25:17.641234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.641447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.641472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.641592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.641703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.641727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.641831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.641954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.641978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.642108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.642229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.642254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.642346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.642469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.642495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.642631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.642729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.642754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.642849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.642947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.642973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.643096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.643223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.643247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.643372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.643497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.643521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.643632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.643756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.643781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.643875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.643971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.643996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.644201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.644319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.644344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.644473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.644601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.644627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.644754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.644882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.644907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.645010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.645100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.645124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.645244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.645343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.645369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.645494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.645577] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:31:03.290 [2024-11-28 01:25:17.645605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.645629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.645735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.645833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.645861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.645962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.646086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.646111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.646211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.646365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.646389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.646502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.646613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.646638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.646762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.646860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.646884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.646978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.647099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.647123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.647342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.647445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.647470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.647569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.647695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.647720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.647818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.647906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.647931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.648031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.648154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.648179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.648277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.648373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.648398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.290 qpair failed and we were unable to recover it. 00:31:03.290 [2024-11-28 01:25:17.648495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.290 [2024-11-28 01:25:17.648603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.648628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.648755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.648850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.648875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.648967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.649091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.649115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.649267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.649480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.649504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.649603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.649703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.649727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.649861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.649991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.650016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.650123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.650326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.650351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.650505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.650622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.650647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.650737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.650879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.650904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.651029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.651124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.651148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.651266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.651360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.651385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.651491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.651621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.651647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.651756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.651878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.651903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.651999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.652120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.652145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.652240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.652337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.652361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.652463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.652555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.652580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.652678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.652811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.652835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.652965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.653065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.653089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.653213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.653336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.653360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.653488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.653597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.653621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.653747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.653845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.653870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.653969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.654064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.654090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.654197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.654297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.654322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.654455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.654576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.654601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.654702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.654831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.654857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.654978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.655072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.655100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.655211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.655308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.655332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.655440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.655592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.655617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.655722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.655836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.291 [2024-11-28 01:25:17.655860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.291 qpair failed and we were unable to recover it. 00:31:03.291 [2024-11-28 01:25:17.655959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.656119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.656143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.656267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.656395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.656420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.656555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.656658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.656684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.656780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.656932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.656957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.657091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.657216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.657241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.657340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.657444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.657469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.657597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.657727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.657752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.657856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.657986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.658011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.658104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.658254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.658278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.658401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.658543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.658568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.658722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.658822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.658848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.658980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.659138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.659163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.659259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.659359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.659382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.659500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.659668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.659694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.659796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.659949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.659974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.660081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.660186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.660210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.660309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.660434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.660458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.660590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.660680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.660704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.660856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.660978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.661003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.661106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.661231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.661255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.661353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.661479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.661504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.661611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.661737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.661761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.661887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.662018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.662042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.662135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.662258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.662283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.662388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.662517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.662546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.662656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.662781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.662805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.662931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.663031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.663055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.663174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.663306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.663332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.663434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.663563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.292 [2024-11-28 01:25:17.663588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.292 qpair failed and we were unable to recover it. 00:31:03.292 [2024-11-28 01:25:17.663688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.663780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.663804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.663924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.664026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.664049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.664154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.664253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.664277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.664371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.664489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.664513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.664674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.664802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.664826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.664976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.665106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.665130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.665227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.665327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.665353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.665443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.665549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.665574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.665709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.665814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.665844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.665948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.666043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.666067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.666163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.666287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.666311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.666407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.666537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.666562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.666716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.666815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.666839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.666964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.667087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.667111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.667236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.667356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.667380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.667481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.667608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.667633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.667733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.667884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.667908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.668000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.668093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.668117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.668235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.668367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.668391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.668496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.668625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.668650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.668756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.668851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.668875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.669027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.669120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.669145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.669248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.669370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.669394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.669487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.669596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.669621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.669745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.669869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.669893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.669990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.670120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.670144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.670239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.670333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.670358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.670485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.670578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.670603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.293 [2024-11-28 01:25:17.670724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.670875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.293 [2024-11-28 01:25:17.670900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.293 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.671004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.671128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.671152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.671310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.671414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.671438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.671567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.671667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.671691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.671789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.671913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.671937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.672033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.672160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.672184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.672281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.672372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.672397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.672502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.672600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.672626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.672749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.672848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.672872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.672996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.673123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.673149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.673246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.673350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.673374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.673533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.673681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.673706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.673824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.673975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.673999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.674097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.674251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.674275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.674374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.674470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.674494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.674607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.674707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.674732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.674825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.674984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.675009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.675105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.675229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.675253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.675344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.675438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.675461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.675585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.675742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.675766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.675870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.675995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.676019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.676122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.676285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.676310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.676442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.676545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.676570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.676673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.676770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.294 [2024-11-28 01:25:17.676796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.294 qpair failed and we were unable to recover it. 00:31:03.294 [2024-11-28 01:25:17.676897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.677002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.677026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.677150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.677254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.677278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.677409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.677537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.677562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.677655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.677750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.677774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.677871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.678000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.678025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.678123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.678227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.678251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.678377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.678502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.678531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.678660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.678783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.678811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.678936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.679104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.679129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.679284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.679385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.679409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.679551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.679639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.679664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.679791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.679921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.679945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.680073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.680194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.680219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.680316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.680465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.680490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.680606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.680729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.680752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.680868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.680963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.680988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.681080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.681199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.681223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.681357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.681452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.681477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.681590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.681698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.681724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.681820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.681910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.681934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.682050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.682172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.682197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.682295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.682386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.682410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.682514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.682622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.682647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.682770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.682899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.682923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.683050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.683143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.683166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.683263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.683356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.683379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.683506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.683612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.683636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.683764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.683865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.683889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.295 [2024-11-28 01:25:17.683995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.684147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.295 [2024-11-28 01:25:17.684171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.295 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.684312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.684436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.684461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.684554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.684676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.684700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.684798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.684898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.684923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.685019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.685143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.685167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.685332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.685457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.685481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.685595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.685718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.685742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.685871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.685973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.685997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.686122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.686224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.686248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.686374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.686472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.686496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.686601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.686753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.686778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.686905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.687029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.687055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.687161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.687253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.687279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.687405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.687505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.687554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.687747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.687872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.687896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.688126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.688222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.688246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.688340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.688465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.688490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.688649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.688779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.688803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.688897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.689034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.689058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.689194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.689312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.689336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.689462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.689561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.689586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.689691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.689788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.689813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.689939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.690042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.690067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.690228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.690325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.690351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.690478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.690632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.690657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.690787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.690910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.690934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.691038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.691195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.691219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.691327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.691428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.691452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.691589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.691709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.691734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.296 qpair failed and we were unable to recover it. 00:31:03.296 [2024-11-28 01:25:17.691838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.691931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.296 [2024-11-28 01:25:17.691955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.692113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.692270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.692299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.692435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.692531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.692557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.692688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.692841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.692866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.692966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.693114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.693138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.693291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.693388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.693412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.693521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.693655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.693681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.693844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.693964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.693988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.694142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.694243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.694267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.694396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.694492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.694515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.694652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.694755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.694779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.694942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.695093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.695118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.695220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.695358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.695382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.695514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.695669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.695694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.695821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.695978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.696002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.696098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.696223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.696247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.696399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.696500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.696531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.696639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.696769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.696793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.696897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.697053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.697077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.697208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.697330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.697354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.697460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.697554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.697579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.697673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.697791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.697815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.697929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.698026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.698050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.698143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.698241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.698267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.698364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.698490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.698514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.698648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.698743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.698768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.698902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.699002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.699026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.699150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.699287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.699312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.699471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.699602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.699628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.297 qpair failed and we were unable to recover it. 00:31:03.297 [2024-11-28 01:25:17.699725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.297 [2024-11-28 01:25:17.699842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.699867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.699991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.700105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.700129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.700234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.700368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.700392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.700554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.700690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.700715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.700813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.700932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.700956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.701117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.701220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.701244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.701373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.701532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.701557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.701683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.701809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.701833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.701934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.702027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.702051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.702146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.702242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.702266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.702391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.702514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.702546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.702698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.702791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.702820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.702948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.703073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.703097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.703217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.703325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.703353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.703507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.703641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.703665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.703830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.703927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.703951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.704050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.704154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.704179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.704276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.704402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.704426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.704553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.704659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.704683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.704774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.704869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.704893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.705021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.705148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.705172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.705274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.705369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.705393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.705521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.705622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.705646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.705736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.705866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.705891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.706049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.706146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.706171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.298 [2024-11-28 01:25:17.706297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.706434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.298 [2024-11-28 01:25:17.706459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.298 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.706600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.706720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.706744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.706841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.706939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.706963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.707069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.707191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.707215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.707320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.707421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.707445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.707556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.707680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.707704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.707812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.707914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.707938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.708049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.708179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.708204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.708335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.708465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.708489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.708643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.708746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.708771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.708882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.709024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.709048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.709205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.709825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.709856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.709999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.710098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.710124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.710222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.710325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.710349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.710460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.710595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.710621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.710721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.710816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.710840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.710930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.711028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.711053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.711159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.711279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.711304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.711404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.711498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.711556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.711668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.711773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.711798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.711902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.711997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.712021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.712181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.712281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.712306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.712397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.712530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.712556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.712661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.712753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.712777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.712938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.713066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.713092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.713220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.713338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.713362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.713460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.713597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.713622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.713743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.713879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.713903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.714029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.714158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.714184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.299 qpair failed and we were unable to recover it. 00:31:03.299 [2024-11-28 01:25:17.714299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.299 [2024-11-28 01:25:17.714432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.714457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.714559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.714688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.714712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.714835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.714932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.714955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.715055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.715184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.715209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.715310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.715437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.715462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.715592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.715721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.715746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.715896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.716020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.716045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.716211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.716306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.716331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.716455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.716585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.716610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.716731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.716859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.716883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.716983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.717109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.717138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.717245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.717366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.717390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.717491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.717622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.717648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.717780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.717882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.717906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.718032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.718156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.718180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.718282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.718403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.718427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.718551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.718651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.718675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.718803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.718903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.718928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.719030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.719153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.719178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.719308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.719441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.719465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.719592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.719692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.719716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.719850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.719959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.719983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.720114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.720241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.720266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.720395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.720485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.720509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.720653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.720773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.720797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.720922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.721043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.721067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.721200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.721322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.721346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.721500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.721638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.721663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.721759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.721889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.300 [2024-11-28 01:25:17.721914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.300 qpair failed and we were unable to recover it. 00:31:03.300 [2024-11-28 01:25:17.722041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.722144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.722168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.722292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.722447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.722471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.722608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.722707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.722732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.722866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.722985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.723010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.723110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.723230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.723256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.723386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.723515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.723568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.723695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.723826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.723851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.723958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.724050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.724075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.724206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.724300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.724325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.724415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.724519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.724551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.724704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.724825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.724850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.724941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.725046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.725071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.725231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.725361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.725386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.725516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.725618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.725642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.725769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.725867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.725892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.725990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.726095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.726119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.726221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.726350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.726376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.726533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.726628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.726653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.726782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.726910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.726935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.727037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.727133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.727158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.727266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.727418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.727443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.727567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.727719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.727745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.727869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.727976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.728000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.728126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.728252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.728277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.728407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.728538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.728564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.728670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.728791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.728816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.728940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.729069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.729093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.729188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.729310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.729336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.729430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.729595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.301 [2024-11-28 01:25:17.729621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.301 qpair failed and we were unable to recover it. 00:31:03.301 [2024-11-28 01:25:17.729759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.729906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.729930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.730033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.730902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.730933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.731068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.731185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.731210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.731364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.731521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.731559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.731691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.731795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.731831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.731963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.732063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.732088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.732800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.732966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.732992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.733124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.733245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.733269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.733419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.733561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.733587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.733682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.733832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.733856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.733990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.734142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.734167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.734268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.734367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.734391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.734489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.734592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.734617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.734714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.734806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.734839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.734938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.734972] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:03.302 [2024-11-28 01:25:17.735026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.735051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.735110] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:03.302 [2024-11-28 01:25:17.735129] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:03.302 [2024-11-28 01:25:17.735143] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:03.302 [2024-11-28 01:25:17.735147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.735253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.735201] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:31:03.302 [2024-11-28 01:25:17.735276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.735264] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:31:03.302 [2024-11-28 01:25:17.735267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:31:03.302 [2024-11-28 01:25:17.735368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.735235] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:31:03.302 [2024-11-28 01:25:17.735465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.735488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.735592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.735684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.735708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.735805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.735908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.735932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.736041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.736188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.736213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.736313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.736417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.736444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.736579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.736682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.736708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.736829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.736982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.737006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.737099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.737230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.737254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.737391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.737518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.737550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.737714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.737847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.737873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.302 qpair failed and we were unable to recover it. 00:31:03.302 [2024-11-28 01:25:17.738002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.738103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.302 [2024-11-28 01:25:17.738127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.738229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.738330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.738355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.738486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.738593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.738619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.738718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.738811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.738836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.738941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.739033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.739058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.739185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.739304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.739329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.739458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.739582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.739607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.739708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.739801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.739836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.739964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.740063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.740088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.740245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.740349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.740373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.740499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.740669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.740695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.740845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.740988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.741013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.741111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.741237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.741261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.741364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.741488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.741516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.741682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.741783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.741808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.741914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.742006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.742030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.742126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.742255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.742280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.742406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.742507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.742542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.742674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.742772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.742797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.742932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.743084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.743110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.743207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.743294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.743319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.743443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.743540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.743567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.743700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.743798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.743823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.743956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.744059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.744083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.744191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.744293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.744317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.744441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.744550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.744576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.303 qpair failed and we were unable to recover it. 00:31:03.303 [2024-11-28 01:25:17.744674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.303 [2024-11-28 01:25:17.744800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.744835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.744962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.745054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.745079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.745208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.745331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.745356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.745456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.745574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.745600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.745694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.745793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.745817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.745912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.746031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.746055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.746176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.746268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.746293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.746412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.746548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.746572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.746669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.746779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.746803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.746905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.747025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.747050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.747148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.747251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.747275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.747384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.747480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.747506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.747649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.747774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.747800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.747904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.748012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.748037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.748124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.748246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.748271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.748428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.748531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.748556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.748657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.748756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.748781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.748893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.748990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.749014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.749117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.749242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.749267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.749370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.749477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.749501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.749600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.749702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.749726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.749869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.749992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.750017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.750139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.750260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.750286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.750405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.750505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.750547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.750676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.750776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.750801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.750915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.751014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.751039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.751188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.751285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.751310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.751443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.751604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.751629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.751717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.751826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.751851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.304 qpair failed and we were unable to recover it. 00:31:03.304 [2024-11-28 01:25:17.751954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.304 [2024-11-28 01:25:17.752076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.752101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.752250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.752378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.752403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.752498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.752673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.752699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.752799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.752929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.752954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.753084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.753213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.753238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.753337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.753457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.753483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.753621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.753721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.753746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.753855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.753947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.753972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.754077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.754207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.754232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.754345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.754442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.754466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.754607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.754707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.754734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.754828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.754953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.754978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.755083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.755211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.755237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.755361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.755486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.755514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.755657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.755759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.755784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.755876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.756001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.756026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.756123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.756214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.756239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.756337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.756431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.756455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.756587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.756683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.756707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.756822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.756952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.756976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.757076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.757178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.757202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.757304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.757433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.757458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.757604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.757706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.757743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.757872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.758014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.758040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.758169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.758294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.758319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.758425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.758531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.758557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.758660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.758759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.758783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.758892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.759013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.759039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.759147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.759242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.305 [2024-11-28 01:25:17.759267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.305 qpair failed and we were unable to recover it. 00:31:03.305 [2024-11-28 01:25:17.759425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.759546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.759572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.759702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.759802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.759834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.759935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.760043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.760069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.760172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.760291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.760316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.760423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.760519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.760578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.760675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.760772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.760796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.760922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.761021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.761046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.761167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.761289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.761314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.761417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.761552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.761578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.761707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.761828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.761853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.761946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.762039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.762065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.762167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.762257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.762282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.762386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.762505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.762547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.762672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.762771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.762795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.762921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.763041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.763065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.763218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.763369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.763394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.763494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.763623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.763649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.763753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.763864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.763890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.764008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.764100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.764124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.764279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.764388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.764413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.764512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.764674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.764699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.764796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.764913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.764938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.765046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.765172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.765198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.765322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.765421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.765445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.765581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.765712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.765737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.765835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.765926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.765950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.766077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.766226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.766251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.766350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.766449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.766474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.306 qpair failed and we were unable to recover it. 00:31:03.306 [2024-11-28 01:25:17.766573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.766663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.306 [2024-11-28 01:25:17.766687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.766781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.766910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.766934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.767034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.767133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.767157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.767245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.767375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.767399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.767500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.767605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.767630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.767730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.767861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.767885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.768016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.768141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.768170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.768261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.768351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.768375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.768488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.768652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.768677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.768774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.768906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.768930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.769037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.769186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.769209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.769309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.769410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.769434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.769537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.769665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.769689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.769782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.769883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.769907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.770039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.770134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.770158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.770250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.770372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.770396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.770494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.770608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.770636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.770740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.770853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.770879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.770971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.771062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.771087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.771223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.771315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.771340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.771475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.771579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.771605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.771705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.771803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.771828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.771938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.772061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.772085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.772177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.772281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.772305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.772410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.772501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.772537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.772638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.772769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.772793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.772882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.772971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.772995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.773103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.773227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.773250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.773350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.773504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.773534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.307 qpair failed and we were unable to recover it. 00:31:03.307 [2024-11-28 01:25:17.773629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.307 [2024-11-28 01:25:17.773731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.773756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.773864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.773960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.773984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.774086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.774182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.774205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.774330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.774457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.774482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.774617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.774715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.774738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.774871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.774978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.775003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.775157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.775251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.775275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.775381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.775479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.775502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.775613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.775718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.775742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.775876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.776025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.776050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.776177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.776282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.776306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.776427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.776521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.776566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.776706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.776802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.776826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.776953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.777083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.777107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.777227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.777352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.777375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.777506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.777617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.777642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.777766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.777892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.777916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.778018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.778145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.778168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.778262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.778385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.778409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.778514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.778635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.778659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.778765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.778872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.778897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.779030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.779155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.779180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.779288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.779422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.779447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.779565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.779705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.779730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.779847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.779975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.779999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.308 qpair failed and we were unable to recover it. 00:31:03.308 [2024-11-28 01:25:17.780123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.780213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.308 [2024-11-28 01:25:17.780238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.780332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.780450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.780475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.780611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.780733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.780757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.780869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.780971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.780999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.781125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.781228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.781253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.781351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.781453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.781479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.781589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.781687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.781712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.781844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.781941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.781966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.782060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.782177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.782201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.782327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.782447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.782471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.782589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.782687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.782710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.782811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.782938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.782962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.783064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.783193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.783216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.783311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.783404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.783428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.783536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.783635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.783659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.783757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.783862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.783885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.784003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.784125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.784148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.784246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.784334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.784358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.784483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.784596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.784620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.784721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.784871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.784895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.785035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.785198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.785223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.785318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.785409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.785433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.785523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.785652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.785676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.785800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.785897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.785921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.786047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.786147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.786171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.786300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.786392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.786416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.786512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.786653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.786679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.786805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.786922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.786946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.787074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.787172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.787196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.309 qpair failed and we were unable to recover it. 00:31:03.309 [2024-11-28 01:25:17.787328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.309 [2024-11-28 01:25:17.787458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.787482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.787596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.787725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.787749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.787874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.787971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.787994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.788089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.788192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.788216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.788312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.788401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.788425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.788563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.788662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.788688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.788790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.788931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.788956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.789055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.789203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.789228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.789328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.789451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.789475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.789577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.789706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.789731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.789819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.789934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.789959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.790084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.790170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.790193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.790290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.790385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.790408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.790612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.790718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.790742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.790866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.790969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.790993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.791084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.791206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.791231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.791333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.791420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.791444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.791566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.791685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.791710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.791811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.792032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.792056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.792185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.792283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.792307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.792435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.792576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.792602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.792729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.792837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.792862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.793004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.793153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.793178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.793309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.793437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.793460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.793568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.793663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.793686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.793793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.793913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.793941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.794066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.794163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.794186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.794288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.794420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.794445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.794552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.794650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.794674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.310 qpair failed and we were unable to recover it. 00:31:03.310 [2024-11-28 01:25:17.794773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.310 [2024-11-28 01:25:17.794889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.794914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.795013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.795111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.795135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.795261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.795381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.795406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.795536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.795632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.795655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.795757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.795862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.795886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.795974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.796076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.796101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.796204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.796301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.796325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.796501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.796642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.796667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.796775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.796903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.796926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.797145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.797236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.797260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.797363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.797486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.797519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.797659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.797758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.797783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.797917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.798040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.798063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.798304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.798425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.798449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.798583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.798693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.798716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.798811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.798916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.798941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.799063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.799187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.799211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.799349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.799444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.799470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.799596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.799723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.799747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.799850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.799948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.799973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.800069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.800159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.800183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.800289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.800392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.800415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.800514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.800692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.800716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.800812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.800906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.800931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.801061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.801155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.801179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.801274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.801396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.801420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.801564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.801665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.801690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.801816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.801948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.801973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.802105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.802202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.311 [2024-11-28 01:25:17.802226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.311 qpair failed and we were unable to recover it. 00:31:03.311 [2024-11-28 01:25:17.802326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.802429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.802454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.802594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.802717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.802742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.802835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.802934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.802958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.803059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.803157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.803181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.803284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.803419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.803443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.803572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.803671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.803694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.803789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.803875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.803899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.804027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.804158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.804182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.804286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.804413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.804443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.804544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.804643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.804667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.804798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.804928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.804951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.805050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.805178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.805202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.805354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.805456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.805480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.805621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.805714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.805738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.805896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.806052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.806076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.806180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.806305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.806329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.806455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.806567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.806593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.806689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.806829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.806853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.806984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.807118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.807147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.807279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.807383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.807408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.807534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.807634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.807659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.807762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.807866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.807890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.807993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.808123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.808148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.808302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.808403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.808428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.808582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.808709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.808734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.312 [2024-11-28 01:25:17.808895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.808996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.312 [2024-11-28 01:25:17.809020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.312 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.809117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.809237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.809261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.809391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.809483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.809508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.809631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.809755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.809780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.809917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.810006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.810031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.810131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.810231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.810254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.810354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.810483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.810508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.810688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.810780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.810805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.810906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.811031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.811055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.811188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.811293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.811318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.811449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.811560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.811586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.811684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.811781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.811805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.811908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.812005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.812029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.812129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.812253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.812284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.812423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.812528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.812554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.812683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.812805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.812835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.812937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.813035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.813062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.813160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.813248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.813273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.813363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.813459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.813483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.813619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.813742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.813766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.813899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.814020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.814045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.814148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.814297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.814322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.814439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.814534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.814559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.814692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.814821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.814845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.814950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.815047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.815071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.815159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.815250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.815274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.815369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.815500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.815539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.815666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.815766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.815790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.815901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.816012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.816037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.313 qpair failed and we were unable to recover it. 00:31:03.313 [2024-11-28 01:25:17.816141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.816261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.313 [2024-11-28 01:25:17.816286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.816373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.816570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.816596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.816698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.816796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.816820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.816924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.817011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.817036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.817159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.817254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.817279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.817388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.817472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.817500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.817614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.817721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.817745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.817845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.817950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.817975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.818110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.818209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.818234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.818367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.818463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.818487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.818597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.818722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.818746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.818842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.818943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.818967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.819093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.819186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.819210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.819306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.819442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.819467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.819570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.819669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.819694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.819793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.819882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.819907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.820009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.820139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.820164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.820269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.820369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.820394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.820532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.820625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.820650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.820742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.820866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.820891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.820989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.821093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.821118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.821218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.821309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.821334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.821423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.821591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.821616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.821717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.821845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.821869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.821978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.822097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.822121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.822220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.822344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.822367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.822469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.822602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.822626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.822752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.822882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.822906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.823000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.823148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.823172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.314 qpair failed and we were unable to recover it. 00:31:03.314 [2024-11-28 01:25:17.823275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.314 [2024-11-28 01:25:17.823378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.823402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.823509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.823622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.823646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.823750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.823860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.823884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.824012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.824135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.824159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.824283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.824401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.824425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.824566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.824669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.824694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.824800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.824913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.824938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.825075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.825200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.825225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.825320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.825420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.825444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.825550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.825673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.825698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.825790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.825913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.825938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.826029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.826128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.826152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.826273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.826370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.826394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.826528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.826630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.826654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.826747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.826876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.826900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.826999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.827114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.827138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.827266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.827395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.827419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.827520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.827625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.827649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.827773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.827877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.827901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.828007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.828101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.828125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.828254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.828354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.828380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.828559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.828656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.828682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.828802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.828902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.828926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.829056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.829153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.829177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.829274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.829366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.829390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.829484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.829590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.829614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.829712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.829815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.829848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.829941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.830024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.830052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.830162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.830258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.830281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.830411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.830496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.830521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.315 [2024-11-28 01:25:17.830653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.830777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.315 [2024-11-28 01:25:17.830802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.315 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.830938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.831033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.831058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.831191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.831286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.831312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.831412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.831510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.831541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.831646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.831737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.831761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.831889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.831982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.832006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.832114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.832205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.832230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.832335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.832455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.832480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.832645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.832795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.832833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.832960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.833087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.833114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.833243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.833333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.833358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.833483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.833611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.833636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.833736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.833837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.833861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.833992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.834111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.834136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.834260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.834378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.834402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.834614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.834724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.834748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.834879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.835011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.835035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.835126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.835224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.835250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.835346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.835441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.835466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.835590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.835690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.835714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.835809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.835911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.835936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.836030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.836134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.836158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.836280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.836384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.836408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.836499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.836606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.836631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.836726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.836828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.836853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.836949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.837048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.837072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.837224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.837350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.837373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.837477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.837573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.837597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.837723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.837851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.837875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.837972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.838066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.838090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.838189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.838286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.838310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.316 [2024-11-28 01:25:17.838406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.838505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.316 [2024-11-28 01:25:17.838537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.316 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.838663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.838786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.838811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.838916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.839041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.839066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.839166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.839294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.839318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.839449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.839604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.839630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.839728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.839864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.839889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.840011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.840115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.840140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.840246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.840379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.840408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.840510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.840630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.840655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.840766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.840869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.840901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.841002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.841130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.841155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.841250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.841342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.841366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.841484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.841593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.841620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.841721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.841851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.841875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.841999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.842096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.842120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.842218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.842338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.842362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.842505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.842604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.842628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.842734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.842867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.842895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.843016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.843116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.843140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.843272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.843414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.843438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.843577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.843696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.843720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.843821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.843946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.843971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.844069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.844158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.844181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.844280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.844409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.844434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.844571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.844699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.844723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.844823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.844960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.844984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.845083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.845201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.845226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.845325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.845455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.845480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.317 qpair failed and we were unable to recover it. 00:31:03.317 [2024-11-28 01:25:17.845609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.317 [2024-11-28 01:25:17.845712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.845737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.845867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.845971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.845996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.846089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.846182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.846206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.846312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.846403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.846428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.846528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.846650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.846674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.846766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.846866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.846891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.846995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.847095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.847119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.847231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.847359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.847384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.847514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.847620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.847644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.847765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.847914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.847938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.848088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.848192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.848216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.848345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.848436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.848459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.848574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.848727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.848751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.848846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.848943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.848967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.849095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.849190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.849214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.849340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.849436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.849461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.849600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.849701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.849725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.849858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.849985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.850009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.850107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.850203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.850226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.850329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.850455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.850479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.850594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.850696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.850720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.850847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.850943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.850967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.851096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.851216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.851240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.851337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.851437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.851461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.851581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.851669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.851694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.851789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.851890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.851914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.852069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.852186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.852212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.852304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.852404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.852429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.852558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.852649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.852674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.852777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.852881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.852906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.852998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.853087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.853115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.318 qpair failed and we were unable to recover it. 00:31:03.318 [2024-11-28 01:25:17.853235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.853333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.318 [2024-11-28 01:25:17.853358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.319 qpair failed and we were unable to recover it. 00:31:03.319 [2024-11-28 01:25:17.853458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.319 [2024-11-28 01:25:17.853573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.319 [2024-11-28 01:25:17.853598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.319 qpair failed and we were unable to recover it. 00:31:03.319 [2024-11-28 01:25:17.853700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.319 [2024-11-28 01:25:17.853797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.319 [2024-11-28 01:25:17.853823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.319 qpair failed and we were unable to recover it. 00:31:03.319 [2024-11-28 01:25:17.853933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.319 [2024-11-28 01:25:17.854056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.319 [2024-11-28 01:25:17.854081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.319 qpair failed and we were unable to recover it. 00:31:03.319 [2024-11-28 01:25:17.854174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.319 [2024-11-28 01:25:17.854276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.319 [2024-11-28 01:25:17.854300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.319 qpair failed and we were unable to recover it. 00:31:03.319 [2024-11-28 01:25:17.854403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.319 [2024-11-28 01:25:17.854532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.319 [2024-11-28 01:25:17.854557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.319 qpair failed and we were unable to recover it. 00:31:03.319 [2024-11-28 01:25:17.854647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.319 [2024-11-28 01:25:17.854748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.319 [2024-11-28 01:25:17.854773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.319 qpair failed and we were unable to recover it. 00:31:03.319 [2024-11-28 01:25:17.854881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.319 [2024-11-28 01:25:17.854972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.319 [2024-11-28 01:25:17.854997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.319 qpair failed and we were unable to recover it. 00:31:03.319 [2024-11-28 01:25:17.855097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.319 [2024-11-28 01:25:17.855194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.602 [2024-11-28 01:25:17.855219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.602 qpair failed and we were unable to recover it. 00:31:03.602 [2024-11-28 01:25:17.855314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.602 [2024-11-28 01:25:17.855432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.602 [2024-11-28 01:25:17.855455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.602 qpair failed and we were unable to recover it. 00:31:03.602 [2024-11-28 01:25:17.855566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.602 [2024-11-28 01:25:17.855669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.602 [2024-11-28 01:25:17.855692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.602 qpair failed and we were unable to recover it. 00:31:03.602 [2024-11-28 01:25:17.855793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.602 [2024-11-28 01:25:17.855929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.602 [2024-11-28 01:25:17.855953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.602 qpair failed and we were unable to recover it. 00:31:03.602 [2024-11-28 01:25:17.856059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.602 [2024-11-28 01:25:17.856189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.602 [2024-11-28 01:25:17.856213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.602 qpair failed and we were unable to recover it. 00:31:03.602 [2024-11-28 01:25:17.856315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.602 [2024-11-28 01:25:17.856414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.602 [2024-11-28 01:25:17.856438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.602 qpair failed and we were unable to recover it. 00:31:03.602 [2024-11-28 01:25:17.856559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.602 [2024-11-28 01:25:17.856657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.602 [2024-11-28 01:25:17.856681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.602 qpair failed and we were unable to recover it. 00:31:03.602 [2024-11-28 01:25:17.856782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.602 [2024-11-28 01:25:17.856883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.602 [2024-11-28 01:25:17.856906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.602 qpair failed and we were unable to recover it. 00:31:03.602 [2024-11-28 01:25:17.857005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.602 [2024-11-28 01:25:17.857123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.602 [2024-11-28 01:25:17.857147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.602 qpair failed and we were unable to recover it. 00:31:03.602 [2024-11-28 01:25:17.857255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.602 [2024-11-28 01:25:17.857343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.602 [2024-11-28 01:25:17.857367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.857459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.857575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.857599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.857693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.857790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.857815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.857933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.858024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.858048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.858151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.858267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.858291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.858421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.858509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.858539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.858647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.858773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.858798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.858930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.859017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.859042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.859134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.859255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.859279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.859389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.859480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.859504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.859641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.859735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.859759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.859870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.859968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.859991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.860091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.860183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.860207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.860335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.860463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.860488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.860599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.860719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.860743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.860871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.860964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.860988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.861080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.861169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.861193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.861314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.861403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.861428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.861568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.861692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.861716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.861840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.861961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.861985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.862111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.862217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.862241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.862335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.862460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.862484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.862595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.862717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.862741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.862838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.862968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.862992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.863110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.863236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.863260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.863359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.863455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.863478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.863592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.863685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.863709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.863812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.863935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.863960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.864080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.864178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.603 [2024-11-28 01:25:17.864203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.603 qpair failed and we were unable to recover it. 00:31:03.603 [2024-11-28 01:25:17.864303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.864393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.864416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.864521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.864641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.864666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.864793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.864901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.864925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.865024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.865150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.865174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.865262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.865363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.865391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.865556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.865652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.865676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.865792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.865916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.865940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.866044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.866174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.866198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.866303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.866424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.866447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.866587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.866693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.866716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.866813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.866909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.866933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.867060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.867147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.867171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.867289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.867379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.867404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.867510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.867656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.867681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.867776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.867883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.867907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.868003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.868153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.868177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.868276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.868402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.868426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.868576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.868699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.868724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.868860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.868956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.868980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.869098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.869194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.869218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.869319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.869412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.869436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.869549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.869656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.869679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.869800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.869896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.869921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.870014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.870107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.870133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.870231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.870349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.870373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.870472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.870590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.870616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.870743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.870830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.870855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.870947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.871067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.871090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.604 [2024-11-28 01:25:17.871223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.871320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.604 [2024-11-28 01:25:17.871344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.604 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.871433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.871517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.871546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.871638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.871735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.871759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.871858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.871989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.872013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.872135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.872231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.872255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.872384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.872481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.872505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.872605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.872702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.872726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.872858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.872996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.873021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.873108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.873193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.873217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.873340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.873462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.873486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.873640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.873738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.873763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.873873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.873989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.874014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.874135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.874220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.874244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.874352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.874472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.874497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.874607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.874702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.874728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.874851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.874998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.875023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.875120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.875239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.875263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.875350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.875489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.875517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.875625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.875750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.875773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.875907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.875997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.876022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.876171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.876272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.876296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.876389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.876549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.876574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.876724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.876809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.876834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.876942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.877060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.877085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.877173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.877289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.877313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.877407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.877505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.877556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.877685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.877816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.877840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.877943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.878035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.878063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.878188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.878285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.878309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.605 qpair failed and we were unable to recover it. 00:31:03.605 [2024-11-28 01:25:17.878435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.878554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.605 [2024-11-28 01:25:17.878578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.878718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.878813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.878837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.878934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.879020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.879044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.879141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.879240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.879264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.879365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.879455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.879480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.879613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.879739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.879763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.879873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.879992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.880017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.880113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.880207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.880231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.880337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.880432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.880456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.880571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.880676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.880700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.880799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.880922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.880946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.881076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.881203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.881227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.881316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.881413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.881436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.881562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.881654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.881678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.881778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.881905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.881928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.882021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.882144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.882169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.882274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.882399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.882423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.882560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.882664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.882688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.882806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.882896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.882919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.883026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.883142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.883173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.883293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.883420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.883444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.883544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.883644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.883670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.883759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.883847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.883872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.883971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.884067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.884092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.884193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.884292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.884316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.884414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.884548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.884573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.884692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.884788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.884811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.884929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.885052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.885076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.885174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.885266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.885289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.606 qpair failed and we were unable to recover it. 00:31:03.606 [2024-11-28 01:25:17.885388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.606 [2024-11-28 01:25:17.885494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.885518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.885624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.885720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.885744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.885834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.885928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.885953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.886103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.886194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.886218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.886305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.886405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.886430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.886590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.886718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.886743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.886849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.886970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.886995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.887121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.887247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.887272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.887378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.887489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.887515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.887648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.887740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.887765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.887862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.887961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.887990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.888095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.888210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.888235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.888331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.888460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.888484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.888683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.888811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.888835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.888942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.889064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.889089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.889176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.889293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.889317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.889442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.889570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.889595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.889726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.889852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.889876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.889977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.890105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.890130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.890234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.890330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.890356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.890446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.890552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.890593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.890753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.890863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.890887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.890983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.891128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.891153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.891282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.891372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.607 [2024-11-28 01:25:17.891396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.607 qpair failed and we were unable to recover it. 00:31:03.607 [2024-11-28 01:25:17.891556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.891653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.891678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.891777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.891913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.891937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.892032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.892151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.892176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.892266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.892355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.892379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.892481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.892619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.892645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.892736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.892873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.892897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.893023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.893112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.893137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.893237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.893334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.893360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.893480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.893572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.893597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.893699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.893793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.893817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.893912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.894004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.894029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.894126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.894222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.894246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.894369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.894469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.894493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.894588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.894715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.894740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.894865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.894954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.894978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.895075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.895198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.895222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.895323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.895467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.895493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.895608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.895705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.895730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.895852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.895955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.895979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.896076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.896225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.896249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.896338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.896462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.896487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.896616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.896721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.896746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.896848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.896970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.896995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.897088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.897184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.897208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.897329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.897427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.897451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.897587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.897705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.897730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.897854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.897947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.897973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.608 [2024-11-28 01:25:17.898105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.898238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.608 [2024-11-28 01:25:17.898264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.608 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.898394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.898490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.898515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.898634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.898732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.898756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.898884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.898977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.899002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.899098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.899191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.899216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.899343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.899460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.899484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.899588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.899737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.899761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.899881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.900000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.900025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.900116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.900243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.900277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.900430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.900556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.900591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.900712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.900836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.900865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.900997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.901094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.901118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.901221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.901346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.901371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.901467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.901575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.901601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.901708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.901861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.901886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.901986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.902083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.902108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.902228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.902376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.902401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.902502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.902630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.902655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.902774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.902867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.902893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.902993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.903085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.903110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.903206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.903326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.903351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.903477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.903604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.903630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.903724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.903822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.903847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.903938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.904064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.904088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.904210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.904331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.904356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.904449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.904582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.904607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.904708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.904836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.904861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.904989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.905110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.905135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.905230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.905320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.609 [2024-11-28 01:25:17.905345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.609 qpair failed and we were unable to recover it. 00:31:03.609 [2024-11-28 01:25:17.905437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.905561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.905586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.905680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.905769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.905794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.905935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.906061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.906085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.906182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.906302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.906326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.906429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.906557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.906583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.906680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.906780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.906804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.906922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.907072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.907097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.907192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.907311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.907336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.907424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.907553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.907578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.907681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.907776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.907801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.907889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.907982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.908005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.908100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.908194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.908217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.908348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.908446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.908471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.908584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.908683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.908708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.908829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.908925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.908949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.909056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.909181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.909206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.909304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.909425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.909449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.909601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.909751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.909775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.909881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.909977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.910002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.910091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.910178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.910201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.910298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.910401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.910426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.910538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.910641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.910665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.910760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.910888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.910920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.911015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.911107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.911131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.911221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.911312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.911335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.911431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.911564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.911589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.911691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.911799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.911824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.911947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.912049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.912074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.610 [2024-11-28 01:25:17.912162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.912257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.610 [2024-11-28 01:25:17.912281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.610 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.912405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.912501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.912530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.912650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.912752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.912776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.912906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.913029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.913053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.913153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.913279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.913308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.913430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.913521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.913570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.913683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.913780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.913804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.913925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.914104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.914129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.914264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.914384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.914408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.914542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.914639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.914665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.914751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.914844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.914868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.915028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.915121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.915146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.915296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.915390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.915415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.915542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.915632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.915656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.915758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.915851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.915874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.915973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.916093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.916117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.916212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.916359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.916383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.916510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.916647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.916671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.916825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.916949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.916974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.917095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.917192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.917217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.917320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.917422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.917447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.917560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.917660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.917685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.917803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.917900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.917924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.918017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.918107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.918131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.918222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.918312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.918337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.918447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.918541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.611 [2024-11-28 01:25:17.918566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.611 qpair failed and we were unable to recover it. 00:31:03.611 [2024-11-28 01:25:17.918664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.918790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.918814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.918904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.919027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.919052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.919152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.919251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.919276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.919427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.919518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.919548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.919637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.919761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.919786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.919871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.919960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.919984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.920115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.920211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.920235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.920361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.920460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.920486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.920615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.920724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.920748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.920847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.920945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.920970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.921076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.921175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.921199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.921322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.921449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.921474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.921593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.921688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.921713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.921839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.921958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.921983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.922138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.922261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.922286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.922431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.922530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.922557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.922689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.922788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.922814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.922913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.923010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.923035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.923132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.923261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.923285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.923388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.923476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.923505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.923604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.923697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.923722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.923820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.923910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.923935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.924032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.924125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.924149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.924279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.924398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.924423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.924528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.924680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.924705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.924801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.924887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.924912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.925005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.925106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.925131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.925223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.925347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.925372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.612 qpair failed and we were unable to recover it. 00:31:03.612 [2024-11-28 01:25:17.925469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.612 [2024-11-28 01:25:17.925588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.925613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.925707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.925798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.925823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.925926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.926076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.926100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.926205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.926331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.926356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.926481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.926573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.926597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.926692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.926820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.926844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.926941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.927066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.927091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.927216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.927310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.927335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.927429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.927528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.927553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.927654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.927776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.927801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.927913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.928032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.928056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.928158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.928253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.928278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.928402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.928490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.928515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.928626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.928751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.928776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.928873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.928998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.929023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.929125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.929216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.929240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.929326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.929462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.929485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.929610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.929713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.929737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.929830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.929947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.929972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.930069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.930166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.930191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.930297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.930422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.930447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.930553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.930678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.930703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.930828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.930928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.930952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.931046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.931136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.931159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.931279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.931373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.931398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.931483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.931605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.931631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.931731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.931824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.931849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.931941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.932064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.932089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.932175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.932265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.613 [2024-11-28 01:25:17.932288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.613 qpair failed and we were unable to recover it. 00:31:03.613 [2024-11-28 01:25:17.932417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.932518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.932547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.932672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.932772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.932796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.932921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.933018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.933042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.933140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.933267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.933292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.933414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.933540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.933566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.933694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.933820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.933844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.933971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.934066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.934090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.934211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.934308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.934332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.934448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.934573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.934598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.934724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.934823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.934849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.934968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.935067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.935092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.935211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.935331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.935355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.935446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.935534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.935560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.935653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.935744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.935774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.935904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.936027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.936052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.936170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.936265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.936289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.936394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.936497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.936521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.936641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.936747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.936772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.936868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.936953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.936978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.937096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.937222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.937247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.937341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.937437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.937462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.937570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.937659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.937684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.937780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.937879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.937903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.937997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.938120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.938144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.938247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.938374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.938398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.938491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.938623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.938647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.938735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.938849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.938874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.938974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.939070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.939095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.614 qpair failed and we were unable to recover it. 00:31:03.614 [2024-11-28 01:25:17.939196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.939346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.614 [2024-11-28 01:25:17.939371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.939495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.939599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.939625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.939748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.939833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.939857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.939944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.940043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.940067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.940162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.940248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.940273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.940403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.940518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.940548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.940650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.940772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.940796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.940886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.940972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.940997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.941103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.941199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.941225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.941330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.941434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.941459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.941586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.941694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.941718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.941852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.942003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.942027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.942149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.942246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.942271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.942360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.942488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.942512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.942618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.942708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.942733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.942830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.942913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.942938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.943029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.943136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.943160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.943246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.943361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.943384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.943515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.943649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.943675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.943805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.943932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.943956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.944057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.944159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.944183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.944281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.944426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.944451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.944546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.944651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.944675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.944770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.944888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.944913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.945011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.945160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.945184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.945312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.945401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.945426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.945517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.945643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.945672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.945767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.945899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.945923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.946027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.946118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.946142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.615 qpair failed and we were unable to recover it. 00:31:03.615 [2024-11-28 01:25:17.946262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.615 [2024-11-28 01:25:17.946381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.946405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.946505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.946610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.946635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.946754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.946887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.946911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.947010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.947136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.947160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.947288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.947384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.947407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.947509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.947645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.947669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.947760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.947847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.947871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.947974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.948064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.948088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.948198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.948346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.948370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.948490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.948586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.948611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.948703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.948819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.948844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.948937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.949031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.949055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.949157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.949317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.949342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.949438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.949579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.949604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.949696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.949812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.949836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.949925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.950051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.950076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.950164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.950288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.950313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.950420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.950512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.950541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.950653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.950748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.950772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.950877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.950992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.951017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.951110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.951201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.951225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.951321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.951442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.951467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.951589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.951697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.951721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.951817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.951935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.951960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.952060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.952181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.952206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.616 [2024-11-28 01:25:17.952311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.952432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.616 [2024-11-28 01:25:17.952457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.616 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.952553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.952645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.952670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.952774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.952881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.952905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.952998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.953091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.953116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.953237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.953331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.953356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.953449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.953542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.953567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.953699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.953816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.953841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.953935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.954055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.954080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.954169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.954259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.954284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.954415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.954535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.954561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.954671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.954757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.954781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.954897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.954996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.955021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.955145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.955265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.955290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.955381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.955470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.955494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.955602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.955731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.955756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.955882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.955981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.956006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.956126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.956222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.956247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.956348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.956475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.956500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.956614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.956716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.956741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.956830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.956949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.956973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.957073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.957201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.957226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.957318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.957452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.957476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.957605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.957695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.957720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.957818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.957972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.958014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.958110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.958235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.958259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.958387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.958485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.958510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.958611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.958702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.958727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.958850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.958945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.958970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.959084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.959174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.959198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.617 qpair failed and we were unable to recover it. 00:31:03.617 [2024-11-28 01:25:17.959293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.959410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.617 [2024-11-28 01:25:17.959434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.959535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.959625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.959649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.959739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.959861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.959886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.959990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.960111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.960136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.960268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.960358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.960382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.960535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.960632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.960657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.960779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.960897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.960922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.961045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.961146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.961170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.961317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.961418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.961443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.961572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.961690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.961715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.961820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.961966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.961991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.962092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.962198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.962223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.962345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.962439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.962463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.962588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.962687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.962711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.962807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.962932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.962956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.963091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.963211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.963236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.963329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.963431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.963457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.963559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.963657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.963682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.963831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.963917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.963941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.964046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.964136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.964160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.964254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.964375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.964399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.964490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.964591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.964617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.964717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.964809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.964834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.964930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.965052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.965076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.965163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.965290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.965314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.965413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.965510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.965542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.965644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.965743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.965768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.965865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.965990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.966015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.966110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.966232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.966257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.618 qpair failed and we were unable to recover it. 00:31:03.618 [2024-11-28 01:25:17.966354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.618 [2024-11-28 01:25:17.966454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.966479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.966606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.966698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.966724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.966828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.966923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.966947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.967037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.967130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.967154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.967274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.967366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.967390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.967515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.967610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.967635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.967763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.967894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.967918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.968005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.968099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.968123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.968208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.968303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.968328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.968418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.968564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.968591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.968686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.968803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.968827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.968922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.969073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.969097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.969228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.969351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.969375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.969469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.969552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.969578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.969701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.969792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.969817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.969949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.970043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.970067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.970193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.970324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.970352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.970477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.970607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.970632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.970755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.970873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.970897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.971006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.971097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.971121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.971245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.971342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.971368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.971465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.971565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.971590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.971692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.971794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.971818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.971915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.972032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.972057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.972147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.972241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.972265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.972393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.972480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.972504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.972613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.972739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.972763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.972868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.972953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.972978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.973067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.973217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.973242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.619 qpair failed and we were unable to recover it. 00:31:03.619 [2024-11-28 01:25:17.973369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.619 [2024-11-28 01:25:17.973485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.973509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.973623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.973722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.973747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.973843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.973966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.973991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.974087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.974211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.974235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.974326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.974473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.974498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.974592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.974689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.974715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.974809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.974962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.974987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.975082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.975190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.975215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.975308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.975437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.975462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.975569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.975659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.975684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.975780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.975906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.975930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.976040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.976168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.976193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.976324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.976450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.976475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.976587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.976693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.976718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.976853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.976958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.976983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.977105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.977227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.977251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.977380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.977469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.977494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.977623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.977728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.977753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.977861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.977958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.977983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.978081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.978188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.978212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.978315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.978401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.978426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.978533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.978632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.978658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.978787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.978879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.978905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.979005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.979131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.979156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.979253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.979376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.979401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.979498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.979601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.979626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.979724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.979846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.979870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.979996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.980119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.980144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.620 [2024-11-28 01:25:17.980270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.980364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.620 [2024-11-28 01:25:17.980393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.620 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.980494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.980613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.980639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.980747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.980859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.980882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.980986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.981081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.981105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.981230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.981349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.981373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.981466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.981598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.981623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.981746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.981848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.981872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.981993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.982086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.982110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.982240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.982339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.982364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.982464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.982594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.982620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.982710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.982805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.982829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.982930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.983051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.983076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.983176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.983263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.983287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.983434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.983532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.983558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.983650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.983747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.983771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.983876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.983994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.984017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.984139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.984281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.984306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.984423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.984552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.984577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.984669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.984808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.984832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.984930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.985059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.985083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.985184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.985309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.985334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.985436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.985569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.985596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.985698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.985794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.985818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.985943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.986038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.986061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.986187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.986305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.986329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.986457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.986590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.621 [2024-11-28 01:25:17.986615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.621 qpair failed and we were unable to recover it. 00:31:03.621 [2024-11-28 01:25:17.986717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.986812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.986836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.986947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.987072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.987095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.987198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.987325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.987350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.987447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.987583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.987609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.987706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.987828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.987852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.987968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.988098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.988123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.988225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.988318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.988343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.988474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.988563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.988589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.988710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.988814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.988839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.988938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.989065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.989090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.989192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.989317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.989342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.989475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.989583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.989609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.989703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.989831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.989856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.989949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.990066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.990091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.990215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.990345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.990369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.990494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.990596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.990622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.990726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.990815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.990839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.990938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.991059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.991083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.991184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.991273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.991298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.991401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.991488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.991513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.991633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.991760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.991785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.991883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.992012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.992036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.992133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.992258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.992283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.992384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.992510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.992541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.992643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.992767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.992791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.992914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.993011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.993040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.993129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.993253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.993278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.993405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.993536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.993561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.993656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.993752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.622 [2024-11-28 01:25:17.993778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.622 qpair failed and we were unable to recover it. 00:31:03.622 [2024-11-28 01:25:17.993884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.994009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.994034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.994161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.994286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.994310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.994408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.994522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.994554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.994653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.994776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.994800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.994889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.994975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.994999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.995122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.995246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.995270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.995424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.995553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.995588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.995686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.995779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.995804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.995902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.996023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.996047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.996145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.996273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.996298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.996414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.996509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.996539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.996637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.996731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.996756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.996849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.996976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.997000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.997097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.997191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.997215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.997333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.997450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.997474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.997604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.997708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.997733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.997825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.997945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.997969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.998094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.998190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.998215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.998336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.998430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.998455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.998578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.998690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.998715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.998819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.998918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.998944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.999065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.999192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.999217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.999316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.999438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.999462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.999560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.999666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.999690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:17.999779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.999871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:17.999895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:18.000013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:18.000131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:18.000156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:18.000275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:18.000370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:18.000395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:18.000500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:18.000606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:18.000632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.623 qpair failed and we were unable to recover it. 00:31:03.623 [2024-11-28 01:25:18.000785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:18.000910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.623 [2024-11-28 01:25:18.000935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.001035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.001121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.001146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.001230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.001318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.001344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.001448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.001566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.001592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.001693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.001787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.001812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.001936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.002024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.002049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.002148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.002266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.002290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.002388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.002483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.002508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.002640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.002760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.002785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.002889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.002989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.003014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.003114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.003207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.003232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.003354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.003502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.003533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.003631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.003752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.003777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.003903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.004024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.004048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.004147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.004272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.004297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.004388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.004476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.004500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.004609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.004734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.004758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.004856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.004954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.004979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.005099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.005221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.005247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.005366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.005460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.005489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.005618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.005747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.005772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.005861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.005955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.005980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.006106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.006205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.006230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.006333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.006460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.006485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.006604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.006732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.006756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.006848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.006955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.006980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.007082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.007175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.007199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.007357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.007458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.007483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.007608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.007705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.007730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.624 qpair failed and we were unable to recover it. 00:31:03.624 [2024-11-28 01:25:18.007830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.624 [2024-11-28 01:25:18.007979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.008003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.008135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.008228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.008252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.008347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.008434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.008459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.008613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.008712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.008736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.008837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.008934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.008958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.009080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.009204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.009228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.009318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.009444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.009469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.009562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.009663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.009688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.009807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.009893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.009918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.010043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.010141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.010166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.010316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.010440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.010464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.010570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.010694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.010719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.010841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.010936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.010961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.011059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.011186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.011212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.011309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.011433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.011457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.011585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.011678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.011703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.011829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.011920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.011944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.012049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.012169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.012193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.012292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.012381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.012406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.012536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.012654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.012679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.012783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.012936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.012960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.013054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.013162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.013187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.013275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.013379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.013403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.013503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.013603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.013628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.013759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.013884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.013908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.625 [2024-11-28 01:25:18.014012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.014102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.625 [2024-11-28 01:25:18.014127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.625 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.014255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.014375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.014400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.014545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.014657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.014682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.014778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.014868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.014893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.014994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.015122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.015146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.015249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.015367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.015392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.015479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.015571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.015601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.015700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.015824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.015848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.015950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.016099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.016123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.016212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.016336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.016360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.016453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.016560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.016586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.016724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.016814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.016838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.016942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.017070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.017095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.017187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.017283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.017309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.017441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.017542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.017568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.017671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.017794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.017819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.017917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.018039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.018063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.018165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.018289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.018313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.018411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.018501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.018530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.018637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.018736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.018762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.018891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.018989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.019015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.019110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.019203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.019228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.019319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.019420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.019444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.019567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.019654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.019679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.019780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.019869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.019895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.019986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.020079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.020104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.020235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.020351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.020376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.020468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.020568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.020593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.020694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.020782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.020807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.626 qpair failed and we were unable to recover it. 00:31:03.626 [2024-11-28 01:25:18.020907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.626 [2024-11-28 01:25:18.020995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.021020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.021141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.021231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.021256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.021343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.021465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.021489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.021594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.021712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.021736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.021838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.021932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.021956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.022075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.022171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.022195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.022314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.022436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.022460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.022547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.022666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.022691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.022802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.022905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.022929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.023033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.023154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.023178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.023269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.023390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.023415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.023505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.023602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.023627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.023725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.023845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.023869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.023970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.024064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.024089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.024240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.024354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.024378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.024499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.024619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.024644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.024743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.024871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.024896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.024989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.025074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.025099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.025189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.025282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.025306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.025396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.025546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.025572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.025669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.025761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.025786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.025915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.026016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.026041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.026135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.026257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.026281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.026375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.026473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.026497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.026606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.026703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.026729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.026827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.026921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.026946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.027064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.027156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.027181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.027270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.027388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.027412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.027504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.027608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.627 [2024-11-28 01:25:18.027637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.627 qpair failed and we were unable to recover it. 00:31:03.627 [2024-11-28 01:25:18.027739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.027841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.027866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.027990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.028083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.028108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.028207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.028292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.028316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.028411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.028552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.028578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.028678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.028797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.028822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.028914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.029032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.029056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.029160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.029264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.029290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.029376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.029530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.029555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.029652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.029773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.029798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.029922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.030041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.030065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.030198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.030319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.030343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.030437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.030543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.030569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.030667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.030765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.030790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.030913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.031036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.031061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.031155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.031273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.031297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.031397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.031506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.031536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.031629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.031713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.031738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.031845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.031939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.031964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.032083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.032233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.032257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.032351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.032499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.032523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.032631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.032727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.032751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.032845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.032969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.032995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.033095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.033199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.033224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.033348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.033447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.033472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.033603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.033700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.033725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.033819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.033904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.033928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.034056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.034190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.034215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.034300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.034396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.034421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.628 [2024-11-28 01:25:18.034547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.034644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.628 [2024-11-28 01:25:18.034669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.628 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.034769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.034892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.034916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.035044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.035142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.035168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.035292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.035415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.035440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.035546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.035649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.035674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.035802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.035922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.035946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.036077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.036167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.036191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.036283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.036401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.036426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.036532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.036629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.036654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.036750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.036901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.036925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.037028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.037149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.037174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.037274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.037432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.037457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.037569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.037672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.037696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.037804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.037897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.037921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.038015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.038111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.038135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.038224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.038346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.038370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.038465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.038558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.038584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.038684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.038780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.038805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.038912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.039037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.039061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.039163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.039254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.039278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.039376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.039472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.039497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.039606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.039723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.039748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.039851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.039953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.039983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.040110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.040215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.040239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.040338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.040436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.040462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.040566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.040687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.040712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.040808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.040962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.040986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.041079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.041175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.041199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.041320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.041419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.041444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.629 qpair failed and we were unable to recover it. 00:31:03.629 [2024-11-28 01:25:18.041542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.629 [2024-11-28 01:25:18.041665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.041690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.041783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.041905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.041930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.042020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.042139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.042164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.042320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.042423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.042448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.042577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.042682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.042707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.042814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.042911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.042935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.043054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.043156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.043180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.043281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.043376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.043402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.043498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.043624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.043649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.043751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.043844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.043869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.043970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.044095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.044119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.044228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.044353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.044378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.044473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.044595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.044620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.044715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.044847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.044872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.044968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.045088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.045113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.045235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.045321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.045346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.045443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.045569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.045594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.045691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.045794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.045819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.045919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.046010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.046034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.046148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.046275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.046302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.046435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.046563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.046589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.046690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.046789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.046813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.046940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.047066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.047090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.047181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.047277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.047301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.047390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.047486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.047510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.047607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.047728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.630 [2024-11-28 01:25:18.047753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.630 qpair failed and we were unable to recover it. 00:31:03.630 [2024-11-28 01:25:18.047877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.048030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.048054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.048154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.048271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.048296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.048389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.048513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.048543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.048654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.048777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.048802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.048891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.048983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.049008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.049139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.049224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.049248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.049339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.049433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.049459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.049581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.049675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.049700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.049831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.049925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.049953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.050072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.050172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.050197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.050312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.050434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.050459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.050586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.050709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.050734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.050859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.050961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.050986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.051113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.051206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.051231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.051335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.051455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.051479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.051576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.051672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.051697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.051799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.051929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.051953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.052057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.052146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.052170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.052271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.052423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.052448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.052580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.052679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.052704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.052854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.052951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.052976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.053082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.053172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.053197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.053358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.053454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.053479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.053575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.053669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.053693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.053794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.053917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.053942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.054040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.054158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.054182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.054272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.054400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.054425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.054551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.054653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.054677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.631 [2024-11-28 01:25:18.054769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.054893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.631 [2024-11-28 01:25:18.054918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.631 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.055052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.055180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.055204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.055300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.055421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.055446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.055545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.055642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.055667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.055786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.055913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.055938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.056025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.056151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.056176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.056283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.056378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.056402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.056563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.056648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.056673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.056766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.056864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.056888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.056982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.057070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.057094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.057217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.057313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.057338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.057438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.057547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.057573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.057672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.057789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.057814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.057910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.058005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.058030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.058149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.058279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.058304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.058397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.058499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.058530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.058634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.058755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.058780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.058871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.058964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.058988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.059089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.059188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.059212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.059340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.059466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.059491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.059600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.059691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.059716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.059842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.059942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.059967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.060067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.060171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.060196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.060293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.060419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.060444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.060538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.060625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.060650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.060752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.060869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.060893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.060988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.061088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.061114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.061218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.061314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.061338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.061437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.061534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.061559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.632 qpair failed and we were unable to recover it. 00:31:03.632 [2024-11-28 01:25:18.061660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.632 [2024-11-28 01:25:18.061756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.061781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.061884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.061974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.061999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.062127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.062230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.062259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.062353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.062473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.062497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.062630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.062732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.062757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.062854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.063005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.063029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.063133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.063250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.063275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.063365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.063465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.063490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.063603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.063703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.063727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.063847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.063941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.063966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.064103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.064190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.064215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.064340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.064464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.064489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.064595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.064713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.064738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.064866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.064982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.065006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.065131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.065223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.065248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.065340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.065460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.065485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.065597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.065694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.065719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.065821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.065918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.065942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.066070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.066193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.066217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.066322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.066414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.066439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.066544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.066643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.066668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.066774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.066863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.066887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.066974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.067078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.067102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.067198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.067294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.067318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.067439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.067541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.067567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.067661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.067760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.067785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.067906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.068006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.068033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.068127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.068257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.068282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.068384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.068509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.068539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.633 qpair failed and we were unable to recover it. 00:31:03.633 [2024-11-28 01:25:18.068660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.633 [2024-11-28 01:25:18.068760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.068785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.068875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.068972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.068996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.069089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.069208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.069232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.069331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.069451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.069475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.069577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.069681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.069706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.069800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.069897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.069922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.070041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.070128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.070153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.070254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.070353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.070377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.070498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.070630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.070656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.070779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.070903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.070928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.071051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.071153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.071177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.071273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.071376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.071401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.071502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.071606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.071631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.071731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.071856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.071881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.072008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.072102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.072127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.072253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.072353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.072378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.072480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.072606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.072631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.072733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.072830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.072855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.072983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.073070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.073095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.073242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.073332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.073356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.073457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.073575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.073600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.073701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.073788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.073812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.073960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.074063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.074087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.074178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.074275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.074300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.074395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.074530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.074560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.634 qpair failed and we were unable to recover it. 00:31:03.634 [2024-11-28 01:25:18.074687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.634 [2024-11-28 01:25:18.074782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.074807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.074928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.075022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.075047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.075143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.075237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.075262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.075349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.075467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.075492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.075594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.075687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.075711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.075810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.075938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.075962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.076082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.076178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.076203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.076299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.076428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.076453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.076556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.076675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.076699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.076826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.076921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.076947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.077082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.077207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.077231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.077327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.077420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.077444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.077567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.077692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.077717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.077841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.077935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.077959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.078058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.078152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.078178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.078316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.078437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.078462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.078583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.078681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.078706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.078810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.078903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.078929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.079031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.079121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.079146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.079233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.079329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.079354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.079489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.079588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.079614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.079738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.079835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.079859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.079951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.080044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.080068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.080188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.080307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.080332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.080462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.080589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.080615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.080709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.080803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.080828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.080939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.081039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.081064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.081193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.081309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.081334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.081451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.081547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.635 [2024-11-28 01:25:18.081573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.635 qpair failed and we were unable to recover it. 00:31:03.635 [2024-11-28 01:25:18.081674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.081758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.081782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.081880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.081975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.082000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.082087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.082212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.082237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.082362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.082460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.082484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.082580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.082675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.082701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.082831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.082924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.082949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.083039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.083143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.083167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.083261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.083360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.083387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.083492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.083605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.083630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.083756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.083856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.083882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.084014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.084099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.084124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.084220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.084319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.084348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.084441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.084532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.084557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.084649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.084796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.084820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.084924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.085019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.085043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.085144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.085248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.085272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.085372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.085475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.085501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.085639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.085740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.085766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.085918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.086006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.086031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.086127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.086252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.086277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.086382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.086506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.086562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.086665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.086791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.086816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.086949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.087047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.087072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.087162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.087289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.087314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.087406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.087500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.087531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.087650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.087799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.087824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.087921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.088021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.088049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.088147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.088275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.088300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.636 [2024-11-28 01:25:18.088391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.088510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.636 [2024-11-28 01:25:18.088541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.636 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.088637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.088728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.088752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.088883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.089001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.089026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.089187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.089279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.089303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.089413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.089508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.089539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.089640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.089733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.089758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.089852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.089971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.089995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.090094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.090211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.090236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.090330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.090479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.090503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.090603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.090735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.090760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.090864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.090959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.090984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.091088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.091187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.091212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.091336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.091466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.091490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.091621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.091717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.091741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.091835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.091954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.091979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.092080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.092229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.092254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.092349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.092448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.092473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.092577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.092679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.092704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.092801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.092894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.092918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.093010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.093109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.093133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.093256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.093355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.093379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.093507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.093614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.093639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.093738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.093855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.093880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.093976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.094072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.094097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.094192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.094293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.094318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.094408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.094507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.094537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.094647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.094738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.094763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.094890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.094985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.095011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.095107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.095204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.095229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.637 qpair failed and we were unable to recover it. 00:31:03.637 [2024-11-28 01:25:18.095328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.095480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.637 [2024-11-28 01:25:18.095504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.095636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.095751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.095776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.095926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.096024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.096049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.096139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.096238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.096264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.096370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.096470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.096495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.096608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.096762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.096793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.096933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.097026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.097051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.097180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.097272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.097297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.097394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.097513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.097544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.097675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.097778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.097803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.097940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.098030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.098054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.098189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.098282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.098307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.098407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.098581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.098616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.098746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.098847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.098872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.098995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.099088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.099113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.099211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.099334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.099359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.099464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.099588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.099614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.099712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.099859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.099884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.100004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.100142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.100166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.100259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.100389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.100413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.100509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.100610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.100635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.100736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.100842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.100868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.100968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.101092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.101117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.101244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.101365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.101390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.101492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.101618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.101643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.101742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.101865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.101890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.102017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.102138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.102162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.102250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.102347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.102372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.102499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.102650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.102676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.638 qpair failed and we were unable to recover it. 00:31:03.638 [2024-11-28 01:25:18.102794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.638 [2024-11-28 01:25:18.102913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.102937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.103035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.103157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.103181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.103280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.103367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.103391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.103492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.103597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.103622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.103717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.103869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.103894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.103997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.104095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.104120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.104243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.104334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.104359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.104464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.104559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.104585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.104680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.104773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.104798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.104905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.104995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.105020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.105111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.105213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.105238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.105330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.105425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.105450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.105587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.105696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.105720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.105823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.105973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.105998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.106119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.106207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.106231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.106330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.106429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.106454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.106561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.106658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.106683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.106807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.106930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.106955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.107052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.107199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.107224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.107321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.107415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.107439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.107567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.107674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.107699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.107792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.107895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.107919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.108011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.108111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.108136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.108232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.108325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.108349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.108470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.108597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.108622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.639 [2024-11-28 01:25:18.108751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.108845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.639 [2024-11-28 01:25:18.108870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.639 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.108967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.109086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.109110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.109199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.109335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.109364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.109471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.109567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.109592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.109712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.109801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.109834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.109971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.110089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.110113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.110222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.110324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.110350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.110468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.110566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.110592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.110690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.110783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.110808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.110925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.111046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.111071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.111208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.111335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.111359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.111479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.111603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.111628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.111723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.111842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.111867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.111962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.112085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.112111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.112213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.112302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.112327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.112417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.112539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.112565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.112662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.112760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.112785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.112909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.113011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.113037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.113140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.113225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.113250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.113348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.113449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.113473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.113593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.113686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.113710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.113802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.113899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.113924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.114017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.114115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.114139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.114239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.114327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.114352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.114473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.114575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.114601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.114733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.114852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.114876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.114977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.115103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.115128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.115223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.115316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.115341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.115430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.115522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.115553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.640 qpair failed and we were unable to recover it. 00:31:03.640 [2024-11-28 01:25:18.115648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.115745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.640 [2024-11-28 01:25:18.115771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.115869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.115993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.116018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.116146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.116239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.116264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.116397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.116529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.116555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.116684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.116818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.116843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.116939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.117028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.117053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.117142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.117270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.117295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.117496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.117627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.117652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.117771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.117860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.117885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.117989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.118082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.118107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.118209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.118302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.118327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.118441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.118552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.118578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.118678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.118773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.118798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.118930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.119028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.119053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.119148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.119238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.119267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.119357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.119556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.119582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.119682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.119779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.119804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.119952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.120042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.120067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.120170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.120297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.120321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.120417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.120506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.120537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.120739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.120868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.120893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.121016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.121111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.121135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.121239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.121333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.121358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.121495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.121625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.121650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.121784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.121900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.121925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.122032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.122133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.122157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.122250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.122372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.122397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.122515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.122667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.122693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.122796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.122923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.122948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.641 qpair failed and we were unable to recover it. 00:31:03.641 [2024-11-28 01:25:18.123050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.641 [2024-11-28 01:25:18.123154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.123178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.123383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.123505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.123537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.123668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.123760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.123785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.123912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.124016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.124041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.124137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.124227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.124251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.124377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.124480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.124504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.124605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.124725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.124750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.124845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.124969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.124995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.125090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.125237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.125262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.125364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.125485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.125510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.125614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.125817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.125841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.125939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.126069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.126094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.126187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.126287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.126312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.126417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.126516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.126548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.126645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.126749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.126773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.126868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.126972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.126996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.127119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.127212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.127238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.127341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.127460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.127484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.127586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.127787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.127811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.127941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.128037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.128061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.128263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.128352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.128377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.128537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.128636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.128660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.128749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.128845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.128870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.128961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.129086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.129110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.129205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.129308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.129333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.129435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.129536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.129562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.129655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.129783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.129809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.129903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.130032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.130056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.130163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.130253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.130277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.642 qpair failed and we were unable to recover it. 00:31:03.642 [2024-11-28 01:25:18.130373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.642 [2024-11-28 01:25:18.130497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.130521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.130654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.130743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.130767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.130858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.130951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.130975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.131075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.131167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.131192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.131281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.131401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.131426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.131555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.131658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.131684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.131784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.131912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.131937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.132068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.132183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.132212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.132311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.132448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.132473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.132567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.132689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.132714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.132805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.132910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.132935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.133061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.133181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.133205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.133289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.133408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.133432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.133552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.133646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.133673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.133806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.133905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.133931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.134033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.134187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.134212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.134349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.134453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.134477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.134572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.134710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.134735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.134867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.134958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.134983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.135112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.135236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.135261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.135355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.135470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.135495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.135630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.135755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.135780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.135935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.136053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.136077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.136172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.136270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.136294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.136416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.136536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.136562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.136714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.136803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.136827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.136947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.137067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.137092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.137189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.137275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.137300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.137406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.137534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.643 [2024-11-28 01:25:18.137559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.643 qpair failed and we were unable to recover it. 00:31:03.643 [2024-11-28 01:25:18.137656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.137753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.137778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.137905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.138031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.138055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.138152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.138244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.138268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.138361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.138487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.138512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.138633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.138759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.138784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.138880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.138975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.138999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.139118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.139243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.139267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.139470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.139574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.139599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.139689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.139804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.139829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.139960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.140057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.140081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.140178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.140300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.140325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.140422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.140516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.140548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.140668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.140763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.140787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.140885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.141015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.141039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.141170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.141268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.141292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.141412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.141499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.141531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.141664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.141758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.141782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.141880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.142008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.142033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.142135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.142237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.142261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.142386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.142491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.142516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.142618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.142739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.142765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.142867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.142965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.142991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.143115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.143240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.143264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.143359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.143479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.143504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.143637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.143736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.644 [2024-11-28 01:25:18.143761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.644 qpair failed and we were unable to recover it. 00:31:03.644 [2024-11-28 01:25:18.143864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.143984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.144010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.144109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.144228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.144253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.144374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.144467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.144492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.144593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.144693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.144718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.144806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.144935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.144964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.145060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.145184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.145209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.145306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.145402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.145427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.145550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.145657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.145682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.145818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.145922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.145947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.146067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.146170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.146195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.146299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.146417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.146452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.146557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.146660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.146686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.146791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.146911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.146937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.147028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.147123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.147148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.147248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.147364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.147389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.147492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.147635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.147661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.147786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.147883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.147908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.148058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.148149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.148174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.148270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.148392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.148417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.148509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.148620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.148645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.148795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.148881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.148906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.149008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.149136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.149161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.149283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.149378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.149403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.149494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.149595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.149620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.149750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.149883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.149908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.150015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.150152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.150176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.150274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.150380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.150405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.150508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.150641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.150667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.645 [2024-11-28 01:25:18.150799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.150892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.645 [2024-11-28 01:25:18.150917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.645 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.151015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.151149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.151175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.151273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.151402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.151427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.151532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.151659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.151683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.151814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.151899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.151924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.152050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.152171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.152196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.152291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.152385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.152410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.152500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.152639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.152664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.152764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.152861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.152886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.152986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.153112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.153137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.153224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.153321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.153353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.153446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.153552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.153577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.153706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.153807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.153840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.153942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.154080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.154104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.154200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.154336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.154361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.154486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.154583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.154610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.154709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.154811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.154836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.154962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.155060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.155089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.155213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.155315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.155339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.155436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.155536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.155561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.155650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.155768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.155793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.155889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.155982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.156006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.156104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.156208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.156233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.156337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.156458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.156484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.156591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.156689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.156714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.156812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.156937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.156963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.157083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.157198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.157223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.157321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.157571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.157597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.157698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.157802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.157826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.646 qpair failed and we were unable to recover it. 00:31:03.646 [2024-11-28 01:25:18.157934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.646 [2024-11-28 01:25:18.158065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.158089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.158211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.158373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.158397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.158491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.158647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.158675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.158799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.158893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.158918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.159012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.159103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.159128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.159219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.159344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.159369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.159488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.159598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.159624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.159724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.159824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.159849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.159996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.160089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.160114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.160213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.160342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.160367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.160530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.160623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.160648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.160747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.160857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.160881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.161022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.161122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.161146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.161245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.161346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.161370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.161461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.161563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.161589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.161715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.161841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.161866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.161963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.162079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.162105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.162202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.162302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.162327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.162452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.162569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.162594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.162685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.162788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.162813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.162933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.163058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.163082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.163183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.163306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.163331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.163451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.163557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.163583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.163685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.163804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.163829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.163926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.164025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.164050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.164144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.164242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.164267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.164366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.164470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.164495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.164611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.164712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.164737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.164830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.164938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.164963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.165059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.165163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.165189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.165306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.165424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.165449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.647 qpair failed and we were unable to recover it. 00:31:03.647 [2024-11-28 01:25:18.165564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.647 [2024-11-28 01:25:18.165660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.165685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.165808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.165910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.165935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.166038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.166130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.166155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.166274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.166375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.166400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.166548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.166672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.166697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.166835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.166973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.166997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.167124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.167252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.167276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.167401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.167517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.167548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.167679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.167778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.167807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.167924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.168075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.168100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.168231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.168318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.168342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.168439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.168544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.168570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.168662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.168750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.168774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.168881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.169008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.169044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.169176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.169306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.169331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.169459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.169565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.169590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.169696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.169792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.169817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.169909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.170009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.170034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.170160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.170260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.170285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.170395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.170486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.170511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.170633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.170786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.170812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.170940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.171061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.171086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.171184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.171304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.171328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.171419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.171515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.171547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.171669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.171771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.171795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.171896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.171982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.172007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.172100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.172191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.172216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.172314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.172423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.172448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.648 qpair failed and we were unable to recover it. 00:31:03.648 [2024-11-28 01:25:18.172576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.648 [2024-11-28 01:25:18.172705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.172730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.649 qpair failed and we were unable to recover it. 00:31:03.649 [2024-11-28 01:25:18.172830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.172923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.172948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.649 qpair failed and we were unable to recover it. 00:31:03.649 [2024-11-28 01:25:18.173038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.173130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.173155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.649 qpair failed and we were unable to recover it. 00:31:03.649 [2024-11-28 01:25:18.173252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.173372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.173396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.649 qpair failed and we were unable to recover it. 00:31:03.649 [2024-11-28 01:25:18.173495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.173624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.173649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.649 qpair failed and we were unable to recover it. 00:31:03.649 [2024-11-28 01:25:18.173748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.173855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.173880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.649 qpair failed and we were unable to recover it. 00:31:03.649 [2024-11-28 01:25:18.173983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.174085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.174110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.649 qpair failed and we were unable to recover it. 00:31:03.649 [2024-11-28 01:25:18.174206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.174299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.174324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.649 qpair failed and we were unable to recover it. 00:31:03.649 [2024-11-28 01:25:18.174416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.174551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.174577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.649 qpair failed and we were unable to recover it. 00:31:03.649 [2024-11-28 01:25:18.174705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.174807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.174831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.649 qpair failed and we were unable to recover it. 00:31:03.649 [2024-11-28 01:25:18.174964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.175060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.175084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.649 qpair failed and we were unable to recover it. 00:31:03.649 [2024-11-28 01:25:18.175231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.175334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.175358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.649 qpair failed and we were unable to recover it. 00:31:03.649 [2024-11-28 01:25:18.175459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.175576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.175603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.649 qpair failed and we were unable to recover it. 00:31:03.649 [2024-11-28 01:25:18.175709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.175809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.175835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.649 qpair failed and we were unable to recover it. 00:31:03.649 [2024-11-28 01:25:18.175932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.176027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.176052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.649 qpair failed and we were unable to recover it. 00:31:03.649 [2024-11-28 01:25:18.176163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.176258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.176284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.649 qpair failed and we were unable to recover it. 00:31:03.649 [2024-11-28 01:25:18.176376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.176503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.176534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.649 qpair failed and we were unable to recover it. 00:31:03.649 [2024-11-28 01:25:18.176631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.176754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.176779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.649 qpair failed and we were unable to recover it. 00:31:03.649 [2024-11-28 01:25:18.176903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.177006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.177031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.649 qpair failed and we were unable to recover it. 00:31:03.649 [2024-11-28 01:25:18.177119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.177210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.649 [2024-11-28 01:25:18.177234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.649 qpair failed and we were unable to recover it. 00:31:03.650 [2024-11-28 01:25:18.177354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.177486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.177521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.650 qpair failed and we were unable to recover it. 00:31:03.650 [2024-11-28 01:25:18.177634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.177738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.177763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.650 qpair failed and we were unable to recover it. 00:31:03.650 [2024-11-28 01:25:18.177860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.177954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.177979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.650 qpair failed and we were unable to recover it. 00:31:03.650 [2024-11-28 01:25:18.178067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.178155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.178179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.650 qpair failed and we were unable to recover it. 00:31:03.650 [2024-11-28 01:25:18.178271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.178393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.178418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.650 qpair failed and we were unable to recover it. 00:31:03.650 [2024-11-28 01:25:18.178560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.178664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.178689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.650 qpair failed and we were unable to recover it. 00:31:03.650 [2024-11-28 01:25:18.178783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.178882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.178906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.650 qpair failed and we were unable to recover it. 00:31:03.650 [2024-11-28 01:25:18.179017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.179114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.179138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.650 qpair failed and we were unable to recover it. 00:31:03.650 [2024-11-28 01:25:18.179237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.179369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.179393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.650 qpair failed and we were unable to recover it. 00:31:03.650 [2024-11-28 01:25:18.179502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.179603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.179628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.650 qpair failed and we were unable to recover it. 00:31:03.650 [2024-11-28 01:25:18.179734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.179827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.650 [2024-11-28 01:25:18.179852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.650 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.179954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.180056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.180085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.180182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.180270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.180295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.180397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.180543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.180576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.180684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.180810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.180835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.180957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.181054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.181079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.181191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.181315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.181340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.181434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.181522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.181553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.181651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.181747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.181772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.181878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.181980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.182005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.182103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.182196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.182228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.182340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.182434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.182459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.182580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.182676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.182702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.182796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.182893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.182918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.183016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.183147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.183171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.183296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.183398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.183423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.183534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.183686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.183711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.183806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.183914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.183938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.184039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.184139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.184163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.184279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.184403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.184430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.184538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.184640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.184665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.184787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.184886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.184911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.185023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.185147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.185171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.185269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.185364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.185389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.185479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.185581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.185607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.934 qpair failed and we were unable to recover it. 00:31:03.934 [2024-11-28 01:25:18.185712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.934 [2024-11-28 01:25:18.185811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.185836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.185931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.186072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.186096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.186211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.186314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.186339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.186468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.186599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.186625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.186728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.186827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.186857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.186952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.187069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.187094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.187216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.187311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.187336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.187426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.187582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.187608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.187761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.187865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.187889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.187980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.188106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.188131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.188232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.188357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.188381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.188477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.188617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.188642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.188737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.188889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.188914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.189034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.189160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.189185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.189336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.189431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.189456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.189557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.189675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.189700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.189808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.189900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.189925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.190052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.190176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.190206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.190297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.190398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.190423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.190516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.190651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.190676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.190780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.190873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.190898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.190985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.191079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.191104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.191193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.191292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.191317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.191413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.191497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.191521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.191629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.191763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.191787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.191932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.192024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.192048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.192143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.192294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.192318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.192409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.192499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.192530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.192631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.192729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.935 [2024-11-28 01:25:18.192753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.935 qpair failed and we were unable to recover it. 00:31:03.935 [2024-11-28 01:25:18.192873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.193007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.193032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.193127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.193286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.193311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.193434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.193534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.193559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.193657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.193753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.193777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.193877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.194004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.194037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.194166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.194285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.194310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.194414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.194559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.194585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.194685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.194786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.194811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.194919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.195039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.195064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.195186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.195278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.195303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.195421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.195513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.195543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.195668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.195771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.195795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.195904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.195998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.196022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.196151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.196245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.196269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.196372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.196471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.196495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.196628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.196751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.196777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.196876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.196975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.196999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.197101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.197222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.197247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.197369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.197480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.197505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.197607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.197707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.197731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.197831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.197955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.197980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.198075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.198164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.198199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.198301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.198420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.198444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.198568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.198675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.198700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.198790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.198880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.198904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.199011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.199133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.199164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.199256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.199351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.199376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.199481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.199578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.199603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.936 [2024-11-28 01:25:18.199708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.199861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.936 [2024-11-28 01:25:18.199886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.936 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.199996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.200098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.200123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.200219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.200338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.200363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.200463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.200562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.200587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.200686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.200781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.200806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.200909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.201033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.201058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.201163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.201293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.201329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.201420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.201539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.201564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.201668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.201797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.201822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.201947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.202077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.202102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.202207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.202300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.202325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.202441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.202537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.202567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.202719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.202812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.202836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.202937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.203057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.203082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.203221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.203316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.203342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.203475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.203647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.203672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.203795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.203900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.203924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.204051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.204147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.204172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.204267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.204396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.204421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.204516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.204656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.204681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.204780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.204911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.204936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.205039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.205142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.205167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.205270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.205415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.205448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.205576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.205667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.205692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.205799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.205937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.205961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.206088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.206177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.206201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.206297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.206397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.206421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.206531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.206627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.206651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.206774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.206885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.206910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.937 qpair failed and we were unable to recover it. 00:31:03.937 [2024-11-28 01:25:18.207005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.207106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.937 [2024-11-28 01:25:18.207131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.207250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.207378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.207402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.207491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.207596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.207621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.207724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.207827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.207852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.207956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.208065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.208090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.208196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.208338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.208363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.208469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.208572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.208597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.208695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.208821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.208846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.208975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.209069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.209093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.209202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.209323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.209348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.209485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.209618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.209643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.209741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.209838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.209864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.209967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.210089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.210122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.210219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.210354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.210379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.210506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.210614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.210640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.210742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.210869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.210904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.211001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.211087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.211111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.211201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.211294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.211319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.211445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.211539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.211564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.211687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.211777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.211802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.211928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.212052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.212076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.212204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.212295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.212319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.212411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.212545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.212570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.212668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.212765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.212790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.938 qpair failed and we were unable to recover it. 00:31:03.938 [2024-11-28 01:25:18.212891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.212989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.938 [2024-11-28 01:25:18.213015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.213110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.213235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.213260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.213371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.213519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.213549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.213667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.213760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.213785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.213881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.214014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.214039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.214139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.214235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.214259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.214383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.214484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.214508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.214615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.214715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.214740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.214842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.214991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.215018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.215119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.215220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.215250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.215378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.215494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.215519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.215652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.215774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.215799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.215903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.216002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.216028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.216200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.216291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.216315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.216417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.216505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.216538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.216642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.216778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.216803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.216937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.217039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.217065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.217191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.217296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.217323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.217456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.217582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.217608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.217715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.217869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.217893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.218052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.218148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.218173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.218300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.218419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.218444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.218558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.218679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.218704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.218856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.218953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.218978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.219115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.219210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.219234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.219374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.219535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.219561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.219691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.219787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.219811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.219972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.220085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.220110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.220213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.220316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.220342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.939 qpair failed and we were unable to recover it. 00:31:03.939 [2024-11-28 01:25:18.220467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.939 [2024-11-28 01:25:18.220615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.220640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.220764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.220862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.220887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.220986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.221135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.221160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.221254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.221344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.221369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.221493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.221602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.221627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.221724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.221858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.221884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.222022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.222123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.222147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.222256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.222374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.222398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.222533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.222669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.222694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.222801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.222915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.222939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.223037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.223156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.223181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.223272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.223419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.223445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.223554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.223645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.223670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.223763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.223870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.223895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.223984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.224079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.224104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.224201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.224290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.224315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.224403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.224522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.224552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.224642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.224742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.224767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.224889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.224984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.225009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.225101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.225202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.225227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.225332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.225428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.225453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.225573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.225670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.225699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.225832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.225927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.225952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.226052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.226146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.226170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.226294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.226397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.226421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.226566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.226665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.226690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.226812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.226904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.226929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.227027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.227159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.227185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.227314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.227461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.940 [2024-11-28 01:25:18.227487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.940 qpair failed and we were unable to recover it. 00:31:03.940 [2024-11-28 01:25:18.227596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.227716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.227741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.227873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.227965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.227990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.228115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.228229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.228254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.228361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.228482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.228507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.228615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.228708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.228732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.228858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.228965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.228989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.229118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.229220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.229245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.229341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.229431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.229457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.229567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.229664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.229689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.229812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.229939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.229964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.230062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.230185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.230210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.230336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.230463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.230488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.230600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.230718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.230742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.230840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.230969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.230993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.231118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.231245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.231270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.231383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.231475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.231499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.231641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.231731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.231756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.231867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.232010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.232035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.232172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.232267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.232292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.232387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.232475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.232500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.232610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.232756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.232782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.232883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.232984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.233010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.233164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.233258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.233283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.233388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.233486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.233511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.233606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.233692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.233717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.233808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.233940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.233968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.234060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.234156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.234181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.234284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.234389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.234414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.941 [2024-11-28 01:25:18.234520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.234630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.941 [2024-11-28 01:25:18.234655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.941 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.234788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.234882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.234907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.235010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.235110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.235135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.235226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.235315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.235340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.235472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.235624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.235650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.235778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.235882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.235907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.236000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.236123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.236147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.236271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.236370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.236394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.236488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.236592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.236618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.236707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.236809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.236833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.236948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.237045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.237069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.237182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.237311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.237337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.237442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.237561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.237586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.237688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.237786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.237810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.237911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.237998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.238022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.238159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.238295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.238324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.238416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.238552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.238577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.238679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.238782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.238807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.238914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.239019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.239043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.239169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.239257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.239282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.239407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.239499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.239530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.239636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.239762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.239787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.239886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.239985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.240009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.240105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.240227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.240251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.240379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.240503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.240533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.240627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.240829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.240854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.240987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.241118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.241142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.241251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.241345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.241369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.241570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.241670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.241695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.942 qpair failed and we were unable to recover it. 00:31:03.942 [2024-11-28 01:25:18.241794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.241919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.942 [2024-11-28 01:25:18.241944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.242090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.242189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.242214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.242339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.242430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.242454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.242566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.242692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.242717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.242823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.242954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.242979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.243076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.243197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.243222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.243348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.243484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.243509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.243620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.243714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.243739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.243868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.243992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.244017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.244118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.244248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.244274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.244369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.244572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.244597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.244801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.244936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.244961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.245089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.245194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.245219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.245345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.245476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.245501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.245614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.245706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.245732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.245865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.246016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.246041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.246163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.246266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.246291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.246383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.246504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.246536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.246665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.246804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.246829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.246929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.247026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.247051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.247252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.247360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.247384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.247503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.247611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.247636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.247734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.247827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.247852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.247980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.248179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.248204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.248327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.248453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.248477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.943 [2024-11-28 01:25:18.248587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.248688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.943 [2024-11-28 01:25:18.248715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.943 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.248808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.248914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.248940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.249076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.249175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.249200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.249297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.249394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.249420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.249543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.249661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.249686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.249842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.249950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.249975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.250077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.250199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.250223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.250338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.250462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.250487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.250634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.250730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.250755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.250958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.251081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.251106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.251205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.251303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.251327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.251429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.251551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.251577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.251700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.251801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.251840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.251931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.252048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.252073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.252274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.252433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.252458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.252565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.252670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.252695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.252789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.252918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.252943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.253041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.253201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.253226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.253441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.253556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.253581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.253714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.253819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.253844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.253946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.254041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.254065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.254194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.254297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.254321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.254423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.254522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.254555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.254695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.254792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.254817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.254924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.255054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.255081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.255182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.255277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.255302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.255428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.255519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.255553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.255676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.255799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.255824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.255924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.256041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.256066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.944 [2024-11-28 01:25:18.256162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.256251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.944 [2024-11-28 01:25:18.256276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.944 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.256406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.256508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.256539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.256643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.256739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.256763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.256866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.256986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.257011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.257117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.257218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.257243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.257344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.257435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.257459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.257566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.257663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.257688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.257779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.257905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.257930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.258079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.258203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.258228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.258329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.258424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.258448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.258587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.258706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.258731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.258837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.258931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.258955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.259078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.259171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.259196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.259305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.259399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.259428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.259534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.259627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.259652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.259804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.259901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.259927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.260047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.260171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.260195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.260319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.260417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.260441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.260564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.260662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.260686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.260774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.260924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.260948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.261047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.261153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.261177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.261278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.261403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.261428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.261552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.261644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.261669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.261768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.261878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.261902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.262040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.262133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.262161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.262258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.262355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.262380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.262503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.262647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.262672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.262766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.262898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.262922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.263044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.263138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.263163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.945 qpair failed and we were unable to recover it. 00:31:03.945 [2024-11-28 01:25:18.263282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.945 [2024-11-28 01:25:18.263388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.263412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.263504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.263635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.263661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.263758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.263887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.263912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.264011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.264140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.264164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.264369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.264490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.264515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.264614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.264707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.264731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.264841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.264937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.264962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.265111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.265235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.265260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.265358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.265558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.265584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.265686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.265787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.265812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.265911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.266030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.266055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.266153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.266246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.266271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.266394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.266483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.266508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.266618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.266745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.266769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.266972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.267068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.267093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.267183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.267309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.267333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.267441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.267536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.267562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.267655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.267803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.267828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.267950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.268071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.268096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.268223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.268342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.268367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.268467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.268572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.268597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.268701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.268796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.268821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.268945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.269071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.269097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.269193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.269291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.269315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.269416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.269509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.269548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.269678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.269797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.269822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.269922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.270043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.270067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.270167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.270259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.270284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.270411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.270537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.270562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.946 qpair failed and we were unable to recover it. 00:31:03.946 [2024-11-28 01:25:18.270667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.946 [2024-11-28 01:25:18.270758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.270783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.270925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.271047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.271072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.271198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.271297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.271322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.271441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.271537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.271562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.271656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.271756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.271781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.271877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.271981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.272006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.272102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.272200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.272226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.272320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.272421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.272446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.272576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.272675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.272700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.272811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.272941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.272966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.273083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.273185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.273209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.273316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.273405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.273430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.273553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.273649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.273674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.273773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.273873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.273898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.273996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.274087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.274112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.274206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.274299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.274323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.274475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.274598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.274623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.274721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.274813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.274878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.274981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.275099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.275124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.275242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.275331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.275356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.275453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.275547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.275572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.275669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.275820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.275844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.275972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.276062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.276086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.276293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.276379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.276403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.276531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.276626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.276650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.276774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.276898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.947 [2024-11-28 01:25:18.276923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.947 qpair failed and we were unable to recover it. 00:31:03.947 [2024-11-28 01:25:18.277019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.277146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.277171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.277273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.277474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.277498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.277666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.277787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.277811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.277909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.278034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.278059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.278188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.278279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.278304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.278396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.278492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.278516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.278622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.278724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.278748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.278868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.278990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.279015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.279137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.279259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.279285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.279385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.279480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.279505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.279633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.279730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.279756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.279885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.280007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.280032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.280176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.280271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.280295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.280431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.280530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.280556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.280650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.280748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.280773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.280888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.281011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.281036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.281159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.281281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.281307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.281406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.281557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.281583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.281669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.281822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.281847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.281950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.282080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.282105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.282201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.282364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.282389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.282494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.282597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.282622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.282727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.282827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.282853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.282981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.283088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.283113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.283216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.283312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.283338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.283456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.283576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.283601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.283703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.283795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.283820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.283947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.284039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.284065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.948 qpair failed and we were unable to recover it. 00:31:03.948 [2024-11-28 01:25:18.284192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.284290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.948 [2024-11-28 01:25:18.284315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.284437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.284575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.284600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.284693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.284794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.284818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.284906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.285033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.285057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.285179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.285305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.285330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.285415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.285562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.285588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.285709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.285802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.285827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.285926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.286063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.286087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.286206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.286302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.286327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.286447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.286551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.286577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.286677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.286771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.286796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.286897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.287022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.287046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.287164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.287252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.287277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.287374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.287495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.287519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.287679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.287765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.287796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.287896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.287987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.288012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.288115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.288209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.288234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.288357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.288455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.288479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.288597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.288748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.288773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.288932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.289024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.289049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.289146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.289275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.289300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.289420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.289511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.289548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.289643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.289749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.289773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.289900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.290028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.290052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.290147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.290244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.290270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.290406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.290534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.290560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.290661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.290759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.290784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.290885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.291010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.291035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.291154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.291254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.291278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.949 qpair failed and we were unable to recover it. 00:31:03.949 [2024-11-28 01:25:18.291406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.949 [2024-11-28 01:25:18.291522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.291553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.291658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.291753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.291778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.291902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.291991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.292016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.292112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.292233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.292257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.292381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.292498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.292523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.292634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.292731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.292755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.292860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.292959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.292984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.293083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.293202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.293227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.293330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.293454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.293478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.293601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.293727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.293751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.293852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.293974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.293999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.294091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.294185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.294210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.294339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.294435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.294460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.294627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.294746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.294770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.294859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.294979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.295005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.295126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.295219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.295243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.295372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.295514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.295545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.295635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.295781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.295806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.295908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.296030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.296055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.296151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.296248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.296272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.296365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.296461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.296486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.296615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.296745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.296770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.296859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.296992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.297016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.297137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.297264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.297289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.297383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.297484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.297508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.297639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.297735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.297760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.297893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.298015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.298044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.298182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.298272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.298296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.298415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.298538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.950 [2024-11-28 01:25:18.298563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.950 qpair failed and we were unable to recover it. 00:31:03.950 [2024-11-28 01:25:18.298660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.298756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.298781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.298889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.299019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.299044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.299169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.299266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.299291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.299417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.299541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.299566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.299688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.299782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.299807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.299904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.300027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.300052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.300169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.300267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.300292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.300447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.300538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.300563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.300667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.300755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.300780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.300873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.301028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.301053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.301146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.301283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.301308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.301426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.301556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.301581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.301679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.301777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.301801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.301896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.302018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.302043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.302173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.302272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.302297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.302389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.302540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.302565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.302653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.302772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.302796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.302932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.303022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.303047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.303179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.303279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.303304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.303402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.303534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.303559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.303651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.303776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.303800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.303890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.304017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.304042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.304173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.304262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.304287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.304387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.304538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.304563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.304694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.304797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.304822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.304921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.305018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.305043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.305135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.305233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.305258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.305353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.305444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.305468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.305613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.305711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.951 [2024-11-28 01:25:18.305736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.951 qpair failed and we were unable to recover it. 00:31:03.951 [2024-11-28 01:25:18.305837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.305932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.305957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.306051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.306141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.306167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.306286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.306424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.306449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.306557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.306668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.306693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.306831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.306955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.306980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.307082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.307206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.307232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.307337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.307434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.307459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.307563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.307689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.307715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.307817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.307937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.307962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.308060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.308190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.308215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.308335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.308428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.308453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.308576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.308703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.308727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.308827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.308918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.308943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.309034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.309125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.309151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.309278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.309378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.309403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.309543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.309671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.309697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.309819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.309943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.309967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.310087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.310204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.310229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.310354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.310474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.310498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.310603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.310697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.310726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.310815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.310939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.310964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.311056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.311144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.311169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.311264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.311355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.311379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.311507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.311613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.311638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.311737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.311859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.952 [2024-11-28 01:25:18.311884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.952 qpair failed and we were unable to recover it. 00:31:03.952 [2024-11-28 01:25:18.311986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.312101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.312126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.312216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.312343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.312368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.312514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.312614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.312639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.312760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.312861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.312886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.312986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.313088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.313113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.313247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.313367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.313391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.313517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.313634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.313660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.313783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.313872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.313896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.314023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.314142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.314166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.314289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.314411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.314435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.314521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.314621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.314646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.314748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.314881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.314906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.314996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.315115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.315140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.315235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.315362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.315386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.315517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.315619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.315643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.315738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.315843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.315868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.316001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.316089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.316114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.316224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.316345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.316369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.316492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.316594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.316620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.316748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.316852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.316877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.317006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.317130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.317156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.317252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.317366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.317391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.317552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.317683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.317707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.317804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.317899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.317923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.318075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.318170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.318194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.318313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.318410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.318435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.318550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.318645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.318670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.318778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.318899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.318923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.953 [2024-11-28 01:25:18.319024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.319166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.953 [2024-11-28 01:25:18.319191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.953 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.319319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.319422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.319447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.319580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.319674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.319698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.319788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.319895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.319920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.320017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.320112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.320137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.320230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.320358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.320383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.320478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.320577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.320602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.320700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.320831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.320856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.320958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.321051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.321075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.321167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.321290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.321315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.321412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.321533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.321558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.321650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.321750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.321774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.321899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.321990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.322014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.322114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.322233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.322258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.322359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.322452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.322476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.322600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.322698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.322723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.322852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.322949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.322973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.323108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.323224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.323252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.323379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.323474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.323499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.323594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.323721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.323746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.323875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.323966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.323991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.324095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.324190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.324216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.324320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.324418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.324443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.324547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.324677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.324702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.324825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.324923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.324947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.325051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.325148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.325173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.325262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.325384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.325409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.325545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.325670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.325696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.325806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.325934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.325958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.954 qpair failed and we were unable to recover it. 00:31:03.954 [2024-11-28 01:25:18.326062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.954 [2024-11-28 01:25:18.326157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.326181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.326306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.326399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.326424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.326557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.326649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.326673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.326769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.326895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.326919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.327021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.327118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.327142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.327234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.327325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.327349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.327449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.327547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.327572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.327697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.327817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.327842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.327940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.328035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.328059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.328185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.328302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.328327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.328427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.328532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.328558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.328657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.328749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.328774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.328868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.328963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.328987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.329090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.329186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.329210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.329331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.329456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.329480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.329636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.329727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.329751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.329850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.329947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.329971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.330069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.330166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.330191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.330286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.330408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.330433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.330520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.330632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.330656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.330775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.330865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.330890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.330990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.331077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.331102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.331227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.331318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.331343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.331434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.331535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.331561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.331679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.331784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.331808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.331909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.332002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.332027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.332122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.332247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.332273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.332368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.332460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.332486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.332581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.332700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.955 [2024-11-28 01:25:18.332725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.955 qpair failed and we were unable to recover it. 00:31:03.955 [2024-11-28 01:25:18.332820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.332906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.332935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.333036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.333166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.333191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.333284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.333379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.333404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.333537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.333636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.333662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.333767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.333860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.333884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.333978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.334103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.334128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.334226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.334350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.334375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.334461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.334561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.334586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.334678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.334771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.334797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.334897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.334988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.335013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.335109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.335197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.335221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.335315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.335473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.335497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.335630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.335718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.335743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.335889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.335987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.336012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.336101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.336198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.336224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.336316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.336439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.336464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.336592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.336686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.336711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.336815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.336912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.336936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.337089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.337183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.337208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.337299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.337385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.337409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.337502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.337622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.337647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.337782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.337912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.337937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.338038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.338135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.338160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.338276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.338372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.338396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.338485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.338589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.338614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.338712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.338809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.338834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.338985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.339090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.339115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.339211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.339304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.339331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.956 [2024-11-28 01:25:18.339455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.339616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.956 [2024-11-28 01:25:18.339641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.956 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.339732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.339859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.339884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.339980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.340106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.340130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.340248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.340341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.340366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.340491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.340593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.340617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.340742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.340902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.340927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.341055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.341152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.341177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.341271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.341388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.341413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.341502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.341616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.341641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.341765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.341860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.341886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.341982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.342113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.342137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.342235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.342329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.342353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.342480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.342581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.342606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.342697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.342792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.342817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.342913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.343042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.343067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.343160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.343256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.343281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.343403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.343500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.343532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.343660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.343755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.343780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.343882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.343967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.343991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.344113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.344213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.344237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.344345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.344472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.344498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.344615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.344708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.344733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.344835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.344955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.344979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.345106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.345231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.345260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.345383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.345480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.345505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.345649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.345752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.957 [2024-11-28 01:25:18.345776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.957 qpair failed and we were unable to recover it. 00:31:03.957 [2024-11-28 01:25:18.345873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.345969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.345994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.346116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.346211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.346235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.346324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.346477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.346501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.346615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.346710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.346735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.346858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.346946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.346971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.347066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.347192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.347217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.347316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.347405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.347429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.347555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.347647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.347672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.347777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.347881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.347906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.348003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.348123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.348148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.348245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.348343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.348367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.348467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.348593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.348619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.348720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.348821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.348845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.348938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.349059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.349084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.349210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.349331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.349356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.349481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.349597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.349622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.349723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.349815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.349840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.349965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.350069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.350093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.350210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.350307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.350332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.350427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.350513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.350564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.350661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.350784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.350809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.350924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.351051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.351075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.351174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.351274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.351300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.351399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.351516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.351549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.351648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.351772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.351797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.351932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.352030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.352055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.352151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.352244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.352268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.352360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.352473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.352498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.958 [2024-11-28 01:25:18.352607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.352716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.958 [2024-11-28 01:25:18.352742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.958 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.352843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.352961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.352985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.353106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.353194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.353219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.353305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.353393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.353418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.353541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.353647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.353679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.353809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.353905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.353930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.354061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.354155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.354181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.354309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.354470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.354495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.354588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.354689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.354714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.354838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.354933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.354958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.355056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.355151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.355175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.355295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.355384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.355409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.355529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.355623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.355648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.355775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.355873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.355900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.356002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.356101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.356132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.356227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.356319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.356344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.356479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.356606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.356632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.356734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.356859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.356884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.357021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.357114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.357138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.357232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.357322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.357347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.357476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.357606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.357636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.357734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.357831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.357856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.357985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.358113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.358137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.358227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.358315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.358340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.358429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.358518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.358567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.358692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.358812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.358837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.358935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.359035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.359060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.359156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.359252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.359277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.359394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.359511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.359542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.959 qpair failed and we were unable to recover it. 00:31:03.959 [2024-11-28 01:25:18.359636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.359734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.959 [2024-11-28 01:25:18.359758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.359855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.360015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.360040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.360169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.360255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.360279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.360379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.360495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.360519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.360627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.360723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.360748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.360838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.360967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.360991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.361121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.361211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.361236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.361337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.361437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.361462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.361571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.361721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.361746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.361841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.361970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.361994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.362122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.362216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.362241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.362341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.362441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.362466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.362573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.362665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.362689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.362791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.362876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.362900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.363035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.363123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.363148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.363241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.363360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.363385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.363510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.363623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.363648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.363770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.363863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.363888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.364011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.364107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.364134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.364294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.364394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.364420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.364544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.364647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.364672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.364792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.364909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.364935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.365062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.365160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.365186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.365304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.365430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.365455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.365554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.365648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.365673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.365762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.365884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.365909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.366012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.366104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.366128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.366220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.366309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.366333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.366427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.366522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.366559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.960 qpair failed and we were unable to recover it. 00:31:03.960 [2024-11-28 01:25:18.366652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.960 [2024-11-28 01:25:18.366739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.366764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.366887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.366986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.367010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.367115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.367208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.367232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.367358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.367483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.367512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.367646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.367744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.367768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.367891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.368017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.368041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.368139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.368243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.368268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.368389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.368480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.368505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.368608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.368706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.368732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.368862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.368989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.369014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.369113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.369234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.369259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.369376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.369491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.369516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.369619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.369716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.369741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.369830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.369955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.369980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.370084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.370202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.370227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.370351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.370448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.370473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.370580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.370705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.370730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.370839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.370964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.370988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.371099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.371197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.371221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.371321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.371414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.371438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.371540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.371666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.371690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.371821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.371917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.371942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.372061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.372187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.372211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.372334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.372422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.372446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.372583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.372685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.372710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.961 [2024-11-28 01:25:18.372808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.372905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.961 [2024-11-28 01:25:18.372931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.961 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.373059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.373165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.373190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.373288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.373404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.373428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.373517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.373623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.373648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.373747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.373875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.373899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.374026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.374122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.374148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.374266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.374361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.374386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.374485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.374605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.374630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.374755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.374905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.374930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.375054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.375159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.375184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.375291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.375380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.375404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.375531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.375625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.375650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.375747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.375871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.375895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.376018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.376133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.376157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.376250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.376408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.376432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.376557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.376653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.376677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.376767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.376866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.376891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.377014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.377109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.377133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.377226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.377342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.377367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.377488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.377596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.377621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.377749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.377838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.377862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.377994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.378119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.378143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.378250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.378344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.378368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.378497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.378601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.378626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.378748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.378875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.378899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.378991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.379088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.379114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.379238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.379360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.379385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.379512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.379605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.379630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.379758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.379913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.379938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.962 [2024-11-28 01:25:18.380030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.380123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.962 [2024-11-28 01:25:18.380151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.962 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.380251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.380354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.380379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.380502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.380606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.380631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.380749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.380835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.380860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.380962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.381064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.381089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.381212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.381303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.381327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.381431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.381552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.381578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.381684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.381785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.381810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.381902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.381995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.382021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.382122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.382243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.382268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.382392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.382487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.382511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.382628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.382728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.382753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.382873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.382970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.382994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.383107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.383212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.383238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.383369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.383490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.383515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.383616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.383707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.383732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.383821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.383941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.383965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.384065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.384157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.384182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.384283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.384382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.384407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.384507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.384601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.384627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.384756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.384848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.384873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.385002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.385101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.385126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.385247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.385336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.385360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.385485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.385591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.385616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.385739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.385870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.385894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.385989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.386086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.386111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.386234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.386328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.386352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.386474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.386581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.386607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.386733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.386862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.386887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.963 qpair failed and we were unable to recover it. 00:31:03.963 [2024-11-28 01:25:18.386984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.963 [2024-11-28 01:25:18.387078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.387103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.387206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.387305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.387329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.387430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.387538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.387563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.387660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.387828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.387854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.387955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.388083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.388108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.388200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.388288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.388313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.388415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.388535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.388560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.388667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.388758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.388783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.388875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.388992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.389016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.389120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.389217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.389241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.389351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.389477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.389501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.389639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.389735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.389759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.389849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.389984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.390009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.390102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.390192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.390219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.390320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.390415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.390440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.390565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.390657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.390682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.390780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.390908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.390933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.391022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.391122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.391146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.391240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.391364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.391389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.391521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.391620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.391645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.391773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.391896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.391920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.392014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.392136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.392161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.392260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.392384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.392414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.392514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.392616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.392641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.392728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.392847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.392871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.392972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.393094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.393118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.393211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.393336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.393360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.393493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.393605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.393629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.393734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.393841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.393865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.964 qpair failed and we were unable to recover it. 00:31:03.964 [2024-11-28 01:25:18.394015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.964 [2024-11-28 01:25:18.394111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.394136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.394262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.394384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.394409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.394498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.394675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.394701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.394855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.394980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.395005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.395136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.395236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.395261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.395356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.395455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.395480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.395584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.395676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.395702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.395797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.395890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.395914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.396008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.396133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.396158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.396249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.396366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.396390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.396482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.396583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.396609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.396737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.396841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.396865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.396959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.397050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.397075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.397208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.397299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.397323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.397419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.397541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.397567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.397665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.397756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.397781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.397902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.397993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.398018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.398114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.398208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.398233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.398361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.398461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.398487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.398618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.398725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.398750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.398872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.398990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.399014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.399111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.399230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.399254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.399406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.399533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.399559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.399658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.399756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.399782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.399908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.400007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.400032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.400185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.400276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.400301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.400453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.400578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.400604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.400699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.400801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.400826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.400913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.401043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.401067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.965 qpair failed and we were unable to recover it. 00:31:03.965 [2024-11-28 01:25:18.401170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.965 [2024-11-28 01:25:18.401297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.401321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.401450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.401568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.401593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.401720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.401855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.401881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.401971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.402093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.402118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.402210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.402303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.402329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.402429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.402599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.402629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.402732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.402823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.402847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.402969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.403058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.403083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.403175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.403301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.403326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.403429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.403534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.403560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.403652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.403775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.403799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.403918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.404004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.404029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.404152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.404253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.404279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.404373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.404469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.404494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.404604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.404704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.404729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.404825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.404950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.404975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.405074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.405171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.405195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.405312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.405439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.405464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.405590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.405714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.405739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.405833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.405929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.405954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.406073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.406165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.406190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.406319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.406415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.406439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.406556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.406647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.406672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.406775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.406877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.406902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.406994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.407087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.407112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.966 [2024-11-28 01:25:18.407214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.407347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.966 [2024-11-28 01:25:18.407372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.966 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.407510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.407612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.407636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.407761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.407932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.407957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.408055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.408145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.408170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.408294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.408386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.408410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.408506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.408630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.408655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.408781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.408869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.408894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.408989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.409079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.409104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.409225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.409324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.409349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.409475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.409595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.409620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.409717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.409802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.409826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.409954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.410076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.410101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.410193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.410284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.410311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.410409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.410544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.410582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.410710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.410831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.410856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.410982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.411084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.411109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.411239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.411333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.411358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.411477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.411577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.411602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.411703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.411804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.411829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.411924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.412047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.412072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.412180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.412336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.412361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.412454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.412553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.412579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.412699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.412816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.412841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.412935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.413029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.413054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.413157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.413250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.413275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.413421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.413510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.413542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.413638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.413756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.413781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.413879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.413998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.414023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.414143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.414235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.414260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.967 qpair failed and we were unable to recover it. 00:31:03.967 [2024-11-28 01:25:18.414349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.967 [2024-11-28 01:25:18.414440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.414465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.414595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.414723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.414748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.414864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.414983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.415011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.415138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.415234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.415259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.415356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.415482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.415507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.415636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.415722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.415747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.415869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.415995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.416020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.416111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.416202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.416228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.416328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.416424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.416449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.416544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.416663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.416687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.416784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.416880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.416906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.417005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.417120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.417145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.417264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.417383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.417408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.417535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.417640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.417665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.417795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.417890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.417915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.418035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.418163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.418188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.418287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.418378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.418402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.418498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.418631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.418656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.418759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.418854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.418879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.418979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.419101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.419125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.419227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.419353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.419378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.419505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.419598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.419623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.419720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.419816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.419841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.419966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.420062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.420086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.420187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.420310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.420335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.420429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.420531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.420556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.420668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.420764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.420789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.420912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.421031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.421056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.421148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.421275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.968 [2024-11-28 01:25:18.421299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.968 qpair failed and we were unable to recover it. 00:31:03.968 [2024-11-28 01:25:18.421398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.421520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.421552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.421678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.421777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.421802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.421929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.422087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.422112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.422220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.422318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.422345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.422447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.422574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.422601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.422696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.422821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.422845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.422971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.423062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.423086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.423184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.423278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.423303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.423433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.423584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.423610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.423703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.423793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.423817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.423909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.424034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.424059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.424152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.424245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.424270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.424369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.424498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.424523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.424647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.424739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.424765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.424855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.424981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.425006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.425129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.425225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.425249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.425336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.425420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.425444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.425545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.425664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.425689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.425790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.425919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.425944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.426067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.426162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.426187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.426285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.426376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.426401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.426498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.426603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.426628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.426719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.426822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.426847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.427000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.427086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.427111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.427206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.427334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.427363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.427472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.427571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.427596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.427721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.427813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.427838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.427929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.428047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.428072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.969 [2024-11-28 01:25:18.428169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.428265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.969 [2024-11-28 01:25:18.428291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.969 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.428386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.428505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.428535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.428658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.428755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.428780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.428876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.428983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.429008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.429104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.429223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.429248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.429352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.429472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.429497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.429602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.429720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.429745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.429877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.429973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.429998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.430124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.430220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.430245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.430371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.430466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.430491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.430629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.430730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.430755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.430860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.431013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.431038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.431180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.431276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.431301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.431421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.431513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.431544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.431642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.431762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.431787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.431892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.431983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.432008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.432126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.432221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.432246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.432377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.432536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.432563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.432660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.432762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.432787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.432882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.432978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.433003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.433131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.433221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.433245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.433340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.433463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.433487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.433592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.433685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.433710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.433812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.433929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.433954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.434046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.434165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.434191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.434287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.434407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.434432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.970 qpair failed and we were unable to recover it. 00:31:03.970 [2024-11-28 01:25:18.434518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.970 [2024-11-28 01:25:18.434644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.434670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.434800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.434926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.434951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.435073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.435193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.435217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.435312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.435400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.435424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.435532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.435685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.435710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.435810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.435900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.435925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.436028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.436124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.436148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.436245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.436337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.436363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.436485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.436628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.436654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.436743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.436838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.436863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.436990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.437109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.437133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.437251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.437371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.437402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.437531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.437622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.437647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.437748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.437841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.437866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.438028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.438153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.438178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.438273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.438398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.438424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.438515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.438651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.438676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.438764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.438859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.438883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.438982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.439077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.439101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.439196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.439300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.439327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.439448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.439568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.439594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.439716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.439811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.439835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.439966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.440069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.440094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.440185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.440281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.440306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.440410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.440507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.440536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.440636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.440752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.440777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.440872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.440993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.441018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.441140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.441232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.441257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.441383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.441471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.971 [2024-11-28 01:25:18.441496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.971 qpair failed and we were unable to recover it. 00:31:03.971 [2024-11-28 01:25:18.441594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.441724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.441749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.441848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.441969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.441993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.442093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.442188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.442215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.442319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.442416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.442441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.442540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.442663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.442688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.442776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.442902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.442927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.443056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.443162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.443187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.443285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.443383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.443408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.443503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.443639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.443665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.443755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.443845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.443869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.443975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.444097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.444122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.444216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.444341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.444366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.444484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.444589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.444614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.444705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.444802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.444827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.444947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.445038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.445063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.445159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.445278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.445303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.445450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.445602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.445627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.445718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.445817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.445842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.445993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.446114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.446139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.446239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.446334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.446358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.446444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.446553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.446579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.446686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.446780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.446804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.446904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.447007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.447032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.447136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.447236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.447261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.447352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.447446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.447470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.447561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.447662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.447687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.447810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.447917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.447942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.448094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.448189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.448213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.972 [2024-11-28 01:25:18.448306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.448390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.972 [2024-11-28 01:25:18.448416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.972 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.448507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.448612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.448638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.448742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.448836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.448862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.448959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.449085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.449109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.449203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.449305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.449331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.449450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.449548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.449578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.449706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.449831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.449856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.449951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.450041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.450067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.450192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.450319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.450343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.450432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.450530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.450555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.450652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.450749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.450774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.450870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.450961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.450986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.451107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.451257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.451282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.451404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.451495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.451520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.451652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.451777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.451803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.451907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.452010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.452035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.452163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.452258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.452285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.452413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.452511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.452541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.452641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.452726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.452751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.452873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.452996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.453020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.453120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.453247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.453272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.453402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.453522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.453554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.453658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.453812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.453837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.453932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.454051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.454075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.454180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.454270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.454296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.454390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.454520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.454553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.454659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.454785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.454815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.454939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.455030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.455055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.455189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.455282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.455307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.973 qpair failed and we were unable to recover it. 00:31:03.973 [2024-11-28 01:25:18.455461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.455548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.973 [2024-11-28 01:25:18.455573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.455702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.455792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.455817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.455936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.456088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.456113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.456211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.456338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.456364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.456489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.456611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.456637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.456736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.456831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.456856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.456984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.457087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.457112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.457234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.457364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.457389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.457513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.457615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.457639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.457734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.457860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.457886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.458007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.458106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.458131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.458228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.458329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.458354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.458478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.458573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.458599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.458722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.458813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.458837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.458964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.459093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.459118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.459209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.459328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.459352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.459490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.459592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.459617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.459724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.459821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.459849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.459975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.460102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.460129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.460258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.460357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.460382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.460491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.460619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.460645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.460743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.460842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.460867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.460963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.461109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.461134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.461227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.461319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.461344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.461474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.461576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.461601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.461703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.461859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.461884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.461987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.462081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.462106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.462222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.462339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.462368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.462464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.462619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.462645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.974 qpair failed and we were unable to recover it. 00:31:03.974 [2024-11-28 01:25:18.462744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.462845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.974 [2024-11-28 01:25:18.462871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.462975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.463099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.463124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.463240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.463358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.463383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.463482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.463583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.463609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.463705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.463798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.463823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.463926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.464013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.464038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.464157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.464248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.464273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.464370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.464488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.464512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.464619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.464713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.464742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.464840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.464937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.464962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.465060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.465154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.465179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.465275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.465426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.465450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.465564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.465670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.465695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.465792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.465920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.465946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.466044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.466141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.466167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.466296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.466394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.466418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.466523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.466684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.466710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.466841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.466938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.466963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.467063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.467190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.467215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.467316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.467448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.467473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.467598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.467700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.467726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.467816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.467919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.467944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.468069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.468189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.468214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.468338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.468435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.468459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.468555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.468651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.468676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.468810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.468910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.975 [2024-11-28 01:25:18.468935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.975 qpair failed and we were unable to recover it. 00:31:03.975 [2024-11-28 01:25:18.469029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.469149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.469175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.469291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.469411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.469436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.469564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.469652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.469677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.469773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.469862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.469887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.469995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.470087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.470112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.470241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.470366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.470390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.470491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.470619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.470644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.470747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.470878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.470902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.471003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.471130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.471155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.471275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.471400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.471425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.471556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.471648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.471672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.471765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.471852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.471877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.471974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.472102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.472128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.472230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.472352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.472381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.472513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.472644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.472669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.472794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.472879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.472904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.473032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.473156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.473181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.473279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.473398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.473423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.473518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.473620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.473647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.473798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.473928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.473953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.474083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.474178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.474202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.474299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.474428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.474452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.474557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.474659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.474684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.474834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.474925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.474949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.475083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.475178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.475203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.475297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.475389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.475414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.475544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.475664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.475689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.475790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.475909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.475933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.476025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.476144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.476168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.476270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.476368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.476393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.976 [2024-11-28 01:25:18.476498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.476600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.976 [2024-11-28 01:25:18.476626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.976 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.476723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.476821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.476846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.476970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.477067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.477091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.477186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.477276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.477300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.477437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.477560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.477586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.477684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.477776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.477802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.477900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.477989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.478014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.478112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.478213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.478238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.478365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.478486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.478511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.478641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.478736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.478760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.478862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.478962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.478987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.479079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.479198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.479223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.479319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.479411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.479435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.479537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.479639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.479664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.479821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.479909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.479934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.480046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.480144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.480169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.480265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.480366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.480391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.480482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.480603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.480628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.480718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.480817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.480842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.480937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.481033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.481057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.481143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.481261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.481286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.481380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.481497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.481522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.481625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.481710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.481735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.481838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.481935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.481961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.482052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.482177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.482202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.482325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.482414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.482439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.482570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.482662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.482687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.482791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.482917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.482942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.483066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.483157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.483182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.483281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.483389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.483415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.483510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.483613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.483638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.483756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.483878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.977 [2024-11-28 01:25:18.483903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.977 qpair failed and we were unable to recover it. 00:31:03.977 [2024-11-28 01:25:18.484000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.484127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.484152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.484308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.484432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.484457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.484590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.484687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.484717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.484819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.484908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.484933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.485034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.485151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.485176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.485273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.485399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.485424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.485518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.485613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.485638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.485743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.485845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.485870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.485976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.486071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.486096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.486187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.486281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.486307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.486407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.486500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.486544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.486648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.486743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.486768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.486905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.487003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.487028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.487184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.487280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.487307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.487425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.487543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.487569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.487706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.487796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.487821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.487944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.488038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.488063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.488155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.488248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.488275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.488406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.488495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.488520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.488627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.488721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.488746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.488875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.488997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.489023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.489117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.489212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.489238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.489337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.489426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.489451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.489580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.489702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.489726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.489819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.489939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.489963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.490085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.490182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.490206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.490305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.490404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.490430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.490560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.490668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.490693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.490794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.490883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.490911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.491028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.491149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.491174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.491269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.491374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.978 [2024-11-28 01:25:18.491398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.978 qpair failed and we were unable to recover it. 00:31:03.978 [2024-11-28 01:25:18.491494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.491596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.491622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.491714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.491902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.491927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.492027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.492122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.492147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.492269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.492369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.492393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.492515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.492620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.492644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.492741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.492841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.492866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.493024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.493110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.493135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.493230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.493373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.493398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.493520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.493619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.493645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.493744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.493840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.493866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.493986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.494110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.494135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.494224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.494310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.494335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.494460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.494584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.494614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.494721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.494821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.494850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.494954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.495053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.495079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.495207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.495304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.495328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.495417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.495574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.495600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.495722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.495820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.495845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.495992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.496092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.496117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.496244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.496341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.496366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.496460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.496569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.496594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.496686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.496810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.496847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.497001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.497153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.497182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.497299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.497393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.497417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.497517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.497620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.497645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.497742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.497853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.497878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.497972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.498059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.498084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.979 [2024-11-28 01:25:18.498209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.498304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.979 [2024-11-28 01:25:18.498329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.979 qpair failed and we were unable to recover it. 00:31:03.980 [2024-11-28 01:25:18.498453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.498578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.498604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.980 qpair failed and we were unable to recover it. 00:31:03.980 [2024-11-28 01:25:18.498694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.498815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.498840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.980 qpair failed and we were unable to recover it. 00:31:03.980 [2024-11-28 01:25:18.498927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.499020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.499045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.980 qpair failed and we were unable to recover it. 00:31:03.980 [2024-11-28 01:25:18.499147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.499242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.499266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.980 qpair failed and we were unable to recover it. 00:31:03.980 [2024-11-28 01:25:18.499401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.499507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.499546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.980 qpair failed and we were unable to recover it. 00:31:03.980 [2024-11-28 01:25:18.499652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.499753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.499779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.980 qpair failed and we were unable to recover it. 00:31:03.980 [2024-11-28 01:25:18.499924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.500018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.500043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.980 qpair failed and we were unable to recover it. 00:31:03.980 [2024-11-28 01:25:18.500136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.500265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.500290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.980 qpair failed and we were unable to recover it. 00:31:03.980 [2024-11-28 01:25:18.500383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.500483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.500508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.980 qpair failed and we were unable to recover it. 00:31:03.980 [2024-11-28 01:25:18.500623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.500719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.500745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.980 qpair failed and we were unable to recover it. 00:31:03.980 [2024-11-28 01:25:18.500850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.500950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.500976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.980 qpair failed and we were unable to recover it. 00:31:03.980 [2024-11-28 01:25:18.501076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.501202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.501228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.980 qpair failed and we were unable to recover it. 00:31:03.980 [2024-11-28 01:25:18.501322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.501478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.501503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.980 qpair failed and we were unable to recover it. 00:31:03.980 [2024-11-28 01:25:18.501605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.501695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.501720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.980 qpair failed and we were unable to recover it. 00:31:03.980 [2024-11-28 01:25:18.501819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.501923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.501948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.980 qpair failed and we were unable to recover it. 00:31:03.980 [2024-11-28 01:25:18.502055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.502186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.502211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.980 qpair failed and we were unable to recover it. 00:31:03.980 [2024-11-28 01:25:18.502303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.502393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.502418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.980 qpair failed and we were unable to recover it. 00:31:03.980 [2024-11-28 01:25:18.502517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.502623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.502648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.980 qpair failed and we were unable to recover it. 00:31:03.980 [2024-11-28 01:25:18.502769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.502897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.502922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.980 qpair failed and we were unable to recover it. 00:31:03.980 [2024-11-28 01:25:18.503048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.980 [2024-11-28 01:25:18.503135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.503160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.503251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.503376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.503401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.503505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.503671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.503696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.503791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.503889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.503914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.504002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.504129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.504154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.504249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.504403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.504428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.504566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.504687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.504712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.504851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.504999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.505024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.505145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.505251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.505276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.505371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.505463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.505488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.505623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.505722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.505748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.505842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.505948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.505973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.506096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.506195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.506220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.506341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.506466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.506491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.506676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.506771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.506796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.506897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.507023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.507048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.507176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.507277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.507307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.507408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.507504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.507533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.507629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.507726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.507751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.507856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.507958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.507983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.508107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.508199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.508224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.508318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.508416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.508441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.508551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.508662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.508688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.508782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.508880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.508906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.509004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.509107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.509131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.509238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.509336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.509360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.509449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.509553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.509579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.509684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.509803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.509828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.981 [2024-11-28 01:25:18.509916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.510024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.981 [2024-11-28 01:25:18.510050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.981 qpair failed and we were unable to recover it. 00:31:03.982 [2024-11-28 01:25:18.510203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.982 [2024-11-28 01:25:18.510298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.982 [2024-11-28 01:25:18.510323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.982 qpair failed and we were unable to recover it. 00:31:03.982 [2024-11-28 01:25:18.510450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.982 [2024-11-28 01:25:18.510552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.982 [2024-11-28 01:25:18.510578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.982 qpair failed and we were unable to recover it. 00:31:03.982 [2024-11-28 01:25:18.510671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.982 [2024-11-28 01:25:18.510768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:03.982 [2024-11-28 01:25:18.510792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:03.982 qpair failed and we were unable to recover it. 00:31:04.254 [2024-11-28 01:25:18.510895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.254 [2024-11-28 01:25:18.510995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.254 [2024-11-28 01:25:18.511020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.254 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.511115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.511212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.511237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.511332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.511421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.511446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.511536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.511639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.511663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.511756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.511881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.511905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.512007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.512104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.512129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.512220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.512309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.512334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.512441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.512571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.512597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.512693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.512842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.512867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.512964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.513067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.513092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.513197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.513299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.513324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.513430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.513522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.513553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.513654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.513751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.513775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.513866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.513956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.513980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.514078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.514200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.514224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.514334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.514426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.514451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.514583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.514673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.514697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.514798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.514900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.514926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.515021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.515115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.515140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.515227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.515332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.515357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.515452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.515582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.515607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.515707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.515804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.515829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.515931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.516027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.516051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.516159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.516283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.516308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.516413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.516511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.516543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.516641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.516768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.516793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.516913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.517004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.517029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.517154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.517258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.255 [2024-11-28 01:25:18.517283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.255 qpair failed and we were unable to recover it. 00:31:04.255 [2024-11-28 01:25:18.517387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.517508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.517553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.517664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.517755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.517780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.517869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.517964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.517988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.518092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.518211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.518235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.518337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.518432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.518457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.518586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.518680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.518704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.518802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.518920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.518944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.519050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.519142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.519171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.519266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.519416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.519440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.519538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.519658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.519683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.519786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.519877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.519902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.520026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.520147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.520171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.520272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.520367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.520392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.520479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.520576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.520601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.520692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.520824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.520849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.520949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.521053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.521079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.521173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.521265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.521290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.521392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.521488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.521513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.521633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.521733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.521757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.521867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.521993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.522017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.522128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.522264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.522289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.522378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.522462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.522487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.522638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.522732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.522757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.522870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.522964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.522989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.523084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.523176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.523201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.523290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.523385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.523409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.523532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.523686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.523711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.523812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.523906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.523931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.256 qpair failed and we were unable to recover it. 00:31:04.256 [2024-11-28 01:25:18.524050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.524153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.256 [2024-11-28 01:25:18.524178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.524300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.524393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.524417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.524505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.524620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.524645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.524753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.524878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.524902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.524999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.525125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.525150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.525253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.525377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.525401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.525536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.525625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.525650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.525742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.525831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.525855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.525952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.526073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.526098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.526195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.526291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.526317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.526442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.526550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.526576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.526666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.526793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.526817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.526941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.527039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.527063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.527162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.527280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.527305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.527398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.527573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.527599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.527731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.527824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.527849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.527940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.528035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.528060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.528170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.528294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.528318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.528417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.528536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.528561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.528681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.528834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.528858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.528959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.529047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.529076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.529219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.529321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.529346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.529451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.529567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.529593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.529694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.529789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.529815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.529917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.530006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.530030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.530157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.530346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.530371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.530502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.530609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.530635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.530900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.531023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.531047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.257 [2024-11-28 01:25:18.531143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.531264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.257 [2024-11-28 01:25:18.531289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.257 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.531416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.531509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.531541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.531674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.531762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.531790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.531889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.531987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.532011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.532110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 01:25:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:04.258 [2024-11-28 01:25:18.532237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.532263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 01:25:18 -- common/autotest_common.sh@862 -- # return 0 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.532364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 01:25:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:04.258 [2024-11-28 01:25:18.532452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.532477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 01:25:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:04.258 [2024-11-28 01:25:18.532576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 01:25:18 -- common/autotest_common.sh@10 -- # set +x 00:31:04.258 [2024-11-28 01:25:18.532705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.532730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.532827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.532919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.532943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.533034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.533162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.533187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.533325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.533428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.533452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.533565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.533658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.533683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.533779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.533874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.533899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.534001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.534098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.534122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.534220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.534343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.534370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.534470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.534572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.534598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.534722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.534813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.534838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.534984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.535082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.535106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.535195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.535315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.535340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.535439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.535551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.535576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.535672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.535762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.535787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.535888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.536032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.536069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.536198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.536313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.536347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.536448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.536582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.536607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.536717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.536861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.536885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.536989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.537078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.537103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.537235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.537323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.537348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.537441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.537551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.537577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.537673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.537768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.537794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.258 [2024-11-28 01:25:18.537902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.538024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.258 [2024-11-28 01:25:18.538049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.258 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.538141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.538245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.538269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.538396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.538492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.538517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.538610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.538705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.538731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.538840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.538935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.538964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.539062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.539179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.539204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.539302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.539402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.539427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.539568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.539674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.539699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.539797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.539953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.539984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.540083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.540186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.540212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.540319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.540414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.540439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.540588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.540691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.540716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.540815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.540917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.540942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.541048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.541186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.541211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.541375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.541469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.541493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.541609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.541711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.541736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.541836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.541967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.541991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.542083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.542238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.542263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.542350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.542442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.542466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.542601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.542726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.542751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.542896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.542985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.543009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.543134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.543229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.543253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.543357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.543478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.543504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.543606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.543710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.543735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.259 qpair failed and we were unable to recover it. 00:31:04.259 [2024-11-28 01:25:18.543859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.259 [2024-11-28 01:25:18.544030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.544055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.544159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.544250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.544274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.544372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.544496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.544520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.544639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.544735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.544761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.544902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.545027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.545052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.545147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.545249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.545273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.545394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.545489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.545514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.545633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.545762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.545787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.545891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.546015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.546041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.546129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.546227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.546251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.546350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.546477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.546503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.546620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.546717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.546742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.546875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.546996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.547021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.547116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.547205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.547230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.547332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.547435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.547460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.547590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.547716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.547741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.547872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.547979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.548004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.548092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.548185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.548210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.548347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.548475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.548501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.548600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.548700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.548725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.548817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.548934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.548959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.549100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.549201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.549228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.549389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.549487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.549512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.549642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.549737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.549762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.549863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.550016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.550042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.550149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.550264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.550289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.550388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.550487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.550513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.550650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.550754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.550779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.550926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.551018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.260 [2024-11-28 01:25:18.551042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.260 qpair failed and we were unable to recover it. 00:31:04.260 [2024-11-28 01:25:18.551148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.551240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.551264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.551364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.551489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.551514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.551660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.551759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.551788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.551925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.552014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.552038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.552160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.552262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.552286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.552389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.552495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.552520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.552629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.552735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.552760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.552861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 01:25:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:04.261 [2024-11-28 01:25:18.552960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.552986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.553113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.553238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 01:25:18 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:31:04.261 [2024-11-28 01:25:18.553264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.553375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.553496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.553521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 01:25:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:04.261 [2024-11-28 01:25:18.553656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 01:25:18 -- common/autotest_common.sh@10 -- # set +x 00:31:04.261 [2024-11-28 01:25:18.553748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.553773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.553882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.553986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.554010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.554118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.554237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.554261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.554363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.554489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.554514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.554627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.554719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.554743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.554848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.554951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.554976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.555103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.555252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.555276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.555379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.555498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.555523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.555631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.555726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.555751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.555852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.555951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.555976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.556079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.556199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.556224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.556322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.556425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.556449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.556550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.556687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.556712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.556809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.556959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.556984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.557106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.557255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.557280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.557382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.557506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.557536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.557643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.557731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.557755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.557846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.557938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.261 [2024-11-28 01:25:18.557962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.261 qpair failed and we were unable to recover it. 00:31:04.261 [2024-11-28 01:25:18.558087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.558239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.558264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.558362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.558463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.558488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.558637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.558765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.558789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.558885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.559013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.559038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.559138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.559232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.559261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.559361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.559487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.559511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.559642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.559737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.559761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.559882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.559969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.559994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.560117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.560243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.560268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.560395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.560494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.560519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.560670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.560756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.560781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.560888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.561006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.561030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.561133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.561259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.561285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.561407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.561501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.561533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.561669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.561791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.561820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.561920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.562016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.562041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.562179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.562306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.562331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.562432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.562530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.562556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.562694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.562823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.562847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.562943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.563039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.563064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.563164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.563282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.563306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.563434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.563534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.563560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.563663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.563759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.563784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.563876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.564011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.564036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.564154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.564250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.564276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.564397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.564535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.564561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.564692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.564783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.564808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.564897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.564995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.565019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.262 [2024-11-28 01:25:18.565109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.565218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.262 [2024-11-28 01:25:18.565241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.262 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.565367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.565472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.565496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.565604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.568673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.568699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.568828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.568986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.569011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.569139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.569242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.569266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.569394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.569492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.569517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.569667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.569758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.569782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.569878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.569999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.570024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.570155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.570254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.570279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.570408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.570503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.570534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.570701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.570803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.570828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.570961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.571056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.571083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.571176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.571306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.571331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.571434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.571536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.571562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.571693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.571824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.571848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.571945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.572066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.572090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.572217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.572318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.572343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.572471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.572579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.572608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.572715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.572809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.572834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.572968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.573070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.573094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.573190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.573314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.573339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.573439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.573537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.573563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.573667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.573757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.573781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.573882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.573974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.573999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.574099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.574201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.574225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.574334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.574438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.574462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.574566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.574663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.574687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.574815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.574949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.574978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.575071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.575162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.575188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.263 qpair failed and we were unable to recover it. 00:31:04.263 [2024-11-28 01:25:18.575314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.263 [2024-11-28 01:25:18.575448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.575473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.575574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.575668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.575692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.575812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.575908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.575933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.576055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.576158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.576183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.576276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.576397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.576421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.576516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.576628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.576653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.576783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.576884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.576908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.577008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.577098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.577122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.577283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.577387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.577412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.577522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.577630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.577655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.577752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.577869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.577894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.578002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.578100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 Malloc0 00:31:04.264 [2024-11-28 01:25:18.578126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.578235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.578382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.578407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 01:25:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:04.264 [2024-11-28 01:25:18.578504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.578617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.578642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 01:25:18 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:31:04.264 [2024-11-28 01:25:18.578776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 01:25:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:04.264 [2024-11-28 01:25:18.578883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.578908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 01:25:18 -- common/autotest_common.sh@10 -- # set +x 00:31:04.264 [2024-11-28 01:25:18.579013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.579111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.579136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.579264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.579357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.579381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.579481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.579592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.579618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.579728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.579833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.579858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.579950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.580073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.580097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.580201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.580302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.580326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.580417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.580519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.580551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.580675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.580799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.580824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.580936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.581067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.581092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.581188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.581279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.264 [2024-11-28 01:25:18.581303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.264 qpair failed and we were unable to recover it. 00:31:04.264 [2024-11-28 01:25:18.581404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.581520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.581551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.581646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.581740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.581765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.581822] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:04.265 [2024-11-28 01:25:18.581896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.582045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.582069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.582174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.582266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.582290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.582384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.582479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.582505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x645f20 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.582650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.582796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.582825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.582956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.583089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.583114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.583210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.583330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.583355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.583518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.583670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.583705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.583831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.583963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.583989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.584089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.584191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.584218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.584360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.584457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.584482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.584600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.584701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.584728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.584855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.584965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.584990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.585121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.585222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.585258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.585375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.585475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.585500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.585616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.585726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.585751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.585894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.585996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.586021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.586151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.586269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.586305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.586429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.586540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.586568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.586679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.586773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.586800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.586929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.587030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.587056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.587183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.587300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.587325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.587429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.587557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.587591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.587692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.587788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.587813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.587952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.588051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.588076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.588181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.588303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.588328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.588431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.588545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.588572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.265 qpair failed and we were unable to recover it. 00:31:04.265 [2024-11-28 01:25:18.588668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.265 [2024-11-28 01:25:18.588797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.588822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.588948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.589040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.589065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.589187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.589315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.589340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.589437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.589539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.589565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.589690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.589817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.589842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.589947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 01:25:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:04.266 [2024-11-28 01:25:18.590071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.590096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.590188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 01:25:18 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:31:04.266 [2024-11-28 01:25:18.590288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.590314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 01:25:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.590410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 01:25:18 -- common/autotest_common.sh@10 -- # set +x 00:31:04.266 [2024-11-28 01:25:18.590537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.590562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.590662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.590766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.590792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.590919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.591045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.591070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.591165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.591297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.591322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.591428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.591521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.591555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.591663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.591757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.591782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.591888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.592016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.592042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.592138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.592266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.592291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.592420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.592531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.592558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.592680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.592781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.592805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.592903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.593007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.593032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.593127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.593227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.593253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.593351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.593448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.593473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.593615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.593742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.593766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.593869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.594000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.594025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.594151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.594279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.594304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.594415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.594511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.594543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.594681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.594773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.594798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.594920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.595051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.595076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.595165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.595286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.595311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.266 [2024-11-28 01:25:18.595410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.595534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.266 [2024-11-28 01:25:18.595560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.266 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.595690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.595795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.595820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.595948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.596048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.596073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.596162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.596264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.596290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.596392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.596483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.596509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.596631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.596787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.596812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.596943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.597070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.597096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.597218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.597318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.597343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.597449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.597548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.597574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.597700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.597802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.597829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.597941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.598040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.598065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 01:25:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:04.267 [2024-11-28 01:25:18.598192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 01:25:18 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:31:04.267 [2024-11-28 01:25:18.598301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.598327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 01:25:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:04.267 [2024-11-28 01:25:18.598423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 01:25:18 -- common/autotest_common.sh@10 -- # set +x 00:31:04.267 [2024-11-28 01:25:18.598550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.598576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.598668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.598765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.598791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.598896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.598991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.599017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.599123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.599242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.599267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.599371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.599466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.599492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.599602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.599710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.599735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.599839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.599963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.599988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.600110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.600211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.600237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.600370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.600491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.600517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.600616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.600712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.600739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.600841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.600940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.600966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.601095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.601223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.601248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.601367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.601462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.601488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.601593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.601693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.601718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.601842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.601942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.601969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.602071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.602208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.602234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.267 qpair failed and we were unable to recover it. 00:31:04.267 [2024-11-28 01:25:18.602365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.602493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.267 [2024-11-28 01:25:18.602518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.602633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.602733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.602758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.602887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.603009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.603034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.603156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.603281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.603306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.603400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.603503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.603535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.603663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.603759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.603786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.603883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.604009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.604036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.604165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.604260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.604286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.604410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.604515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.604548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.604644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.604777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.604802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.604899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.605001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.605026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.605129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.605222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.605248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.605375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.605474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.605499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.605652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.605741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.605766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.605868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.605963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.605989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 01:25:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:04.268 [2024-11-28 01:25:18.606082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.606213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 01:25:18 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:04.268 [2024-11-28 01:25:18.606238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.606341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 01:25:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:04.268 01:25:18 -- common/autotest_common.sh@10 -- # set +x 00:31:04.268 [2024-11-28 01:25:18.606470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.606495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.606608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.606716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.606742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.606840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.606967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.606993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.607107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.607229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.607255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.607358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.607455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.607480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.607581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.607675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.607700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.607803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.607930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.607955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.608052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.608177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.608203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.608304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.608428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.268 [2024-11-28 01:25:18.608453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.268 qpair failed and we were unable to recover it. 00:31:04.268 [2024-11-28 01:25:18.608559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.269 [2024-11-28 01:25:18.608657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.269 [2024-11-28 01:25:18.608683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.269 qpair failed and we were unable to recover it. 00:31:04.269 [2024-11-28 01:25:18.608818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.269 [2024-11-28 01:25:18.608970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.269 [2024-11-28 01:25:18.608995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.269 qpair failed and we were unable to recover it. 00:31:04.269 [2024-11-28 01:25:18.609149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.269 [2024-11-28 01:25:18.609246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.269 [2024-11-28 01:25:18.609272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.269 qpair failed and we were unable to recover it. 00:31:04.269 [2024-11-28 01:25:18.609370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.269 [2024-11-28 01:25:18.609464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.269 [2024-11-28 01:25:18.609491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.269 qpair failed and we were unable to recover it. 00:31:04.269 [2024-11-28 01:25:18.609604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.269 [2024-11-28 01:25:18.609728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.269 [2024-11-28 01:25:18.609754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa3a8000b90 with addr=10.0.0.2, port=4420 00:31:04.269 qpair failed and we were unable to recover it. 00:31:04.269 [2024-11-28 01:25:18.609855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.269 [2024-11-28 01:25:18.610058] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:04.269 [2024-11-28 01:25:18.612927] posix.c: 670:posix_sock_psk_use_session_client_cb: *ERROR*: PSK is not set 00:31:04.269 [2024-11-28 01:25:18.613004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7fa3a8000b90 (107): Transport endpoint is not connected 00:31:04.269 [2024-11-28 01:25:18.613074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:04.269 qpair failed and we were unable to recover it. 00:31:04.269 01:25:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:04.269 01:25:18 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:31:04.269 01:25:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:04.269 01:25:18 -- common/autotest_common.sh@10 -- # set +x 00:31:04.269 01:25:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:04.269 01:25:18 -- host/target_disconnect.sh@58 -- # wait 2168856 00:31:04.269 [2024-11-28 01:25:18.622534] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.269 [2024-11-28 01:25:18.622661] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.269 [2024-11-28 01:25:18.622690] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.269 [2024-11-28 01:25:18.622706] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.269 [2024-11-28 01:25:18.622718] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3a8000b90 00:31:04.269 [2024-11-28 01:25:18.622748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:04.269 qpair failed and we were unable to recover it. 00:31:04.269 [2024-11-28 01:25:18.632502] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.269 [2024-11-28 01:25:18.632611] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.269 [2024-11-28 01:25:18.632639] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.269 [2024-11-28 01:25:18.632653] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.269 [2024-11-28 01:25:18.632665] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3a8000b90 00:31:04.269 [2024-11-28 01:25:18.632695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:04.269 qpair failed and we were unable to recover it. 00:31:04.269 [2024-11-28 01:25:18.642426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.269 [2024-11-28 01:25:18.642545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.269 [2024-11-28 01:25:18.642585] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.269 [2024-11-28 01:25:18.642599] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.269 [2024-11-28 01:25:18.642617] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3a8000b90 00:31:04.269 [2024-11-28 01:25:18.642647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:04.269 qpair failed and we were unable to recover it. 00:31:04.269 [2024-11-28 01:25:18.652494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.269 [2024-11-28 01:25:18.652622] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.269 [2024-11-28 01:25:18.652649] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.269 [2024-11-28 01:25:18.652664] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.269 [2024-11-28 01:25:18.652675] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3a8000b90 00:31:04.269 [2024-11-28 01:25:18.652705] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:04.269 qpair failed and we were unable to recover it. 00:31:04.269 [2024-11-28 01:25:18.662467] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.269 [2024-11-28 01:25:18.662584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.269 [2024-11-28 01:25:18.662611] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.269 [2024-11-28 01:25:18.662625] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.269 [2024-11-28 01:25:18.662638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3a8000b90 00:31:04.269 [2024-11-28 01:25:18.662667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:04.269 qpair failed and we were unable to recover it. 00:31:04.269 [2024-11-28 01:25:18.672464] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.269 [2024-11-28 01:25:18.672567] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.269 [2024-11-28 01:25:18.672593] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.269 [2024-11-28 01:25:18.672607] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.269 [2024-11-28 01:25:18.672619] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3a8000b90 00:31:04.269 [2024-11-28 01:25:18.672648] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:04.269 qpair failed and we were unable to recover it. 00:31:04.269 [2024-11-28 01:25:18.682564] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.269 [2024-11-28 01:25:18.682671] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.269 [2024-11-28 01:25:18.682697] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.269 [2024-11-28 01:25:18.682711] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.269 [2024-11-28 01:25:18.682722] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3a8000b90 00:31:04.269 [2024-11-28 01:25:18.682752] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:04.269 qpair failed and we were unable to recover it. 00:31:04.269 [2024-11-28 01:25:18.692519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.269 [2024-11-28 01:25:18.692645] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.269 [2024-11-28 01:25:18.692672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.269 [2024-11-28 01:25:18.692687] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.269 [2024-11-28 01:25:18.692699] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3a8000b90 00:31:04.269 [2024-11-28 01:25:18.692729] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:04.269 qpair failed and we were unable to recover it. 00:31:04.269 [2024-11-28 01:25:18.702534] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.269 [2024-11-28 01:25:18.702647] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.269 [2024-11-28 01:25:18.702673] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.269 [2024-11-28 01:25:18.702687] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.269 [2024-11-28 01:25:18.702699] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3a8000b90 00:31:04.269 [2024-11-28 01:25:18.702728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:04.269 qpair failed and we were unable to recover it. 00:31:04.269 [2024-11-28 01:25:18.712563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.269 [2024-11-28 01:25:18.712673] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.269 [2024-11-28 01:25:18.712699] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.269 [2024-11-28 01:25:18.712714] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.270 [2024-11-28 01:25:18.712726] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3a8000b90 00:31:04.270 [2024-11-28 01:25:18.712755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:04.270 qpair failed and we were unable to recover it. 00:31:04.270 [2024-11-28 01:25:18.722583] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.270 [2024-11-28 01:25:18.722699] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.270 [2024-11-28 01:25:18.722725] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.270 [2024-11-28 01:25:18.722739] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.270 [2024-11-28 01:25:18.722751] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3a8000b90 00:31:04.270 [2024-11-28 01:25:18.722781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:04.270 qpair failed and we were unable to recover it. 00:31:04.270 [2024-11-28 01:25:18.732667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.270 [2024-11-28 01:25:18.732782] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.270 [2024-11-28 01:25:18.732808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.270 [2024-11-28 01:25:18.732822] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.270 [2024-11-28 01:25:18.732841] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3a8000b90 00:31:04.270 [2024-11-28 01:25:18.732871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:04.270 qpair failed and we were unable to recover it. 00:31:04.270 [2024-11-28 01:25:18.742642] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.270 [2024-11-28 01:25:18.742748] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.270 [2024-11-28 01:25:18.742774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.270 [2024-11-28 01:25:18.742788] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.270 [2024-11-28 01:25:18.742800] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3a8000b90 00:31:04.270 [2024-11-28 01:25:18.742829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:04.270 qpair failed and we were unable to recover it. 00:31:04.270 [2024-11-28 01:25:18.752809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.270 [2024-11-28 01:25:18.752924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.270 [2024-11-28 01:25:18.752951] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.270 [2024-11-28 01:25:18.752965] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.270 [2024-11-28 01:25:18.752978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3a8000b90 00:31:04.270 [2024-11-28 01:25:18.753007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:04.270 qpair failed and we were unable to recover it. 00:31:04.270 [2024-11-28 01:25:18.762763] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.270 [2024-11-28 01:25:18.762876] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.270 [2024-11-28 01:25:18.762902] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.270 [2024-11-28 01:25:18.762916] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.270 [2024-11-28 01:25:18.762928] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3a8000b90 00:31:04.270 [2024-11-28 01:25:18.762957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:04.270 qpair failed and we were unable to recover it. 00:31:04.270 [2024-11-28 01:25:18.772743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.270 [2024-11-28 01:25:18.772857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.270 [2024-11-28 01:25:18.772884] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.270 [2024-11-28 01:25:18.772898] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.270 [2024-11-28 01:25:18.772911] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3a8000b90 00:31:04.270 [2024-11-28 01:25:18.772941] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:04.270 qpair failed and we were unable to recover it. 00:31:04.270 [2024-11-28 01:25:18.782792] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.270 [2024-11-28 01:25:18.782896] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.270 [2024-11-28 01:25:18.782929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.270 [2024-11-28 01:25:18.782946] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.270 [2024-11-28 01:25:18.782958] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.270 [2024-11-28 01:25:18.782991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.270 qpair failed and we were unable to recover it. 00:31:04.270 [2024-11-28 01:25:18.792784] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.270 [2024-11-28 01:25:18.792890] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.270 [2024-11-28 01:25:18.792918] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.270 [2024-11-28 01:25:18.792933] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.270 [2024-11-28 01:25:18.792945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.270 [2024-11-28 01:25:18.792975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.270 qpair failed and we were unable to recover it. 00:31:04.270 [2024-11-28 01:25:18.802813] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.270 [2024-11-28 01:25:18.802923] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.270 [2024-11-28 01:25:18.802950] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.270 [2024-11-28 01:25:18.802965] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.270 [2024-11-28 01:25:18.802977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.270 [2024-11-28 01:25:18.803010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.270 qpair failed and we were unable to recover it. 00:31:04.270 [2024-11-28 01:25:18.812844] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.270 [2024-11-28 01:25:18.812958] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.270 [2024-11-28 01:25:18.812985] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.270 [2024-11-28 01:25:18.812999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.270 [2024-11-28 01:25:18.813011] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.270 [2024-11-28 01:25:18.813039] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.270 qpair failed and we were unable to recover it. 00:31:04.270 [2024-11-28 01:25:18.822838] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.270 [2024-11-28 01:25:18.822940] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.270 [2024-11-28 01:25:18.822970] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.270 [2024-11-28 01:25:18.822992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.270 [2024-11-28 01:25:18.823005] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.270 [2024-11-28 01:25:18.823038] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.270 qpair failed and we were unable to recover it. 00:31:04.270 [2024-11-28 01:25:18.832863] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.270 [2024-11-28 01:25:18.832988] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.270 [2024-11-28 01:25:18.833015] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.270 [2024-11-28 01:25:18.833030] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.270 [2024-11-28 01:25:18.833042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.270 [2024-11-28 01:25:18.833071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.270 qpair failed and we were unable to recover it. 00:31:04.530 [2024-11-28 01:25:18.842889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.530 [2024-11-28 01:25:18.843003] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.530 [2024-11-28 01:25:18.843039] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.530 [2024-11-28 01:25:18.843062] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.530 [2024-11-28 01:25:18.843081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.530 [2024-11-28 01:25:18.843122] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.530 qpair failed and we were unable to recover it. 00:31:04.530 [2024-11-28 01:25:18.853034] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.530 [2024-11-28 01:25:18.853140] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.530 [2024-11-28 01:25:18.853168] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.530 [2024-11-28 01:25:18.853183] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.530 [2024-11-28 01:25:18.853195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.530 [2024-11-28 01:25:18.853225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.530 qpair failed and we were unable to recover it. 00:31:04.530 [2024-11-28 01:25:18.863049] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.530 [2024-11-28 01:25:18.863152] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.530 [2024-11-28 01:25:18.863179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.530 [2024-11-28 01:25:18.863194] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.530 [2024-11-28 01:25:18.863206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.530 [2024-11-28 01:25:18.863236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.530 qpair failed and we were unable to recover it. 00:31:04.530 [2024-11-28 01:25:18.873034] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.530 [2024-11-28 01:25:18.873143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.530 [2024-11-28 01:25:18.873169] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.530 [2024-11-28 01:25:18.873184] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.530 [2024-11-28 01:25:18.873196] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.530 [2024-11-28 01:25:18.873225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.530 qpair failed and we were unable to recover it. 00:31:04.530 [2024-11-28 01:25:18.883069] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.530 [2024-11-28 01:25:18.883189] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.530 [2024-11-28 01:25:18.883216] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.530 [2024-11-28 01:25:18.883231] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.530 [2024-11-28 01:25:18.883243] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.530 [2024-11-28 01:25:18.883274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.530 qpair failed and we were unable to recover it. 00:31:04.530 [2024-11-28 01:25:18.893045] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.530 [2024-11-28 01:25:18.893154] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.530 [2024-11-28 01:25:18.893181] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.530 [2024-11-28 01:25:18.893196] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.530 [2024-11-28 01:25:18.893208] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.530 [2024-11-28 01:25:18.893237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.530 qpair failed and we were unable to recover it. 00:31:04.530 [2024-11-28 01:25:18.903155] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.530 [2024-11-28 01:25:18.903250] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.530 [2024-11-28 01:25:18.903277] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.530 [2024-11-28 01:25:18.903291] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.530 [2024-11-28 01:25:18.903303] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.530 [2024-11-28 01:25:18.903332] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.530 qpair failed and we were unable to recover it. 00:31:04.530 [2024-11-28 01:25:18.913197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.530 [2024-11-28 01:25:18.913295] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.530 [2024-11-28 01:25:18.913321] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.530 [2024-11-28 01:25:18.913341] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.530 [2024-11-28 01:25:18.913355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.530 [2024-11-28 01:25:18.913384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.530 qpair failed and we were unable to recover it. 00:31:04.530 [2024-11-28 01:25:18.923151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.530 [2024-11-28 01:25:18.923258] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.530 [2024-11-28 01:25:18.923285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.530 [2024-11-28 01:25:18.923299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.530 [2024-11-28 01:25:18.923311] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.530 [2024-11-28 01:25:18.923340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.530 qpair failed and we were unable to recover it. 00:31:04.530 [2024-11-28 01:25:18.933269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.530 [2024-11-28 01:25:18.933375] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.530 [2024-11-28 01:25:18.933401] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.530 [2024-11-28 01:25:18.933415] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.531 [2024-11-28 01:25:18.933427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.531 [2024-11-28 01:25:18.933456] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.531 qpair failed and we were unable to recover it. 00:31:04.531 [2024-11-28 01:25:18.943311] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.531 [2024-11-28 01:25:18.943412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.531 [2024-11-28 01:25:18.943439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.531 [2024-11-28 01:25:18.943453] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.531 [2024-11-28 01:25:18.943465] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.531 [2024-11-28 01:25:18.943494] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.531 qpair failed and we were unable to recover it. 00:31:04.531 [2024-11-28 01:25:18.953236] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.531 [2024-11-28 01:25:18.953361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.531 [2024-11-28 01:25:18.953388] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.531 [2024-11-28 01:25:18.953402] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.531 [2024-11-28 01:25:18.953414] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.531 [2024-11-28 01:25:18.953443] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.531 qpair failed and we were unable to recover it. 00:31:04.531 [2024-11-28 01:25:18.963277] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.531 [2024-11-28 01:25:18.963382] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.531 [2024-11-28 01:25:18.963408] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.531 [2024-11-28 01:25:18.963422] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.531 [2024-11-28 01:25:18.963434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.531 [2024-11-28 01:25:18.963467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.531 qpair failed and we were unable to recover it. 00:31:04.531 [2024-11-28 01:25:18.973312] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.531 [2024-11-28 01:25:18.973438] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.531 [2024-11-28 01:25:18.973465] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.531 [2024-11-28 01:25:18.973480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.531 [2024-11-28 01:25:18.973496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.531 [2024-11-28 01:25:18.973533] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.531 qpair failed and we were unable to recover it. 00:31:04.531 [2024-11-28 01:25:18.983314] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.531 [2024-11-28 01:25:18.983421] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.531 [2024-11-28 01:25:18.983448] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.531 [2024-11-28 01:25:18.983463] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.531 [2024-11-28 01:25:18.983475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.531 [2024-11-28 01:25:18.983504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.531 qpair failed and we were unable to recover it. 00:31:04.531 [2024-11-28 01:25:18.993332] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.531 [2024-11-28 01:25:18.993445] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.531 [2024-11-28 01:25:18.993471] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.531 [2024-11-28 01:25:18.993485] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.531 [2024-11-28 01:25:18.993497] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.531 [2024-11-28 01:25:18.993534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.531 qpair failed and we were unable to recover it. 00:31:04.531 [2024-11-28 01:25:19.003390] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.531 [2024-11-28 01:25:19.003498] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.531 [2024-11-28 01:25:19.003541] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.531 [2024-11-28 01:25:19.003559] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.531 [2024-11-28 01:25:19.003571] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.531 [2024-11-28 01:25:19.003604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.531 qpair failed and we were unable to recover it. 00:31:04.531 [2024-11-28 01:25:19.013511] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.531 [2024-11-28 01:25:19.013627] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.531 [2024-11-28 01:25:19.013654] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.531 [2024-11-28 01:25:19.013668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.531 [2024-11-28 01:25:19.013680] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.531 [2024-11-28 01:25:19.013709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.531 qpair failed and we were unable to recover it. 00:31:04.531 [2024-11-28 01:25:19.023490] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.531 [2024-11-28 01:25:19.023594] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.531 [2024-11-28 01:25:19.023621] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.531 [2024-11-28 01:25:19.023635] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.531 [2024-11-28 01:25:19.023646] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.531 [2024-11-28 01:25:19.023676] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.531 qpair failed and we were unable to recover it. 00:31:04.531 [2024-11-28 01:25:19.033484] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.531 [2024-11-28 01:25:19.033602] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.531 [2024-11-28 01:25:19.033628] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.531 [2024-11-28 01:25:19.033643] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.531 [2024-11-28 01:25:19.033654] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.531 [2024-11-28 01:25:19.033684] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.531 qpair failed and we were unable to recover it. 00:31:04.531 [2024-11-28 01:25:19.043522] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.531 [2024-11-28 01:25:19.043650] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.531 [2024-11-28 01:25:19.043676] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.531 [2024-11-28 01:25:19.043690] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.531 [2024-11-28 01:25:19.043701] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.531 [2024-11-28 01:25:19.043737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.531 qpair failed and we were unable to recover it. 00:31:04.531 [2024-11-28 01:25:19.053621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.531 [2024-11-28 01:25:19.053731] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.531 [2024-11-28 01:25:19.053756] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.531 [2024-11-28 01:25:19.053769] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.531 [2024-11-28 01:25:19.053782] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.531 [2024-11-28 01:25:19.053811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.531 qpair failed and we were unable to recover it. 00:31:04.531 [2024-11-28 01:25:19.063561] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.531 [2024-11-28 01:25:19.063663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.531 [2024-11-28 01:25:19.063689] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.531 [2024-11-28 01:25:19.063703] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.531 [2024-11-28 01:25:19.063715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.532 [2024-11-28 01:25:19.063744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.532 qpair failed and we were unable to recover it. 00:31:04.532 [2024-11-28 01:25:19.073575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.532 [2024-11-28 01:25:19.073677] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.532 [2024-11-28 01:25:19.073703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.532 [2024-11-28 01:25:19.073717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.532 [2024-11-28 01:25:19.073730] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.532 [2024-11-28 01:25:19.073759] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.532 qpair failed and we were unable to recover it. 00:31:04.532 [2024-11-28 01:25:19.083630] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.532 [2024-11-28 01:25:19.083773] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.532 [2024-11-28 01:25:19.083801] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.532 [2024-11-28 01:25:19.083816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.532 [2024-11-28 01:25:19.083833] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.532 [2024-11-28 01:25:19.083878] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.532 qpair failed and we were unable to recover it. 00:31:04.532 [2024-11-28 01:25:19.093650] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.532 [2024-11-28 01:25:19.093762] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.532 [2024-11-28 01:25:19.093797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.532 [2024-11-28 01:25:19.093813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.532 [2024-11-28 01:25:19.093825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.532 [2024-11-28 01:25:19.093854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.532 qpair failed and we were unable to recover it. 00:31:04.532 [2024-11-28 01:25:19.103696] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.532 [2024-11-28 01:25:19.103828] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.532 [2024-11-28 01:25:19.103854] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.532 [2024-11-28 01:25:19.103868] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.532 [2024-11-28 01:25:19.103880] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.532 [2024-11-28 01:25:19.103909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.532 qpair failed and we were unable to recover it. 00:31:04.532 [2024-11-28 01:25:19.113789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.532 [2024-11-28 01:25:19.113891] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.532 [2024-11-28 01:25:19.113917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.532 [2024-11-28 01:25:19.113931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.532 [2024-11-28 01:25:19.113943] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.532 [2024-11-28 01:25:19.113972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.532 qpair failed and we were unable to recover it. 00:31:04.532 [2024-11-28 01:25:19.123836] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.532 [2024-11-28 01:25:19.123954] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.532 [2024-11-28 01:25:19.123994] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.532 [2024-11-28 01:25:19.124008] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.532 [2024-11-28 01:25:19.124019] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.532 [2024-11-28 01:25:19.124062] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.532 qpair failed and we were unable to recover it. 00:31:04.791 [2024-11-28 01:25:19.133909] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.791 [2024-11-28 01:25:19.134039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.791 [2024-11-28 01:25:19.134067] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.791 [2024-11-28 01:25:19.134082] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.791 [2024-11-28 01:25:19.134100] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.791 [2024-11-28 01:25:19.134146] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.791 qpair failed and we were unable to recover it. 00:31:04.791 [2024-11-28 01:25:19.143773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.791 [2024-11-28 01:25:19.143871] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.791 [2024-11-28 01:25:19.143899] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.791 [2024-11-28 01:25:19.143914] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.791 [2024-11-28 01:25:19.143926] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.791 [2024-11-28 01:25:19.143956] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.791 qpair failed and we were unable to recover it. 00:31:04.791 [2024-11-28 01:25:19.153803] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.791 [2024-11-28 01:25:19.153902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.791 [2024-11-28 01:25:19.153929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.791 [2024-11-28 01:25:19.153944] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.791 [2024-11-28 01:25:19.153956] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.791 [2024-11-28 01:25:19.153985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.791 qpair failed and we were unable to recover it. 00:31:04.791 [2024-11-28 01:25:19.163859] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.791 [2024-11-28 01:25:19.163961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.791 [2024-11-28 01:25:19.163987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.791 [2024-11-28 01:25:19.164001] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.791 [2024-11-28 01:25:19.164014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.791 [2024-11-28 01:25:19.164054] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.792 qpair failed and we were unable to recover it. 00:31:04.792 [2024-11-28 01:25:19.173964] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.792 [2024-11-28 01:25:19.174078] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.792 [2024-11-28 01:25:19.174105] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.792 [2024-11-28 01:25:19.174119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.792 [2024-11-28 01:25:19.174131] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.792 [2024-11-28 01:25:19.174160] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.792 qpair failed and we were unable to recover it. 00:31:04.792 [2024-11-28 01:25:19.183991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.792 [2024-11-28 01:25:19.184093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.792 [2024-11-28 01:25:19.184119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.792 [2024-11-28 01:25:19.184133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.792 [2024-11-28 01:25:19.184146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.792 [2024-11-28 01:25:19.184175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.792 qpair failed and we were unable to recover it. 00:31:04.792 [2024-11-28 01:25:19.193927] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.792 [2024-11-28 01:25:19.194023] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.792 [2024-11-28 01:25:19.194049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.792 [2024-11-28 01:25:19.194064] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.792 [2024-11-28 01:25:19.194076] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.792 [2024-11-28 01:25:19.194104] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.792 qpair failed and we were unable to recover it. 00:31:04.792 [2024-11-28 01:25:19.204011] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.792 [2024-11-28 01:25:19.204115] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.792 [2024-11-28 01:25:19.204141] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.792 [2024-11-28 01:25:19.204155] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.792 [2024-11-28 01:25:19.204167] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.792 [2024-11-28 01:25:19.204196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.792 qpair failed and we were unable to recover it. 00:31:04.792 [2024-11-28 01:25:19.214082] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.792 [2024-11-28 01:25:19.214181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.792 [2024-11-28 01:25:19.214206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.792 [2024-11-28 01:25:19.214220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.792 [2024-11-28 01:25:19.214232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.792 [2024-11-28 01:25:19.214260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.792 qpair failed and we were unable to recover it. 00:31:04.792 [2024-11-28 01:25:19.224047] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.792 [2024-11-28 01:25:19.224147] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.792 [2024-11-28 01:25:19.224173] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.792 [2024-11-28 01:25:19.224187] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.792 [2024-11-28 01:25:19.224206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.792 [2024-11-28 01:25:19.224235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.792 qpair failed and we were unable to recover it. 00:31:04.792 [2024-11-28 01:25:19.234055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.792 [2024-11-28 01:25:19.234160] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.792 [2024-11-28 01:25:19.234185] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.792 [2024-11-28 01:25:19.234199] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.792 [2024-11-28 01:25:19.234211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.792 [2024-11-28 01:25:19.234240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.792 qpair failed and we were unable to recover it. 00:31:04.792 [2024-11-28 01:25:19.244183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.792 [2024-11-28 01:25:19.244281] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.792 [2024-11-28 01:25:19.244307] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.792 [2024-11-28 01:25:19.244321] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.792 [2024-11-28 01:25:19.244333] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.792 [2024-11-28 01:25:19.244363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.792 qpair failed and we were unable to recover it. 00:31:04.792 [2024-11-28 01:25:19.254193] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.792 [2024-11-28 01:25:19.254305] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.792 [2024-11-28 01:25:19.254331] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.792 [2024-11-28 01:25:19.254345] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.792 [2024-11-28 01:25:19.254358] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.792 [2024-11-28 01:25:19.254387] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.792 qpair failed and we were unable to recover it. 00:31:04.792 [2024-11-28 01:25:19.264110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.792 [2024-11-28 01:25:19.264221] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.792 [2024-11-28 01:25:19.264247] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.792 [2024-11-28 01:25:19.264261] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.792 [2024-11-28 01:25:19.264273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.792 [2024-11-28 01:25:19.264302] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.792 qpair failed and we were unable to recover it. 00:31:04.792 [2024-11-28 01:25:19.274212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.792 [2024-11-28 01:25:19.274320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.792 [2024-11-28 01:25:19.274347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.792 [2024-11-28 01:25:19.274362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.792 [2024-11-28 01:25:19.274374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.792 [2024-11-28 01:25:19.274405] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.792 qpair failed and we were unable to recover it. 00:31:04.792 [2024-11-28 01:25:19.284190] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.792 [2024-11-28 01:25:19.284296] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.792 [2024-11-28 01:25:19.284322] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.792 [2024-11-28 01:25:19.284336] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.792 [2024-11-28 01:25:19.284348] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.792 [2024-11-28 01:25:19.284377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.792 qpair failed and we were unable to recover it. 00:31:04.792 [2024-11-28 01:25:19.294205] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.792 [2024-11-28 01:25:19.294322] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.792 [2024-11-28 01:25:19.294347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.792 [2024-11-28 01:25:19.294362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.792 [2024-11-28 01:25:19.294374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.792 [2024-11-28 01:25:19.294402] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.792 qpair failed and we were unable to recover it. 00:31:04.792 [2024-11-28 01:25:19.304246] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.793 [2024-11-28 01:25:19.304357] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.793 [2024-11-28 01:25:19.304383] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.793 [2024-11-28 01:25:19.304396] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.793 [2024-11-28 01:25:19.304409] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.793 [2024-11-28 01:25:19.304437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.793 qpair failed and we were unable to recover it. 00:31:04.793 [2024-11-28 01:25:19.314269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.793 [2024-11-28 01:25:19.314394] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.793 [2024-11-28 01:25:19.314421] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.793 [2024-11-28 01:25:19.314441] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.793 [2024-11-28 01:25:19.314454] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.793 [2024-11-28 01:25:19.314483] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.793 qpair failed and we were unable to recover it. 00:31:04.793 [2024-11-28 01:25:19.324397] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.793 [2024-11-28 01:25:19.324505] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.793 [2024-11-28 01:25:19.324536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.793 [2024-11-28 01:25:19.324552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.793 [2024-11-28 01:25:19.324564] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.793 [2024-11-28 01:25:19.324594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.793 qpair failed and we were unable to recover it. 00:31:04.793 [2024-11-28 01:25:19.334367] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.793 [2024-11-28 01:25:19.334477] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.793 [2024-11-28 01:25:19.334504] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.793 [2024-11-28 01:25:19.334518] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.793 [2024-11-28 01:25:19.334539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.793 [2024-11-28 01:25:19.334569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.793 qpair failed and we were unable to recover it. 00:31:04.793 [2024-11-28 01:25:19.344451] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.793 [2024-11-28 01:25:19.344567] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.793 [2024-11-28 01:25:19.344594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.793 [2024-11-28 01:25:19.344608] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.793 [2024-11-28 01:25:19.344620] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.793 [2024-11-28 01:25:19.344649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.793 qpair failed and we were unable to recover it. 00:31:04.793 [2024-11-28 01:25:19.354509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.793 [2024-11-28 01:25:19.354645] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.793 [2024-11-28 01:25:19.354671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.793 [2024-11-28 01:25:19.354685] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.793 [2024-11-28 01:25:19.354697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.793 [2024-11-28 01:25:19.354726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.793 qpair failed and we were unable to recover it. 00:31:04.793 [2024-11-28 01:25:19.364543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.793 [2024-11-28 01:25:19.364654] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.793 [2024-11-28 01:25:19.364681] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.793 [2024-11-28 01:25:19.364695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.793 [2024-11-28 01:25:19.364707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.793 [2024-11-28 01:25:19.364736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.793 qpair failed and we were unable to recover it. 00:31:04.793 [2024-11-28 01:25:19.374448] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.793 [2024-11-28 01:25:19.374556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.793 [2024-11-28 01:25:19.374583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.793 [2024-11-28 01:25:19.374597] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.793 [2024-11-28 01:25:19.374609] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.793 [2024-11-28 01:25:19.374639] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.793 qpair failed and we were unable to recover it. 00:31:04.793 [2024-11-28 01:25:19.384506] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:04.793 [2024-11-28 01:25:19.384627] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:04.793 [2024-11-28 01:25:19.384653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:04.793 [2024-11-28 01:25:19.384668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:04.793 [2024-11-28 01:25:19.384679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:04.793 [2024-11-28 01:25:19.384709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:04.793 qpair failed and we were unable to recover it. 00:31:05.052 [2024-11-28 01:25:19.394546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.052 [2024-11-28 01:25:19.394663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.052 [2024-11-28 01:25:19.394691] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.052 [2024-11-28 01:25:19.394706] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.052 [2024-11-28 01:25:19.394718] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.052 [2024-11-28 01:25:19.394748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.052 qpair failed and we were unable to recover it. 00:31:05.052 [2024-11-28 01:25:19.404572] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.052 [2024-11-28 01:25:19.404675] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.052 [2024-11-28 01:25:19.404703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.052 [2024-11-28 01:25:19.404727] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.052 [2024-11-28 01:25:19.404741] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.052 [2024-11-28 01:25:19.404771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.052 qpair failed and we were unable to recover it. 00:31:05.052 [2024-11-28 01:25:19.414595] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.052 [2024-11-28 01:25:19.414719] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.052 [2024-11-28 01:25:19.414745] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.052 [2024-11-28 01:25:19.414760] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.052 [2024-11-28 01:25:19.414772] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.052 [2024-11-28 01:25:19.414801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.052 qpair failed and we were unable to recover it. 00:31:05.052 [2024-11-28 01:25:19.424702] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.052 [2024-11-28 01:25:19.424802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.052 [2024-11-28 01:25:19.424828] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.052 [2024-11-28 01:25:19.424843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.052 [2024-11-28 01:25:19.424855] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.052 [2024-11-28 01:25:19.424883] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.052 qpair failed and we were unable to recover it. 00:31:05.052 [2024-11-28 01:25:19.434628] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.052 [2024-11-28 01:25:19.434728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.052 [2024-11-28 01:25:19.434754] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.052 [2024-11-28 01:25:19.434769] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.052 [2024-11-28 01:25:19.434781] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.052 [2024-11-28 01:25:19.434813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.052 qpair failed and we were unable to recover it. 00:31:05.052 [2024-11-28 01:25:19.444706] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.052 [2024-11-28 01:25:19.444837] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.052 [2024-11-28 01:25:19.444865] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.052 [2024-11-28 01:25:19.444880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.052 [2024-11-28 01:25:19.444896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.053 [2024-11-28 01:25:19.444942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.053 qpair failed and we were unable to recover it. 00:31:05.053 [2024-11-28 01:25:19.454698] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.053 [2024-11-28 01:25:19.454811] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.053 [2024-11-28 01:25:19.454838] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.053 [2024-11-28 01:25:19.454852] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.053 [2024-11-28 01:25:19.454864] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.053 [2024-11-28 01:25:19.454893] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.053 qpair failed and we were unable to recover it. 00:31:05.053 [2024-11-28 01:25:19.464709] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.053 [2024-11-28 01:25:19.464810] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.053 [2024-11-28 01:25:19.464836] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.053 [2024-11-28 01:25:19.464850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.053 [2024-11-28 01:25:19.464862] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.053 [2024-11-28 01:25:19.464891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.053 qpair failed and we were unable to recover it. 00:31:05.053 [2024-11-28 01:25:19.474744] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.053 [2024-11-28 01:25:19.474846] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.053 [2024-11-28 01:25:19.474872] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.053 [2024-11-28 01:25:19.474886] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.053 [2024-11-28 01:25:19.474898] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.053 [2024-11-28 01:25:19.474927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.053 qpair failed and we were unable to recover it. 00:31:05.053 [2024-11-28 01:25:19.484811] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.053 [2024-11-28 01:25:19.484956] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.053 [2024-11-28 01:25:19.484982] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.053 [2024-11-28 01:25:19.484996] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.053 [2024-11-28 01:25:19.485007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.053 [2024-11-28 01:25:19.485037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.053 qpair failed and we were unable to recover it. 00:31:05.053 [2024-11-28 01:25:19.494844] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.053 [2024-11-28 01:25:19.494969] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.053 [2024-11-28 01:25:19.495000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.053 [2024-11-28 01:25:19.495016] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.053 [2024-11-28 01:25:19.495028] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.053 [2024-11-28 01:25:19.495056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.053 qpair failed and we were unable to recover it. 00:31:05.053 [2024-11-28 01:25:19.504845] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.053 [2024-11-28 01:25:19.504946] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.053 [2024-11-28 01:25:19.504971] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.053 [2024-11-28 01:25:19.504985] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.053 [2024-11-28 01:25:19.504997] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.053 [2024-11-28 01:25:19.505026] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.053 qpair failed and we were unable to recover it. 00:31:05.053 [2024-11-28 01:25:19.514865] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.053 [2024-11-28 01:25:19.514966] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.053 [2024-11-28 01:25:19.514992] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.053 [2024-11-28 01:25:19.515006] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.053 [2024-11-28 01:25:19.515018] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.053 [2024-11-28 01:25:19.515046] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.053 qpair failed and we were unable to recover it. 00:31:05.053 [2024-11-28 01:25:19.524989] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.053 [2024-11-28 01:25:19.525092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.053 [2024-11-28 01:25:19.525118] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.053 [2024-11-28 01:25:19.525132] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.053 [2024-11-28 01:25:19.525143] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.053 [2024-11-28 01:25:19.525172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.053 qpair failed and we were unable to recover it. 00:31:05.053 [2024-11-28 01:25:19.534920] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.053 [2024-11-28 01:25:19.535028] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.053 [2024-11-28 01:25:19.535054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.053 [2024-11-28 01:25:19.535068] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.053 [2024-11-28 01:25:19.535080] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.053 [2024-11-28 01:25:19.535114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.053 qpair failed and we were unable to recover it. 00:31:05.053 [2024-11-28 01:25:19.545044] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.053 [2024-11-28 01:25:19.545140] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.053 [2024-11-28 01:25:19.545166] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.053 [2024-11-28 01:25:19.545180] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.053 [2024-11-28 01:25:19.545192] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.053 [2024-11-28 01:25:19.545221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.053 qpair failed and we were unable to recover it. 00:31:05.053 [2024-11-28 01:25:19.555007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.053 [2024-11-28 01:25:19.555121] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.053 [2024-11-28 01:25:19.555146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.053 [2024-11-28 01:25:19.555160] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.053 [2024-11-28 01:25:19.555171] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.053 [2024-11-28 01:25:19.555200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.053 qpair failed and we were unable to recover it. 00:31:05.053 [2024-11-28 01:25:19.565157] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.053 [2024-11-28 01:25:19.565302] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.053 [2024-11-28 01:25:19.565328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.053 [2024-11-28 01:25:19.565342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.053 [2024-11-28 01:25:19.565353] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.053 [2024-11-28 01:25:19.565395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.053 qpair failed and we were unable to recover it. 00:31:05.053 [2024-11-28 01:25:19.575042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.053 [2024-11-28 01:25:19.575143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.053 [2024-11-28 01:25:19.575170] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.053 [2024-11-28 01:25:19.575184] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.054 [2024-11-28 01:25:19.575195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.054 [2024-11-28 01:25:19.575224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.054 qpair failed and we were unable to recover it. 00:31:05.054 [2024-11-28 01:25:19.585168] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.054 [2024-11-28 01:25:19.585265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.054 [2024-11-28 01:25:19.585295] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.054 [2024-11-28 01:25:19.585310] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.054 [2024-11-28 01:25:19.585322] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.054 [2024-11-28 01:25:19.585350] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.054 qpair failed and we were unable to recover it. 00:31:05.054 [2024-11-28 01:25:19.595117] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.054 [2024-11-28 01:25:19.595224] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.054 [2024-11-28 01:25:19.595250] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.054 [2024-11-28 01:25:19.595264] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.054 [2024-11-28 01:25:19.595276] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.054 [2024-11-28 01:25:19.595305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.054 qpair failed and we were unable to recover it. 00:31:05.054 [2024-11-28 01:25:19.605228] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.054 [2024-11-28 01:25:19.605333] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.054 [2024-11-28 01:25:19.605362] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.054 [2024-11-28 01:25:19.605377] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.054 [2024-11-28 01:25:19.605390] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.054 [2024-11-28 01:25:19.605423] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.054 qpair failed and we were unable to recover it. 00:31:05.054 [2024-11-28 01:25:19.615183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.054 [2024-11-28 01:25:19.615304] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.054 [2024-11-28 01:25:19.615331] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.054 [2024-11-28 01:25:19.615346] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.054 [2024-11-28 01:25:19.615358] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.054 [2024-11-28 01:25:19.615389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.054 qpair failed and we were unable to recover it. 00:31:05.054 [2024-11-28 01:25:19.625269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.054 [2024-11-28 01:25:19.625370] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.054 [2024-11-28 01:25:19.625396] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.054 [2024-11-28 01:25:19.625411] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.054 [2024-11-28 01:25:19.625423] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.054 [2024-11-28 01:25:19.625458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.054 qpair failed and we were unable to recover it. 00:31:05.054 [2024-11-28 01:25:19.635276] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.054 [2024-11-28 01:25:19.635376] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.054 [2024-11-28 01:25:19.635402] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.054 [2024-11-28 01:25:19.635416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.054 [2024-11-28 01:25:19.635428] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.054 [2024-11-28 01:25:19.635470] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.054 qpair failed and we were unable to recover it. 00:31:05.054 [2024-11-28 01:25:19.645249] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.054 [2024-11-28 01:25:19.645356] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.054 [2024-11-28 01:25:19.645382] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.054 [2024-11-28 01:25:19.645395] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.054 [2024-11-28 01:25:19.645408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.054 [2024-11-28 01:25:19.645437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.054 qpair failed and we were unable to recover it. 00:31:05.313 [2024-11-28 01:25:19.655279] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.313 [2024-11-28 01:25:19.655383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.313 [2024-11-28 01:25:19.655411] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.313 [2024-11-28 01:25:19.655426] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.313 [2024-11-28 01:25:19.655438] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.313 [2024-11-28 01:25:19.655467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.313 qpair failed and we were unable to recover it. 00:31:05.313 [2024-11-28 01:25:19.665320] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.313 [2024-11-28 01:25:19.665421] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.313 [2024-11-28 01:25:19.665448] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.313 [2024-11-28 01:25:19.665463] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.313 [2024-11-28 01:25:19.665474] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.313 [2024-11-28 01:25:19.665505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.313 qpair failed and we were unable to recover it. 00:31:05.313 [2024-11-28 01:25:19.675325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.313 [2024-11-28 01:25:19.675424] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.313 [2024-11-28 01:25:19.675451] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.313 [2024-11-28 01:25:19.675465] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.313 [2024-11-28 01:25:19.675477] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.313 [2024-11-28 01:25:19.675505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.313 qpair failed and we were unable to recover it. 00:31:05.313 [2024-11-28 01:25:19.685369] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.313 [2024-11-28 01:25:19.685468] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.313 [2024-11-28 01:25:19.685494] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.313 [2024-11-28 01:25:19.685508] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.313 [2024-11-28 01:25:19.685520] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.313 [2024-11-28 01:25:19.685557] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.313 qpair failed and we were unable to recover it. 00:31:05.313 [2024-11-28 01:25:19.695430] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.313 [2024-11-28 01:25:19.695548] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.313 [2024-11-28 01:25:19.695574] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.313 [2024-11-28 01:25:19.695588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.313 [2024-11-28 01:25:19.695600] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.313 [2024-11-28 01:25:19.695629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.313 qpair failed and we were unable to recover it. 00:31:05.313 [2024-11-28 01:25:19.705531] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.313 [2024-11-28 01:25:19.705628] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.313 [2024-11-28 01:25:19.705654] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.313 [2024-11-28 01:25:19.705668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.313 [2024-11-28 01:25:19.705680] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.314 [2024-11-28 01:25:19.705710] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.314 qpair failed and we were unable to recover it. 00:31:05.314 [2024-11-28 01:25:19.715443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.314 [2024-11-28 01:25:19.715552] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.314 [2024-11-28 01:25:19.715579] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.314 [2024-11-28 01:25:19.715593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.314 [2024-11-28 01:25:19.715612] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.314 [2024-11-28 01:25:19.715642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.314 qpair failed and we were unable to recover it. 00:31:05.314 [2024-11-28 01:25:19.725594] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.314 [2024-11-28 01:25:19.725732] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.314 [2024-11-28 01:25:19.725758] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.314 [2024-11-28 01:25:19.725772] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.314 [2024-11-28 01:25:19.725784] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.314 [2024-11-28 01:25:19.725813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.314 qpair failed and we were unable to recover it. 00:31:05.314 [2024-11-28 01:25:19.735521] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.314 [2024-11-28 01:25:19.735644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.314 [2024-11-28 01:25:19.735670] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.314 [2024-11-28 01:25:19.735684] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.314 [2024-11-28 01:25:19.735696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.314 [2024-11-28 01:25:19.735724] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.314 qpair failed and we were unable to recover it. 00:31:05.314 [2024-11-28 01:25:19.745551] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.314 [2024-11-28 01:25:19.745649] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.314 [2024-11-28 01:25:19.745675] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.314 [2024-11-28 01:25:19.745689] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.314 [2024-11-28 01:25:19.745701] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.314 [2024-11-28 01:25:19.745730] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.314 qpair failed and we were unable to recover it. 00:31:05.314 [2024-11-28 01:25:19.755563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.314 [2024-11-28 01:25:19.755661] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.314 [2024-11-28 01:25:19.755687] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.314 [2024-11-28 01:25:19.755702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.314 [2024-11-28 01:25:19.755714] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.314 [2024-11-28 01:25:19.755743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.314 qpair failed and we were unable to recover it. 00:31:05.314 [2024-11-28 01:25:19.765639] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.314 [2024-11-28 01:25:19.765748] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.314 [2024-11-28 01:25:19.765775] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.314 [2024-11-28 01:25:19.765789] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.314 [2024-11-28 01:25:19.765801] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.314 [2024-11-28 01:25:19.765830] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.314 qpair failed and we were unable to recover it. 00:31:05.314 [2024-11-28 01:25:19.775647] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.314 [2024-11-28 01:25:19.775759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.314 [2024-11-28 01:25:19.775785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.314 [2024-11-28 01:25:19.775799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.314 [2024-11-28 01:25:19.775811] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.314 [2024-11-28 01:25:19.775840] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.314 qpair failed and we were unable to recover it. 00:31:05.314 [2024-11-28 01:25:19.785663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.314 [2024-11-28 01:25:19.785765] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.314 [2024-11-28 01:25:19.785791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.314 [2024-11-28 01:25:19.785805] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.314 [2024-11-28 01:25:19.785816] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.314 [2024-11-28 01:25:19.785845] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.314 qpair failed and we were unable to recover it. 00:31:05.314 [2024-11-28 01:25:19.795718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.314 [2024-11-28 01:25:19.795817] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.314 [2024-11-28 01:25:19.795843] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.314 [2024-11-28 01:25:19.795857] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.314 [2024-11-28 01:25:19.795869] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.314 [2024-11-28 01:25:19.795898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.314 qpair failed and we were unable to recover it. 00:31:05.314 [2024-11-28 01:25:19.805723] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.314 [2024-11-28 01:25:19.805828] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.314 [2024-11-28 01:25:19.805854] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.314 [2024-11-28 01:25:19.805875] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.314 [2024-11-28 01:25:19.805889] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.314 [2024-11-28 01:25:19.805920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.314 qpair failed and we were unable to recover it. 00:31:05.314 [2024-11-28 01:25:19.815847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.314 [2024-11-28 01:25:19.815962] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.314 [2024-11-28 01:25:19.815988] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.314 [2024-11-28 01:25:19.816002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.314 [2024-11-28 01:25:19.816014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.314 [2024-11-28 01:25:19.816044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.314 qpair failed and we were unable to recover it. 00:31:05.314 [2024-11-28 01:25:19.825890] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.314 [2024-11-28 01:25:19.825986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.314 [2024-11-28 01:25:19.826011] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.314 [2024-11-28 01:25:19.826024] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.314 [2024-11-28 01:25:19.826037] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.314 [2024-11-28 01:25:19.826066] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.314 qpair failed and we were unable to recover it. 00:31:05.314 [2024-11-28 01:25:19.835805] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.314 [2024-11-28 01:25:19.835934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.314 [2024-11-28 01:25:19.835960] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.314 [2024-11-28 01:25:19.835974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.314 [2024-11-28 01:25:19.835986] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.314 [2024-11-28 01:25:19.836014] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.314 qpair failed and we were unable to recover it. 00:31:05.315 [2024-11-28 01:25:19.845850] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.315 [2024-11-28 01:25:19.845950] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.315 [2024-11-28 01:25:19.845975] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.315 [2024-11-28 01:25:19.845989] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.315 [2024-11-28 01:25:19.846001] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.315 [2024-11-28 01:25:19.846030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.315 qpair failed and we were unable to recover it. 00:31:05.315 [2024-11-28 01:25:19.855888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.315 [2024-11-28 01:25:19.856000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.315 [2024-11-28 01:25:19.856025] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.315 [2024-11-28 01:25:19.856039] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.315 [2024-11-28 01:25:19.856051] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.315 [2024-11-28 01:25:19.856080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.315 qpair failed and we were unable to recover it. 00:31:05.315 [2024-11-28 01:25:19.865908] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.315 [2024-11-28 01:25:19.866014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.315 [2024-11-28 01:25:19.866043] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.315 [2024-11-28 01:25:19.866058] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.315 [2024-11-28 01:25:19.866071] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.315 [2024-11-28 01:25:19.866101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.315 qpair failed and we were unable to recover it. 00:31:05.315 [2024-11-28 01:25:19.875957] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.315 [2024-11-28 01:25:19.876053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.315 [2024-11-28 01:25:19.876080] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.315 [2024-11-28 01:25:19.876094] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.315 [2024-11-28 01:25:19.876106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.315 [2024-11-28 01:25:19.876136] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.315 qpair failed and we were unable to recover it. 00:31:05.315 [2024-11-28 01:25:19.886049] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.315 [2024-11-28 01:25:19.886163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.315 [2024-11-28 01:25:19.886189] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.315 [2024-11-28 01:25:19.886204] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.315 [2024-11-28 01:25:19.886215] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.315 [2024-11-28 01:25:19.886256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.315 qpair failed and we were unable to recover it. 00:31:05.315 [2024-11-28 01:25:19.896108] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.315 [2024-11-28 01:25:19.896216] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.315 [2024-11-28 01:25:19.896242] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.315 [2024-11-28 01:25:19.896262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.315 [2024-11-28 01:25:19.896274] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.315 [2024-11-28 01:25:19.896303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.315 qpair failed and we were unable to recover it. 00:31:05.315 [2024-11-28 01:25:19.906065] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.315 [2024-11-28 01:25:19.906177] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.315 [2024-11-28 01:25:19.906207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.315 [2024-11-28 01:25:19.906222] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.315 [2024-11-28 01:25:19.906233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.315 [2024-11-28 01:25:19.906264] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.315 qpair failed and we were unable to recover it. 00:31:05.575 [2024-11-28 01:25:19.916053] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.575 [2024-11-28 01:25:19.916149] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.575 [2024-11-28 01:25:19.916177] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.575 [2024-11-28 01:25:19.916191] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.575 [2024-11-28 01:25:19.916203] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.575 [2024-11-28 01:25:19.916239] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.575 qpair failed and we were unable to recover it. 00:31:05.575 [2024-11-28 01:25:19.926218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.575 [2024-11-28 01:25:19.926324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.575 [2024-11-28 01:25:19.926351] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.575 [2024-11-28 01:25:19.926366] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.575 [2024-11-28 01:25:19.926378] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.575 [2024-11-28 01:25:19.926408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.575 qpair failed and we were unable to recover it. 00:31:05.575 [2024-11-28 01:25:19.936212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.575 [2024-11-28 01:25:19.936352] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.575 [2024-11-28 01:25:19.936378] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.575 [2024-11-28 01:25:19.936392] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.575 [2024-11-28 01:25:19.936404] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.575 [2024-11-28 01:25:19.936432] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.575 qpair failed and we were unable to recover it. 00:31:05.575 [2024-11-28 01:25:19.946208] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.575 [2024-11-28 01:25:19.946304] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.575 [2024-11-28 01:25:19.946330] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.575 [2024-11-28 01:25:19.946344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.575 [2024-11-28 01:25:19.946356] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.575 [2024-11-28 01:25:19.946386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.575 qpair failed and we were unable to recover it. 00:31:05.575 [2024-11-28 01:25:19.956164] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.575 [2024-11-28 01:25:19.956261] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.575 [2024-11-28 01:25:19.956287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.575 [2024-11-28 01:25:19.956301] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.575 [2024-11-28 01:25:19.956313] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.575 [2024-11-28 01:25:19.956342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.575 qpair failed and we were unable to recover it. 00:31:05.575 [2024-11-28 01:25:19.966204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.575 [2024-11-28 01:25:19.966304] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.575 [2024-11-28 01:25:19.966330] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.575 [2024-11-28 01:25:19.966344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.575 [2024-11-28 01:25:19.966356] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.575 [2024-11-28 01:25:19.966386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.575 qpair failed and we were unable to recover it. 00:31:05.575 [2024-11-28 01:25:19.976216] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.575 [2024-11-28 01:25:19.976324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.575 [2024-11-28 01:25:19.976350] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.575 [2024-11-28 01:25:19.976363] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.575 [2024-11-28 01:25:19.976376] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.575 [2024-11-28 01:25:19.976405] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.575 qpair failed and we were unable to recover it. 00:31:05.575 [2024-11-28 01:25:19.986259] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.575 [2024-11-28 01:25:19.986360] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.575 [2024-11-28 01:25:19.986391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.575 [2024-11-28 01:25:19.986406] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.575 [2024-11-28 01:25:19.986418] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.575 [2024-11-28 01:25:19.986447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.575 qpair failed and we were unable to recover it. 00:31:05.575 [2024-11-28 01:25:19.996322] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.575 [2024-11-28 01:25:19.996431] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.575 [2024-11-28 01:25:19.996457] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.575 [2024-11-28 01:25:19.996472] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.575 [2024-11-28 01:25:19.996484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.575 [2024-11-28 01:25:19.996531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.575 qpair failed and we were unable to recover it. 00:31:05.575 [2024-11-28 01:25:20.006410] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.575 [2024-11-28 01:25:20.006541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.575 [2024-11-28 01:25:20.006569] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.576 [2024-11-28 01:25:20.006585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.576 [2024-11-28 01:25:20.006597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.576 [2024-11-28 01:25:20.006628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.576 qpair failed and we were unable to recover it. 00:31:05.576 [2024-11-28 01:25:20.016389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.576 [2024-11-28 01:25:20.016519] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.576 [2024-11-28 01:25:20.016556] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.576 [2024-11-28 01:25:20.016572] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.576 [2024-11-28 01:25:20.016584] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.576 [2024-11-28 01:25:20.016615] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.576 qpair failed and we were unable to recover it. 00:31:05.576 [2024-11-28 01:25:20.026438] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.576 [2024-11-28 01:25:20.026557] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.576 [2024-11-28 01:25:20.026588] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.576 [2024-11-28 01:25:20.026609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.576 [2024-11-28 01:25:20.026622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.576 [2024-11-28 01:25:20.026665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.576 qpair failed and we were unable to recover it. 00:31:05.576 [2024-11-28 01:25:20.036429] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.576 [2024-11-28 01:25:20.036542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.576 [2024-11-28 01:25:20.036571] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.576 [2024-11-28 01:25:20.036586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.576 [2024-11-28 01:25:20.036599] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.576 [2024-11-28 01:25:20.036629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.576 qpair failed and we were unable to recover it. 00:31:05.576 [2024-11-28 01:25:20.046582] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.576 [2024-11-28 01:25:20.046696] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.576 [2024-11-28 01:25:20.046727] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.576 [2024-11-28 01:25:20.046742] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.576 [2024-11-28 01:25:20.046755] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.576 [2024-11-28 01:25:20.046788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.576 qpair failed and we were unable to recover it. 00:31:05.576 [2024-11-28 01:25:20.056473] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.576 [2024-11-28 01:25:20.056586] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.576 [2024-11-28 01:25:20.056613] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.576 [2024-11-28 01:25:20.056628] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.576 [2024-11-28 01:25:20.056640] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.576 [2024-11-28 01:25:20.056671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.576 qpair failed and we were unable to recover it. 00:31:05.576 [2024-11-28 01:25:20.066618] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.576 [2024-11-28 01:25:20.066745] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.576 [2024-11-28 01:25:20.066773] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.576 [2024-11-28 01:25:20.066789] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.576 [2024-11-28 01:25:20.066813] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.576 [2024-11-28 01:25:20.066847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.576 qpair failed and we were unable to recover it. 00:31:05.576 [2024-11-28 01:25:20.076557] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.576 [2024-11-28 01:25:20.077146] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.576 [2024-11-28 01:25:20.077218] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.576 [2024-11-28 01:25:20.077249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.576 [2024-11-28 01:25:20.077265] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.576 [2024-11-28 01:25:20.077336] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.576 qpair failed and we were unable to recover it. 00:31:05.576 [2024-11-28 01:25:20.086674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.576 [2024-11-28 01:25:20.086781] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.576 [2024-11-28 01:25:20.086809] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.576 [2024-11-28 01:25:20.086823] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.576 [2024-11-28 01:25:20.086835] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.576 [2024-11-28 01:25:20.086865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.576 qpair failed and we were unable to recover it. 00:31:05.576 [2024-11-28 01:25:20.096667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.576 [2024-11-28 01:25:20.096770] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.576 [2024-11-28 01:25:20.096798] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.576 [2024-11-28 01:25:20.096813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.576 [2024-11-28 01:25:20.096825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.576 [2024-11-28 01:25:20.096869] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.576 qpair failed and we were unable to recover it. 00:31:05.576 [2024-11-28 01:25:20.106626] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.576 [2024-11-28 01:25:20.106740] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.576 [2024-11-28 01:25:20.106767] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.576 [2024-11-28 01:25:20.106782] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.576 [2024-11-28 01:25:20.106794] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.576 [2024-11-28 01:25:20.106844] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.576 qpair failed and we were unable to recover it. 00:31:05.576 [2024-11-28 01:25:20.116634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.576 [2024-11-28 01:25:20.116736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.576 [2024-11-28 01:25:20.116763] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.576 [2024-11-28 01:25:20.116777] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.576 [2024-11-28 01:25:20.116790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.576 [2024-11-28 01:25:20.116827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.576 qpair failed and we were unable to recover it. 00:31:05.576 [2024-11-28 01:25:20.126689] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.576 [2024-11-28 01:25:20.126793] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.576 [2024-11-28 01:25:20.126831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.576 [2024-11-28 01:25:20.126845] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.576 [2024-11-28 01:25:20.126857] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.576 [2024-11-28 01:25:20.126887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.576 qpair failed and we were unable to recover it. 00:31:05.576 [2024-11-28 01:25:20.136688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.576 [2024-11-28 01:25:20.136798] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.576 [2024-11-28 01:25:20.136824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.576 [2024-11-28 01:25:20.136839] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.577 [2024-11-28 01:25:20.136850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.577 [2024-11-28 01:25:20.136880] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.577 qpair failed and we were unable to recover it. 00:31:05.577 [2024-11-28 01:25:20.146760] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.577 [2024-11-28 01:25:20.146870] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.577 [2024-11-28 01:25:20.146897] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.577 [2024-11-28 01:25:20.146912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.577 [2024-11-28 01:25:20.146924] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.577 [2024-11-28 01:25:20.146954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.577 qpair failed and we were unable to recover it. 00:31:05.577 [2024-11-28 01:25:20.156790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.577 [2024-11-28 01:25:20.156915] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.577 [2024-11-28 01:25:20.156942] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.577 [2024-11-28 01:25:20.156956] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.577 [2024-11-28 01:25:20.156968] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.577 [2024-11-28 01:25:20.156997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.577 qpair failed and we were unable to recover it. 00:31:05.577 [2024-11-28 01:25:20.166799] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.577 [2024-11-28 01:25:20.166918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.577 [2024-11-28 01:25:20.166951] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.577 [2024-11-28 01:25:20.166966] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.577 [2024-11-28 01:25:20.166978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.577 [2024-11-28 01:25:20.167010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.577 qpair failed and we were unable to recover it. 00:31:05.836 [2024-11-28 01:25:20.176814] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.837 [2024-11-28 01:25:20.176940] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.837 [2024-11-28 01:25:20.176969] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.837 [2024-11-28 01:25:20.176984] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.837 [2024-11-28 01:25:20.176996] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.837 [2024-11-28 01:25:20.177025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.837 qpair failed and we were unable to recover it. 00:31:05.837 [2024-11-28 01:25:20.186928] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.837 [2024-11-28 01:25:20.187046] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.837 [2024-11-28 01:25:20.187075] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.837 [2024-11-28 01:25:20.187089] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.837 [2024-11-28 01:25:20.187102] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.837 [2024-11-28 01:25:20.187131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.837 qpair failed and we were unable to recover it. 00:31:05.837 [2024-11-28 01:25:20.196866] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.837 [2024-11-28 01:25:20.196969] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.837 [2024-11-28 01:25:20.197002] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.837 [2024-11-28 01:25:20.197016] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.837 [2024-11-28 01:25:20.197028] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.837 [2024-11-28 01:25:20.197058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.837 qpair failed and we were unable to recover it. 00:31:05.837 [2024-11-28 01:25:20.206909] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.837 [2024-11-28 01:25:20.207014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.837 [2024-11-28 01:25:20.207041] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.837 [2024-11-28 01:25:20.207055] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.837 [2024-11-28 01:25:20.207072] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.837 [2024-11-28 01:25:20.207103] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.837 qpair failed and we were unable to recover it. 00:31:05.837 [2024-11-28 01:25:20.216954] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.837 [2024-11-28 01:25:20.217060] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.837 [2024-11-28 01:25:20.217087] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.837 [2024-11-28 01:25:20.217101] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.837 [2024-11-28 01:25:20.217113] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.837 [2024-11-28 01:25:20.217142] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.837 qpair failed and we were unable to recover it. 00:31:05.837 [2024-11-28 01:25:20.226984] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.837 [2024-11-28 01:25:20.227098] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.837 [2024-11-28 01:25:20.227125] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.837 [2024-11-28 01:25:20.227139] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.837 [2024-11-28 01:25:20.227151] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.837 [2024-11-28 01:25:20.227188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.837 qpair failed and we were unable to recover it. 00:31:05.837 [2024-11-28 01:25:20.237058] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.837 [2024-11-28 01:25:20.237160] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.837 [2024-11-28 01:25:20.237187] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.837 [2024-11-28 01:25:20.237201] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.837 [2024-11-28 01:25:20.237212] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.837 [2024-11-28 01:25:20.237242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.837 qpair failed and we were unable to recover it. 00:31:05.837 [2024-11-28 01:25:20.247110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.837 [2024-11-28 01:25:20.247221] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.837 [2024-11-28 01:25:20.247248] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.837 [2024-11-28 01:25:20.247263] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.837 [2024-11-28 01:25:20.247275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.837 [2024-11-28 01:25:20.247304] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.837 qpair failed and we were unable to recover it. 00:31:05.837 [2024-11-28 01:25:20.257098] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.837 [2024-11-28 01:25:20.257237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.837 [2024-11-28 01:25:20.257264] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.837 [2024-11-28 01:25:20.257278] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.837 [2024-11-28 01:25:20.257290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.837 [2024-11-28 01:25:20.257335] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.837 qpair failed and we were unable to recover it. 00:31:05.837 [2024-11-28 01:25:20.267065] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.837 [2024-11-28 01:25:20.267171] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.837 [2024-11-28 01:25:20.267198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.837 [2024-11-28 01:25:20.267212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.837 [2024-11-28 01:25:20.267223] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.837 [2024-11-28 01:25:20.267253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.837 qpair failed and we were unable to recover it. 00:31:05.837 [2024-11-28 01:25:20.277115] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.837 [2024-11-28 01:25:20.277238] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.837 [2024-11-28 01:25:20.277263] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.837 [2024-11-28 01:25:20.277278] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.837 [2024-11-28 01:25:20.277290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.837 [2024-11-28 01:25:20.277319] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.837 qpair failed and we were unable to recover it. 00:31:05.837 [2024-11-28 01:25:20.287242] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.837 [2024-11-28 01:25:20.287347] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.837 [2024-11-28 01:25:20.287374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.837 [2024-11-28 01:25:20.287389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.837 [2024-11-28 01:25:20.287401] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.837 [2024-11-28 01:25:20.287430] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.837 qpair failed and we were unable to recover it. 00:31:05.837 [2024-11-28 01:25:20.297163] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.837 [2024-11-28 01:25:20.297277] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.837 [2024-11-28 01:25:20.297303] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.837 [2024-11-28 01:25:20.297318] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.837 [2024-11-28 01:25:20.297339] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.837 [2024-11-28 01:25:20.297370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.837 qpair failed and we were unable to recover it. 00:31:05.837 [2024-11-28 01:25:20.307228] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.838 [2024-11-28 01:25:20.307350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.838 [2024-11-28 01:25:20.307377] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.838 [2024-11-28 01:25:20.307391] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.838 [2024-11-28 01:25:20.307402] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.838 [2024-11-28 01:25:20.307432] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.838 qpair failed and we were unable to recover it. 00:31:05.838 [2024-11-28 01:25:20.317240] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.838 [2024-11-28 01:25:20.317346] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.838 [2024-11-28 01:25:20.317372] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.838 [2024-11-28 01:25:20.317387] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.838 [2024-11-28 01:25:20.317399] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.838 [2024-11-28 01:25:20.317428] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.838 qpair failed and we were unable to recover it. 00:31:05.838 [2024-11-28 01:25:20.327277] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.838 [2024-11-28 01:25:20.327436] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.838 [2024-11-28 01:25:20.327462] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.838 [2024-11-28 01:25:20.327477] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.838 [2024-11-28 01:25:20.327488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.838 [2024-11-28 01:25:20.327518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.838 qpair failed and we were unable to recover it. 00:31:05.838 [2024-11-28 01:25:20.337283] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.838 [2024-11-28 01:25:20.337393] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.838 [2024-11-28 01:25:20.337419] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.838 [2024-11-28 01:25:20.337433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.838 [2024-11-28 01:25:20.337445] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.838 [2024-11-28 01:25:20.337473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.838 qpair failed and we were unable to recover it. 00:31:05.838 [2024-11-28 01:25:20.347401] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.838 [2024-11-28 01:25:20.347522] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.838 [2024-11-28 01:25:20.347556] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.838 [2024-11-28 01:25:20.347570] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.838 [2024-11-28 01:25:20.347583] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.838 [2024-11-28 01:25:20.347613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.838 qpair failed and we were unable to recover it. 00:31:05.838 [2024-11-28 01:25:20.357440] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.838 [2024-11-28 01:25:20.357558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.838 [2024-11-28 01:25:20.357585] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.838 [2024-11-28 01:25:20.357600] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.838 [2024-11-28 01:25:20.357612] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.838 [2024-11-28 01:25:20.357653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.838 qpair failed and we were unable to recover it. 00:31:05.838 [2024-11-28 01:25:20.367450] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.838 [2024-11-28 01:25:20.367563] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.838 [2024-11-28 01:25:20.367589] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.838 [2024-11-28 01:25:20.367604] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.838 [2024-11-28 01:25:20.367616] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.838 [2024-11-28 01:25:20.367657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.838 qpair failed and we were unable to recover it. 00:31:05.838 [2024-11-28 01:25:20.377495] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.838 [2024-11-28 01:25:20.377606] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.838 [2024-11-28 01:25:20.377636] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.838 [2024-11-28 01:25:20.377651] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.838 [2024-11-28 01:25:20.377662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.838 [2024-11-28 01:25:20.377692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.838 qpair failed and we were unable to recover it. 00:31:05.838 [2024-11-28 01:25:20.387523] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.838 [2024-11-28 01:25:20.387654] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.838 [2024-11-28 01:25:20.387683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.838 [2024-11-28 01:25:20.387703] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.838 [2024-11-28 01:25:20.387716] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.838 [2024-11-28 01:25:20.387746] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.838 qpair failed and we were unable to recover it. 00:31:05.838 [2024-11-28 01:25:20.397463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.838 [2024-11-28 01:25:20.397574] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.838 [2024-11-28 01:25:20.397601] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.838 [2024-11-28 01:25:20.397615] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.838 [2024-11-28 01:25:20.397627] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.838 [2024-11-28 01:25:20.397656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.838 qpair failed and we were unable to recover it. 00:31:05.838 [2024-11-28 01:25:20.407492] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.838 [2024-11-28 01:25:20.407615] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.838 [2024-11-28 01:25:20.407642] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.838 [2024-11-28 01:25:20.407657] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.838 [2024-11-28 01:25:20.407669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.838 [2024-11-28 01:25:20.407699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.838 qpair failed and we were unable to recover it. 00:31:05.838 [2024-11-28 01:25:20.417502] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.838 [2024-11-28 01:25:20.417630] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.838 [2024-11-28 01:25:20.417656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.838 [2024-11-28 01:25:20.417670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.838 [2024-11-28 01:25:20.417682] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.838 [2024-11-28 01:25:20.417712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.838 qpair failed and we were unable to recover it. 00:31:05.838 [2024-11-28 01:25:20.427602] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:05.838 [2024-11-28 01:25:20.427717] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:05.838 [2024-11-28 01:25:20.427743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:05.838 [2024-11-28 01:25:20.427757] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:05.838 [2024-11-28 01:25:20.427769] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:05.838 [2024-11-28 01:25:20.427811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:05.838 qpair failed and we were unable to recover it. 00:31:06.098 [2024-11-28 01:25:20.437627] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.098 [2024-11-28 01:25:20.437785] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.098 [2024-11-28 01:25:20.437819] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.098 [2024-11-28 01:25:20.437836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.098 [2024-11-28 01:25:20.437849] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.098 [2024-11-28 01:25:20.437896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.098 qpair failed and we were unable to recover it. 00:31:06.098 [2024-11-28 01:25:20.447646] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.098 [2024-11-28 01:25:20.447778] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.098 [2024-11-28 01:25:20.447807] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.098 [2024-11-28 01:25:20.447822] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.098 [2024-11-28 01:25:20.447834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.098 [2024-11-28 01:25:20.447879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.098 qpair failed and we were unable to recover it. 00:31:06.098 [2024-11-28 01:25:20.457628] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.098 [2024-11-28 01:25:20.457736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.098 [2024-11-28 01:25:20.457763] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.098 [2024-11-28 01:25:20.457778] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.098 [2024-11-28 01:25:20.457790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.098 [2024-11-28 01:25:20.457819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.098 qpair failed and we were unable to recover it. 00:31:06.098 [2024-11-28 01:25:20.467649] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.098 [2024-11-28 01:25:20.467761] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.098 [2024-11-28 01:25:20.467788] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.098 [2024-11-28 01:25:20.467803] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.098 [2024-11-28 01:25:20.467814] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.098 [2024-11-28 01:25:20.467844] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.098 qpair failed and we were unable to recover it. 00:31:06.098 [2024-11-28 01:25:20.477719] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.098 [2024-11-28 01:25:20.477819] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.098 [2024-11-28 01:25:20.477846] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.098 [2024-11-28 01:25:20.477866] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.098 [2024-11-28 01:25:20.477879] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.098 [2024-11-28 01:25:20.477909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.098 qpair failed and we were unable to recover it. 00:31:06.098 [2024-11-28 01:25:20.487775] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.098 [2024-11-28 01:25:20.487938] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.098 [2024-11-28 01:25:20.487966] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.098 [2024-11-28 01:25:20.487980] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.098 [2024-11-28 01:25:20.487992] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.098 [2024-11-28 01:25:20.488021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.098 qpair failed and we were unable to recover it. 00:31:06.098 [2024-11-28 01:25:20.497842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.098 [2024-11-28 01:25:20.497952] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.098 [2024-11-28 01:25:20.497978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.098 [2024-11-28 01:25:20.497992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.098 [2024-11-28 01:25:20.498004] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.098 [2024-11-28 01:25:20.498033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.098 qpair failed and we were unable to recover it. 00:31:06.099 [2024-11-28 01:25:20.507824] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.099 [2024-11-28 01:25:20.507947] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.099 [2024-11-28 01:25:20.507977] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.099 [2024-11-28 01:25:20.507992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.099 [2024-11-28 01:25:20.508004] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.099 [2024-11-28 01:25:20.508033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.099 qpair failed and we were unable to recover it. 00:31:06.099 [2024-11-28 01:25:20.517806] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.099 [2024-11-28 01:25:20.517908] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.099 [2024-11-28 01:25:20.517934] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.099 [2024-11-28 01:25:20.517949] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.099 [2024-11-28 01:25:20.517961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.099 [2024-11-28 01:25:20.517990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.099 qpair failed and we were unable to recover it. 00:31:06.099 [2024-11-28 01:25:20.527919] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.099 [2024-11-28 01:25:20.528054] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.099 [2024-11-28 01:25:20.528080] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.099 [2024-11-28 01:25:20.528095] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.099 [2024-11-28 01:25:20.528107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.099 [2024-11-28 01:25:20.528162] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.099 qpair failed and we were unable to recover it. 00:31:06.099 [2024-11-28 01:25:20.537924] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.099 [2024-11-28 01:25:20.538038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.099 [2024-11-28 01:25:20.538065] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.099 [2024-11-28 01:25:20.538079] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.099 [2024-11-28 01:25:20.538091] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.099 [2024-11-28 01:25:20.538121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.099 qpair failed and we were unable to recover it. 00:31:06.099 [2024-11-28 01:25:20.548003] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.099 [2024-11-28 01:25:20.548114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.099 [2024-11-28 01:25:20.548142] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.099 [2024-11-28 01:25:20.548156] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.099 [2024-11-28 01:25:20.548168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.099 [2024-11-28 01:25:20.548198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.099 qpair failed and we were unable to recover it. 00:31:06.099 [2024-11-28 01:25:20.557990] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.099 [2024-11-28 01:25:20.558097] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.099 [2024-11-28 01:25:20.558124] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.099 [2024-11-28 01:25:20.558139] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.099 [2024-11-28 01:25:20.558150] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.099 [2024-11-28 01:25:20.558179] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.099 qpair failed and we were unable to recover it. 00:31:06.099 [2024-11-28 01:25:20.567991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.099 [2024-11-28 01:25:20.568110] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.099 [2024-11-28 01:25:20.568142] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.099 [2024-11-28 01:25:20.568157] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.099 [2024-11-28 01:25:20.568169] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.099 [2024-11-28 01:25:20.568199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.099 qpair failed and we were unable to recover it. 00:31:06.099 [2024-11-28 01:25:20.578057] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.099 [2024-11-28 01:25:20.578159] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.099 [2024-11-28 01:25:20.578186] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.099 [2024-11-28 01:25:20.578200] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.099 [2024-11-28 01:25:20.578212] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.099 [2024-11-28 01:25:20.578241] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.099 qpair failed and we were unable to recover it. 00:31:06.099 [2024-11-28 01:25:20.588008] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.099 [2024-11-28 01:25:20.588112] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.099 [2024-11-28 01:25:20.588137] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.099 [2024-11-28 01:25:20.588151] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.099 [2024-11-28 01:25:20.588162] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.099 [2024-11-28 01:25:20.588191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.099 qpair failed and we were unable to recover it. 00:31:06.099 [2024-11-28 01:25:20.598081] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.099 [2024-11-28 01:25:20.598178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.099 [2024-11-28 01:25:20.598204] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.099 [2024-11-28 01:25:20.598219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.099 [2024-11-28 01:25:20.598231] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.099 [2024-11-28 01:25:20.598272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.099 qpair failed and we were unable to recover it. 00:31:06.099 [2024-11-28 01:25:20.608191] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.099 [2024-11-28 01:25:20.608298] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.099 [2024-11-28 01:25:20.608339] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.099 [2024-11-28 01:25:20.608353] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.099 [2024-11-28 01:25:20.608365] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.099 [2024-11-28 01:25:20.608414] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.099 qpair failed and we were unable to recover it. 00:31:06.099 [2024-11-28 01:25:20.618083] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.099 [2024-11-28 01:25:20.618182] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.099 [2024-11-28 01:25:20.618209] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.099 [2024-11-28 01:25:20.618224] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.099 [2024-11-28 01:25:20.618235] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.099 [2024-11-28 01:25:20.618264] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.099 qpair failed and we were unable to recover it. 00:31:06.099 [2024-11-28 01:25:20.628138] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.099 [2024-11-28 01:25:20.628268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.099 [2024-11-28 01:25:20.628294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.099 [2024-11-28 01:25:20.628308] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.099 [2024-11-28 01:25:20.628320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.099 [2024-11-28 01:25:20.628349] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.099 qpair failed and we were unable to recover it. 00:31:06.099 [2024-11-28 01:25:20.638258] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.099 [2024-11-28 01:25:20.638357] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.100 [2024-11-28 01:25:20.638384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.100 [2024-11-28 01:25:20.638399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.100 [2024-11-28 01:25:20.638415] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.100 [2024-11-28 01:25:20.638445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.100 qpair failed and we were unable to recover it. 00:31:06.100 [2024-11-28 01:25:20.648217] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.100 [2024-11-28 01:25:20.648322] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.100 [2024-11-28 01:25:20.648349] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.100 [2024-11-28 01:25:20.648364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.100 [2024-11-28 01:25:20.648376] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.100 [2024-11-28 01:25:20.648406] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.100 qpair failed and we were unable to recover it. 00:31:06.100 [2024-11-28 01:25:20.658324] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.100 [2024-11-28 01:25:20.658422] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.100 [2024-11-28 01:25:20.658454] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.100 [2024-11-28 01:25:20.658469] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.100 [2024-11-28 01:25:20.658481] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.100 [2024-11-28 01:25:20.658510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.100 qpair failed and we were unable to recover it. 00:31:06.100 [2024-11-28 01:25:20.668233] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.100 [2024-11-28 01:25:20.668346] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.100 [2024-11-28 01:25:20.668372] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.100 [2024-11-28 01:25:20.668387] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.100 [2024-11-28 01:25:20.668398] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.100 [2024-11-28 01:25:20.668428] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.100 qpair failed and we were unable to recover it. 00:31:06.100 [2024-11-28 01:25:20.678384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.100 [2024-11-28 01:25:20.678519] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.100 [2024-11-28 01:25:20.678552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.100 [2024-11-28 01:25:20.678567] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.100 [2024-11-28 01:25:20.678578] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.100 [2024-11-28 01:25:20.678608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.100 qpair failed and we were unable to recover it. 00:31:06.100 [2024-11-28 01:25:20.688392] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.100 [2024-11-28 01:25:20.688514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.100 [2024-11-28 01:25:20.688546] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.100 [2024-11-28 01:25:20.688561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.100 [2024-11-28 01:25:20.688573] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.100 [2024-11-28 01:25:20.688603] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.100 qpair failed and we were unable to recover it. 00:31:06.100 [2024-11-28 01:25:20.698322] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.100 [2024-11-28 01:25:20.698442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.100 [2024-11-28 01:25:20.698470] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.100 [2024-11-28 01:25:20.698486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.100 [2024-11-28 01:25:20.698504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.100 [2024-11-28 01:25:20.698545] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.100 qpair failed and we were unable to recover it. 00:31:06.360 [2024-11-28 01:25:20.708368] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.360 [2024-11-28 01:25:20.708494] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.360 [2024-11-28 01:25:20.708521] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.360 [2024-11-28 01:25:20.708542] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.360 [2024-11-28 01:25:20.708554] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.360 [2024-11-28 01:25:20.708584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.360 qpair failed and we were unable to recover it. 00:31:06.360 [2024-11-28 01:25:20.718391] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.360 [2024-11-28 01:25:20.718520] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.360 [2024-11-28 01:25:20.718553] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.360 [2024-11-28 01:25:20.718567] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.360 [2024-11-28 01:25:20.718579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.360 [2024-11-28 01:25:20.718608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.360 qpair failed and we were unable to recover it. 00:31:06.360 [2024-11-28 01:25:20.728441] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.360 [2024-11-28 01:25:20.728554] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.360 [2024-11-28 01:25:20.728580] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.360 [2024-11-28 01:25:20.728595] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.360 [2024-11-28 01:25:20.728607] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.360 [2024-11-28 01:25:20.728636] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.360 qpair failed and we were unable to recover it. 00:31:06.360 [2024-11-28 01:25:20.738435] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.360 [2024-11-28 01:25:20.738538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.360 [2024-11-28 01:25:20.738564] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.360 [2024-11-28 01:25:20.738579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.360 [2024-11-28 01:25:20.738591] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.360 [2024-11-28 01:25:20.738620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.360 qpair failed and we were unable to recover it. 00:31:06.360 [2024-11-28 01:25:20.748478] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.360 [2024-11-28 01:25:20.748609] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.360 [2024-11-28 01:25:20.748636] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.360 [2024-11-28 01:25:20.748650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.360 [2024-11-28 01:25:20.748662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.360 [2024-11-28 01:25:20.748691] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.360 qpair failed and we were unable to recover it. 00:31:06.360 [2024-11-28 01:25:20.758508] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.360 [2024-11-28 01:25:20.758621] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.360 [2024-11-28 01:25:20.758647] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.360 [2024-11-28 01:25:20.758662] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.360 [2024-11-28 01:25:20.758674] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.360 [2024-11-28 01:25:20.758703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.360 qpair failed and we were unable to recover it. 00:31:06.360 [2024-11-28 01:25:20.768559] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.360 [2024-11-28 01:25:20.768662] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.360 [2024-11-28 01:25:20.768688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.360 [2024-11-28 01:25:20.768702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.360 [2024-11-28 01:25:20.768713] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.360 [2024-11-28 01:25:20.768742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.360 qpair failed and we were unable to recover it. 00:31:06.360 [2024-11-28 01:25:20.778629] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.360 [2024-11-28 01:25:20.778732] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.360 [2024-11-28 01:25:20.778758] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.360 [2024-11-28 01:25:20.778772] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.360 [2024-11-28 01:25:20.778784] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.360 [2024-11-28 01:25:20.778812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.360 qpair failed and we were unable to recover it. 00:31:06.360 [2024-11-28 01:25:20.788718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.360 [2024-11-28 01:25:20.788826] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.360 [2024-11-28 01:25:20.788856] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.360 [2024-11-28 01:25:20.788874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.360 [2024-11-28 01:25:20.788895] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.360 [2024-11-28 01:25:20.788938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.360 qpair failed and we were unable to recover it. 00:31:06.360 [2024-11-28 01:25:20.798634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.360 [2024-11-28 01:25:20.798773] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.360 [2024-11-28 01:25:20.798799] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.360 [2024-11-28 01:25:20.798813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.360 [2024-11-28 01:25:20.798825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.360 [2024-11-28 01:25:20.798854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.360 qpair failed and we were unable to recover it. 00:31:06.360 [2024-11-28 01:25:20.808636] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.360 [2024-11-28 01:25:20.808738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.360 [2024-11-28 01:25:20.808764] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.360 [2024-11-28 01:25:20.808778] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.360 [2024-11-28 01:25:20.808790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.360 [2024-11-28 01:25:20.808819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.360 qpair failed and we were unable to recover it. 00:31:06.360 [2024-11-28 01:25:20.818690] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.360 [2024-11-28 01:25:20.818820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.360 [2024-11-28 01:25:20.818845] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.360 [2024-11-28 01:25:20.818859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.360 [2024-11-28 01:25:20.818871] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.361 [2024-11-28 01:25:20.818899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.361 qpair failed and we were unable to recover it. 00:31:06.361 [2024-11-28 01:25:20.828803] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.361 [2024-11-28 01:25:20.828909] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.361 [2024-11-28 01:25:20.828934] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.361 [2024-11-28 01:25:20.828948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.361 [2024-11-28 01:25:20.828960] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.361 [2024-11-28 01:25:20.828989] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.361 qpair failed and we were unable to recover it. 00:31:06.361 [2024-11-28 01:25:20.838749] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.361 [2024-11-28 01:25:20.838887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.361 [2024-11-28 01:25:20.838913] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.361 [2024-11-28 01:25:20.838927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.361 [2024-11-28 01:25:20.838939] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.361 [2024-11-28 01:25:20.838967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.361 qpair failed and we were unable to recover it. 00:31:06.361 [2024-11-28 01:25:20.848769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.361 [2024-11-28 01:25:20.848872] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.361 [2024-11-28 01:25:20.848897] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.361 [2024-11-28 01:25:20.848912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.361 [2024-11-28 01:25:20.848924] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.361 [2024-11-28 01:25:20.848956] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.361 qpair failed and we were unable to recover it. 00:31:06.361 [2024-11-28 01:25:20.858799] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.361 [2024-11-28 01:25:20.858911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.361 [2024-11-28 01:25:20.858937] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.361 [2024-11-28 01:25:20.858951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.361 [2024-11-28 01:25:20.858963] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.361 [2024-11-28 01:25:20.858992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.361 qpair failed and we were unable to recover it. 00:31:06.361 [2024-11-28 01:25:20.868847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.361 [2024-11-28 01:25:20.868974] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.361 [2024-11-28 01:25:20.869000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.361 [2024-11-28 01:25:20.869015] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.361 [2024-11-28 01:25:20.869026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.361 [2024-11-28 01:25:20.869056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.361 qpair failed and we were unable to recover it. 00:31:06.361 [2024-11-28 01:25:20.878851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.361 [2024-11-28 01:25:20.878953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.361 [2024-11-28 01:25:20.878979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.361 [2024-11-28 01:25:20.878999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.361 [2024-11-28 01:25:20.879012] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.361 [2024-11-28 01:25:20.879041] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.361 qpair failed and we were unable to recover it. 00:31:06.361 [2024-11-28 01:25:20.888931] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.361 [2024-11-28 01:25:20.889040] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.361 [2024-11-28 01:25:20.889066] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.361 [2024-11-28 01:25:20.889081] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.361 [2024-11-28 01:25:20.889092] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.361 [2024-11-28 01:25:20.889136] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.361 qpair failed and we were unable to recover it. 00:31:06.361 [2024-11-28 01:25:20.898906] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.361 [2024-11-28 01:25:20.899015] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.361 [2024-11-28 01:25:20.899041] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.361 [2024-11-28 01:25:20.899055] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.361 [2024-11-28 01:25:20.899066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.361 [2024-11-28 01:25:20.899097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.361 qpair failed and we were unable to recover it. 00:31:06.361 [2024-11-28 01:25:20.908942] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.361 [2024-11-28 01:25:20.909043] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.361 [2024-11-28 01:25:20.909069] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.361 [2024-11-28 01:25:20.909083] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.361 [2024-11-28 01:25:20.909095] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.361 [2024-11-28 01:25:20.909124] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.361 qpair failed and we were unable to recover it. 00:31:06.361 [2024-11-28 01:25:20.919024] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.361 [2024-11-28 01:25:20.919120] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.361 [2024-11-28 01:25:20.919146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.361 [2024-11-28 01:25:20.919161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.361 [2024-11-28 01:25:20.919172] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.361 [2024-11-28 01:25:20.919213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.361 qpair failed and we were unable to recover it. 00:31:06.361 [2024-11-28 01:25:20.929009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.361 [2024-11-28 01:25:20.929153] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.361 [2024-11-28 01:25:20.929180] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.361 [2024-11-28 01:25:20.929194] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.361 [2024-11-28 01:25:20.929206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.361 [2024-11-28 01:25:20.929235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.361 qpair failed and we were unable to recover it. 00:31:06.361 [2024-11-28 01:25:20.939020] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.361 [2024-11-28 01:25:20.939122] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.361 [2024-11-28 01:25:20.939148] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.361 [2024-11-28 01:25:20.939162] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.361 [2024-11-28 01:25:20.939174] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.361 [2024-11-28 01:25:20.939203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.361 qpair failed and we were unable to recover it. 00:31:06.361 [2024-11-28 01:25:20.949052] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.361 [2024-11-28 01:25:20.949197] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.361 [2024-11-28 01:25:20.949223] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.361 [2024-11-28 01:25:20.949237] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.361 [2024-11-28 01:25:20.949249] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.361 [2024-11-28 01:25:20.949278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.361 qpair failed and we were unable to recover it. 00:31:06.362 [2024-11-28 01:25:20.959178] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.362 [2024-11-28 01:25:20.959295] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.362 [2024-11-28 01:25:20.959321] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.362 [2024-11-28 01:25:20.959335] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.362 [2024-11-28 01:25:20.959346] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.362 [2024-11-28 01:25:20.959375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.362 qpair failed and we were unable to recover it. 00:31:06.621 [2024-11-28 01:25:20.969240] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.622 [2024-11-28 01:25:20.969368] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.622 [2024-11-28 01:25:20.969394] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.622 [2024-11-28 01:25:20.969417] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.622 [2024-11-28 01:25:20.969430] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.622 [2024-11-28 01:25:20.969463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.622 qpair failed and we were unable to recover it. 00:31:06.622 [2024-11-28 01:25:20.979122] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.622 [2024-11-28 01:25:20.979224] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.622 [2024-11-28 01:25:20.979250] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.622 [2024-11-28 01:25:20.979265] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.622 [2024-11-28 01:25:20.979277] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.622 [2024-11-28 01:25:20.979305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.622 qpair failed and we were unable to recover it. 00:31:06.622 [2024-11-28 01:25:20.989165] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.622 [2024-11-28 01:25:20.989300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.622 [2024-11-28 01:25:20.989328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.622 [2024-11-28 01:25:20.989342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.622 [2024-11-28 01:25:20.989354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.622 [2024-11-28 01:25:20.989383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.622 qpair failed and we were unable to recover it. 00:31:06.622 [2024-11-28 01:25:20.999206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.622 [2024-11-28 01:25:20.999311] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.622 [2024-11-28 01:25:20.999337] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.622 [2024-11-28 01:25:20.999351] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.622 [2024-11-28 01:25:20.999363] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.622 [2024-11-28 01:25:20.999392] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.622 qpair failed and we were unable to recover it. 00:31:06.622 [2024-11-28 01:25:21.009278] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.622 [2024-11-28 01:25:21.009394] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.622 [2024-11-28 01:25:21.009420] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.622 [2024-11-28 01:25:21.009434] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.622 [2024-11-28 01:25:21.009446] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.622 [2024-11-28 01:25:21.009475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.622 qpair failed and we were unable to recover it. 00:31:06.622 [2024-11-28 01:25:21.019343] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.622 [2024-11-28 01:25:21.019445] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.622 [2024-11-28 01:25:21.019470] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.622 [2024-11-28 01:25:21.019484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.622 [2024-11-28 01:25:21.019496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.622 [2024-11-28 01:25:21.019532] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.622 qpair failed and we were unable to recover it. 00:31:06.622 [2024-11-28 01:25:21.029316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.622 [2024-11-28 01:25:21.029427] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.622 [2024-11-28 01:25:21.029453] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.622 [2024-11-28 01:25:21.029467] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.622 [2024-11-28 01:25:21.029478] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.622 [2024-11-28 01:25:21.029508] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.622 qpair failed and we were unable to recover it. 00:31:06.622 [2024-11-28 01:25:21.039293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.622 [2024-11-28 01:25:21.039417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.622 [2024-11-28 01:25:21.039443] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.622 [2024-11-28 01:25:21.039457] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.622 [2024-11-28 01:25:21.039469] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.622 [2024-11-28 01:25:21.039497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.622 qpair failed and we were unable to recover it. 00:31:06.622 [2024-11-28 01:25:21.049343] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.622 [2024-11-28 01:25:21.049470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.622 [2024-11-28 01:25:21.049496] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.622 [2024-11-28 01:25:21.049511] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.622 [2024-11-28 01:25:21.049523] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.622 [2024-11-28 01:25:21.049561] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.622 qpair failed and we were unable to recover it. 00:31:06.622 [2024-11-28 01:25:21.059382] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.622 [2024-11-28 01:25:21.059498] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.622 [2024-11-28 01:25:21.059538] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.622 [2024-11-28 01:25:21.059556] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.622 [2024-11-28 01:25:21.059568] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.622 [2024-11-28 01:25:21.059600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.622 qpair failed and we were unable to recover it. 00:31:06.622 [2024-11-28 01:25:21.069399] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.622 [2024-11-28 01:25:21.069504] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.622 [2024-11-28 01:25:21.069537] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.622 [2024-11-28 01:25:21.069553] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.622 [2024-11-28 01:25:21.069564] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.622 [2024-11-28 01:25:21.069594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.622 qpair failed and we were unable to recover it. 00:31:06.622 [2024-11-28 01:25:21.079479] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.622 [2024-11-28 01:25:21.079622] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.622 [2024-11-28 01:25:21.079649] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.622 [2024-11-28 01:25:21.079663] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.622 [2024-11-28 01:25:21.079674] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.622 [2024-11-28 01:25:21.079716] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.622 qpair failed and we were unable to recover it. 00:31:06.622 [2024-11-28 01:25:21.089484] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.622 [2024-11-28 01:25:21.089644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.622 [2024-11-28 01:25:21.089670] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.622 [2024-11-28 01:25:21.089684] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.622 [2024-11-28 01:25:21.089696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.622 [2024-11-28 01:25:21.089726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.622 qpair failed and we were unable to recover it. 00:31:06.622 [2024-11-28 01:25:21.099580] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.622 [2024-11-28 01:25:21.099678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.623 [2024-11-28 01:25:21.099703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.623 [2024-11-28 01:25:21.099717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.623 [2024-11-28 01:25:21.099729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.623 [2024-11-28 01:25:21.099765] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.623 qpair failed and we were unable to recover it. 00:31:06.623 [2024-11-28 01:25:21.109552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.623 [2024-11-28 01:25:21.109656] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.623 [2024-11-28 01:25:21.109682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.623 [2024-11-28 01:25:21.109696] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.623 [2024-11-28 01:25:21.109708] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.623 [2024-11-28 01:25:21.109737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.623 qpair failed and we were unable to recover it. 00:31:06.623 [2024-11-28 01:25:21.119584] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.623 [2024-11-28 01:25:21.119694] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.623 [2024-11-28 01:25:21.119721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.623 [2024-11-28 01:25:21.119735] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.623 [2024-11-28 01:25:21.119747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.623 [2024-11-28 01:25:21.119776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.623 qpair failed and we were unable to recover it. 00:31:06.623 [2024-11-28 01:25:21.129666] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.623 [2024-11-28 01:25:21.129818] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.623 [2024-11-28 01:25:21.129844] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.623 [2024-11-28 01:25:21.129858] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.623 [2024-11-28 01:25:21.129870] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.623 [2024-11-28 01:25:21.129899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.623 qpair failed and we were unable to recover it. 00:31:06.623 [2024-11-28 01:25:21.139583] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.623 [2024-11-28 01:25:21.139686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.623 [2024-11-28 01:25:21.139711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.623 [2024-11-28 01:25:21.139725] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.623 [2024-11-28 01:25:21.139737] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.623 [2024-11-28 01:25:21.139770] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.623 qpair failed and we were unable to recover it. 00:31:06.623 [2024-11-28 01:25:21.149645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.623 [2024-11-28 01:25:21.149756] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.623 [2024-11-28 01:25:21.149787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.623 [2024-11-28 01:25:21.149802] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.623 [2024-11-28 01:25:21.149814] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.623 [2024-11-28 01:25:21.149843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.623 qpair failed and we were unable to recover it. 00:31:06.623 [2024-11-28 01:25:21.159735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.623 [2024-11-28 01:25:21.159835] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.623 [2024-11-28 01:25:21.159860] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.623 [2024-11-28 01:25:21.159874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.623 [2024-11-28 01:25:21.159886] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.623 [2024-11-28 01:25:21.159915] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.623 qpair failed and we were unable to recover it. 00:31:06.623 [2024-11-28 01:25:21.169693] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.623 [2024-11-28 01:25:21.169799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.623 [2024-11-28 01:25:21.169825] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.623 [2024-11-28 01:25:21.169839] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.623 [2024-11-28 01:25:21.169851] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.623 [2024-11-28 01:25:21.169881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.623 qpair failed and we were unable to recover it. 00:31:06.623 [2024-11-28 01:25:21.179842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.623 [2024-11-28 01:25:21.179973] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.623 [2024-11-28 01:25:21.180002] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.623 [2024-11-28 01:25:21.180017] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.623 [2024-11-28 01:25:21.180029] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.623 [2024-11-28 01:25:21.180060] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.623 qpair failed and we were unable to recover it. 00:31:06.623 [2024-11-28 01:25:21.189734] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.623 [2024-11-28 01:25:21.189840] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.623 [2024-11-28 01:25:21.189866] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.623 [2024-11-28 01:25:21.189880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.623 [2024-11-28 01:25:21.189892] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.623 [2024-11-28 01:25:21.189935] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.623 qpair failed and we were unable to recover it. 00:31:06.623 [2024-11-28 01:25:21.199821] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.623 [2024-11-28 01:25:21.199922] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.623 [2024-11-28 01:25:21.199949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.623 [2024-11-28 01:25:21.199964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.623 [2024-11-28 01:25:21.199976] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.623 [2024-11-28 01:25:21.200005] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.623 qpair failed and we were unable to recover it. 00:31:06.623 [2024-11-28 01:25:21.209901] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.623 [2024-11-28 01:25:21.210026] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.623 [2024-11-28 01:25:21.210052] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.623 [2024-11-28 01:25:21.210066] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.623 [2024-11-28 01:25:21.210078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.623 [2024-11-28 01:25:21.210107] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.623 qpair failed and we were unable to recover it. 00:31:06.623 [2024-11-28 01:25:21.219856] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.623 [2024-11-28 01:25:21.219962] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.623 [2024-11-28 01:25:21.219988] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.623 [2024-11-28 01:25:21.220002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.623 [2024-11-28 01:25:21.220014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.623 [2024-11-28 01:25:21.220054] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.623 qpair failed and we were unable to recover it. 00:31:06.942 [2024-11-28 01:25:21.229939] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.942 [2024-11-28 01:25:21.230046] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.942 [2024-11-28 01:25:21.230072] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.942 [2024-11-28 01:25:21.230086] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.942 [2024-11-28 01:25:21.230097] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.942 [2024-11-28 01:25:21.230126] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.942 qpair failed and we were unable to recover it. 00:31:06.942 [2024-11-28 01:25:21.239913] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.942 [2024-11-28 01:25:21.240034] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.942 [2024-11-28 01:25:21.240060] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.942 [2024-11-28 01:25:21.240074] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.942 [2024-11-28 01:25:21.240086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.942 [2024-11-28 01:25:21.240114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.942 qpair failed and we were unable to recover it. 00:31:06.942 [2024-11-28 01:25:21.250029] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.942 [2024-11-28 01:25:21.250137] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.942 [2024-11-28 01:25:21.250164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.942 [2024-11-28 01:25:21.250179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.942 [2024-11-28 01:25:21.250191] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.942 [2024-11-28 01:25:21.250220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.942 qpair failed and we were unable to recover it. 00:31:06.942 [2024-11-28 01:25:21.260061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.942 [2024-11-28 01:25:21.260161] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.942 [2024-11-28 01:25:21.260188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.942 [2024-11-28 01:25:21.260202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.942 [2024-11-28 01:25:21.260214] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.942 [2024-11-28 01:25:21.260246] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.942 qpair failed and we were unable to recover it. 00:31:06.942 [2024-11-28 01:25:21.269985] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.942 [2024-11-28 01:25:21.270087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.942 [2024-11-28 01:25:21.270113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.942 [2024-11-28 01:25:21.270127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.942 [2024-11-28 01:25:21.270139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.942 [2024-11-28 01:25:21.270169] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.942 qpair failed and we were unable to recover it. 00:31:06.942 [2024-11-28 01:25:21.280018] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.942 [2024-11-28 01:25:21.280122] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.942 [2024-11-28 01:25:21.280148] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.942 [2024-11-28 01:25:21.280162] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.942 [2024-11-28 01:25:21.280190] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.942 [2024-11-28 01:25:21.280220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.942 qpair failed and we were unable to recover it. 00:31:06.942 [2024-11-28 01:25:21.290125] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.942 [2024-11-28 01:25:21.290226] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.942 [2024-11-28 01:25:21.290252] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.943 [2024-11-28 01:25:21.290266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.943 [2024-11-28 01:25:21.290292] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.943 [2024-11-28 01:25:21.290325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.943 qpair failed and we were unable to recover it. 00:31:06.943 [2024-11-28 01:25:21.300046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.943 [2024-11-28 01:25:21.300147] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.943 [2024-11-28 01:25:21.300173] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.943 [2024-11-28 01:25:21.300187] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.943 [2024-11-28 01:25:21.300199] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.943 [2024-11-28 01:25:21.300227] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.943 qpair failed and we were unable to recover it. 00:31:06.943 [2024-11-28 01:25:21.310089] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.943 [2024-11-28 01:25:21.310234] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.943 [2024-11-28 01:25:21.310260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.943 [2024-11-28 01:25:21.310274] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.943 [2024-11-28 01:25:21.310286] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.943 [2024-11-28 01:25:21.310314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.943 qpair failed and we were unable to recover it. 00:31:06.943 [2024-11-28 01:25:21.320123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.943 [2024-11-28 01:25:21.320241] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.943 [2024-11-28 01:25:21.320270] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.943 [2024-11-28 01:25:21.320285] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.943 [2024-11-28 01:25:21.320298] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.943 [2024-11-28 01:25:21.320327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.943 qpair failed and we were unable to recover it. 00:31:06.943 [2024-11-28 01:25:21.330195] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.943 [2024-11-28 01:25:21.330341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.943 [2024-11-28 01:25:21.330368] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.943 [2024-11-28 01:25:21.330382] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.943 [2024-11-28 01:25:21.330395] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.943 [2024-11-28 01:25:21.330424] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.943 qpair failed and we were unable to recover it. 00:31:06.943 [2024-11-28 01:25:21.340181] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.943 [2024-11-28 01:25:21.340315] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.943 [2024-11-28 01:25:21.340341] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.943 [2024-11-28 01:25:21.340355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.943 [2024-11-28 01:25:21.340367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.943 [2024-11-28 01:25:21.340397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.943 qpair failed and we were unable to recover it. 00:31:06.943 [2024-11-28 01:25:21.350188] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.943 [2024-11-28 01:25:21.350300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.943 [2024-11-28 01:25:21.350326] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.943 [2024-11-28 01:25:21.350340] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.943 [2024-11-28 01:25:21.350352] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.943 [2024-11-28 01:25:21.350381] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.943 qpair failed and we were unable to recover it. 00:31:06.943 [2024-11-28 01:25:21.360239] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.943 [2024-11-28 01:25:21.360341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.943 [2024-11-28 01:25:21.360367] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.943 [2024-11-28 01:25:21.360381] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.943 [2024-11-28 01:25:21.360394] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.943 [2024-11-28 01:25:21.360435] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.943 qpair failed and we were unable to recover it. 00:31:06.943 [2024-11-28 01:25:21.370301] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.943 [2024-11-28 01:25:21.370415] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.943 [2024-11-28 01:25:21.370441] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.943 [2024-11-28 01:25:21.370460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.943 [2024-11-28 01:25:21.370474] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.943 [2024-11-28 01:25:21.370504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.943 qpair failed and we were unable to recover it. 00:31:06.943 [2024-11-28 01:25:21.380265] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.943 [2024-11-28 01:25:21.380361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.943 [2024-11-28 01:25:21.380387] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.943 [2024-11-28 01:25:21.380401] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.943 [2024-11-28 01:25:21.380413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.943 [2024-11-28 01:25:21.380442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.943 qpair failed and we were unable to recover it. 00:31:06.943 [2024-11-28 01:25:21.390317] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.943 [2024-11-28 01:25:21.390441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.943 [2024-11-28 01:25:21.390470] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.943 [2024-11-28 01:25:21.390484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.943 [2024-11-28 01:25:21.390496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.943 [2024-11-28 01:25:21.390531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.943 qpair failed and we were unable to recover it. 00:31:06.943 [2024-11-28 01:25:21.400341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.943 [2024-11-28 01:25:21.400435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.943 [2024-11-28 01:25:21.400461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.943 [2024-11-28 01:25:21.400475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.943 [2024-11-28 01:25:21.400487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.943 [2024-11-28 01:25:21.400516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.943 qpair failed and we were unable to recover it. 00:31:06.943 [2024-11-28 01:25:21.410355] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.943 [2024-11-28 01:25:21.410462] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.943 [2024-11-28 01:25:21.410488] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.943 [2024-11-28 01:25:21.410502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.943 [2024-11-28 01:25:21.410514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.943 [2024-11-28 01:25:21.410551] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.943 qpair failed and we were unable to recover it. 00:31:06.943 [2024-11-28 01:25:21.420414] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.943 [2024-11-28 01:25:21.420523] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.943 [2024-11-28 01:25:21.420558] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.943 [2024-11-28 01:25:21.420572] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.943 [2024-11-28 01:25:21.420584] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.944 [2024-11-28 01:25:21.420613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.944 qpair failed and we were unable to recover it. 00:31:06.944 [2024-11-28 01:25:21.430546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.944 [2024-11-28 01:25:21.430655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.944 [2024-11-28 01:25:21.430681] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.944 [2024-11-28 01:25:21.430695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.944 [2024-11-28 01:25:21.430707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.944 [2024-11-28 01:25:21.430736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.944 qpair failed and we were unable to recover it. 00:31:06.944 [2024-11-28 01:25:21.440442] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.944 [2024-11-28 01:25:21.440542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.944 [2024-11-28 01:25:21.440568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.944 [2024-11-28 01:25:21.440582] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.944 [2024-11-28 01:25:21.440593] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.944 [2024-11-28 01:25:21.440622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.944 qpair failed and we were unable to recover it. 00:31:06.944 [2024-11-28 01:25:21.450465] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.944 [2024-11-28 01:25:21.450565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.944 [2024-11-28 01:25:21.450592] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.944 [2024-11-28 01:25:21.450606] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.944 [2024-11-28 01:25:21.450618] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.944 [2024-11-28 01:25:21.450647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.944 qpair failed and we were unable to recover it. 00:31:06.944 [2024-11-28 01:25:21.460573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.944 [2024-11-28 01:25:21.460676] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.944 [2024-11-28 01:25:21.460702] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.944 [2024-11-28 01:25:21.460725] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.944 [2024-11-28 01:25:21.460738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.944 [2024-11-28 01:25:21.460767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.944 qpair failed and we were unable to recover it. 00:31:06.944 [2024-11-28 01:25:21.470589] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.944 [2024-11-28 01:25:21.470700] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.944 [2024-11-28 01:25:21.470726] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.944 [2024-11-28 01:25:21.470740] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.944 [2024-11-28 01:25:21.470752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.944 [2024-11-28 01:25:21.470781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.944 qpair failed and we were unable to recover it. 00:31:06.944 [2024-11-28 01:25:21.480554] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.944 [2024-11-28 01:25:21.480659] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.944 [2024-11-28 01:25:21.480687] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.944 [2024-11-28 01:25:21.480701] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.944 [2024-11-28 01:25:21.480713] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.944 [2024-11-28 01:25:21.480743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.944 qpair failed and we were unable to recover it. 00:31:06.944 [2024-11-28 01:25:21.490701] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.944 [2024-11-28 01:25:21.490824] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.944 [2024-11-28 01:25:21.490850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.944 [2024-11-28 01:25:21.490864] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.944 [2024-11-28 01:25:21.490876] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.944 [2024-11-28 01:25:21.490905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.944 qpair failed and we were unable to recover it. 00:31:06.944 [2024-11-28 01:25:21.500621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.944 [2024-11-28 01:25:21.500736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.944 [2024-11-28 01:25:21.500763] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.944 [2024-11-28 01:25:21.500777] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.944 [2024-11-28 01:25:21.500789] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.944 [2024-11-28 01:25:21.500817] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.944 qpair failed and we were unable to recover it. 00:31:06.944 [2024-11-28 01:25:21.510658] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.944 [2024-11-28 01:25:21.510776] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.944 [2024-11-28 01:25:21.510804] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.944 [2024-11-28 01:25:21.510819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.944 [2024-11-28 01:25:21.510830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.944 [2024-11-28 01:25:21.510861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.944 qpair failed and we were unable to recover it. 00:31:06.944 [2024-11-28 01:25:21.520768] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.944 [2024-11-28 01:25:21.520871] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.944 [2024-11-28 01:25:21.520898] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.944 [2024-11-28 01:25:21.520912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.944 [2024-11-28 01:25:21.520924] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.944 [2024-11-28 01:25:21.520953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.944 qpair failed and we were unable to recover it. 00:31:06.944 [2024-11-28 01:25:21.530809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.944 [2024-11-28 01:25:21.530925] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.944 [2024-11-28 01:25:21.530953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.944 [2024-11-28 01:25:21.530968] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.944 [2024-11-28 01:25:21.530980] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.944 [2024-11-28 01:25:21.531021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.944 qpair failed and we were unable to recover it. 00:31:06.944 [2024-11-28 01:25:21.540750] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:06.944 [2024-11-28 01:25:21.540877] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:06.944 [2024-11-28 01:25:21.540907] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:06.944 [2024-11-28 01:25:21.540923] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:06.944 [2024-11-28 01:25:21.540935] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:06.944 [2024-11-28 01:25:21.540966] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:06.944 qpair failed and we were unable to recover it. 00:31:07.203 [2024-11-28 01:25:21.550841] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.203 [2024-11-28 01:25:21.550993] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.204 [2024-11-28 01:25:21.551031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.204 [2024-11-28 01:25:21.551047] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.204 [2024-11-28 01:25:21.551059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.204 [2024-11-28 01:25:21.551090] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.204 qpair failed and we were unable to recover it. 00:31:07.204 [2024-11-28 01:25:21.560769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.204 [2024-11-28 01:25:21.560917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.204 [2024-11-28 01:25:21.560944] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.204 [2024-11-28 01:25:21.560958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.204 [2024-11-28 01:25:21.560970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.204 [2024-11-28 01:25:21.560999] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.204 qpair failed and we were unable to recover it. 00:31:07.204 [2024-11-28 01:25:21.570811] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.204 [2024-11-28 01:25:21.570918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.204 [2024-11-28 01:25:21.570947] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.204 [2024-11-28 01:25:21.570961] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.204 [2024-11-28 01:25:21.570973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.204 [2024-11-28 01:25:21.571003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.204 qpair failed and we were unable to recover it. 00:31:07.204 [2024-11-28 01:25:21.580910] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.204 [2024-11-28 01:25:21.581012] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.204 [2024-11-28 01:25:21.581039] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.204 [2024-11-28 01:25:21.581053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.204 [2024-11-28 01:25:21.581065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.204 [2024-11-28 01:25:21.581094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.204 qpair failed and we were unable to recover it. 00:31:07.204 [2024-11-28 01:25:21.590973] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.204 [2024-11-28 01:25:21.591082] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.204 [2024-11-28 01:25:21.591108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.204 [2024-11-28 01:25:21.591124] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.204 [2024-11-28 01:25:21.591139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.204 [2024-11-28 01:25:21.591176] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.204 qpair failed and we were unable to recover it. 00:31:07.204 [2024-11-28 01:25:21.600878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.204 [2024-11-28 01:25:21.600974] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.204 [2024-11-28 01:25:21.601001] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.204 [2024-11-28 01:25:21.601015] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.204 [2024-11-28 01:25:21.601027] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.204 [2024-11-28 01:25:21.601056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.204 qpair failed and we were unable to recover it. 00:31:07.204 [2024-11-28 01:25:21.610921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.204 [2024-11-28 01:25:21.611069] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.204 [2024-11-28 01:25:21.611095] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.204 [2024-11-28 01:25:21.611109] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.204 [2024-11-28 01:25:21.611120] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.204 [2024-11-28 01:25:21.611149] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.204 qpair failed and we were unable to recover it. 00:31:07.204 [2024-11-28 01:25:21.621032] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.204 [2024-11-28 01:25:21.621138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.204 [2024-11-28 01:25:21.621165] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.204 [2024-11-28 01:25:21.621179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.204 [2024-11-28 01:25:21.621191] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.204 [2024-11-28 01:25:21.621220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.204 qpair failed and we were unable to recover it. 00:31:07.204 [2024-11-28 01:25:21.630962] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.204 [2024-11-28 01:25:21.631073] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.204 [2024-11-28 01:25:21.631100] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.204 [2024-11-28 01:25:21.631115] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.204 [2024-11-28 01:25:21.631127] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.204 [2024-11-28 01:25:21.631156] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.204 qpair failed and we were unable to recover it. 00:31:07.204 [2024-11-28 01:25:21.641076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.204 [2024-11-28 01:25:21.641175] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.204 [2024-11-28 01:25:21.641207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.204 [2024-11-28 01:25:21.641222] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.204 [2024-11-28 01:25:21.641234] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.204 [2024-11-28 01:25:21.641263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.204 qpair failed and we were unable to recover it. 00:31:07.204 [2024-11-28 01:25:21.651052] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.204 [2024-11-28 01:25:21.651176] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.204 [2024-11-28 01:25:21.651202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.204 [2024-11-28 01:25:21.651216] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.204 [2024-11-28 01:25:21.651228] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.204 [2024-11-28 01:25:21.651257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.204 qpair failed and we were unable to recover it. 00:31:07.204 [2024-11-28 01:25:21.661034] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.204 [2024-11-28 01:25:21.661158] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.204 [2024-11-28 01:25:21.661184] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.204 [2024-11-28 01:25:21.661198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.204 [2024-11-28 01:25:21.661210] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.204 [2024-11-28 01:25:21.661239] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.204 qpair failed and we were unable to recover it. 00:31:07.204 [2024-11-28 01:25:21.671194] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.204 [2024-11-28 01:25:21.671328] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.204 [2024-11-28 01:25:21.671355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.204 [2024-11-28 01:25:21.671369] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.204 [2024-11-28 01:25:21.671381] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.204 [2024-11-28 01:25:21.671410] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.204 qpair failed and we were unable to recover it. 00:31:07.204 [2024-11-28 01:25:21.681196] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.204 [2024-11-28 01:25:21.681332] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.205 [2024-11-28 01:25:21.681358] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.205 [2024-11-28 01:25:21.681372] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.205 [2024-11-28 01:25:21.681384] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.205 [2024-11-28 01:25:21.681435] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.205 qpair failed and we were unable to recover it. 00:31:07.205 [2024-11-28 01:25:21.691156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.205 [2024-11-28 01:25:21.691261] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.205 [2024-11-28 01:25:21.691291] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.205 [2024-11-28 01:25:21.691305] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.205 [2024-11-28 01:25:21.691317] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.205 [2024-11-28 01:25:21.691350] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.205 qpair failed and we were unable to recover it. 00:31:07.205 [2024-11-28 01:25:21.701184] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.205 [2024-11-28 01:25:21.701303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.205 [2024-11-28 01:25:21.701329] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.205 [2024-11-28 01:25:21.701343] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.205 [2024-11-28 01:25:21.701355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.205 [2024-11-28 01:25:21.701384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.205 qpair failed and we were unable to recover it. 00:31:07.205 [2024-11-28 01:25:21.711292] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.205 [2024-11-28 01:25:21.711416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.205 [2024-11-28 01:25:21.711444] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.205 [2024-11-28 01:25:21.711459] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.205 [2024-11-28 01:25:21.711475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.205 [2024-11-28 01:25:21.711506] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.205 qpair failed and we were unable to recover it. 00:31:07.205 [2024-11-28 01:25:21.721351] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.205 [2024-11-28 01:25:21.721490] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.205 [2024-11-28 01:25:21.721516] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.205 [2024-11-28 01:25:21.721539] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.205 [2024-11-28 01:25:21.721552] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.205 [2024-11-28 01:25:21.721593] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.205 qpair failed and we were unable to recover it. 00:31:07.205 [2024-11-28 01:25:21.731409] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.205 [2024-11-28 01:25:21.731518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.205 [2024-11-28 01:25:21.731557] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.205 [2024-11-28 01:25:21.731572] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.205 [2024-11-28 01:25:21.731585] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.205 [2024-11-28 01:25:21.731614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.205 qpair failed and we were unable to recover it. 00:31:07.205 [2024-11-28 01:25:21.741311] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.205 [2024-11-28 01:25:21.741413] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.205 [2024-11-28 01:25:21.741440] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.205 [2024-11-28 01:25:21.741454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.205 [2024-11-28 01:25:21.741466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.205 [2024-11-28 01:25:21.741507] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.205 qpair failed and we were unable to recover it. 00:31:07.205 [2024-11-28 01:25:21.751345] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.205 [2024-11-28 01:25:21.751485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.205 [2024-11-28 01:25:21.751512] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.205 [2024-11-28 01:25:21.751534] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.205 [2024-11-28 01:25:21.751549] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.205 [2024-11-28 01:25:21.751589] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.205 qpair failed and we were unable to recover it. 00:31:07.205 [2024-11-28 01:25:21.761425] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.205 [2024-11-28 01:25:21.761523] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.205 [2024-11-28 01:25:21.761560] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.205 [2024-11-28 01:25:21.761575] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.205 [2024-11-28 01:25:21.761586] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.205 [2024-11-28 01:25:21.761616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.205 qpair failed and we were unable to recover it. 00:31:07.205 [2024-11-28 01:25:21.771519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.205 [2024-11-28 01:25:21.771652] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.205 [2024-11-28 01:25:21.771678] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.205 [2024-11-28 01:25:21.771692] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.205 [2024-11-28 01:25:21.771714] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.205 [2024-11-28 01:25:21.771744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.205 qpair failed and we were unable to recover it. 00:31:07.205 [2024-11-28 01:25:21.781406] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.205 [2024-11-28 01:25:21.781540] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.205 [2024-11-28 01:25:21.781566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.205 [2024-11-28 01:25:21.781581] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.205 [2024-11-28 01:25:21.781592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.205 [2024-11-28 01:25:21.781621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.205 qpair failed and we were unable to recover it. 00:31:07.205 [2024-11-28 01:25:21.791449] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.205 [2024-11-28 01:25:21.791565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.205 [2024-11-28 01:25:21.791592] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.205 [2024-11-28 01:25:21.791606] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.205 [2024-11-28 01:25:21.791618] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.205 [2024-11-28 01:25:21.791659] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.205 qpair failed and we were unable to recover it. 00:31:07.205 [2024-11-28 01:25:21.801556] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.205 [2024-11-28 01:25:21.801650] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.205 [2024-11-28 01:25:21.801676] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.205 [2024-11-28 01:25:21.801690] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.205 [2024-11-28 01:25:21.801702] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.205 [2024-11-28 01:25:21.801732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.205 qpair failed and we were unable to recover it. 00:31:07.464 [2024-11-28 01:25:21.811513] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.465 [2024-11-28 01:25:21.811640] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.465 [2024-11-28 01:25:21.811667] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.465 [2024-11-28 01:25:21.811682] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.465 [2024-11-28 01:25:21.811698] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.465 [2024-11-28 01:25:21.811730] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.465 qpair failed and we were unable to recover it. 00:31:07.465 [2024-11-28 01:25:21.821538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.465 [2024-11-28 01:25:21.821685] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.465 [2024-11-28 01:25:21.821712] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.465 [2024-11-28 01:25:21.821727] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.465 [2024-11-28 01:25:21.821739] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.465 [2024-11-28 01:25:21.821767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.465 qpair failed and we were unable to recover it. 00:31:07.465 [2024-11-28 01:25:21.831557] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.465 [2024-11-28 01:25:21.831662] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.465 [2024-11-28 01:25:21.831689] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.465 [2024-11-28 01:25:21.831703] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.465 [2024-11-28 01:25:21.831715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.465 [2024-11-28 01:25:21.831744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.465 qpair failed and we were unable to recover it. 00:31:07.465 [2024-11-28 01:25:21.841644] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.465 [2024-11-28 01:25:21.841744] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.465 [2024-11-28 01:25:21.841772] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.465 [2024-11-28 01:25:21.841786] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.465 [2024-11-28 01:25:21.841798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.465 [2024-11-28 01:25:21.841827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.465 qpair failed and we were unable to recover it. 00:31:07.465 [2024-11-28 01:25:21.851608] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.465 [2024-11-28 01:25:21.851711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.465 [2024-11-28 01:25:21.851738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.465 [2024-11-28 01:25:21.851751] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.465 [2024-11-28 01:25:21.851763] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.465 [2024-11-28 01:25:21.851792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.465 qpair failed and we were unable to recover it. 00:31:07.465 [2024-11-28 01:25:21.861751] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.465 [2024-11-28 01:25:21.861874] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.465 [2024-11-28 01:25:21.861901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.465 [2024-11-28 01:25:21.861915] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.465 [2024-11-28 01:25:21.861934] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.465 [2024-11-28 01:25:21.861976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.465 qpair failed and we were unable to recover it. 00:31:07.465 [2024-11-28 01:25:21.871679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.465 [2024-11-28 01:25:21.871789] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.465 [2024-11-28 01:25:21.871815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.465 [2024-11-28 01:25:21.871829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.465 [2024-11-28 01:25:21.871841] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.465 [2024-11-28 01:25:21.871870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.465 qpair failed and we were unable to recover it. 00:31:07.465 [2024-11-28 01:25:21.881667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.465 [2024-11-28 01:25:21.881763] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.465 [2024-11-28 01:25:21.881788] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.465 [2024-11-28 01:25:21.881802] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.465 [2024-11-28 01:25:21.881814] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.465 [2024-11-28 01:25:21.881842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.465 qpair failed and we were unable to recover it. 00:31:07.465 [2024-11-28 01:25:21.891720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.465 [2024-11-28 01:25:21.891820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.465 [2024-11-28 01:25:21.891845] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.465 [2024-11-28 01:25:21.891859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.465 [2024-11-28 01:25:21.891871] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.465 [2024-11-28 01:25:21.891900] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.465 qpair failed and we were unable to recover it. 00:31:07.465 [2024-11-28 01:25:21.901774] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.465 [2024-11-28 01:25:21.901898] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.465 [2024-11-28 01:25:21.901925] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.465 [2024-11-28 01:25:21.901939] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.465 [2024-11-28 01:25:21.901951] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.465 [2024-11-28 01:25:21.901980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.465 qpair failed and we were unable to recover it. 00:31:07.465 [2024-11-28 01:25:21.911798] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.465 [2024-11-28 01:25:21.911909] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.465 [2024-11-28 01:25:21.911934] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.465 [2024-11-28 01:25:21.911949] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.465 [2024-11-28 01:25:21.911961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.465 [2024-11-28 01:25:21.911990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.465 qpair failed and we were unable to recover it. 00:31:07.465 [2024-11-28 01:25:21.921881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.465 [2024-11-28 01:25:21.921981] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.465 [2024-11-28 01:25:21.922006] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.465 [2024-11-28 01:25:21.922020] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.465 [2024-11-28 01:25:21.922032] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.465 [2024-11-28 01:25:21.922060] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.465 qpair failed and we were unable to recover it. 00:31:07.465 [2024-11-28 01:25:21.931936] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.465 [2024-11-28 01:25:21.932071] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.465 [2024-11-28 01:25:21.932097] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.465 [2024-11-28 01:25:21.932111] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.465 [2024-11-28 01:25:21.932122] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.465 [2024-11-28 01:25:21.932151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.465 qpair failed and we were unable to recover it. 00:31:07.466 [2024-11-28 01:25:21.941839] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.466 [2024-11-28 01:25:21.941939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.466 [2024-11-28 01:25:21.941965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.466 [2024-11-28 01:25:21.941980] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.466 [2024-11-28 01:25:21.941992] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.466 [2024-11-28 01:25:21.942020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.466 qpair failed and we were unable to recover it. 00:31:07.466 [2024-11-28 01:25:21.951900] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.466 [2024-11-28 01:25:21.952057] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.466 [2024-11-28 01:25:21.952083] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.466 [2024-11-28 01:25:21.952102] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.466 [2024-11-28 01:25:21.952115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.466 [2024-11-28 01:25:21.952144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.466 qpair failed and we were unable to recover it. 00:31:07.466 [2024-11-28 01:25:21.961894] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.466 [2024-11-28 01:25:21.961994] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.466 [2024-11-28 01:25:21.962020] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.466 [2024-11-28 01:25:21.962034] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.466 [2024-11-28 01:25:21.962046] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.466 [2024-11-28 01:25:21.962075] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.466 qpair failed and we were unable to recover it. 00:31:07.466 [2024-11-28 01:25:21.971976] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.466 [2024-11-28 01:25:21.972084] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.466 [2024-11-28 01:25:21.972110] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.466 [2024-11-28 01:25:21.972124] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.466 [2024-11-28 01:25:21.972135] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.466 [2024-11-28 01:25:21.972164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.466 qpair failed and we were unable to recover it. 00:31:07.466 [2024-11-28 01:25:21.982045] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.466 [2024-11-28 01:25:21.982143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.466 [2024-11-28 01:25:21.982168] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.466 [2024-11-28 01:25:21.982183] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.466 [2024-11-28 01:25:21.982195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.466 [2024-11-28 01:25:21.982223] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.466 qpair failed and we were unable to recover it. 00:31:07.466 [2024-11-28 01:25:21.992019] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.466 [2024-11-28 01:25:21.992134] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.466 [2024-11-28 01:25:21.992161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.466 [2024-11-28 01:25:21.992175] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.466 [2024-11-28 01:25:21.992187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.466 [2024-11-28 01:25:21.992216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.466 qpair failed and we were unable to recover it. 00:31:07.466 [2024-11-28 01:25:22.002043] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.466 [2024-11-28 01:25:22.002143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.466 [2024-11-28 01:25:22.002170] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.466 [2024-11-28 01:25:22.002185] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.466 [2024-11-28 01:25:22.002196] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.466 [2024-11-28 01:25:22.002225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.466 qpair failed and we were unable to recover it. 00:31:07.466 [2024-11-28 01:25:22.012048] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.466 [2024-11-28 01:25:22.012150] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.466 [2024-11-28 01:25:22.012176] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.466 [2024-11-28 01:25:22.012191] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.466 [2024-11-28 01:25:22.012202] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.466 [2024-11-28 01:25:22.012231] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.466 qpair failed and we were unable to recover it. 00:31:07.466 [2024-11-28 01:25:22.022156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.466 [2024-11-28 01:25:22.022260] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.466 [2024-11-28 01:25:22.022287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.466 [2024-11-28 01:25:22.022301] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.466 [2024-11-28 01:25:22.022313] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.466 [2024-11-28 01:25:22.022341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.466 qpair failed and we were unable to recover it. 00:31:07.466 [2024-11-28 01:25:22.032131] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.466 [2024-11-28 01:25:22.032241] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.466 [2024-11-28 01:25:22.032267] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.466 [2024-11-28 01:25:22.032281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.466 [2024-11-28 01:25:22.032293] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.466 [2024-11-28 01:25:22.032322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.466 qpair failed and we were unable to recover it. 00:31:07.466 [2024-11-28 01:25:22.042153] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.466 [2024-11-28 01:25:22.042264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.466 [2024-11-28 01:25:22.042295] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.466 [2024-11-28 01:25:22.042309] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.466 [2024-11-28 01:25:22.042321] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.466 [2024-11-28 01:25:22.042350] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.466 qpair failed and we were unable to recover it. 00:31:07.466 [2024-11-28 01:25:22.052288] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.466 [2024-11-28 01:25:22.052396] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.466 [2024-11-28 01:25:22.052423] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.466 [2024-11-28 01:25:22.052436] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.466 [2024-11-28 01:25:22.052448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.466 [2024-11-28 01:25:22.052477] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.466 qpair failed and we were unable to recover it. 00:31:07.466 [2024-11-28 01:25:22.062203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.466 [2024-11-28 01:25:22.062323] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.466 [2024-11-28 01:25:22.062349] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.466 [2024-11-28 01:25:22.062363] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.466 [2024-11-28 01:25:22.062375] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.466 [2024-11-28 01:25:22.062406] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.466 qpair failed and we were unable to recover it. 00:31:07.725 [2024-11-28 01:25:22.072241] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.726 [2024-11-28 01:25:22.072358] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.726 [2024-11-28 01:25:22.072384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.726 [2024-11-28 01:25:22.072399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.726 [2024-11-28 01:25:22.072411] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.726 [2024-11-28 01:25:22.072440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.726 qpair failed and we were unable to recover it. 00:31:07.726 [2024-11-28 01:25:22.082254] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.726 [2024-11-28 01:25:22.082351] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.726 [2024-11-28 01:25:22.082377] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.726 [2024-11-28 01:25:22.082391] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.726 [2024-11-28 01:25:22.082404] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.726 [2024-11-28 01:25:22.082433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.726 qpair failed and we were unable to recover it. 00:31:07.726 [2024-11-28 01:25:22.092303] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.726 [2024-11-28 01:25:22.092426] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.726 [2024-11-28 01:25:22.092452] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.726 [2024-11-28 01:25:22.092466] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.726 [2024-11-28 01:25:22.092478] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.726 [2024-11-28 01:25:22.092522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.726 qpair failed and we were unable to recover it. 00:31:07.726 [2024-11-28 01:25:22.102294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.726 [2024-11-28 01:25:22.102395] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.726 [2024-11-28 01:25:22.102422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.726 [2024-11-28 01:25:22.102436] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.726 [2024-11-28 01:25:22.102448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.726 [2024-11-28 01:25:22.102477] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.726 qpair failed and we were unable to recover it. 00:31:07.726 [2024-11-28 01:25:22.112364] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.726 [2024-11-28 01:25:22.112493] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.726 [2024-11-28 01:25:22.112518] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.726 [2024-11-28 01:25:22.112541] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.726 [2024-11-28 01:25:22.112554] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.726 [2024-11-28 01:25:22.112583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.726 qpair failed and we were unable to recover it. 00:31:07.726 [2024-11-28 01:25:22.122403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.726 [2024-11-28 01:25:22.122520] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.726 [2024-11-28 01:25:22.122552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.726 [2024-11-28 01:25:22.122566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.726 [2024-11-28 01:25:22.122578] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.726 [2024-11-28 01:25:22.122606] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.726 qpair failed and we were unable to recover it. 00:31:07.726 [2024-11-28 01:25:22.132509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.726 [2024-11-28 01:25:22.132642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.726 [2024-11-28 01:25:22.132674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.726 [2024-11-28 01:25:22.132690] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.726 [2024-11-28 01:25:22.132701] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.726 [2024-11-28 01:25:22.132731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.726 qpair failed and we were unable to recover it. 00:31:07.726 [2024-11-28 01:25:22.142419] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.726 [2024-11-28 01:25:22.142553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.726 [2024-11-28 01:25:22.142580] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.726 [2024-11-28 01:25:22.142594] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.726 [2024-11-28 01:25:22.142606] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.726 [2024-11-28 01:25:22.142635] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.726 qpair failed and we were unable to recover it. 00:31:07.726 [2024-11-28 01:25:22.152449] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.726 [2024-11-28 01:25:22.152556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.726 [2024-11-28 01:25:22.152583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.726 [2024-11-28 01:25:22.152597] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.726 [2024-11-28 01:25:22.152609] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.726 [2024-11-28 01:25:22.152638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.726 qpair failed and we were unable to recover it. 00:31:07.726 [2024-11-28 01:25:22.162568] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.726 [2024-11-28 01:25:22.162670] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.726 [2024-11-28 01:25:22.162699] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.726 [2024-11-28 01:25:22.162713] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.726 [2024-11-28 01:25:22.162725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.726 [2024-11-28 01:25:22.162754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.726 qpair failed and we were unable to recover it. 00:31:07.726 [2024-11-28 01:25:22.172542] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.726 [2024-11-28 01:25:22.172654] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.726 [2024-11-28 01:25:22.172681] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.726 [2024-11-28 01:25:22.172695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.726 [2024-11-28 01:25:22.172707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.726 [2024-11-28 01:25:22.172743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.726 qpair failed and we were unable to recover it. 00:31:07.726 [2024-11-28 01:25:22.182662] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.726 [2024-11-28 01:25:22.182769] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.726 [2024-11-28 01:25:22.182794] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.726 [2024-11-28 01:25:22.182809] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.726 [2024-11-28 01:25:22.182820] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.726 [2024-11-28 01:25:22.182850] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.726 qpair failed and we were unable to recover it. 00:31:07.726 [2024-11-28 01:25:22.192662] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.726 [2024-11-28 01:25:22.192773] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.726 [2024-11-28 01:25:22.192799] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.726 [2024-11-28 01:25:22.192813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.726 [2024-11-28 01:25:22.192825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.726 [2024-11-28 01:25:22.192854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.726 qpair failed and we were unable to recover it. 00:31:07.727 [2024-11-28 01:25:22.202678] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.727 [2024-11-28 01:25:22.202781] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.727 [2024-11-28 01:25:22.202807] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.727 [2024-11-28 01:25:22.202821] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.727 [2024-11-28 01:25:22.202833] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.727 [2024-11-28 01:25:22.202862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.727 qpair failed and we were unable to recover it. 00:31:07.727 [2024-11-28 01:25:22.212698] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.727 [2024-11-28 01:25:22.212801] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.727 [2024-11-28 01:25:22.212828] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.727 [2024-11-28 01:25:22.212842] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.727 [2024-11-28 01:25:22.212854] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.727 [2024-11-28 01:25:22.212896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.727 qpair failed and we were unable to recover it. 00:31:07.727 [2024-11-28 01:25:22.222685] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.727 [2024-11-28 01:25:22.222802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.727 [2024-11-28 01:25:22.222832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.727 [2024-11-28 01:25:22.222848] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.727 [2024-11-28 01:25:22.222859] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.727 [2024-11-28 01:25:22.222892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.727 qpair failed and we were unable to recover it. 00:31:07.727 [2024-11-28 01:25:22.232680] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.727 [2024-11-28 01:25:22.232786] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.727 [2024-11-28 01:25:22.232812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.727 [2024-11-28 01:25:22.232826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.727 [2024-11-28 01:25:22.232838] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.727 [2024-11-28 01:25:22.232867] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.727 qpair failed and we were unable to recover it. 00:31:07.727 [2024-11-28 01:25:22.242717] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.727 [2024-11-28 01:25:22.242823] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.727 [2024-11-28 01:25:22.242849] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.727 [2024-11-28 01:25:22.242864] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.727 [2024-11-28 01:25:22.242875] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.727 [2024-11-28 01:25:22.242904] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.727 qpair failed and we were unable to recover it. 00:31:07.727 [2024-11-28 01:25:22.252777] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.727 [2024-11-28 01:25:22.252887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.727 [2024-11-28 01:25:22.252913] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.727 [2024-11-28 01:25:22.252928] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.727 [2024-11-28 01:25:22.252940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.727 [2024-11-28 01:25:22.252970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.727 qpair failed and we were unable to recover it. 00:31:07.727 [2024-11-28 01:25:22.262880] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.727 [2024-11-28 01:25:22.262983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.727 [2024-11-28 01:25:22.263009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.727 [2024-11-28 01:25:22.263023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.727 [2024-11-28 01:25:22.263041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.727 [2024-11-28 01:25:22.263071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.727 qpair failed and we were unable to recover it. 00:31:07.727 [2024-11-28 01:25:22.272903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.727 [2024-11-28 01:25:22.273021] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.727 [2024-11-28 01:25:22.273047] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.727 [2024-11-28 01:25:22.273060] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.727 [2024-11-28 01:25:22.273072] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.727 [2024-11-28 01:25:22.273101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.727 qpair failed and we were unable to recover it. 00:31:07.727 [2024-11-28 01:25:22.282935] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.727 [2024-11-28 01:25:22.283075] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.727 [2024-11-28 01:25:22.283101] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.727 [2024-11-28 01:25:22.283115] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.727 [2024-11-28 01:25:22.283127] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.727 [2024-11-28 01:25:22.283155] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.727 qpair failed and we were unable to recover it. 00:31:07.727 [2024-11-28 01:25:22.292922] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.727 [2024-11-28 01:25:22.293026] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.727 [2024-11-28 01:25:22.293052] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.727 [2024-11-28 01:25:22.293066] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.727 [2024-11-28 01:25:22.293078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.727 [2024-11-28 01:25:22.293108] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.727 qpair failed and we were unable to recover it. 00:31:07.727 [2024-11-28 01:25:22.302999] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.727 [2024-11-28 01:25:22.303129] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.727 [2024-11-28 01:25:22.303155] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.727 [2024-11-28 01:25:22.303169] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.727 [2024-11-28 01:25:22.303181] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.727 [2024-11-28 01:25:22.303209] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.727 qpair failed and we were unable to recover it. 00:31:07.727 [2024-11-28 01:25:22.313046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.727 [2024-11-28 01:25:22.313170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.727 [2024-11-28 01:25:22.313196] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.727 [2024-11-28 01:25:22.313210] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.727 [2024-11-28 01:25:22.313222] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.727 [2024-11-28 01:25:22.313250] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.727 qpair failed and we were unable to recover it. 00:31:07.727 [2024-11-28 01:25:22.322991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.727 [2024-11-28 01:25:22.323089] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.727 [2024-11-28 01:25:22.323116] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.727 [2024-11-28 01:25:22.323130] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.727 [2024-11-28 01:25:22.323141] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.727 [2024-11-28 01:25:22.323170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.727 qpair failed and we were unable to recover it. 00:31:07.987 [2024-11-28 01:25:22.333015] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.987 [2024-11-28 01:25:22.333125] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.987 [2024-11-28 01:25:22.333152] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.987 [2024-11-28 01:25:22.333167] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.987 [2024-11-28 01:25:22.333179] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.987 [2024-11-28 01:25:22.333207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.987 qpair failed and we were unable to recover it. 00:31:07.987 [2024-11-28 01:25:22.343066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.987 [2024-11-28 01:25:22.343187] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.987 [2024-11-28 01:25:22.343213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.987 [2024-11-28 01:25:22.343227] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.987 [2024-11-28 01:25:22.343239] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.987 [2024-11-28 01:25:22.343270] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.987 qpair failed and we were unable to recover it. 00:31:07.987 [2024-11-28 01:25:22.353092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.987 [2024-11-28 01:25:22.353213] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.987 [2024-11-28 01:25:22.353238] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.987 [2024-11-28 01:25:22.353253] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.987 [2024-11-28 01:25:22.353271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.987 [2024-11-28 01:25:22.353300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.987 qpair failed and we were unable to recover it. 00:31:07.987 [2024-11-28 01:25:22.363138] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.987 [2024-11-28 01:25:22.363235] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.987 [2024-11-28 01:25:22.363261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.987 [2024-11-28 01:25:22.363275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.987 [2024-11-28 01:25:22.363287] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.987 [2024-11-28 01:25:22.363327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.987 qpair failed and we were unable to recover it. 00:31:07.987 [2024-11-28 01:25:22.373127] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.987 [2024-11-28 01:25:22.373230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.987 [2024-11-28 01:25:22.373256] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.987 [2024-11-28 01:25:22.373270] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.987 [2024-11-28 01:25:22.373282] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.987 [2024-11-28 01:25:22.373314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.987 qpair failed and we were unable to recover it. 00:31:07.987 [2024-11-28 01:25:22.383127] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.987 [2024-11-28 01:25:22.383228] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.987 [2024-11-28 01:25:22.383254] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.987 [2024-11-28 01:25:22.383268] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.987 [2024-11-28 01:25:22.383280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.987 [2024-11-28 01:25:22.383309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.987 qpair failed and we were unable to recover it. 00:31:07.987 [2024-11-28 01:25:22.393188] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.987 [2024-11-28 01:25:22.393311] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.987 [2024-11-28 01:25:22.393337] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.987 [2024-11-28 01:25:22.393353] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.987 [2024-11-28 01:25:22.393365] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.987 [2024-11-28 01:25:22.393394] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.987 qpair failed and we were unable to recover it. 00:31:07.987 [2024-11-28 01:25:22.403328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.987 [2024-11-28 01:25:22.403464] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.987 [2024-11-28 01:25:22.403490] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.987 [2024-11-28 01:25:22.403504] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.987 [2024-11-28 01:25:22.403532] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.987 [2024-11-28 01:25:22.403564] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.987 qpair failed and we were unable to recover it. 00:31:07.987 [2024-11-28 01:25:22.413253] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.987 [2024-11-28 01:25:22.413366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.987 [2024-11-28 01:25:22.413392] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.987 [2024-11-28 01:25:22.413406] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.987 [2024-11-28 01:25:22.413418] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.987 [2024-11-28 01:25:22.413446] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.987 qpair failed and we were unable to recover it. 00:31:07.987 [2024-11-28 01:25:22.423344] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.988 [2024-11-28 01:25:22.423494] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.988 [2024-11-28 01:25:22.423534] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.988 [2024-11-28 01:25:22.423551] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.988 [2024-11-28 01:25:22.423563] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.988 [2024-11-28 01:25:22.423595] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.988 qpair failed and we were unable to recover it. 00:31:07.988 [2024-11-28 01:25:22.433355] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.988 [2024-11-28 01:25:22.433462] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.988 [2024-11-28 01:25:22.433488] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.988 [2024-11-28 01:25:22.433502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.988 [2024-11-28 01:25:22.433513] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.988 [2024-11-28 01:25:22.433551] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.988 qpair failed and we were unable to recover it. 00:31:07.988 [2024-11-28 01:25:22.443309] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.988 [2024-11-28 01:25:22.443402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.988 [2024-11-28 01:25:22.443428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.988 [2024-11-28 01:25:22.443448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.988 [2024-11-28 01:25:22.443461] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.988 [2024-11-28 01:25:22.443490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.988 qpair failed and we were unable to recover it. 00:31:07.988 [2024-11-28 01:25:22.453369] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.988 [2024-11-28 01:25:22.453474] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.988 [2024-11-28 01:25:22.453503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.988 [2024-11-28 01:25:22.453517] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.988 [2024-11-28 01:25:22.453540] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.988 [2024-11-28 01:25:22.453583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.988 qpair failed and we were unable to recover it. 00:31:07.988 [2024-11-28 01:25:22.463384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.988 [2024-11-28 01:25:22.463498] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.988 [2024-11-28 01:25:22.463531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.988 [2024-11-28 01:25:22.463547] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.988 [2024-11-28 01:25:22.463560] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.988 [2024-11-28 01:25:22.463602] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.988 qpair failed and we were unable to recover it. 00:31:07.988 [2024-11-28 01:25:22.473399] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.988 [2024-11-28 01:25:22.473507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.988 [2024-11-28 01:25:22.473540] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.988 [2024-11-28 01:25:22.473556] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.988 [2024-11-28 01:25:22.473568] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.988 [2024-11-28 01:25:22.473598] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.988 qpair failed and we were unable to recover it. 00:31:07.988 [2024-11-28 01:25:22.483439] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.988 [2024-11-28 01:25:22.483542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.988 [2024-11-28 01:25:22.483569] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.988 [2024-11-28 01:25:22.483582] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.988 [2024-11-28 01:25:22.483594] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.988 [2024-11-28 01:25:22.483623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.988 qpair failed and we were unable to recover it. 00:31:07.988 [2024-11-28 01:25:22.493555] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.988 [2024-11-28 01:25:22.493660] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.988 [2024-11-28 01:25:22.493686] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.988 [2024-11-28 01:25:22.493700] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.988 [2024-11-28 01:25:22.493712] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.988 [2024-11-28 01:25:22.493741] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.988 qpair failed and we were unable to recover it. 00:31:07.988 [2024-11-28 01:25:22.503470] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.988 [2024-11-28 01:25:22.503578] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.988 [2024-11-28 01:25:22.503604] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.988 [2024-11-28 01:25:22.503618] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.988 [2024-11-28 01:25:22.503630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.988 [2024-11-28 01:25:22.503659] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.988 qpair failed and we were unable to recover it. 00:31:07.988 [2024-11-28 01:25:22.513563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.988 [2024-11-28 01:25:22.513717] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.988 [2024-11-28 01:25:22.513744] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.988 [2024-11-28 01:25:22.513758] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.988 [2024-11-28 01:25:22.513770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.988 [2024-11-28 01:25:22.513799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.988 qpair failed and we were unable to recover it. 00:31:07.988 [2024-11-28 01:25:22.523540] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.988 [2024-11-28 01:25:22.523641] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.988 [2024-11-28 01:25:22.523667] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.988 [2024-11-28 01:25:22.523681] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.988 [2024-11-28 01:25:22.523693] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.988 [2024-11-28 01:25:22.523721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.988 qpair failed and we were unable to recover it. 00:31:07.988 [2024-11-28 01:25:22.533620] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.988 [2024-11-28 01:25:22.533755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.988 [2024-11-28 01:25:22.533781] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.988 [2024-11-28 01:25:22.533804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.988 [2024-11-28 01:25:22.533817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.988 [2024-11-28 01:25:22.533845] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.988 qpair failed and we were unable to recover it. 00:31:07.988 [2024-11-28 01:25:22.543621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.988 [2024-11-28 01:25:22.543738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.988 [2024-11-28 01:25:22.543764] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.988 [2024-11-28 01:25:22.543778] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.988 [2024-11-28 01:25:22.543790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.988 [2024-11-28 01:25:22.543819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.988 qpair failed and we were unable to recover it. 00:31:07.988 [2024-11-28 01:25:22.553648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.988 [2024-11-28 01:25:22.553799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.989 [2024-11-28 01:25:22.553825] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.989 [2024-11-28 01:25:22.553839] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.989 [2024-11-28 01:25:22.553851] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.989 [2024-11-28 01:25:22.553880] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.989 qpair failed and we were unable to recover it. 00:31:07.989 [2024-11-28 01:25:22.563655] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.989 [2024-11-28 01:25:22.563754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.989 [2024-11-28 01:25:22.563780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.989 [2024-11-28 01:25:22.563794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.989 [2024-11-28 01:25:22.563807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.989 [2024-11-28 01:25:22.563835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.989 qpair failed and we were unable to recover it. 00:31:07.989 [2024-11-28 01:25:22.573701] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.989 [2024-11-28 01:25:22.573805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.989 [2024-11-28 01:25:22.573831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.989 [2024-11-28 01:25:22.573846] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.989 [2024-11-28 01:25:22.573858] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.989 [2024-11-28 01:25:22.573887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.989 qpair failed and we were unable to recover it. 00:31:07.989 [2024-11-28 01:25:22.583728] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:07.989 [2024-11-28 01:25:22.583834] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:07.989 [2024-11-28 01:25:22.583863] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:07.989 [2024-11-28 01:25:22.583878] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:07.989 [2024-11-28 01:25:22.583890] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:07.989 [2024-11-28 01:25:22.583919] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:07.989 qpair failed and we were unable to recover it. 00:31:08.248 [2024-11-28 01:25:22.593748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.248 [2024-11-28 01:25:22.593850] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.248 [2024-11-28 01:25:22.593875] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.248 [2024-11-28 01:25:22.593889] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.248 [2024-11-28 01:25:22.593900] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.248 [2024-11-28 01:25:22.593930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.248 qpair failed and we were unable to recover it. 00:31:08.248 [2024-11-28 01:25:22.603806] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.248 [2024-11-28 01:25:22.603937] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.248 [2024-11-28 01:25:22.603962] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.248 [2024-11-28 01:25:22.603976] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.248 [2024-11-28 01:25:22.603988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.248 [2024-11-28 01:25:22.604017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.248 qpair failed and we were unable to recover it. 00:31:08.248 [2024-11-28 01:25:22.613878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.248 [2024-11-28 01:25:22.614015] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.248 [2024-11-28 01:25:22.614040] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.248 [2024-11-28 01:25:22.614054] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.248 [2024-11-28 01:25:22.614066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.248 [2024-11-28 01:25:22.614116] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.248 qpair failed and we were unable to recover it. 00:31:08.248 [2024-11-28 01:25:22.623874] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.248 [2024-11-28 01:25:22.623982] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.248 [2024-11-28 01:25:22.624013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.249 [2024-11-28 01:25:22.624029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.249 [2024-11-28 01:25:22.624040] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.249 [2024-11-28 01:25:22.624069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.249 qpair failed and we were unable to recover it. 00:31:08.249 [2024-11-28 01:25:22.633916] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.249 [2024-11-28 01:25:22.634022] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.249 [2024-11-28 01:25:22.634049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.249 [2024-11-28 01:25:22.634064] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.249 [2024-11-28 01:25:22.634076] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.249 [2024-11-28 01:25:22.634105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.249 qpair failed and we were unable to recover it. 00:31:08.249 [2024-11-28 01:25:22.643898] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.249 [2024-11-28 01:25:22.644028] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.249 [2024-11-28 01:25:22.644054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.249 [2024-11-28 01:25:22.644068] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.249 [2024-11-28 01:25:22.644080] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.249 [2024-11-28 01:25:22.644108] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.249 qpair failed and we were unable to recover it. 00:31:08.249 [2024-11-28 01:25:22.653937] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.249 [2024-11-28 01:25:22.654045] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.249 [2024-11-28 01:25:22.654071] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.249 [2024-11-28 01:25:22.654085] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.249 [2024-11-28 01:25:22.654096] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.249 [2024-11-28 01:25:22.654125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.249 qpair failed and we were unable to recover it. 00:31:08.249 [2024-11-28 01:25:22.663972] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.249 [2024-11-28 01:25:22.664078] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.249 [2024-11-28 01:25:22.664107] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.249 [2024-11-28 01:25:22.664122] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.249 [2024-11-28 01:25:22.664134] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.249 [2024-11-28 01:25:22.664172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.249 qpair failed and we were unable to recover it. 00:31:08.249 [2024-11-28 01:25:22.674003] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.249 [2024-11-28 01:25:22.674122] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.249 [2024-11-28 01:25:22.674149] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.249 [2024-11-28 01:25:22.674163] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.249 [2024-11-28 01:25:22.674176] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.249 [2024-11-28 01:25:22.674205] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.249 qpair failed and we were unable to recover it. 00:31:08.249 [2024-11-28 01:25:22.684026] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.249 [2024-11-28 01:25:22.684139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.249 [2024-11-28 01:25:22.684165] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.249 [2024-11-28 01:25:22.684179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.249 [2024-11-28 01:25:22.684191] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.249 [2024-11-28 01:25:22.684220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.249 qpair failed and we were unable to recover it. 00:31:08.249 [2024-11-28 01:25:22.694107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.249 [2024-11-28 01:25:22.694225] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.249 [2024-11-28 01:25:22.694251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.249 [2024-11-28 01:25:22.694271] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.249 [2024-11-28 01:25:22.694283] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.249 [2024-11-28 01:25:22.694312] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.249 qpair failed and we were unable to recover it. 00:31:08.249 [2024-11-28 01:25:22.704076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.249 [2024-11-28 01:25:22.704177] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.249 [2024-11-28 01:25:22.704203] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.249 [2024-11-28 01:25:22.704217] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.249 [2024-11-28 01:25:22.704230] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.249 [2024-11-28 01:25:22.704262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.249 qpair failed and we were unable to recover it. 00:31:08.249 [2024-11-28 01:25:22.714125] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.249 [2024-11-28 01:25:22.714256] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.249 [2024-11-28 01:25:22.714288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.249 [2024-11-28 01:25:22.714303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.249 [2024-11-28 01:25:22.714315] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.249 [2024-11-28 01:25:22.714344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.249 qpair failed and we were unable to recover it. 00:31:08.249 [2024-11-28 01:25:22.724157] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.249 [2024-11-28 01:25:22.724260] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.249 [2024-11-28 01:25:22.724286] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.249 [2024-11-28 01:25:22.724300] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.249 [2024-11-28 01:25:22.724312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.249 [2024-11-28 01:25:22.724341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.249 qpair failed and we were unable to recover it. 00:31:08.249 [2024-11-28 01:25:22.734204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.249 [2024-11-28 01:25:22.734352] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.249 [2024-11-28 01:25:22.734377] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.249 [2024-11-28 01:25:22.734391] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.249 [2024-11-28 01:25:22.734403] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.249 [2024-11-28 01:25:22.734450] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.249 qpair failed and we were unable to recover it. 00:31:08.249 [2024-11-28 01:25:22.744197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.249 [2024-11-28 01:25:22.744298] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.249 [2024-11-28 01:25:22.744324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.249 [2024-11-28 01:25:22.744338] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.249 [2024-11-28 01:25:22.744350] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.249 [2024-11-28 01:25:22.744378] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.249 qpair failed and we were unable to recover it. 00:31:08.249 [2024-11-28 01:25:22.754337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.249 [2024-11-28 01:25:22.754449] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.249 [2024-11-28 01:25:22.754475] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.249 [2024-11-28 01:25:22.754489] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.250 [2024-11-28 01:25:22.754501] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.250 [2024-11-28 01:25:22.754543] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.250 qpair failed and we were unable to recover it. 00:31:08.250 [2024-11-28 01:25:22.764343] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.250 [2024-11-28 01:25:22.764437] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.250 [2024-11-28 01:25:22.764463] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.250 [2024-11-28 01:25:22.764477] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.250 [2024-11-28 01:25:22.764489] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.250 [2024-11-28 01:25:22.764517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.250 qpair failed and we were unable to recover it. 00:31:08.250 [2024-11-28 01:25:22.774303] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.250 [2024-11-28 01:25:22.774413] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.250 [2024-11-28 01:25:22.774439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.250 [2024-11-28 01:25:22.774453] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.250 [2024-11-28 01:25:22.774465] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.250 [2024-11-28 01:25:22.774494] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.250 qpair failed and we were unable to recover it. 00:31:08.250 [2024-11-28 01:25:22.784327] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.250 [2024-11-28 01:25:22.784426] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.250 [2024-11-28 01:25:22.784453] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.250 [2024-11-28 01:25:22.784467] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.250 [2024-11-28 01:25:22.784478] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.250 [2024-11-28 01:25:22.784507] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.250 qpair failed and we were unable to recover it. 00:31:08.250 [2024-11-28 01:25:22.794342] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.250 [2024-11-28 01:25:22.794452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.250 [2024-11-28 01:25:22.794479] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.250 [2024-11-28 01:25:22.794493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.250 [2024-11-28 01:25:22.794505] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.250 [2024-11-28 01:25:22.794540] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.250 qpair failed and we were unable to recover it. 00:31:08.250 [2024-11-28 01:25:22.804382] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.250 [2024-11-28 01:25:22.804490] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.250 [2024-11-28 01:25:22.804519] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.250 [2024-11-28 01:25:22.804542] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.250 [2024-11-28 01:25:22.804556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.250 [2024-11-28 01:25:22.804588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.250 qpair failed and we were unable to recover it. 00:31:08.250 [2024-11-28 01:25:22.814414] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.250 [2024-11-28 01:25:22.814542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.250 [2024-11-28 01:25:22.814569] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.250 [2024-11-28 01:25:22.814583] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.250 [2024-11-28 01:25:22.814594] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.250 [2024-11-28 01:25:22.814624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.250 qpair failed and we were unable to recover it. 00:31:08.250 [2024-11-28 01:25:22.824409] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.250 [2024-11-28 01:25:22.824512] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.250 [2024-11-28 01:25:22.824545] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.250 [2024-11-28 01:25:22.824560] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.250 [2024-11-28 01:25:22.824572] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.250 [2024-11-28 01:25:22.824601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.250 qpair failed and we were unable to recover it. 00:31:08.250 [2024-11-28 01:25:22.834474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.250 [2024-11-28 01:25:22.834587] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.250 [2024-11-28 01:25:22.834613] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.250 [2024-11-28 01:25:22.834627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.250 [2024-11-28 01:25:22.834639] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.250 [2024-11-28 01:25:22.834668] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.250 qpair failed and we were unable to recover it. 00:31:08.250 [2024-11-28 01:25:22.844494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.250 [2024-11-28 01:25:22.844604] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.250 [2024-11-28 01:25:22.844631] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.250 [2024-11-28 01:25:22.844644] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.250 [2024-11-28 01:25:22.844665] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.250 [2024-11-28 01:25:22.844694] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.250 qpair failed and we were unable to recover it. 00:31:08.509 [2024-11-28 01:25:22.854621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.509 [2024-11-28 01:25:22.854722] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.509 [2024-11-28 01:25:22.854747] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.509 [2024-11-28 01:25:22.854761] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.509 [2024-11-28 01:25:22.854773] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.509 [2024-11-28 01:25:22.854802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.509 qpair failed and we were unable to recover it. 00:31:08.509 [2024-11-28 01:25:22.864543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.509 [2024-11-28 01:25:22.864637] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.509 [2024-11-28 01:25:22.864663] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.509 [2024-11-28 01:25:22.864677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.509 [2024-11-28 01:25:22.864689] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.509 [2024-11-28 01:25:22.864718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.509 qpair failed and we were unable to recover it. 00:31:08.509 [2024-11-28 01:25:22.874611] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.509 [2024-11-28 01:25:22.874733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.509 [2024-11-28 01:25:22.874760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.509 [2024-11-28 01:25:22.874774] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.509 [2024-11-28 01:25:22.874786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.509 [2024-11-28 01:25:22.874815] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.509 qpair failed and we were unable to recover it. 00:31:08.509 [2024-11-28 01:25:22.884614] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.509 [2024-11-28 01:25:22.884720] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.509 [2024-11-28 01:25:22.884746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.509 [2024-11-28 01:25:22.884760] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.509 [2024-11-28 01:25:22.884772] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.509 [2024-11-28 01:25:22.884801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.509 qpair failed and we were unable to recover it. 00:31:08.509 [2024-11-28 01:25:22.894774] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.509 [2024-11-28 01:25:22.894902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.509 [2024-11-28 01:25:22.894928] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.509 [2024-11-28 01:25:22.894942] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.509 [2024-11-28 01:25:22.894954] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.509 [2024-11-28 01:25:22.894998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.509 qpair failed and we were unable to recover it. 00:31:08.509 [2024-11-28 01:25:22.904797] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.509 [2024-11-28 01:25:22.904903] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.509 [2024-11-28 01:25:22.904931] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.509 [2024-11-28 01:25:22.904949] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.509 [2024-11-28 01:25:22.904962] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.509 [2024-11-28 01:25:22.904992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.509 qpair failed and we were unable to recover it. 00:31:08.509 [2024-11-28 01:25:22.914734] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.509 [2024-11-28 01:25:22.914856] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.509 [2024-11-28 01:25:22.914883] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.509 [2024-11-28 01:25:22.914897] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.509 [2024-11-28 01:25:22.914909] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.509 [2024-11-28 01:25:22.914939] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.509 qpair failed and we were unable to recover it. 00:31:08.509 [2024-11-28 01:25:22.924725] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.509 [2024-11-28 01:25:22.924826] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.509 [2024-11-28 01:25:22.924852] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.509 [2024-11-28 01:25:22.924866] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.509 [2024-11-28 01:25:22.924878] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.509 [2024-11-28 01:25:22.924907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.509 qpair failed and we were unable to recover it. 00:31:08.509 [2024-11-28 01:25:22.934790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.509 [2024-11-28 01:25:22.934894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.509 [2024-11-28 01:25:22.934919] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.509 [2024-11-28 01:25:22.934942] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.509 [2024-11-28 01:25:22.934955] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.509 [2024-11-28 01:25:22.934985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.509 qpair failed and we were unable to recover it. 00:31:08.509 [2024-11-28 01:25:22.944879] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.509 [2024-11-28 01:25:22.944984] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.509 [2024-11-28 01:25:22.945010] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.509 [2024-11-28 01:25:22.945024] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.509 [2024-11-28 01:25:22.945036] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.509 [2024-11-28 01:25:22.945065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.509 qpair failed and we were unable to recover it. 00:31:08.509 [2024-11-28 01:25:22.954811] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.509 [2024-11-28 01:25:22.954912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.509 [2024-11-28 01:25:22.954938] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.509 [2024-11-28 01:25:22.954952] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.509 [2024-11-28 01:25:22.954964] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.509 [2024-11-28 01:25:22.954994] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.509 qpair failed and we were unable to recover it. 00:31:08.509 [2024-11-28 01:25:22.964852] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.510 [2024-11-28 01:25:22.964953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.510 [2024-11-28 01:25:22.964978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.510 [2024-11-28 01:25:22.964993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.510 [2024-11-28 01:25:22.965005] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.510 [2024-11-28 01:25:22.965034] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.510 qpair failed and we were unable to recover it. 00:31:08.510 [2024-11-28 01:25:22.974888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.510 [2024-11-28 01:25:22.975022] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.510 [2024-11-28 01:25:22.975048] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.510 [2024-11-28 01:25:22.975063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.510 [2024-11-28 01:25:22.975075] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.510 [2024-11-28 01:25:22.975103] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.510 qpair failed and we were unable to recover it. 00:31:08.510 [2024-11-28 01:25:22.984934] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.510 [2024-11-28 01:25:22.985039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.510 [2024-11-28 01:25:22.985064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.510 [2024-11-28 01:25:22.985079] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.510 [2024-11-28 01:25:22.985091] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.510 [2024-11-28 01:25:22.985123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.510 qpair failed and we were unable to recover it. 00:31:08.510 [2024-11-28 01:25:22.994938] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.510 [2024-11-28 01:25:22.995045] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.510 [2024-11-28 01:25:22.995071] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.510 [2024-11-28 01:25:22.995085] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.510 [2024-11-28 01:25:22.995097] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.510 [2024-11-28 01:25:22.995126] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.510 qpair failed and we were unable to recover it. 00:31:08.510 [2024-11-28 01:25:23.004993] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.510 [2024-11-28 01:25:23.005094] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.510 [2024-11-28 01:25:23.005119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.510 [2024-11-28 01:25:23.005134] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.510 [2024-11-28 01:25:23.005146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.510 [2024-11-28 01:25:23.005175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.510 qpair failed and we were unable to recover it. 00:31:08.510 [2024-11-28 01:25:23.015007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.510 [2024-11-28 01:25:23.015107] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.510 [2024-11-28 01:25:23.015133] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.510 [2024-11-28 01:25:23.015147] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.510 [2024-11-28 01:25:23.015159] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.510 [2024-11-28 01:25:23.015188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.510 qpair failed and we were unable to recover it. 00:31:08.510 [2024-11-28 01:25:23.025152] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.510 [2024-11-28 01:25:23.025296] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.510 [2024-11-28 01:25:23.025323] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.510 [2024-11-28 01:25:23.025346] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.510 [2024-11-28 01:25:23.025363] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.510 [2024-11-28 01:25:23.025394] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.510 qpair failed and we were unable to recover it. 00:31:08.510 [2024-11-28 01:25:23.035056] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.510 [2024-11-28 01:25:23.035164] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.510 [2024-11-28 01:25:23.035191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.510 [2024-11-28 01:25:23.035205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.510 [2024-11-28 01:25:23.035217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.510 [2024-11-28 01:25:23.035246] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.510 qpair failed and we were unable to recover it. 00:31:08.510 [2024-11-28 01:25:23.045136] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.510 [2024-11-28 01:25:23.045256] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.510 [2024-11-28 01:25:23.045282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.510 [2024-11-28 01:25:23.045296] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.510 [2024-11-28 01:25:23.045308] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.510 [2024-11-28 01:25:23.045337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.510 qpair failed and we were unable to recover it. 00:31:08.510 [2024-11-28 01:25:23.055135] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.510 [2024-11-28 01:25:23.055240] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.510 [2024-11-28 01:25:23.055265] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.510 [2024-11-28 01:25:23.055280] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.510 [2024-11-28 01:25:23.055292] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.510 [2024-11-28 01:25:23.055324] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.510 qpair failed and we were unable to recover it. 00:31:08.510 [2024-11-28 01:25:23.065278] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.510 [2024-11-28 01:25:23.065383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.510 [2024-11-28 01:25:23.065408] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.510 [2024-11-28 01:25:23.065422] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.510 [2024-11-28 01:25:23.065434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.510 [2024-11-28 01:25:23.065463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.510 qpair failed and we were unable to recover it. 00:31:08.510 [2024-11-28 01:25:23.075204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.510 [2024-11-28 01:25:23.075320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.510 [2024-11-28 01:25:23.075347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.510 [2024-11-28 01:25:23.075361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.510 [2024-11-28 01:25:23.075373] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.510 [2024-11-28 01:25:23.075402] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.510 qpair failed and we were unable to recover it. 00:31:08.510 [2024-11-28 01:25:23.085279] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.510 [2024-11-28 01:25:23.085422] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.510 [2024-11-28 01:25:23.085450] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.510 [2024-11-28 01:25:23.085465] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.510 [2024-11-28 01:25:23.085486] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.510 [2024-11-28 01:25:23.085557] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.510 qpair failed and we were unable to recover it. 00:31:08.510 [2024-11-28 01:25:23.095294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.510 [2024-11-28 01:25:23.095405] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.510 [2024-11-28 01:25:23.095432] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.511 [2024-11-28 01:25:23.095446] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.511 [2024-11-28 01:25:23.095458] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.511 [2024-11-28 01:25:23.095487] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.511 qpair failed and we were unable to recover it. 00:31:08.511 [2024-11-28 01:25:23.105304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.511 [2024-11-28 01:25:23.105426] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.511 [2024-11-28 01:25:23.105452] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.511 [2024-11-28 01:25:23.105466] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.511 [2024-11-28 01:25:23.105478] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.511 [2024-11-28 01:25:23.105506] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.511 qpair failed and we were unable to recover it. 00:31:08.769 [2024-11-28 01:25:23.115334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.769 [2024-11-28 01:25:23.115442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.769 [2024-11-28 01:25:23.115473] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.769 [2024-11-28 01:25:23.115489] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.769 [2024-11-28 01:25:23.115502] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.769 [2024-11-28 01:25:23.115538] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.769 qpair failed and we were unable to recover it. 00:31:08.769 [2024-11-28 01:25:23.125374] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.769 [2024-11-28 01:25:23.125476] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.769 [2024-11-28 01:25:23.125502] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.769 [2024-11-28 01:25:23.125516] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.769 [2024-11-28 01:25:23.125535] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.769 [2024-11-28 01:25:23.125569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.769 qpair failed and we were unable to recover it. 00:31:08.769 [2024-11-28 01:25:23.135377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.769 [2024-11-28 01:25:23.135484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.769 [2024-11-28 01:25:23.135509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.769 [2024-11-28 01:25:23.135530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.769 [2024-11-28 01:25:23.135548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.769 [2024-11-28 01:25:23.135579] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.769 qpair failed and we were unable to recover it. 00:31:08.769 [2024-11-28 01:25:23.145381] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.769 [2024-11-28 01:25:23.145483] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.769 [2024-11-28 01:25:23.145509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.769 [2024-11-28 01:25:23.145530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.769 [2024-11-28 01:25:23.145544] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.769 [2024-11-28 01:25:23.145576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.769 qpair failed and we were unable to recover it. 00:31:08.769 [2024-11-28 01:25:23.155509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.769 [2024-11-28 01:25:23.155628] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.769 [2024-11-28 01:25:23.155654] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.769 [2024-11-28 01:25:23.155668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.769 [2024-11-28 01:25:23.155681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.769 [2024-11-28 01:25:23.155716] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.769 qpair failed and we were unable to recover it. 00:31:08.769 [2024-11-28 01:25:23.165437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.769 [2024-11-28 01:25:23.165575] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.769 [2024-11-28 01:25:23.165601] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.769 [2024-11-28 01:25:23.165615] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.769 [2024-11-28 01:25:23.165627] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.769 [2024-11-28 01:25:23.165656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.769 qpair failed and we were unable to recover it. 00:31:08.769 [2024-11-28 01:25:23.175497] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.769 [2024-11-28 01:25:23.175662] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.769 [2024-11-28 01:25:23.175688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.769 [2024-11-28 01:25:23.175702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.769 [2024-11-28 01:25:23.175714] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.769 [2024-11-28 01:25:23.175743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.769 qpair failed and we were unable to recover it. 00:31:08.769 [2024-11-28 01:25:23.185523] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.769 [2024-11-28 01:25:23.185635] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.769 [2024-11-28 01:25:23.185661] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.769 [2024-11-28 01:25:23.185675] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.769 [2024-11-28 01:25:23.185687] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.769 [2024-11-28 01:25:23.185716] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.769 qpair failed and we were unable to recover it. 00:31:08.769 [2024-11-28 01:25:23.195541] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.770 [2024-11-28 01:25:23.195645] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.770 [2024-11-28 01:25:23.195670] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.770 [2024-11-28 01:25:23.195684] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.770 [2024-11-28 01:25:23.195696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.770 [2024-11-28 01:25:23.195725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.770 qpair failed and we were unable to recover it. 00:31:08.770 [2024-11-28 01:25:23.205602] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.770 [2024-11-28 01:25:23.205704] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.770 [2024-11-28 01:25:23.205735] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.770 [2024-11-28 01:25:23.205750] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.770 [2024-11-28 01:25:23.205761] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.770 [2024-11-28 01:25:23.205790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.770 qpair failed and we were unable to recover it. 00:31:08.770 [2024-11-28 01:25:23.215723] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.770 [2024-11-28 01:25:23.215833] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.770 [2024-11-28 01:25:23.215859] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.770 [2024-11-28 01:25:23.215873] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.770 [2024-11-28 01:25:23.215885] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.770 [2024-11-28 01:25:23.215914] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.770 qpair failed and we were unable to recover it. 00:31:08.770 [2024-11-28 01:25:23.225630] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.770 [2024-11-28 01:25:23.225731] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.770 [2024-11-28 01:25:23.225757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.770 [2024-11-28 01:25:23.225771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.770 [2024-11-28 01:25:23.225783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.770 [2024-11-28 01:25:23.225811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.770 qpair failed and we were unable to recover it. 00:31:08.770 [2024-11-28 01:25:23.235653] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.770 [2024-11-28 01:25:23.235763] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.770 [2024-11-28 01:25:23.235791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.770 [2024-11-28 01:25:23.235806] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.770 [2024-11-28 01:25:23.235818] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.770 [2024-11-28 01:25:23.235847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.770 qpair failed and we were unable to recover it. 00:31:08.770 [2024-11-28 01:25:23.245663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.770 [2024-11-28 01:25:23.245767] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.770 [2024-11-28 01:25:23.245793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.770 [2024-11-28 01:25:23.245807] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.770 [2024-11-28 01:25:23.245818] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.770 [2024-11-28 01:25:23.245854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.770 qpair failed and we were unable to recover it. 00:31:08.770 [2024-11-28 01:25:23.255829] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.770 [2024-11-28 01:25:23.255946] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.770 [2024-11-28 01:25:23.255974] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.770 [2024-11-28 01:25:23.255989] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.770 [2024-11-28 01:25:23.256006] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.770 [2024-11-28 01:25:23.256037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.770 qpair failed and we were unable to recover it. 00:31:08.770 [2024-11-28 01:25:23.265718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.770 [2024-11-28 01:25:23.265820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.770 [2024-11-28 01:25:23.265847] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.770 [2024-11-28 01:25:23.265861] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.770 [2024-11-28 01:25:23.265873] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.770 [2024-11-28 01:25:23.265902] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.770 qpair failed and we were unable to recover it. 00:31:08.770 [2024-11-28 01:25:23.275763] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.770 [2024-11-28 01:25:23.275873] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.770 [2024-11-28 01:25:23.275900] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.770 [2024-11-28 01:25:23.275913] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.770 [2024-11-28 01:25:23.275925] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.770 [2024-11-28 01:25:23.275954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.770 qpair failed and we were unable to recover it. 00:31:08.770 [2024-11-28 01:25:23.285786] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.770 [2024-11-28 01:25:23.285881] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.770 [2024-11-28 01:25:23.285906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.770 [2024-11-28 01:25:23.285920] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.770 [2024-11-28 01:25:23.285931] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.770 [2024-11-28 01:25:23.285960] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.770 qpair failed and we were unable to recover it. 00:31:08.770 [2024-11-28 01:25:23.295810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.770 [2024-11-28 01:25:23.295911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.770 [2024-11-28 01:25:23.295944] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.770 [2024-11-28 01:25:23.295959] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.770 [2024-11-28 01:25:23.295971] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.770 [2024-11-28 01:25:23.296000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.770 qpair failed and we were unable to recover it. 00:31:08.770 [2024-11-28 01:25:23.305850] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.770 [2024-11-28 01:25:23.305967] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.770 [2024-11-28 01:25:23.305994] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.770 [2024-11-28 01:25:23.306009] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.770 [2024-11-28 01:25:23.306026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.770 [2024-11-28 01:25:23.306070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.770 qpair failed and we were unable to recover it. 00:31:08.770 [2024-11-28 01:25:23.315904] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.770 [2024-11-28 01:25:23.316024] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.770 [2024-11-28 01:25:23.316051] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.770 [2024-11-28 01:25:23.316065] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.770 [2024-11-28 01:25:23.316077] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.770 [2024-11-28 01:25:23.316106] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.770 qpair failed and we were unable to recover it. 00:31:08.770 [2024-11-28 01:25:23.325902] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.770 [2024-11-28 01:25:23.325996] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.771 [2024-11-28 01:25:23.326022] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.771 [2024-11-28 01:25:23.326036] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.771 [2024-11-28 01:25:23.326048] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.771 [2024-11-28 01:25:23.326089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.771 qpair failed and we were unable to recover it. 00:31:08.771 [2024-11-28 01:25:23.336033] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.771 [2024-11-28 01:25:23.336166] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.771 [2024-11-28 01:25:23.336192] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.771 [2024-11-28 01:25:23.336206] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.771 [2024-11-28 01:25:23.336224] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.771 [2024-11-28 01:25:23.336255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.771 qpair failed and we were unable to recover it. 00:31:08.771 [2024-11-28 01:25:23.345952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.771 [2024-11-28 01:25:23.346053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.771 [2024-11-28 01:25:23.346078] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.771 [2024-11-28 01:25:23.346093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.771 [2024-11-28 01:25:23.346105] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.771 [2024-11-28 01:25:23.346133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.771 qpair failed and we were unable to recover it. 00:31:08.771 [2024-11-28 01:25:23.355990] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.771 [2024-11-28 01:25:23.356091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.771 [2024-11-28 01:25:23.356117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.771 [2024-11-28 01:25:23.356131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.771 [2024-11-28 01:25:23.356143] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.771 [2024-11-28 01:25:23.356172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.771 qpair failed and we were unable to recover it. 00:31:08.771 [2024-11-28 01:25:23.366014] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:08.771 [2024-11-28 01:25:23.366108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:08.771 [2024-11-28 01:25:23.366134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:08.771 [2024-11-28 01:25:23.366148] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:08.771 [2024-11-28 01:25:23.366160] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:08.771 [2024-11-28 01:25:23.366188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:08.771 qpair failed and we were unable to recover it. 00:31:09.030 [2024-11-28 01:25:23.376071] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.030 [2024-11-28 01:25:23.376229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.030 [2024-11-28 01:25:23.376256] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.030 [2024-11-28 01:25:23.376270] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.030 [2024-11-28 01:25:23.376297] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.030 [2024-11-28 01:25:23.376325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.030 qpair failed and we were unable to recover it. 00:31:09.030 [2024-11-28 01:25:23.386109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.030 [2024-11-28 01:25:23.386216] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.030 [2024-11-28 01:25:23.386242] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.030 [2024-11-28 01:25:23.386256] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.030 [2024-11-28 01:25:23.386268] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.031 [2024-11-28 01:25:23.386297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.031 qpair failed and we were unable to recover it. 00:31:09.031 [2024-11-28 01:25:23.396213] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.031 [2024-11-28 01:25:23.396315] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.031 [2024-11-28 01:25:23.396340] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.031 [2024-11-28 01:25:23.396355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.031 [2024-11-28 01:25:23.396367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.031 [2024-11-28 01:25:23.396395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.031 qpair failed and we were unable to recover it. 00:31:09.031 [2024-11-28 01:25:23.406184] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.031 [2024-11-28 01:25:23.406303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.031 [2024-11-28 01:25:23.406329] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.031 [2024-11-28 01:25:23.406343] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.031 [2024-11-28 01:25:23.406355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.031 [2024-11-28 01:25:23.406395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.031 qpair failed and we were unable to recover it. 00:31:09.031 [2024-11-28 01:25:23.416179] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.031 [2024-11-28 01:25:23.416279] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.031 [2024-11-28 01:25:23.416305] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.031 [2024-11-28 01:25:23.416319] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.031 [2024-11-28 01:25:23.416331] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.031 [2024-11-28 01:25:23.416362] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.031 qpair failed and we were unable to recover it. 00:31:09.031 [2024-11-28 01:25:23.426218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.031 [2024-11-28 01:25:23.426321] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.031 [2024-11-28 01:25:23.426346] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.031 [2024-11-28 01:25:23.426360] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.031 [2024-11-28 01:25:23.426379] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.031 [2024-11-28 01:25:23.426408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.031 qpair failed and we were unable to recover it. 00:31:09.031 [2024-11-28 01:25:23.436319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.031 [2024-11-28 01:25:23.436448] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.031 [2024-11-28 01:25:23.436474] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.031 [2024-11-28 01:25:23.436488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.031 [2024-11-28 01:25:23.436500] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.031 [2024-11-28 01:25:23.436536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.031 qpair failed and we were unable to recover it. 00:31:09.031 [2024-11-28 01:25:23.446254] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.031 [2024-11-28 01:25:23.446356] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.031 [2024-11-28 01:25:23.446381] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.031 [2024-11-28 01:25:23.446395] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.031 [2024-11-28 01:25:23.446407] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.031 [2024-11-28 01:25:23.446435] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.031 qpair failed and we were unable to recover it. 00:31:09.031 [2024-11-28 01:25:23.456336] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.031 [2024-11-28 01:25:23.456436] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.031 [2024-11-28 01:25:23.456462] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.031 [2024-11-28 01:25:23.456476] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.031 [2024-11-28 01:25:23.456488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.031 [2024-11-28 01:25:23.456517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.031 qpair failed and we were unable to recover it. 00:31:09.031 [2024-11-28 01:25:23.466345] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.031 [2024-11-28 01:25:23.466456] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.031 [2024-11-28 01:25:23.466484] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.031 [2024-11-28 01:25:23.466499] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.031 [2024-11-28 01:25:23.466511] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.031 [2024-11-28 01:25:23.466554] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.031 qpair failed and we were unable to recover it. 00:31:09.031 [2024-11-28 01:25:23.476447] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.031 [2024-11-28 01:25:23.476565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.031 [2024-11-28 01:25:23.476592] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.031 [2024-11-28 01:25:23.476606] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.031 [2024-11-28 01:25:23.476619] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.031 [2024-11-28 01:25:23.476649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.031 qpair failed and we were unable to recover it. 00:31:09.031 [2024-11-28 01:25:23.486391] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.031 [2024-11-28 01:25:23.486491] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.031 [2024-11-28 01:25:23.486517] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.031 [2024-11-28 01:25:23.486539] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.031 [2024-11-28 01:25:23.486552] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.031 [2024-11-28 01:25:23.486585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.031 qpair failed and we were unable to recover it. 00:31:09.031 [2024-11-28 01:25:23.496453] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.031 [2024-11-28 01:25:23.496572] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.031 [2024-11-28 01:25:23.496598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.031 [2024-11-28 01:25:23.496612] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.031 [2024-11-28 01:25:23.496625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.031 [2024-11-28 01:25:23.496654] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.031 qpair failed and we were unable to recover it. 00:31:09.031 [2024-11-28 01:25:23.506538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.031 [2024-11-28 01:25:23.506649] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.031 [2024-11-28 01:25:23.506675] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.031 [2024-11-28 01:25:23.506689] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.031 [2024-11-28 01:25:23.506701] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.031 [2024-11-28 01:25:23.506730] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.031 qpair failed and we were unable to recover it. 00:31:09.031 [2024-11-28 01:25:23.516497] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.031 [2024-11-28 01:25:23.516621] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.031 [2024-11-28 01:25:23.516647] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.031 [2024-11-28 01:25:23.516667] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.031 [2024-11-28 01:25:23.516679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.031 [2024-11-28 01:25:23.516708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.032 qpair failed and we were unable to recover it. 00:31:09.032 [2024-11-28 01:25:23.526512] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.032 [2024-11-28 01:25:23.526621] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.032 [2024-11-28 01:25:23.526647] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.032 [2024-11-28 01:25:23.526661] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.032 [2024-11-28 01:25:23.526673] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.032 [2024-11-28 01:25:23.526702] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.032 qpair failed and we were unable to recover it. 00:31:09.032 [2024-11-28 01:25:23.536575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.032 [2024-11-28 01:25:23.536681] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.032 [2024-11-28 01:25:23.536707] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.032 [2024-11-28 01:25:23.536723] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.032 [2024-11-28 01:25:23.536736] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.032 [2024-11-28 01:25:23.536766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.032 qpair failed and we were unable to recover it. 00:31:09.032 [2024-11-28 01:25:23.546574] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.032 [2024-11-28 01:25:23.546677] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.032 [2024-11-28 01:25:23.546703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.032 [2024-11-28 01:25:23.546717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.032 [2024-11-28 01:25:23.546728] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.032 [2024-11-28 01:25:23.546757] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.032 qpair failed and we were unable to recover it. 00:31:09.032 [2024-11-28 01:25:23.556687] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.032 [2024-11-28 01:25:23.556790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.032 [2024-11-28 01:25:23.556816] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.032 [2024-11-28 01:25:23.556830] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.032 [2024-11-28 01:25:23.556842] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.032 [2024-11-28 01:25:23.556871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.032 qpair failed and we were unable to recover it. 00:31:09.032 [2024-11-28 01:25:23.566635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.032 [2024-11-28 01:25:23.566740] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.032 [2024-11-28 01:25:23.566766] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.032 [2024-11-28 01:25:23.566781] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.032 [2024-11-28 01:25:23.566792] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.032 [2024-11-28 01:25:23.566821] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.032 qpair failed and we were unable to recover it. 00:31:09.032 [2024-11-28 01:25:23.576690] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.032 [2024-11-28 01:25:23.576817] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.032 [2024-11-28 01:25:23.576843] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.032 [2024-11-28 01:25:23.576857] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.032 [2024-11-28 01:25:23.576868] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.032 [2024-11-28 01:25:23.576913] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.032 qpair failed and we were unable to recover it. 00:31:09.032 [2024-11-28 01:25:23.586701] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.032 [2024-11-28 01:25:23.586807] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.032 [2024-11-28 01:25:23.586832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.032 [2024-11-28 01:25:23.586846] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.032 [2024-11-28 01:25:23.586857] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.032 [2024-11-28 01:25:23.586886] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.032 qpair failed and we were unable to recover it. 00:31:09.032 [2024-11-28 01:25:23.596748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.032 [2024-11-28 01:25:23.596859] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.032 [2024-11-28 01:25:23.596887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.032 [2024-11-28 01:25:23.596901] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.032 [2024-11-28 01:25:23.596913] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.032 [2024-11-28 01:25:23.596953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.032 qpair failed and we were unable to recover it. 00:31:09.032 [2024-11-28 01:25:23.606810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.032 [2024-11-28 01:25:23.606922] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.032 [2024-11-28 01:25:23.606953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.032 [2024-11-28 01:25:23.606968] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.032 [2024-11-28 01:25:23.606980] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.032 [2024-11-28 01:25:23.607008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.032 qpair failed and we were unable to recover it. 00:31:09.032 [2024-11-28 01:25:23.616794] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.032 [2024-11-28 01:25:23.616895] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.032 [2024-11-28 01:25:23.616920] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.032 [2024-11-28 01:25:23.616934] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.032 [2024-11-28 01:25:23.616946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.032 [2024-11-28 01:25:23.616975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.032 qpair failed and we were unable to recover it. 00:31:09.032 [2024-11-28 01:25:23.626938] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.032 [2024-11-28 01:25:23.627068] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.032 [2024-11-28 01:25:23.627094] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.032 [2024-11-28 01:25:23.627108] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.032 [2024-11-28 01:25:23.627120] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.032 [2024-11-28 01:25:23.627148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.032 qpair failed and we were unable to recover it. 00:31:09.292 [2024-11-28 01:25:23.636831] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.292 [2024-11-28 01:25:23.636940] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.292 [2024-11-28 01:25:23.636966] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.292 [2024-11-28 01:25:23.636980] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.292 [2024-11-28 01:25:23.636991] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.292 [2024-11-28 01:25:23.637020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.292 qpair failed and we were unable to recover it. 00:31:09.292 [2024-11-28 01:25:23.646884] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.292 [2024-11-28 01:25:23.647017] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.292 [2024-11-28 01:25:23.647043] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.292 [2024-11-28 01:25:23.647057] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.292 [2024-11-28 01:25:23.647069] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.292 [2024-11-28 01:25:23.647098] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.292 qpair failed and we were unable to recover it. 00:31:09.292 [2024-11-28 01:25:23.656921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.292 [2024-11-28 01:25:23.657039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.292 [2024-11-28 01:25:23.657064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.292 [2024-11-28 01:25:23.657078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.292 [2024-11-28 01:25:23.657090] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.292 [2024-11-28 01:25:23.657119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.292 qpair failed and we were unable to recover it. 00:31:09.292 [2024-11-28 01:25:23.666922] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.292 [2024-11-28 01:25:23.667054] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.292 [2024-11-28 01:25:23.667080] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.292 [2024-11-28 01:25:23.667094] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.292 [2024-11-28 01:25:23.667106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.292 [2024-11-28 01:25:23.667134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.292 qpair failed and we were unable to recover it. 00:31:09.292 [2024-11-28 01:25:23.677093] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.292 [2024-11-28 01:25:23.677202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.292 [2024-11-28 01:25:23.677228] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.292 [2024-11-28 01:25:23.677242] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.292 [2024-11-28 01:25:23.677254] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.292 [2024-11-28 01:25:23.677283] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.292 qpair failed and we were unable to recover it. 00:31:09.292 [2024-11-28 01:25:23.687077] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.292 [2024-11-28 01:25:23.687206] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.292 [2024-11-28 01:25:23.687232] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.292 [2024-11-28 01:25:23.687246] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.292 [2024-11-28 01:25:23.687258] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.292 [2024-11-28 01:25:23.687286] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.292 qpair failed and we were unable to recover it. 00:31:09.292 [2024-11-28 01:25:23.696998] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.292 [2024-11-28 01:25:23.697102] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.293 [2024-11-28 01:25:23.697133] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.293 [2024-11-28 01:25:23.697148] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.293 [2024-11-28 01:25:23.697160] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.293 [2024-11-28 01:25:23.697189] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.293 qpair failed and we were unable to recover it. 00:31:09.293 [2024-11-28 01:25:23.707068] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.293 [2024-11-28 01:25:23.707178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.293 [2024-11-28 01:25:23.707204] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.293 [2024-11-28 01:25:23.707218] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.293 [2024-11-28 01:25:23.707230] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.293 [2024-11-28 01:25:23.707262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.293 qpair failed and we were unable to recover it. 00:31:09.293 [2024-11-28 01:25:23.717158] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.293 [2024-11-28 01:25:23.717266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.293 [2024-11-28 01:25:23.717291] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.293 [2024-11-28 01:25:23.717305] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.293 [2024-11-28 01:25:23.717317] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.293 [2024-11-28 01:25:23.717346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.293 qpair failed and we were unable to recover it. 00:31:09.293 [2024-11-28 01:25:23.727095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.293 [2024-11-28 01:25:23.727195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.293 [2024-11-28 01:25:23.727221] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.293 [2024-11-28 01:25:23.727236] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.293 [2024-11-28 01:25:23.727247] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.293 [2024-11-28 01:25:23.727276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.293 qpair failed and we were unable to recover it. 00:31:09.293 [2024-11-28 01:25:23.737123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.293 [2024-11-28 01:25:23.737225] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.293 [2024-11-28 01:25:23.737251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.293 [2024-11-28 01:25:23.737264] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.293 [2024-11-28 01:25:23.737277] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.293 [2024-11-28 01:25:23.737324] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.293 qpair failed and we were unable to recover it. 00:31:09.293 [2024-11-28 01:25:23.747264] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.293 [2024-11-28 01:25:23.747369] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.293 [2024-11-28 01:25:23.747396] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.293 [2024-11-28 01:25:23.747410] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.293 [2024-11-28 01:25:23.747422] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.293 [2024-11-28 01:25:23.747451] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.293 qpair failed and we were unable to recover it. 00:31:09.293 [2024-11-28 01:25:23.757272] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.293 [2024-11-28 01:25:23.757391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.293 [2024-11-28 01:25:23.757423] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.293 [2024-11-28 01:25:23.757439] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.293 [2024-11-28 01:25:23.757452] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.293 [2024-11-28 01:25:23.757483] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.293 qpair failed and we were unable to recover it. 00:31:09.293 [2024-11-28 01:25:23.767234] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.293 [2024-11-28 01:25:23.767334] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.293 [2024-11-28 01:25:23.767360] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.293 [2024-11-28 01:25:23.767375] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.293 [2024-11-28 01:25:23.767387] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.293 [2024-11-28 01:25:23.767416] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.293 qpair failed and we were unable to recover it. 00:31:09.293 [2024-11-28 01:25:23.777233] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.293 [2024-11-28 01:25:23.777344] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.293 [2024-11-28 01:25:23.777370] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.293 [2024-11-28 01:25:23.777384] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.293 [2024-11-28 01:25:23.777396] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.293 [2024-11-28 01:25:23.777425] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.293 qpair failed and we were unable to recover it. 00:31:09.293 [2024-11-28 01:25:23.787342] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.293 [2024-11-28 01:25:23.787438] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.293 [2024-11-28 01:25:23.787470] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.293 [2024-11-28 01:25:23.787484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.293 [2024-11-28 01:25:23.787496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.293 [2024-11-28 01:25:23.787534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.293 qpair failed and we were unable to recover it. 00:31:09.293 [2024-11-28 01:25:23.797297] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.293 [2024-11-28 01:25:23.797401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.293 [2024-11-28 01:25:23.797427] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.293 [2024-11-28 01:25:23.797441] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.293 [2024-11-28 01:25:23.797453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.293 [2024-11-28 01:25:23.797482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.293 qpair failed and we were unable to recover it. 00:31:09.293 [2024-11-28 01:25:23.807287] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.293 [2024-11-28 01:25:23.807382] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.293 [2024-11-28 01:25:23.807420] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.293 [2024-11-28 01:25:23.807433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.293 [2024-11-28 01:25:23.807446] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.293 [2024-11-28 01:25:23.807475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.293 qpair failed and we were unable to recover it. 00:31:09.293 [2024-11-28 01:25:23.817391] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.293 [2024-11-28 01:25:23.817496] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.293 [2024-11-28 01:25:23.817544] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.293 [2024-11-28 01:25:23.817561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.293 [2024-11-28 01:25:23.817573] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.293 [2024-11-28 01:25:23.817606] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.293 qpair failed and we were unable to recover it. 00:31:09.293 [2024-11-28 01:25:23.827382] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.293 [2024-11-28 01:25:23.827486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.293 [2024-11-28 01:25:23.827512] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.294 [2024-11-28 01:25:23.827537] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.294 [2024-11-28 01:25:23.827557] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.294 [2024-11-28 01:25:23.827589] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.294 qpair failed and we were unable to recover it. 00:31:09.294 [2024-11-28 01:25:23.837512] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.294 [2024-11-28 01:25:23.837637] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.294 [2024-11-28 01:25:23.837662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.294 [2024-11-28 01:25:23.837677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.294 [2024-11-28 01:25:23.837688] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.294 [2024-11-28 01:25:23.837717] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.294 qpair failed and we were unable to recover it. 00:31:09.294 [2024-11-28 01:25:23.847423] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.294 [2024-11-28 01:25:23.847542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.294 [2024-11-28 01:25:23.847568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.294 [2024-11-28 01:25:23.847582] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.294 [2024-11-28 01:25:23.847594] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.294 [2024-11-28 01:25:23.847623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.294 qpair failed and we were unable to recover it. 00:31:09.294 [2024-11-28 01:25:23.857498] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.294 [2024-11-28 01:25:23.857623] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.294 [2024-11-28 01:25:23.857650] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.294 [2024-11-28 01:25:23.857664] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.294 [2024-11-28 01:25:23.857675] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.294 [2024-11-28 01:25:23.857717] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.294 qpair failed and we were unable to recover it. 00:31:09.294 [2024-11-28 01:25:23.867539] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.294 [2024-11-28 01:25:23.867642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.294 [2024-11-28 01:25:23.867669] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.294 [2024-11-28 01:25:23.867683] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.294 [2024-11-28 01:25:23.867695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3b0000b90 00:31:09.294 [2024-11-28 01:25:23.867736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:09.294 qpair failed and we were unable to recover it. 00:31:09.294 [2024-11-28 01:25:23.877563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.294 [2024-11-28 01:25:23.877675] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.294 [2024-11-28 01:25:23.877709] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.294 [2024-11-28 01:25:23.877725] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.294 [2024-11-28 01:25:23.877737] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x645f20 00:31:09.294 [2024-11-28 01:25:23.877767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:31:09.294 qpair failed and we were unable to recover it. 00:31:09.294 [2024-11-28 01:25:23.887585] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.294 [2024-11-28 01:25:23.887687] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.294 [2024-11-28 01:25:23.887714] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.294 [2024-11-28 01:25:23.887728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.294 [2024-11-28 01:25:23.887740] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x645f20 00:31:09.294 [2024-11-28 01:25:23.887769] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:31:09.294 qpair failed and we were unable to recover it. 00:31:09.552 [2024-11-28 01:25:23.897646] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.552 [2024-11-28 01:25:23.897796] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.552 [2024-11-28 01:25:23.897839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.552 [2024-11-28 01:25:23.897855] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.552 [2024-11-28 01:25:23.897867] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3a8000b90 00:31:09.552 [2024-11-28 01:25:23.897901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:09.552 qpair failed and we were unable to recover it. 00:31:09.552 [2024-11-28 01:25:23.907606] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.552 [2024-11-28 01:25:23.907703] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.552 [2024-11-28 01:25:23.907732] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.552 [2024-11-28 01:25:23.907746] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.552 [2024-11-28 01:25:23.907758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3a8000b90 00:31:09.552 [2024-11-28 01:25:23.907790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:09.552 qpair failed and we were unable to recover it. 00:31:09.552 [2024-11-28 01:25:23.907929] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:31:09.552 A controller has encountered a failure and is being reset. 00:31:09.552 [2024-11-28 01:25:23.917660] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.552 [2024-11-28 01:25:23.917774] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.553 [2024-11-28 01:25:23.917812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.553 [2024-11-28 01:25:23.917838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.553 [2024-11-28 01:25:23.917850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3a4000b90 00:31:09.553 [2024-11-28 01:25:23.917881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:09.553 qpair failed and we were unable to recover it. 00:31:09.553 [2024-11-28 01:25:23.927663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:09.553 [2024-11-28 01:25:23.927786] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:09.553 [2024-11-28 01:25:23.927815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:09.553 [2024-11-28 01:25:23.927829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:09.553 [2024-11-28 01:25:23.927847] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fa3a4000b90 00:31:09.553 [2024-11-28 01:25:23.927877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:09.553 qpair failed and we were unable to recover it. 00:31:09.553 Controller properly reset. 00:31:09.553 Initializing NVMe Controllers 00:31:09.553 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:31:09.553 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:31:09.553 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:31:09.553 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:31:09.553 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:31:09.553 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:31:09.553 Initialization complete. Launching workers. 00:31:09.553 Starting thread on core 1 00:31:09.553 Starting thread on core 2 00:31:09.553 Starting thread on core 3 00:31:09.553 Starting thread on core 0 00:31:09.553 01:25:24 -- host/target_disconnect.sh@59 -- # sync 00:31:09.553 00:31:09.553 real 0m11.712s 00:31:09.553 user 0m21.396s 00:31:09.553 sys 0m5.191s 00:31:09.553 01:25:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:09.553 01:25:24 -- common/autotest_common.sh@10 -- # set +x 00:31:09.553 ************************************ 00:31:09.553 END TEST nvmf_target_disconnect_tc2 00:31:09.553 ************************************ 00:31:09.553 01:25:24 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:31:09.553 01:25:24 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:31:09.553 01:25:24 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:31:09.553 01:25:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:09.553 01:25:24 -- nvmf/common.sh@116 -- # sync 00:31:09.553 01:25:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:09.553 01:25:24 -- nvmf/common.sh@119 -- # set +e 00:31:09.553 01:25:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:09.553 01:25:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:09.553 rmmod nvme_tcp 00:31:09.811 rmmod nvme_fabrics 00:31:09.811 rmmod nvme_keyring 00:31:09.811 01:25:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:09.811 01:25:24 -- nvmf/common.sh@123 -- # set -e 00:31:09.811 01:25:24 -- nvmf/common.sh@124 -- # return 0 00:31:09.811 01:25:24 -- nvmf/common.sh@477 -- # '[' -n 2169394 ']' 00:31:09.811 01:25:24 -- nvmf/common.sh@478 -- # killprocess 2169394 00:31:09.811 01:25:24 -- common/autotest_common.sh@936 -- # '[' -z 2169394 ']' 00:31:09.811 01:25:24 -- common/autotest_common.sh@940 -- # kill -0 2169394 00:31:09.811 01:25:24 -- common/autotest_common.sh@941 -- # uname 00:31:09.811 01:25:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:09.811 01:25:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2169394 00:31:09.811 01:25:24 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:31:09.811 01:25:24 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:31:09.811 01:25:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2169394' 00:31:09.811 killing process with pid 2169394 00:31:09.811 01:25:24 -- common/autotest_common.sh@955 -- # kill 2169394 00:31:09.811 01:25:24 -- common/autotest_common.sh@960 -- # wait 2169394 00:31:10.069 01:25:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:10.069 01:25:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:10.069 01:25:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:10.069 01:25:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:10.069 01:25:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:10.069 01:25:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:10.069 01:25:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:31:10.069 01:25:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:11.969 01:25:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:11.969 00:31:11.969 real 0m16.526s 00:31:11.969 user 0m48.655s 00:31:11.969 sys 0m7.144s 00:31:11.969 01:25:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:11.969 01:25:26 -- common/autotest_common.sh@10 -- # set +x 00:31:11.969 ************************************ 00:31:11.969 END TEST nvmf_target_disconnect 00:31:11.969 ************************************ 00:31:11.969 01:25:26 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:31:11.969 01:25:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:11.969 01:25:26 -- common/autotest_common.sh@10 -- # set +x 00:31:12.228 01:25:26 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:31:12.228 00:31:12.228 real 22m56.103s 00:31:12.228 user 66m32.454s 00:31:12.228 sys 5m31.799s 00:31:12.228 01:25:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:12.228 01:25:26 -- common/autotest_common.sh@10 -- # set +x 00:31:12.228 ************************************ 00:31:12.228 END TEST nvmf_tcp 00:31:12.228 ************************************ 00:31:12.228 01:25:26 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:31:12.228 01:25:26 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:31:12.228 01:25:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:12.228 01:25:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:12.228 01:25:26 -- common/autotest_common.sh@10 -- # set +x 00:31:12.228 ************************************ 00:31:12.228 START TEST spdkcli_nvmf_tcp 00:31:12.228 ************************************ 00:31:12.228 01:25:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:31:12.228 * Looking for test storage... 00:31:12.228 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:31:12.228 01:25:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:12.228 01:25:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:12.228 01:25:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:12.228 01:25:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:12.228 01:25:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:12.228 01:25:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:12.228 01:25:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:12.228 01:25:26 -- scripts/common.sh@335 -- # IFS=.-: 00:31:12.228 01:25:26 -- scripts/common.sh@335 -- # read -ra ver1 00:31:12.228 01:25:26 -- scripts/common.sh@336 -- # IFS=.-: 00:31:12.228 01:25:26 -- scripts/common.sh@336 -- # read -ra ver2 00:31:12.228 01:25:26 -- scripts/common.sh@337 -- # local 'op=<' 00:31:12.228 01:25:26 -- scripts/common.sh@339 -- # ver1_l=2 00:31:12.228 01:25:26 -- scripts/common.sh@340 -- # ver2_l=1 00:31:12.228 01:25:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:12.228 01:25:26 -- scripts/common.sh@343 -- # case "$op" in 00:31:12.228 01:25:26 -- scripts/common.sh@344 -- # : 1 00:31:12.228 01:25:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:12.228 01:25:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:12.228 01:25:26 -- scripts/common.sh@364 -- # decimal 1 00:31:12.228 01:25:26 -- scripts/common.sh@352 -- # local d=1 00:31:12.228 01:25:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:12.228 01:25:26 -- scripts/common.sh@354 -- # echo 1 00:31:12.228 01:25:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:12.228 01:25:26 -- scripts/common.sh@365 -- # decimal 2 00:31:12.228 01:25:26 -- scripts/common.sh@352 -- # local d=2 00:31:12.228 01:25:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:12.228 01:25:26 -- scripts/common.sh@354 -- # echo 2 00:31:12.228 01:25:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:12.228 01:25:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:12.228 01:25:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:12.228 01:25:26 -- scripts/common.sh@367 -- # return 0 00:31:12.228 01:25:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:12.228 01:25:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:12.228 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:12.228 --rc genhtml_branch_coverage=1 00:31:12.228 --rc genhtml_function_coverage=1 00:31:12.228 --rc genhtml_legend=1 00:31:12.228 --rc geninfo_all_blocks=1 00:31:12.228 --rc geninfo_unexecuted_blocks=1 00:31:12.228 00:31:12.228 ' 00:31:12.228 01:25:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:12.228 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:12.228 --rc genhtml_branch_coverage=1 00:31:12.228 --rc genhtml_function_coverage=1 00:31:12.228 --rc genhtml_legend=1 00:31:12.228 --rc geninfo_all_blocks=1 00:31:12.228 --rc geninfo_unexecuted_blocks=1 00:31:12.228 00:31:12.228 ' 00:31:12.228 01:25:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:12.228 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:12.228 --rc genhtml_branch_coverage=1 00:31:12.228 --rc genhtml_function_coverage=1 00:31:12.228 --rc genhtml_legend=1 00:31:12.228 --rc geninfo_all_blocks=1 00:31:12.228 --rc geninfo_unexecuted_blocks=1 00:31:12.228 00:31:12.228 ' 00:31:12.228 01:25:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:12.228 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:12.228 --rc genhtml_branch_coverage=1 00:31:12.228 --rc genhtml_function_coverage=1 00:31:12.228 --rc genhtml_legend=1 00:31:12.228 --rc geninfo_all_blocks=1 00:31:12.228 --rc geninfo_unexecuted_blocks=1 00:31:12.228 00:31:12.228 ' 00:31:12.228 01:25:26 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:31:12.228 01:25:26 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:31:12.228 01:25:26 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:31:12.228 01:25:26 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:12.228 01:25:26 -- nvmf/common.sh@7 -- # uname -s 00:31:12.228 01:25:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:12.228 01:25:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:12.228 01:25:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:12.228 01:25:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:12.228 01:25:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:12.228 01:25:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:12.228 01:25:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:12.228 01:25:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:12.228 01:25:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:12.228 01:25:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:12.228 01:25:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:12.228 01:25:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:12.228 01:25:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:12.228 01:25:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:12.228 01:25:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:12.228 01:25:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:12.229 01:25:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:12.229 01:25:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:12.229 01:25:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:12.229 01:25:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:12.229 01:25:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:12.229 01:25:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:12.229 01:25:26 -- paths/export.sh@5 -- # export PATH 00:31:12.229 01:25:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:12.229 01:25:26 -- nvmf/common.sh@46 -- # : 0 00:31:12.229 01:25:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:12.229 01:25:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:12.229 01:25:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:12.229 01:25:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:12.229 01:25:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:12.229 01:25:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:12.229 01:25:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:12.229 01:25:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:12.229 01:25:26 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:31:12.229 01:25:26 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:31:12.229 01:25:26 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:31:12.229 01:25:26 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:31:12.229 01:25:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:12.229 01:25:26 -- common/autotest_common.sh@10 -- # set +x 00:31:12.229 01:25:26 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:31:12.229 01:25:26 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=2170627 00:31:12.229 01:25:26 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:31:12.229 01:25:26 -- spdkcli/common.sh@34 -- # waitforlisten 2170627 00:31:12.229 01:25:26 -- common/autotest_common.sh@829 -- # '[' -z 2170627 ']' 00:31:12.229 01:25:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:12.229 01:25:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:12.229 01:25:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:12.229 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:12.229 01:25:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:12.229 01:25:26 -- common/autotest_common.sh@10 -- # set +x 00:31:12.229 [2024-11-28 01:25:26.809670] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:31:12.229 [2024-11-28 01:25:26.809756] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2170627 ] 00:31:12.487 EAL: No free 2048 kB hugepages reported on node 1 00:31:12.487 [2024-11-28 01:25:26.871979] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:31:12.487 [2024-11-28 01:25:26.962543] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:12.487 [2024-11-28 01:25:26.962739] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:12.487 [2024-11-28 01:25:26.962744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:13.418 01:25:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:13.418 01:25:27 -- common/autotest_common.sh@862 -- # return 0 00:31:13.418 01:25:27 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:31:13.418 01:25:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:13.418 01:25:27 -- common/autotest_common.sh@10 -- # set +x 00:31:13.418 01:25:27 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:31:13.418 01:25:27 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:31:13.418 01:25:27 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:31:13.418 01:25:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:13.418 01:25:27 -- common/autotest_common.sh@10 -- # set +x 00:31:13.418 01:25:27 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:31:13.418 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:31:13.418 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:31:13.418 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:31:13.418 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:31:13.418 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:31:13.418 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:31:13.418 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:31:13.418 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:31:13.418 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:31:13.418 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:31:13.418 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:13.418 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:31:13.418 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:31:13.419 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:13.419 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:31:13.419 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:31:13.419 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:31:13.419 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:31:13.419 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:13.419 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:31:13.419 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:31:13.419 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:31:13.419 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:31:13.419 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:13.419 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:31:13.419 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:31:13.419 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:31:13.419 ' 00:31:13.674 [2024-11-28 01:25:28.170556] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:16.197 [2024-11-28 01:25:30.366177] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:17.130 [2024-11-28 01:25:31.606634] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:31:19.658 [2024-11-28 01:25:33.893907] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:31:21.555 [2024-11-28 01:25:35.912630] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:31:22.928 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:31:22.928 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:31:22.928 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:31:22.928 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:31:22.928 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:31:22.928 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:31:22.928 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:31:22.929 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:31:22.929 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:31:22.929 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:31:22.929 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:22.929 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:22.929 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:31:22.929 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:22.929 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:22.929 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:31:22.929 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:22.929 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:31:22.929 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:31:22.929 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:22.929 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:31:22.929 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:31:22.929 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:31:22.929 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:31:22.929 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:22.929 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:31:22.929 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:31:22.929 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:31:23.187 01:25:37 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:31:23.187 01:25:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:23.187 01:25:37 -- common/autotest_common.sh@10 -- # set +x 00:31:23.187 01:25:37 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:31:23.187 01:25:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:23.187 01:25:37 -- common/autotest_common.sh@10 -- # set +x 00:31:23.187 01:25:37 -- spdkcli/nvmf.sh@69 -- # check_match 00:31:23.187 01:25:37 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:31:23.444 01:25:37 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:31:23.444 01:25:38 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:31:23.444 01:25:38 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:31:23.444 01:25:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:23.444 01:25:38 -- common/autotest_common.sh@10 -- # set +x 00:31:23.444 01:25:38 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:31:23.444 01:25:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:23.444 01:25:38 -- common/autotest_common.sh@10 -- # set +x 00:31:23.702 01:25:38 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:31:23.702 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:31:23.702 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:31:23.702 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:31:23.702 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:31:23.702 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:31:23.702 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:31:23.702 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:31:23.702 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:31:23.702 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:31:23.702 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:31:23.702 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:31:23.702 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:31:23.702 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:31:23.702 ' 00:31:28.965 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:31:28.965 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:31:28.965 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:28.965 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:31:28.965 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:31:28.965 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:31:28.965 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:31:28.965 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:28.965 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:31:28.965 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:31:28.965 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:31:28.965 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:31:28.965 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:31:28.965 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:31:28.965 01:25:43 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:31:28.965 01:25:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:28.965 01:25:43 -- common/autotest_common.sh@10 -- # set +x 00:31:28.965 01:25:43 -- spdkcli/nvmf.sh@90 -- # killprocess 2170627 00:31:28.965 01:25:43 -- common/autotest_common.sh@936 -- # '[' -z 2170627 ']' 00:31:28.965 01:25:43 -- common/autotest_common.sh@940 -- # kill -0 2170627 00:31:28.965 01:25:43 -- common/autotest_common.sh@941 -- # uname 00:31:28.965 01:25:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:28.965 01:25:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2170627 00:31:28.965 01:25:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:28.965 01:25:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:28.965 01:25:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2170627' 00:31:28.965 killing process with pid 2170627 00:31:28.965 01:25:43 -- common/autotest_common.sh@955 -- # kill 2170627 00:31:28.965 [2024-11-28 01:25:43.398721] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:28.965 01:25:43 -- common/autotest_common.sh@960 -- # wait 2170627 00:31:29.224 01:25:43 -- spdkcli/nvmf.sh@1 -- # cleanup 00:31:29.224 01:25:43 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:31:29.224 01:25:43 -- spdkcli/common.sh@13 -- # '[' -n 2170627 ']' 00:31:29.224 01:25:43 -- spdkcli/common.sh@14 -- # killprocess 2170627 00:31:29.224 01:25:43 -- common/autotest_common.sh@936 -- # '[' -z 2170627 ']' 00:31:29.224 01:25:43 -- common/autotest_common.sh@940 -- # kill -0 2170627 00:31:29.224 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2170627) - No such process 00:31:29.224 01:25:43 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2170627 is not found' 00:31:29.224 Process with pid 2170627 is not found 00:31:29.224 01:25:43 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:31:29.224 01:25:43 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:31:29.224 01:25:43 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:31:29.224 00:31:29.224 real 0m17.003s 00:31:29.224 user 0m36.283s 00:31:29.224 sys 0m0.791s 00:31:29.224 01:25:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:29.224 01:25:43 -- common/autotest_common.sh@10 -- # set +x 00:31:29.224 ************************************ 00:31:29.224 END TEST spdkcli_nvmf_tcp 00:31:29.224 ************************************ 00:31:29.224 01:25:43 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:29.224 01:25:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:29.224 01:25:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:29.224 01:25:43 -- common/autotest_common.sh@10 -- # set +x 00:31:29.224 ************************************ 00:31:29.224 START TEST nvmf_identify_passthru 00:31:29.224 ************************************ 00:31:29.224 01:25:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:29.224 * Looking for test storage... 00:31:29.224 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:29.224 01:25:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:29.224 01:25:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:29.224 01:25:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:29.224 01:25:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:29.224 01:25:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:29.224 01:25:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:29.224 01:25:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:29.224 01:25:43 -- scripts/common.sh@335 -- # IFS=.-: 00:31:29.224 01:25:43 -- scripts/common.sh@335 -- # read -ra ver1 00:31:29.224 01:25:43 -- scripts/common.sh@336 -- # IFS=.-: 00:31:29.224 01:25:43 -- scripts/common.sh@336 -- # read -ra ver2 00:31:29.224 01:25:43 -- scripts/common.sh@337 -- # local 'op=<' 00:31:29.224 01:25:43 -- scripts/common.sh@339 -- # ver1_l=2 00:31:29.224 01:25:43 -- scripts/common.sh@340 -- # ver2_l=1 00:31:29.224 01:25:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:29.224 01:25:43 -- scripts/common.sh@343 -- # case "$op" in 00:31:29.224 01:25:43 -- scripts/common.sh@344 -- # : 1 00:31:29.224 01:25:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:29.224 01:25:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:29.224 01:25:43 -- scripts/common.sh@364 -- # decimal 1 00:31:29.224 01:25:43 -- scripts/common.sh@352 -- # local d=1 00:31:29.224 01:25:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:29.224 01:25:43 -- scripts/common.sh@354 -- # echo 1 00:31:29.224 01:25:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:29.224 01:25:43 -- scripts/common.sh@365 -- # decimal 2 00:31:29.224 01:25:43 -- scripts/common.sh@352 -- # local d=2 00:31:29.224 01:25:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:29.224 01:25:43 -- scripts/common.sh@354 -- # echo 2 00:31:29.224 01:25:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:29.224 01:25:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:29.224 01:25:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:29.224 01:25:43 -- scripts/common.sh@367 -- # return 0 00:31:29.224 01:25:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:29.225 01:25:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:29.225 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:29.225 --rc genhtml_branch_coverage=1 00:31:29.225 --rc genhtml_function_coverage=1 00:31:29.225 --rc genhtml_legend=1 00:31:29.225 --rc geninfo_all_blocks=1 00:31:29.225 --rc geninfo_unexecuted_blocks=1 00:31:29.225 00:31:29.225 ' 00:31:29.225 01:25:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:29.225 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:29.225 --rc genhtml_branch_coverage=1 00:31:29.225 --rc genhtml_function_coverage=1 00:31:29.225 --rc genhtml_legend=1 00:31:29.225 --rc geninfo_all_blocks=1 00:31:29.225 --rc geninfo_unexecuted_blocks=1 00:31:29.225 00:31:29.225 ' 00:31:29.225 01:25:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:29.225 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:29.225 --rc genhtml_branch_coverage=1 00:31:29.225 --rc genhtml_function_coverage=1 00:31:29.225 --rc genhtml_legend=1 00:31:29.225 --rc geninfo_all_blocks=1 00:31:29.225 --rc geninfo_unexecuted_blocks=1 00:31:29.225 00:31:29.225 ' 00:31:29.225 01:25:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:29.225 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:29.225 --rc genhtml_branch_coverage=1 00:31:29.225 --rc genhtml_function_coverage=1 00:31:29.225 --rc genhtml_legend=1 00:31:29.225 --rc geninfo_all_blocks=1 00:31:29.225 --rc geninfo_unexecuted_blocks=1 00:31:29.225 00:31:29.225 ' 00:31:29.225 01:25:43 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:29.225 01:25:43 -- nvmf/common.sh@7 -- # uname -s 00:31:29.225 01:25:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:29.225 01:25:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:29.225 01:25:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:29.225 01:25:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:29.225 01:25:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:29.225 01:25:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:29.225 01:25:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:29.225 01:25:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:29.225 01:25:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:29.225 01:25:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:29.225 01:25:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:29.225 01:25:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:29.225 01:25:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:29.225 01:25:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:29.225 01:25:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:29.225 01:25:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:29.225 01:25:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:29.225 01:25:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:29.225 01:25:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:29.225 01:25:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:29.225 01:25:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:29.225 01:25:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:29.225 01:25:43 -- paths/export.sh@5 -- # export PATH 00:31:29.225 01:25:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:29.225 01:25:43 -- nvmf/common.sh@46 -- # : 0 00:31:29.225 01:25:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:29.225 01:25:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:29.225 01:25:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:29.225 01:25:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:29.225 01:25:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:29.225 01:25:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:29.225 01:25:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:29.225 01:25:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:29.225 01:25:43 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:29.225 01:25:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:29.225 01:25:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:29.225 01:25:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:29.225 01:25:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:29.225 01:25:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:29.225 01:25:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:29.225 01:25:43 -- paths/export.sh@5 -- # export PATH 00:31:29.225 01:25:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:29.225 01:25:43 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:31:29.225 01:25:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:29.225 01:25:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:29.225 01:25:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:29.225 01:25:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:29.225 01:25:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:29.225 01:25:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:29.225 01:25:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:29.225 01:25:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:29.225 01:25:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:29.225 01:25:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:29.225 01:25:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:29.225 01:25:43 -- common/autotest_common.sh@10 -- # set +x 00:31:31.755 01:25:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:31.755 01:25:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:31.755 01:25:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:31.755 01:25:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:31.755 01:25:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:31.755 01:25:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:31.755 01:25:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:31.755 01:25:45 -- nvmf/common.sh@294 -- # net_devs=() 00:31:31.755 01:25:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:31.755 01:25:45 -- nvmf/common.sh@295 -- # e810=() 00:31:31.755 01:25:45 -- nvmf/common.sh@295 -- # local -ga e810 00:31:31.755 01:25:45 -- nvmf/common.sh@296 -- # x722=() 00:31:31.755 01:25:45 -- nvmf/common.sh@296 -- # local -ga x722 00:31:31.755 01:25:45 -- nvmf/common.sh@297 -- # mlx=() 00:31:31.755 01:25:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:31.755 01:25:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:31.755 01:25:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:31.755 01:25:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:31.755 01:25:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:31.755 01:25:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:31.755 01:25:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:31.755 01:25:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:31.755 01:25:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:31.755 01:25:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:31.755 01:25:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:31.755 01:25:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:31.755 01:25:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:31.755 01:25:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:31.755 01:25:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:31.755 01:25:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:31.755 01:25:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:31.755 01:25:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:31.755 01:25:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:31.755 01:25:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:31.755 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:31.755 01:25:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:31.755 01:25:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:31.755 01:25:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:31.755 01:25:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:31.755 01:25:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:31.755 01:25:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:31.755 01:25:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:31.755 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:31.755 01:25:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:31.755 01:25:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:31.755 01:25:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:31.755 01:25:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:31.755 01:25:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:31.755 01:25:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:31.755 01:25:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:31.755 01:25:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:31.755 01:25:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:31.755 01:25:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:31.755 01:25:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:31.755 01:25:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:31.755 01:25:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:31.755 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:31.755 01:25:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:31.755 01:25:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:31.755 01:25:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:31.755 01:25:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:31.755 01:25:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:31.755 01:25:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:31.755 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:31.755 01:25:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:31.755 01:25:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:31.755 01:25:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:31.755 01:25:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:31.755 01:25:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:31.755 01:25:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:31.755 01:25:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:31.755 01:25:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:31.755 01:25:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:31.755 01:25:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:31.755 01:25:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:31.755 01:25:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:31.755 01:25:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:31.755 01:25:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:31.755 01:25:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:31.755 01:25:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:31.755 01:25:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:31.755 01:25:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:31.755 01:25:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:31.755 01:25:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:31.755 01:25:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:31.755 01:25:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:31.755 01:25:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:31.755 01:25:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:31.755 01:25:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:31.755 01:25:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:31.755 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:31.755 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.178 ms 00:31:31.755 00:31:31.755 --- 10.0.0.2 ping statistics --- 00:31:31.755 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:31.755 rtt min/avg/max/mdev = 0.178/0.178/0.178/0.000 ms 00:31:31.755 01:25:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:31.755 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:31.755 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:31:31.755 00:31:31.755 --- 10.0.0.1 ping statistics --- 00:31:31.755 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:31.755 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:31:31.755 01:25:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:31.755 01:25:45 -- nvmf/common.sh@410 -- # return 0 00:31:31.755 01:25:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:31:31.755 01:25:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:31.755 01:25:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:31.755 01:25:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:31.755 01:25:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:31.755 01:25:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:31.755 01:25:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:31.755 01:25:45 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:31:31.755 01:25:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:31.755 01:25:45 -- common/autotest_common.sh@10 -- # set +x 00:31:31.755 01:25:45 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:31:31.755 01:25:45 -- common/autotest_common.sh@1519 -- # bdfs=() 00:31:31.755 01:25:45 -- common/autotest_common.sh@1519 -- # local bdfs 00:31:31.755 01:25:45 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:31:31.755 01:25:45 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:31:31.755 01:25:45 -- common/autotest_common.sh@1508 -- # bdfs=() 00:31:31.755 01:25:45 -- common/autotest_common.sh@1508 -- # local bdfs 00:31:31.755 01:25:45 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:31:31.755 01:25:45 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:31:31.755 01:25:45 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:31:31.755 01:25:46 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:31:31.755 01:25:46 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:31:31.755 01:25:46 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:31:31.755 01:25:46 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:31:31.755 01:25:46 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:31:31.756 01:25:46 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:31.756 01:25:46 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:31:31.756 01:25:46 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:31:31.756 EAL: No free 2048 kB hugepages reported on node 1 00:31:35.937 01:25:50 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:31:35.937 01:25:50 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:35.937 01:25:50 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:31:35.937 01:25:50 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:31:35.937 EAL: No free 2048 kB hugepages reported on node 1 00:31:40.123 01:25:54 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:31:40.123 01:25:54 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:31:40.123 01:25:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:40.123 01:25:54 -- common/autotest_common.sh@10 -- # set +x 00:31:40.123 01:25:54 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:31:40.123 01:25:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:40.123 01:25:54 -- common/autotest_common.sh@10 -- # set +x 00:31:40.123 01:25:54 -- target/identify_passthru.sh@31 -- # nvmfpid=2175369 00:31:40.123 01:25:54 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:31:40.123 01:25:54 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:31:40.123 01:25:54 -- target/identify_passthru.sh@35 -- # waitforlisten 2175369 00:31:40.123 01:25:54 -- common/autotest_common.sh@829 -- # '[' -z 2175369 ']' 00:31:40.123 01:25:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:40.123 01:25:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:40.123 01:25:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:40.123 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:40.123 01:25:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:40.123 01:25:54 -- common/autotest_common.sh@10 -- # set +x 00:31:40.123 [2024-11-28 01:25:54.485540] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:31:40.123 [2024-11-28 01:25:54.485637] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:40.123 EAL: No free 2048 kB hugepages reported on node 1 00:31:40.123 [2024-11-28 01:25:54.552129] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:31:40.123 [2024-11-28 01:25:54.638730] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:40.123 [2024-11-28 01:25:54.638905] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:40.123 [2024-11-28 01:25:54.638921] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:40.123 [2024-11-28 01:25:54.638934] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:40.123 [2024-11-28 01:25:54.638990] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:40.123 [2024-11-28 01:25:54.639052] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:31:40.123 [2024-11-28 01:25:54.639117] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:31:40.123 [2024-11-28 01:25:54.639120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:40.123 01:25:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:40.123 01:25:54 -- common/autotest_common.sh@862 -- # return 0 00:31:40.123 01:25:54 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:31:40.123 01:25:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.123 01:25:54 -- common/autotest_common.sh@10 -- # set +x 00:31:40.123 INFO: Log level set to 20 00:31:40.123 INFO: Requests: 00:31:40.123 { 00:31:40.123 "jsonrpc": "2.0", 00:31:40.123 "method": "nvmf_set_config", 00:31:40.123 "id": 1, 00:31:40.123 "params": { 00:31:40.123 "admin_cmd_passthru": { 00:31:40.123 "identify_ctrlr": true 00:31:40.123 } 00:31:40.123 } 00:31:40.123 } 00:31:40.123 00:31:40.123 INFO: response: 00:31:40.123 { 00:31:40.123 "jsonrpc": "2.0", 00:31:40.123 "id": 1, 00:31:40.123 "result": true 00:31:40.123 } 00:31:40.123 00:31:40.123 01:25:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.123 01:25:54 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:31:40.123 01:25:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.123 01:25:54 -- common/autotest_common.sh@10 -- # set +x 00:31:40.123 INFO: Setting log level to 20 00:31:40.123 INFO: Setting log level to 20 00:31:40.123 INFO: Log level set to 20 00:31:40.123 INFO: Log level set to 20 00:31:40.123 INFO: Requests: 00:31:40.123 { 00:31:40.123 "jsonrpc": "2.0", 00:31:40.123 "method": "framework_start_init", 00:31:40.123 "id": 1 00:31:40.123 } 00:31:40.123 00:31:40.123 INFO: Requests: 00:31:40.123 { 00:31:40.123 "jsonrpc": "2.0", 00:31:40.123 "method": "framework_start_init", 00:31:40.123 "id": 1 00:31:40.123 } 00:31:40.123 00:31:40.382 [2024-11-28 01:25:54.815743] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:31:40.382 INFO: response: 00:31:40.382 { 00:31:40.382 "jsonrpc": "2.0", 00:31:40.382 "id": 1, 00:31:40.382 "result": true 00:31:40.382 } 00:31:40.382 00:31:40.382 INFO: response: 00:31:40.382 { 00:31:40.382 "jsonrpc": "2.0", 00:31:40.382 "id": 1, 00:31:40.382 "result": true 00:31:40.382 } 00:31:40.382 00:31:40.382 01:25:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.382 01:25:54 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:31:40.382 01:25:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.382 01:25:54 -- common/autotest_common.sh@10 -- # set +x 00:31:40.382 INFO: Setting log level to 40 00:31:40.382 INFO: Setting log level to 40 00:31:40.382 INFO: Setting log level to 40 00:31:40.382 [2024-11-28 01:25:54.825638] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:40.382 01:25:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.382 01:25:54 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:31:40.382 01:25:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:40.382 01:25:54 -- common/autotest_common.sh@10 -- # set +x 00:31:40.382 01:25:54 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:31:40.382 01:25:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.382 01:25:54 -- common/autotest_common.sh@10 -- # set +x 00:31:43.658 Nvme0n1 00:31:43.658 01:25:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:43.658 01:25:57 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:31:43.658 01:25:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:43.658 01:25:57 -- common/autotest_common.sh@10 -- # set +x 00:31:43.658 01:25:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:43.658 01:25:57 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:31:43.658 01:25:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:43.658 01:25:57 -- common/autotest_common.sh@10 -- # set +x 00:31:43.658 01:25:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:43.658 01:25:57 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:43.658 01:25:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:43.658 01:25:57 -- common/autotest_common.sh@10 -- # set +x 00:31:43.658 [2024-11-28 01:25:57.710639] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:43.658 01:25:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:43.658 01:25:57 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:31:43.658 01:25:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:43.658 01:25:57 -- common/autotest_common.sh@10 -- # set +x 00:31:43.658 [2024-11-28 01:25:57.718319] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:43.658 [ 00:31:43.658 { 00:31:43.658 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:31:43.658 "subtype": "Discovery", 00:31:43.658 "listen_addresses": [], 00:31:43.658 "allow_any_host": true, 00:31:43.658 "hosts": [] 00:31:43.658 }, 00:31:43.658 { 00:31:43.658 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:31:43.658 "subtype": "NVMe", 00:31:43.658 "listen_addresses": [ 00:31:43.658 { 00:31:43.658 "transport": "TCP", 00:31:43.658 "trtype": "TCP", 00:31:43.658 "adrfam": "IPv4", 00:31:43.658 "traddr": "10.0.0.2", 00:31:43.658 "trsvcid": "4420" 00:31:43.658 } 00:31:43.658 ], 00:31:43.658 "allow_any_host": true, 00:31:43.658 "hosts": [], 00:31:43.658 "serial_number": "SPDK00000000000001", 00:31:43.658 "model_number": "SPDK bdev Controller", 00:31:43.658 "max_namespaces": 1, 00:31:43.658 "min_cntlid": 1, 00:31:43.658 "max_cntlid": 65519, 00:31:43.658 "namespaces": [ 00:31:43.658 { 00:31:43.658 "nsid": 1, 00:31:43.658 "bdev_name": "Nvme0n1", 00:31:43.658 "name": "Nvme0n1", 00:31:43.658 "nguid": "5903648D83674E60BBCEDD9F1DF8AE03", 00:31:43.658 "uuid": "5903648d-8367-4e60-bbce-dd9f1df8ae03" 00:31:43.658 } 00:31:43.658 ] 00:31:43.658 } 00:31:43.658 ] 00:31:43.658 01:25:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:43.658 01:25:57 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:43.658 01:25:57 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:31:43.658 01:25:57 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:31:43.658 EAL: No free 2048 kB hugepages reported on node 1 00:31:43.658 01:25:57 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:31:43.658 01:25:57 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:43.658 01:25:57 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:31:43.658 01:25:57 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:31:43.658 EAL: No free 2048 kB hugepages reported on node 1 00:31:43.659 01:25:58 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:31:43.659 01:25:58 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:31:43.659 01:25:58 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:31:43.659 01:25:58 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:43.659 01:25:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:43.659 01:25:58 -- common/autotest_common.sh@10 -- # set +x 00:31:43.659 01:25:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:43.659 01:25:58 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:31:43.659 01:25:58 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:31:43.659 01:25:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:43.659 01:25:58 -- nvmf/common.sh@116 -- # sync 00:31:43.659 01:25:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:43.659 01:25:58 -- nvmf/common.sh@119 -- # set +e 00:31:43.659 01:25:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:43.659 01:25:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:43.659 rmmod nvme_tcp 00:31:43.659 rmmod nvme_fabrics 00:31:43.659 rmmod nvme_keyring 00:31:43.659 01:25:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:43.659 01:25:58 -- nvmf/common.sh@123 -- # set -e 00:31:43.659 01:25:58 -- nvmf/common.sh@124 -- # return 0 00:31:43.659 01:25:58 -- nvmf/common.sh@477 -- # '[' -n 2175369 ']' 00:31:43.659 01:25:58 -- nvmf/common.sh@478 -- # killprocess 2175369 00:31:43.659 01:25:58 -- common/autotest_common.sh@936 -- # '[' -z 2175369 ']' 00:31:43.659 01:25:58 -- common/autotest_common.sh@940 -- # kill -0 2175369 00:31:43.659 01:25:58 -- common/autotest_common.sh@941 -- # uname 00:31:43.659 01:25:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:43.659 01:25:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2175369 00:31:43.659 01:25:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:43.659 01:25:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:43.659 01:25:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2175369' 00:31:43.659 killing process with pid 2175369 00:31:43.659 01:25:58 -- common/autotest_common.sh@955 -- # kill 2175369 00:31:43.659 [2024-11-28 01:25:58.203919] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:43.659 01:25:58 -- common/autotest_common.sh@960 -- # wait 2175369 00:31:45.557 01:25:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:45.557 01:25:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:45.557 01:25:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:45.557 01:25:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:45.557 01:25:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:45.557 01:25:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:45.557 01:25:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:45.557 01:25:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:47.460 01:26:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:47.460 00:31:47.460 real 0m18.187s 00:31:47.460 user 0m27.054s 00:31:47.460 sys 0m2.376s 00:31:47.460 01:26:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:47.460 01:26:01 -- common/autotest_common.sh@10 -- # set +x 00:31:47.460 ************************************ 00:31:47.460 END TEST nvmf_identify_passthru 00:31:47.460 ************************************ 00:31:47.460 01:26:01 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:47.460 01:26:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:47.460 01:26:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:47.460 01:26:01 -- common/autotest_common.sh@10 -- # set +x 00:31:47.460 ************************************ 00:31:47.460 START TEST nvmf_dif 00:31:47.460 ************************************ 00:31:47.460 01:26:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:47.460 * Looking for test storage... 00:31:47.460 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:47.460 01:26:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:47.460 01:26:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:47.460 01:26:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:47.460 01:26:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:47.460 01:26:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:47.460 01:26:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:47.460 01:26:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:47.460 01:26:01 -- scripts/common.sh@335 -- # IFS=.-: 00:31:47.460 01:26:01 -- scripts/common.sh@335 -- # read -ra ver1 00:31:47.460 01:26:01 -- scripts/common.sh@336 -- # IFS=.-: 00:31:47.460 01:26:01 -- scripts/common.sh@336 -- # read -ra ver2 00:31:47.460 01:26:01 -- scripts/common.sh@337 -- # local 'op=<' 00:31:47.460 01:26:01 -- scripts/common.sh@339 -- # ver1_l=2 00:31:47.460 01:26:01 -- scripts/common.sh@340 -- # ver2_l=1 00:31:47.460 01:26:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:47.460 01:26:01 -- scripts/common.sh@343 -- # case "$op" in 00:31:47.460 01:26:01 -- scripts/common.sh@344 -- # : 1 00:31:47.460 01:26:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:47.460 01:26:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:47.460 01:26:01 -- scripts/common.sh@364 -- # decimal 1 00:31:47.460 01:26:01 -- scripts/common.sh@352 -- # local d=1 00:31:47.460 01:26:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:47.460 01:26:01 -- scripts/common.sh@354 -- # echo 1 00:31:47.460 01:26:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:47.460 01:26:01 -- scripts/common.sh@365 -- # decimal 2 00:31:47.460 01:26:01 -- scripts/common.sh@352 -- # local d=2 00:31:47.460 01:26:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:47.460 01:26:01 -- scripts/common.sh@354 -- # echo 2 00:31:47.460 01:26:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:47.460 01:26:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:47.460 01:26:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:47.460 01:26:01 -- scripts/common.sh@367 -- # return 0 00:31:47.460 01:26:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:47.460 01:26:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:47.460 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:47.460 --rc genhtml_branch_coverage=1 00:31:47.461 --rc genhtml_function_coverage=1 00:31:47.461 --rc genhtml_legend=1 00:31:47.461 --rc geninfo_all_blocks=1 00:31:47.461 --rc geninfo_unexecuted_blocks=1 00:31:47.461 00:31:47.461 ' 00:31:47.461 01:26:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:47.461 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:47.461 --rc genhtml_branch_coverage=1 00:31:47.461 --rc genhtml_function_coverage=1 00:31:47.461 --rc genhtml_legend=1 00:31:47.461 --rc geninfo_all_blocks=1 00:31:47.461 --rc geninfo_unexecuted_blocks=1 00:31:47.461 00:31:47.461 ' 00:31:47.461 01:26:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:47.461 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:47.461 --rc genhtml_branch_coverage=1 00:31:47.461 --rc genhtml_function_coverage=1 00:31:47.461 --rc genhtml_legend=1 00:31:47.461 --rc geninfo_all_blocks=1 00:31:47.461 --rc geninfo_unexecuted_blocks=1 00:31:47.461 00:31:47.461 ' 00:31:47.461 01:26:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:47.461 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:47.461 --rc genhtml_branch_coverage=1 00:31:47.461 --rc genhtml_function_coverage=1 00:31:47.461 --rc genhtml_legend=1 00:31:47.461 --rc geninfo_all_blocks=1 00:31:47.461 --rc geninfo_unexecuted_blocks=1 00:31:47.461 00:31:47.461 ' 00:31:47.461 01:26:01 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:47.461 01:26:01 -- nvmf/common.sh@7 -- # uname -s 00:31:47.461 01:26:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:47.461 01:26:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:47.461 01:26:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:47.461 01:26:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:47.461 01:26:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:47.461 01:26:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:47.461 01:26:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:47.461 01:26:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:47.461 01:26:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:47.461 01:26:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:47.461 01:26:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:47.461 01:26:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:47.461 01:26:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:47.461 01:26:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:47.461 01:26:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:47.461 01:26:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:47.461 01:26:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:47.461 01:26:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:47.461 01:26:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:47.461 01:26:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:47.461 01:26:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:47.461 01:26:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:47.461 01:26:01 -- paths/export.sh@5 -- # export PATH 00:31:47.461 01:26:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:47.461 01:26:01 -- nvmf/common.sh@46 -- # : 0 00:31:47.461 01:26:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:47.461 01:26:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:47.461 01:26:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:47.461 01:26:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:47.461 01:26:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:47.461 01:26:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:47.461 01:26:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:47.461 01:26:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:47.461 01:26:02 -- target/dif.sh@15 -- # NULL_META=16 00:31:47.461 01:26:02 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:31:47.461 01:26:02 -- target/dif.sh@15 -- # NULL_SIZE=64 00:31:47.461 01:26:02 -- target/dif.sh@15 -- # NULL_DIF=1 00:31:47.461 01:26:02 -- target/dif.sh@135 -- # nvmftestinit 00:31:47.461 01:26:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:47.461 01:26:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:47.461 01:26:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:47.461 01:26:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:47.461 01:26:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:47.461 01:26:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:47.461 01:26:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:47.461 01:26:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:47.461 01:26:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:47.461 01:26:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:47.461 01:26:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:47.461 01:26:02 -- common/autotest_common.sh@10 -- # set +x 00:31:49.365 01:26:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:49.365 01:26:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:49.365 01:26:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:49.365 01:26:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:49.365 01:26:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:49.365 01:26:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:49.365 01:26:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:49.365 01:26:03 -- nvmf/common.sh@294 -- # net_devs=() 00:31:49.365 01:26:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:49.365 01:26:03 -- nvmf/common.sh@295 -- # e810=() 00:31:49.365 01:26:03 -- nvmf/common.sh@295 -- # local -ga e810 00:31:49.365 01:26:03 -- nvmf/common.sh@296 -- # x722=() 00:31:49.365 01:26:03 -- nvmf/common.sh@296 -- # local -ga x722 00:31:49.365 01:26:03 -- nvmf/common.sh@297 -- # mlx=() 00:31:49.365 01:26:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:49.365 01:26:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:49.365 01:26:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:49.365 01:26:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:49.365 01:26:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:49.365 01:26:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:49.365 01:26:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:49.365 01:26:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:49.365 01:26:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:49.365 01:26:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:49.365 01:26:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:49.365 01:26:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:49.365 01:26:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:49.365 01:26:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:49.365 01:26:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:49.365 01:26:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:49.365 01:26:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:49.365 01:26:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:49.365 01:26:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:49.365 01:26:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:49.365 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:49.365 01:26:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:49.365 01:26:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:49.365 01:26:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:49.365 01:26:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:49.365 01:26:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:49.365 01:26:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:49.365 01:26:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:49.365 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:49.365 01:26:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:49.365 01:26:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:49.365 01:26:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:49.365 01:26:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:49.365 01:26:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:49.365 01:26:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:49.365 01:26:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:49.365 01:26:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:49.365 01:26:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:49.365 01:26:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:49.365 01:26:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:49.365 01:26:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:49.365 01:26:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:49.365 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:49.365 01:26:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:49.365 01:26:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:49.365 01:26:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:49.365 01:26:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:49.365 01:26:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:49.365 01:26:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:49.365 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:49.365 01:26:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:49.365 01:26:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:49.365 01:26:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:49.365 01:26:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:49.365 01:26:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:49.365 01:26:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:49.365 01:26:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:49.365 01:26:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:49.365 01:26:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:49.365 01:26:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:49.365 01:26:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:49.365 01:26:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:49.365 01:26:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:49.365 01:26:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:49.365 01:26:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:49.365 01:26:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:49.365 01:26:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:49.365 01:26:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:49.365 01:26:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:49.365 01:26:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:49.365 01:26:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:49.365 01:26:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:49.365 01:26:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:49.624 01:26:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:49.624 01:26:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:49.624 01:26:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:49.624 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:49.624 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.283 ms 00:31:49.624 00:31:49.624 --- 10.0.0.2 ping statistics --- 00:31:49.624 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:49.624 rtt min/avg/max/mdev = 0.283/0.283/0.283/0.000 ms 00:31:49.624 01:26:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:49.624 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:49.624 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:31:49.624 00:31:49.624 --- 10.0.0.1 ping statistics --- 00:31:49.624 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:49.624 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:31:49.624 01:26:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:49.624 01:26:04 -- nvmf/common.sh@410 -- # return 0 00:31:49.624 01:26:04 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:31:49.624 01:26:04 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:31:50.560 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:50.560 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:31:50.560 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:50.560 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:50.560 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:50.560 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:50.560 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:50.560 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:50.560 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:50.560 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:50.560 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:50.560 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:50.560 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:50.560 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:50.560 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:50.560 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:50.560 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:50.818 01:26:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:50.818 01:26:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:50.818 01:26:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:50.818 01:26:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:50.818 01:26:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:50.818 01:26:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:50.818 01:26:05 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:31:50.818 01:26:05 -- target/dif.sh@137 -- # nvmfappstart 00:31:50.818 01:26:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:50.818 01:26:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:50.818 01:26:05 -- common/autotest_common.sh@10 -- # set +x 00:31:50.818 01:26:05 -- nvmf/common.sh@469 -- # nvmfpid=2178687 00:31:50.818 01:26:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:31:50.818 01:26:05 -- nvmf/common.sh@470 -- # waitforlisten 2178687 00:31:50.818 01:26:05 -- common/autotest_common.sh@829 -- # '[' -z 2178687 ']' 00:31:50.818 01:26:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:50.818 01:26:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:50.818 01:26:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:50.818 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:50.818 01:26:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:50.818 01:26:05 -- common/autotest_common.sh@10 -- # set +x 00:31:50.818 [2024-11-28 01:26:05.345307] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:31:50.818 [2024-11-28 01:26:05.345392] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:50.818 EAL: No free 2048 kB hugepages reported on node 1 00:31:50.818 [2024-11-28 01:26:05.415147] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:51.076 [2024-11-28 01:26:05.504300] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:51.076 [2024-11-28 01:26:05.504461] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:51.076 [2024-11-28 01:26:05.504481] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:51.076 [2024-11-28 01:26:05.504495] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:51.076 [2024-11-28 01:26:05.504543] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:52.008 01:26:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:52.008 01:26:06 -- common/autotest_common.sh@862 -- # return 0 00:31:52.008 01:26:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:52.008 01:26:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:52.008 01:26:06 -- common/autotest_common.sh@10 -- # set +x 00:31:52.008 01:26:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:52.008 01:26:06 -- target/dif.sh@139 -- # create_transport 00:31:52.008 01:26:06 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:31:52.008 01:26:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.008 01:26:06 -- common/autotest_common.sh@10 -- # set +x 00:31:52.008 [2024-11-28 01:26:06.325118] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:52.008 01:26:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.008 01:26:06 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:31:52.008 01:26:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:52.008 01:26:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:52.008 01:26:06 -- common/autotest_common.sh@10 -- # set +x 00:31:52.008 ************************************ 00:31:52.008 START TEST fio_dif_1_default 00:31:52.008 ************************************ 00:31:52.008 01:26:06 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:31:52.008 01:26:06 -- target/dif.sh@86 -- # create_subsystems 0 00:31:52.008 01:26:06 -- target/dif.sh@28 -- # local sub 00:31:52.008 01:26:06 -- target/dif.sh@30 -- # for sub in "$@" 00:31:52.008 01:26:06 -- target/dif.sh@31 -- # create_subsystem 0 00:31:52.008 01:26:06 -- target/dif.sh@18 -- # local sub_id=0 00:31:52.008 01:26:06 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:52.008 01:26:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.008 01:26:06 -- common/autotest_common.sh@10 -- # set +x 00:31:52.008 bdev_null0 00:31:52.008 01:26:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.008 01:26:06 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:52.008 01:26:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.008 01:26:06 -- common/autotest_common.sh@10 -- # set +x 00:31:52.008 01:26:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.008 01:26:06 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:52.008 01:26:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.008 01:26:06 -- common/autotest_common.sh@10 -- # set +x 00:31:52.008 01:26:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.008 01:26:06 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:52.008 01:26:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.008 01:26:06 -- common/autotest_common.sh@10 -- # set +x 00:31:52.008 [2024-11-28 01:26:06.365374] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:52.008 01:26:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.008 01:26:06 -- target/dif.sh@87 -- # fio /dev/fd/62 00:31:52.008 01:26:06 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:31:52.008 01:26:06 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:52.008 01:26:06 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:52.008 01:26:06 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:52.008 01:26:06 -- nvmf/common.sh@520 -- # config=() 00:31:52.008 01:26:06 -- target/dif.sh@82 -- # gen_fio_conf 00:31:52.008 01:26:06 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:52.008 01:26:06 -- nvmf/common.sh@520 -- # local subsystem config 00:31:52.008 01:26:06 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:52.008 01:26:06 -- target/dif.sh@54 -- # local file 00:31:52.008 01:26:06 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:52.008 01:26:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:52.008 01:26:06 -- target/dif.sh@56 -- # cat 00:31:52.008 01:26:06 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:52.008 01:26:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:52.008 { 00:31:52.008 "params": { 00:31:52.008 "name": "Nvme$subsystem", 00:31:52.008 "trtype": "$TEST_TRANSPORT", 00:31:52.008 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:52.008 "adrfam": "ipv4", 00:31:52.008 "trsvcid": "$NVMF_PORT", 00:31:52.008 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:52.008 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:52.008 "hdgst": ${hdgst:-false}, 00:31:52.008 "ddgst": ${ddgst:-false} 00:31:52.008 }, 00:31:52.008 "method": "bdev_nvme_attach_controller" 00:31:52.008 } 00:31:52.008 EOF 00:31:52.008 )") 00:31:52.008 01:26:06 -- common/autotest_common.sh@1330 -- # shift 00:31:52.008 01:26:06 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:52.008 01:26:06 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:52.008 01:26:06 -- nvmf/common.sh@542 -- # cat 00:31:52.008 01:26:06 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:52.008 01:26:06 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:52.008 01:26:06 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:52.008 01:26:06 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:52.008 01:26:06 -- target/dif.sh@72 -- # (( file <= files )) 00:31:52.008 01:26:06 -- nvmf/common.sh@544 -- # jq . 00:31:52.008 01:26:06 -- nvmf/common.sh@545 -- # IFS=, 00:31:52.008 01:26:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:52.008 "params": { 00:31:52.008 "name": "Nvme0", 00:31:52.008 "trtype": "tcp", 00:31:52.008 "traddr": "10.0.0.2", 00:31:52.008 "adrfam": "ipv4", 00:31:52.008 "trsvcid": "4420", 00:31:52.008 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:52.008 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:52.008 "hdgst": false, 00:31:52.008 "ddgst": false 00:31:52.008 }, 00:31:52.008 "method": "bdev_nvme_attach_controller" 00:31:52.008 }' 00:31:52.008 01:26:06 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:52.008 01:26:06 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:52.008 01:26:06 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:52.008 01:26:06 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:52.008 01:26:06 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:52.008 01:26:06 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:52.008 01:26:06 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:52.008 01:26:06 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:52.008 01:26:06 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:52.008 01:26:06 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:52.266 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:52.266 fio-3.35 00:31:52.266 Starting 1 thread 00:31:52.266 EAL: No free 2048 kB hugepages reported on node 1 00:31:52.523 [2024-11-28 01:26:07.051124] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:52.523 [2024-11-28 01:26:07.051205] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:04.726 00:32:04.726 filename0: (groupid=0, jobs=1): err= 0: pid=2178952: Thu Nov 28 01:26:17 2024 00:32:04.726 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10007msec) 00:32:04.726 slat (nsec): min=4896, max=70511, avg=8674.03, stdev=3407.92 00:32:04.726 clat (usec): min=40787, max=43865, avg=40983.89, stdev=186.44 00:32:04.726 lat (usec): min=40794, max=43899, avg=40992.57, stdev=186.71 00:32:04.726 clat percentiles (usec): 00:32:04.726 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:32:04.726 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:32:04.726 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:32:04.726 | 99.00th=[41157], 99.50th=[41157], 99.90th=[43779], 99.95th=[43779], 00:32:04.726 | 99.99th=[43779] 00:32:04.726 bw ( KiB/s): min= 384, max= 416, per=99.46%, avg=388.80, stdev=11.72, samples=20 00:32:04.726 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:32:04.726 lat (msec) : 50=100.00% 00:32:04.726 cpu : usr=91.60%, sys=8.12%, ctx=24, majf=0, minf=195 00:32:04.726 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:04.726 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:04.726 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:04.726 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:04.726 latency : target=0, window=0, percentile=100.00%, depth=4 00:32:04.726 00:32:04.726 Run status group 0 (all jobs): 00:32:04.726 READ: bw=390KiB/s (399kB/s), 390KiB/s-390KiB/s (399kB/s-399kB/s), io=3904KiB (3998kB), run=10007-10007msec 00:32:04.726 01:26:17 -- target/dif.sh@88 -- # destroy_subsystems 0 00:32:04.726 01:26:17 -- target/dif.sh@43 -- # local sub 00:32:04.726 01:26:17 -- target/dif.sh@45 -- # for sub in "$@" 00:32:04.726 01:26:17 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:04.726 01:26:17 -- target/dif.sh@36 -- # local sub_id=0 00:32:04.726 01:26:17 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:04.726 01:26:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:04.726 01:26:17 -- common/autotest_common.sh@10 -- # set +x 00:32:04.726 01:26:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:04.726 01:26:17 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:04.726 01:26:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:04.726 01:26:17 -- common/autotest_common.sh@10 -- # set +x 00:32:04.726 01:26:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:04.726 00:32:04.726 real 0m11.058s 00:32:04.726 user 0m10.219s 00:32:04.726 sys 0m1.085s 00:32:04.726 01:26:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:04.726 01:26:17 -- common/autotest_common.sh@10 -- # set +x 00:32:04.726 ************************************ 00:32:04.726 END TEST fio_dif_1_default 00:32:04.726 ************************************ 00:32:04.726 01:26:17 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:32:04.726 01:26:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:04.726 01:26:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:04.726 01:26:17 -- common/autotest_common.sh@10 -- # set +x 00:32:04.726 ************************************ 00:32:04.726 START TEST fio_dif_1_multi_subsystems 00:32:04.726 ************************************ 00:32:04.726 01:26:17 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:32:04.726 01:26:17 -- target/dif.sh@92 -- # local files=1 00:32:04.726 01:26:17 -- target/dif.sh@94 -- # create_subsystems 0 1 00:32:04.726 01:26:17 -- target/dif.sh@28 -- # local sub 00:32:04.726 01:26:17 -- target/dif.sh@30 -- # for sub in "$@" 00:32:04.726 01:26:17 -- target/dif.sh@31 -- # create_subsystem 0 00:32:04.726 01:26:17 -- target/dif.sh@18 -- # local sub_id=0 00:32:04.726 01:26:17 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:32:04.726 01:26:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:04.726 01:26:17 -- common/autotest_common.sh@10 -- # set +x 00:32:04.726 bdev_null0 00:32:04.726 01:26:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:04.726 01:26:17 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:04.726 01:26:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:04.726 01:26:17 -- common/autotest_common.sh@10 -- # set +x 00:32:04.726 01:26:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:04.726 01:26:17 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:04.726 01:26:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:04.726 01:26:17 -- common/autotest_common.sh@10 -- # set +x 00:32:04.726 01:26:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:04.726 01:26:17 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:04.727 01:26:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:04.727 01:26:17 -- common/autotest_common.sh@10 -- # set +x 00:32:04.727 [2024-11-28 01:26:17.452381] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:04.727 01:26:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:04.727 01:26:17 -- target/dif.sh@30 -- # for sub in "$@" 00:32:04.727 01:26:17 -- target/dif.sh@31 -- # create_subsystem 1 00:32:04.727 01:26:17 -- target/dif.sh@18 -- # local sub_id=1 00:32:04.727 01:26:17 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:32:04.727 01:26:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:04.727 01:26:17 -- common/autotest_common.sh@10 -- # set +x 00:32:04.727 bdev_null1 00:32:04.727 01:26:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:04.727 01:26:17 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:04.727 01:26:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:04.727 01:26:17 -- common/autotest_common.sh@10 -- # set +x 00:32:04.727 01:26:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:04.727 01:26:17 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:04.727 01:26:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:04.727 01:26:17 -- common/autotest_common.sh@10 -- # set +x 00:32:04.727 01:26:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:04.727 01:26:17 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:04.727 01:26:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:04.727 01:26:17 -- common/autotest_common.sh@10 -- # set +x 00:32:04.727 01:26:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:04.727 01:26:17 -- target/dif.sh@95 -- # fio /dev/fd/62 00:32:04.727 01:26:17 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:32:04.727 01:26:17 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:32:04.727 01:26:17 -- nvmf/common.sh@520 -- # config=() 00:32:04.727 01:26:17 -- nvmf/common.sh@520 -- # local subsystem config 00:32:04.727 01:26:17 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:04.727 01:26:17 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:04.727 01:26:17 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:04.727 { 00:32:04.727 "params": { 00:32:04.727 "name": "Nvme$subsystem", 00:32:04.727 "trtype": "$TEST_TRANSPORT", 00:32:04.727 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:04.727 "adrfam": "ipv4", 00:32:04.727 "trsvcid": "$NVMF_PORT", 00:32:04.727 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:04.727 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:04.727 "hdgst": ${hdgst:-false}, 00:32:04.727 "ddgst": ${ddgst:-false} 00:32:04.727 }, 00:32:04.727 "method": "bdev_nvme_attach_controller" 00:32:04.727 } 00:32:04.727 EOF 00:32:04.727 )") 00:32:04.727 01:26:17 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:04.727 01:26:17 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:04.727 01:26:17 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:04.727 01:26:17 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:04.727 01:26:17 -- target/dif.sh@82 -- # gen_fio_conf 00:32:04.727 01:26:17 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:04.727 01:26:17 -- common/autotest_common.sh@1330 -- # shift 00:32:04.727 01:26:17 -- target/dif.sh@54 -- # local file 00:32:04.727 01:26:17 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:04.727 01:26:17 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:04.727 01:26:17 -- target/dif.sh@56 -- # cat 00:32:04.727 01:26:17 -- nvmf/common.sh@542 -- # cat 00:32:04.727 01:26:17 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:04.727 01:26:17 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:04.727 01:26:17 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:04.727 01:26:17 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:04.727 01:26:17 -- target/dif.sh@72 -- # (( file <= files )) 00:32:04.727 01:26:17 -- target/dif.sh@73 -- # cat 00:32:04.727 01:26:17 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:04.727 01:26:17 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:04.727 { 00:32:04.727 "params": { 00:32:04.727 "name": "Nvme$subsystem", 00:32:04.727 "trtype": "$TEST_TRANSPORT", 00:32:04.727 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:04.727 "adrfam": "ipv4", 00:32:04.727 "trsvcid": "$NVMF_PORT", 00:32:04.727 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:04.727 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:04.727 "hdgst": ${hdgst:-false}, 00:32:04.727 "ddgst": ${ddgst:-false} 00:32:04.727 }, 00:32:04.727 "method": "bdev_nvme_attach_controller" 00:32:04.727 } 00:32:04.727 EOF 00:32:04.727 )") 00:32:04.727 01:26:17 -- nvmf/common.sh@542 -- # cat 00:32:04.727 01:26:17 -- target/dif.sh@72 -- # (( file++ )) 00:32:04.727 01:26:17 -- target/dif.sh@72 -- # (( file <= files )) 00:32:04.727 01:26:17 -- nvmf/common.sh@544 -- # jq . 00:32:04.727 01:26:17 -- nvmf/common.sh@545 -- # IFS=, 00:32:04.727 01:26:17 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:04.727 "params": { 00:32:04.727 "name": "Nvme0", 00:32:04.727 "trtype": "tcp", 00:32:04.727 "traddr": "10.0.0.2", 00:32:04.727 "adrfam": "ipv4", 00:32:04.727 "trsvcid": "4420", 00:32:04.727 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:04.727 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:04.727 "hdgst": false, 00:32:04.727 "ddgst": false 00:32:04.727 }, 00:32:04.727 "method": "bdev_nvme_attach_controller" 00:32:04.727 },{ 00:32:04.727 "params": { 00:32:04.727 "name": "Nvme1", 00:32:04.727 "trtype": "tcp", 00:32:04.727 "traddr": "10.0.0.2", 00:32:04.727 "adrfam": "ipv4", 00:32:04.727 "trsvcid": "4420", 00:32:04.727 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:04.727 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:04.727 "hdgst": false, 00:32:04.727 "ddgst": false 00:32:04.727 }, 00:32:04.727 "method": "bdev_nvme_attach_controller" 00:32:04.727 }' 00:32:04.727 01:26:17 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:04.727 01:26:17 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:04.727 01:26:17 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:04.727 01:26:17 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:04.727 01:26:17 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:04.727 01:26:17 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:04.727 01:26:17 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:04.727 01:26:17 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:04.727 01:26:17 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:04.727 01:26:17 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:04.727 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:32:04.727 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:32:04.727 fio-3.35 00:32:04.727 Starting 2 threads 00:32:04.727 EAL: No free 2048 kB hugepages reported on node 1 00:32:04.727 [2024-11-28 01:26:18.230834] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:04.727 [2024-11-28 01:26:18.230921] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:14.697 00:32:14.697 filename0: (groupid=0, jobs=1): err= 0: pid=2180367: Thu Nov 28 01:26:28 2024 00:32:14.697 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10010msec) 00:32:14.697 slat (nsec): min=7043, max=27426, avg=8783.47, stdev=2489.09 00:32:14.697 clat (usec): min=40807, max=43811, avg=40996.37, stdev=229.31 00:32:14.697 lat (usec): min=40815, max=43838, avg=41005.16, stdev=229.81 00:32:14.697 clat percentiles (usec): 00:32:14.697 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:32:14.697 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:32:14.697 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:32:14.697 | 99.00th=[42206], 99.50th=[42730], 99.90th=[43779], 99.95th=[43779], 00:32:14.697 | 99.99th=[43779] 00:32:14.697 bw ( KiB/s): min= 384, max= 416, per=49.74%, avg=388.80, stdev=11.72, samples=20 00:32:14.697 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:32:14.697 lat (msec) : 50=100.00% 00:32:14.697 cpu : usr=95.71%, sys=3.98%, ctx=17, majf=0, minf=60 00:32:14.697 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:14.697 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:14.697 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:14.697 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:14.697 latency : target=0, window=0, percentile=100.00%, depth=4 00:32:14.697 filename1: (groupid=0, jobs=1): err= 0: pid=2180368: Thu Nov 28 01:26:28 2024 00:32:14.697 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10008msec) 00:32:14.698 slat (nsec): min=6827, max=65056, avg=8858.02, stdev=3070.60 00:32:14.698 clat (usec): min=40778, max=43810, avg=40987.74, stdev=192.28 00:32:14.698 lat (usec): min=40785, max=43837, avg=40996.59, stdev=192.67 00:32:14.698 clat percentiles (usec): 00:32:14.698 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:32:14.698 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:32:14.698 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:32:14.698 | 99.00th=[41157], 99.50th=[42206], 99.90th=[43779], 99.95th=[43779], 00:32:14.698 | 99.99th=[43779] 00:32:14.698 bw ( KiB/s): min= 384, max= 416, per=49.74%, avg=388.80, stdev=11.72, samples=20 00:32:14.698 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:32:14.698 lat (msec) : 50=100.00% 00:32:14.698 cpu : usr=95.71%, sys=3.98%, ctx=23, majf=0, minf=268 00:32:14.698 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:14.698 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:14.698 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:14.698 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:14.698 latency : target=0, window=0, percentile=100.00%, depth=4 00:32:14.698 00:32:14.698 Run status group 0 (all jobs): 00:32:14.698 READ: bw=780KiB/s (799kB/s), 390KiB/s-390KiB/s (399kB/s-399kB/s), io=7808KiB (7995kB), run=10008-10010msec 00:32:14.698 01:26:28 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:32:14.698 01:26:28 -- target/dif.sh@43 -- # local sub 00:32:14.698 01:26:28 -- target/dif.sh@45 -- # for sub in "$@" 00:32:14.698 01:26:28 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:14.698 01:26:28 -- target/dif.sh@36 -- # local sub_id=0 00:32:14.698 01:26:28 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:14.698 01:26:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:14.698 01:26:28 -- common/autotest_common.sh@10 -- # set +x 00:32:14.698 01:26:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:14.698 01:26:28 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:14.698 01:26:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:14.698 01:26:28 -- common/autotest_common.sh@10 -- # set +x 00:32:14.698 01:26:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:14.698 01:26:28 -- target/dif.sh@45 -- # for sub in "$@" 00:32:14.698 01:26:28 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:14.698 01:26:28 -- target/dif.sh@36 -- # local sub_id=1 00:32:14.698 01:26:28 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:14.698 01:26:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:14.698 01:26:28 -- common/autotest_common.sh@10 -- # set +x 00:32:14.698 01:26:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:14.698 01:26:28 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:14.698 01:26:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:14.698 01:26:28 -- common/autotest_common.sh@10 -- # set +x 00:32:14.698 01:26:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:14.698 00:32:14.698 real 0m11.167s 00:32:14.698 user 0m20.456s 00:32:14.698 sys 0m1.079s 00:32:14.698 01:26:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:14.698 01:26:28 -- common/autotest_common.sh@10 -- # set +x 00:32:14.698 ************************************ 00:32:14.698 END TEST fio_dif_1_multi_subsystems 00:32:14.698 ************************************ 00:32:14.698 01:26:28 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:32:14.698 01:26:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:14.698 01:26:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:14.698 01:26:28 -- common/autotest_common.sh@10 -- # set +x 00:32:14.698 ************************************ 00:32:14.698 START TEST fio_dif_rand_params 00:32:14.698 ************************************ 00:32:14.698 01:26:28 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:32:14.698 01:26:28 -- target/dif.sh@100 -- # local NULL_DIF 00:32:14.698 01:26:28 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:32:14.698 01:26:28 -- target/dif.sh@103 -- # NULL_DIF=3 00:32:14.698 01:26:28 -- target/dif.sh@103 -- # bs=128k 00:32:14.698 01:26:28 -- target/dif.sh@103 -- # numjobs=3 00:32:14.698 01:26:28 -- target/dif.sh@103 -- # iodepth=3 00:32:14.698 01:26:28 -- target/dif.sh@103 -- # runtime=5 00:32:14.698 01:26:28 -- target/dif.sh@105 -- # create_subsystems 0 00:32:14.698 01:26:28 -- target/dif.sh@28 -- # local sub 00:32:14.698 01:26:28 -- target/dif.sh@30 -- # for sub in "$@" 00:32:14.698 01:26:28 -- target/dif.sh@31 -- # create_subsystem 0 00:32:14.698 01:26:28 -- target/dif.sh@18 -- # local sub_id=0 00:32:14.698 01:26:28 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:32:14.698 01:26:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:14.698 01:26:28 -- common/autotest_common.sh@10 -- # set +x 00:32:14.698 bdev_null0 00:32:14.698 01:26:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:14.698 01:26:28 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:14.698 01:26:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:14.698 01:26:28 -- common/autotest_common.sh@10 -- # set +x 00:32:14.698 01:26:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:14.698 01:26:28 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:14.698 01:26:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:14.698 01:26:28 -- common/autotest_common.sh@10 -- # set +x 00:32:14.698 01:26:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:14.698 01:26:28 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:14.698 01:26:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:14.698 01:26:28 -- common/autotest_common.sh@10 -- # set +x 00:32:14.698 [2024-11-28 01:26:28.644378] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:14.698 01:26:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:14.698 01:26:28 -- target/dif.sh@106 -- # fio /dev/fd/62 00:32:14.698 01:26:28 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:32:14.698 01:26:28 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:14.698 01:26:28 -- nvmf/common.sh@520 -- # config=() 00:32:14.698 01:26:28 -- nvmf/common.sh@520 -- # local subsystem config 00:32:14.698 01:26:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:14.698 01:26:28 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:14.698 01:26:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:14.698 { 00:32:14.698 "params": { 00:32:14.698 "name": "Nvme$subsystem", 00:32:14.698 "trtype": "$TEST_TRANSPORT", 00:32:14.698 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:14.698 "adrfam": "ipv4", 00:32:14.698 "trsvcid": "$NVMF_PORT", 00:32:14.698 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:14.698 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:14.698 "hdgst": ${hdgst:-false}, 00:32:14.698 "ddgst": ${ddgst:-false} 00:32:14.698 }, 00:32:14.698 "method": "bdev_nvme_attach_controller" 00:32:14.698 } 00:32:14.698 EOF 00:32:14.698 )") 00:32:14.698 01:26:28 -- target/dif.sh@82 -- # gen_fio_conf 00:32:14.698 01:26:28 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:14.698 01:26:28 -- target/dif.sh@54 -- # local file 00:32:14.698 01:26:28 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:14.698 01:26:28 -- target/dif.sh@56 -- # cat 00:32:14.698 01:26:28 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:14.698 01:26:28 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:14.698 01:26:28 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:14.698 01:26:28 -- common/autotest_common.sh@1330 -- # shift 00:32:14.698 01:26:28 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:14.698 01:26:28 -- nvmf/common.sh@542 -- # cat 00:32:14.698 01:26:28 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:14.698 01:26:28 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:14.698 01:26:28 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:14.698 01:26:28 -- target/dif.sh@72 -- # (( file <= files )) 00:32:14.698 01:26:28 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:14.698 01:26:28 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:14.698 01:26:28 -- nvmf/common.sh@544 -- # jq . 00:32:14.698 01:26:28 -- nvmf/common.sh@545 -- # IFS=, 00:32:14.698 01:26:28 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:14.698 "params": { 00:32:14.698 "name": "Nvme0", 00:32:14.698 "trtype": "tcp", 00:32:14.698 "traddr": "10.0.0.2", 00:32:14.698 "adrfam": "ipv4", 00:32:14.698 "trsvcid": "4420", 00:32:14.698 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:14.698 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:14.698 "hdgst": false, 00:32:14.698 "ddgst": false 00:32:14.698 }, 00:32:14.698 "method": "bdev_nvme_attach_controller" 00:32:14.698 }' 00:32:14.698 01:26:28 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:14.698 01:26:28 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:14.698 01:26:28 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:14.698 01:26:28 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:14.698 01:26:28 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:14.698 01:26:28 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:14.698 01:26:28 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:14.698 01:26:28 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:14.698 01:26:28 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:14.698 01:26:28 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:14.698 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:32:14.698 ... 00:32:14.698 fio-3.35 00:32:14.698 Starting 3 threads 00:32:14.698 EAL: No free 2048 kB hugepages reported on node 1 00:32:14.957 [2024-11-28 01:26:29.423809] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:14.957 [2024-11-28 01:26:29.423884] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:20.226 00:32:20.226 filename0: (groupid=0, jobs=1): err= 0: pid=2181806: Thu Nov 28 01:26:34 2024 00:32:20.226 read: IOPS=217, BW=27.2MiB/s (28.5MB/s)(136MiB/5004msec) 00:32:20.226 slat (usec): min=4, max=100, avg=12.20, stdev= 3.28 00:32:20.226 clat (usec): min=5141, max=56089, avg=13791.13, stdev=9404.91 00:32:20.226 lat (usec): min=5152, max=56102, avg=13803.33, stdev=9405.10 00:32:20.226 clat percentiles (usec): 00:32:20.226 | 1.00th=[ 5407], 5.00th=[ 7373], 10.00th=[ 8356], 20.00th=[ 9372], 00:32:20.226 | 30.00th=[10290], 40.00th=[11207], 50.00th=[11863], 60.00th=[12518], 00:32:20.226 | 70.00th=[13435], 80.00th=[14222], 90.00th=[15795], 95.00th=[48497], 00:32:20.226 | 99.00th=[52691], 99.50th=[53740], 99.90th=[55837], 99.95th=[55837], 00:32:20.226 | 99.99th=[55837] 00:32:20.226 bw ( KiB/s): min=23808, max=33792, per=32.00%, avg=27755.90, stdev=3060.96, samples=10 00:32:20.226 iops : min= 186, max= 264, avg=216.80, stdev=23.91, samples=10 00:32:20.226 lat (msec) : 10=25.39%, 20=69.09%, 50=1.47%, 100=4.05% 00:32:20.226 cpu : usr=93.16%, sys=6.36%, ctx=14, majf=0, minf=120 00:32:20.226 IO depths : 1=0.4%, 2=99.6%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:20.226 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:20.226 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:20.226 issued rwts: total=1087,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:20.226 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:20.226 filename0: (groupid=0, jobs=1): err= 0: pid=2181807: Thu Nov 28 01:26:34 2024 00:32:20.226 read: IOPS=242, BW=30.3MiB/s (31.8MB/s)(153MiB/5043msec) 00:32:20.226 slat (nsec): min=6631, max=31780, avg=12339.78, stdev=1749.01 00:32:20.226 clat (usec): min=4980, max=55381, avg=12319.91, stdev=6366.37 00:32:20.226 lat (usec): min=4992, max=55394, avg=12332.25, stdev=6366.35 00:32:20.226 clat percentiles (usec): 00:32:20.226 | 1.00th=[ 5276], 5.00th=[ 6128], 10.00th=[ 7635], 20.00th=[ 8717], 00:32:20.226 | 30.00th=[ 9765], 40.00th=[11076], 50.00th=[11994], 60.00th=[12780], 00:32:20.226 | 70.00th=[13435], 80.00th=[14222], 90.00th=[15270], 95.00th=[16319], 00:32:20.226 | 99.00th=[51643], 99.50th=[52167], 99.90th=[53740], 99.95th=[55313], 00:32:20.226 | 99.99th=[55313] 00:32:20.226 bw ( KiB/s): min=23552, max=36352, per=36.03%, avg=31257.60, stdev=3710.68, samples=10 00:32:20.226 iops : min= 184, max= 284, avg=244.20, stdev=28.99, samples=10 00:32:20.226 lat (msec) : 10=31.89%, 20=65.99%, 50=0.65%, 100=1.47% 00:32:20.226 cpu : usr=92.19%, sys=7.34%, ctx=12, majf=0, minf=102 00:32:20.226 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:20.226 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:20.226 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:20.226 issued rwts: total=1223,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:20.226 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:20.226 filename0: (groupid=0, jobs=1): err= 0: pid=2181808: Thu Nov 28 01:26:34 2024 00:32:20.226 read: IOPS=219, BW=27.5MiB/s (28.8MB/s)(139MiB/5045msec) 00:32:20.226 slat (usec): min=4, max=109, avg=12.42, stdev= 3.52 00:32:20.226 clat (usec): min=4743, max=55985, avg=13590.52, stdev=9689.71 00:32:20.226 lat (usec): min=4755, max=55997, avg=13602.94, stdev=9689.63 00:32:20.226 clat percentiles (usec): 00:32:20.226 | 1.00th=[ 5669], 5.00th=[ 7046], 10.00th=[ 8029], 20.00th=[ 9110], 00:32:20.226 | 30.00th=[10159], 40.00th=[10814], 50.00th=[11469], 60.00th=[12125], 00:32:20.226 | 70.00th=[12911], 80.00th=[13829], 90.00th=[15533], 95.00th=[48497], 00:32:20.226 | 99.00th=[52691], 99.50th=[53740], 99.90th=[54789], 99.95th=[55837], 00:32:20.226 | 99.99th=[55837] 00:32:20.226 bw ( KiB/s): min=21248, max=33024, per=32.67%, avg=28339.20, stdev=3549.39, samples=10 00:32:20.226 iops : min= 166, max= 258, avg=221.40, stdev=27.73, samples=10 00:32:20.226 lat (msec) : 10=28.22%, 20=65.64%, 50=1.89%, 100=4.24% 00:32:20.226 cpu : usr=92.78%, sys=6.74%, ctx=18, majf=0, minf=120 00:32:20.226 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:20.226 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:20.226 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:20.226 issued rwts: total=1109,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:20.226 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:20.226 00:32:20.226 Run status group 0 (all jobs): 00:32:20.226 READ: bw=84.7MiB/s (88.8MB/s), 27.2MiB/s-30.3MiB/s (28.5MB/s-31.8MB/s), io=427MiB (448MB), run=5004-5045msec 00:32:20.226 01:26:34 -- target/dif.sh@107 -- # destroy_subsystems 0 00:32:20.226 01:26:34 -- target/dif.sh@43 -- # local sub 00:32:20.226 01:26:34 -- target/dif.sh@45 -- # for sub in "$@" 00:32:20.226 01:26:34 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:20.226 01:26:34 -- target/dif.sh@36 -- # local sub_id=0 00:32:20.226 01:26:34 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:20.226 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:20.226 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:32:20.226 01:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:20.226 01:26:34 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:20.226 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:20.226 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:32:20.226 01:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:20.226 01:26:34 -- target/dif.sh@109 -- # NULL_DIF=2 00:32:20.226 01:26:34 -- target/dif.sh@109 -- # bs=4k 00:32:20.226 01:26:34 -- target/dif.sh@109 -- # numjobs=8 00:32:20.226 01:26:34 -- target/dif.sh@109 -- # iodepth=16 00:32:20.226 01:26:34 -- target/dif.sh@109 -- # runtime= 00:32:20.226 01:26:34 -- target/dif.sh@109 -- # files=2 00:32:20.226 01:26:34 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:32:20.226 01:26:34 -- target/dif.sh@28 -- # local sub 00:32:20.226 01:26:34 -- target/dif.sh@30 -- # for sub in "$@" 00:32:20.226 01:26:34 -- target/dif.sh@31 -- # create_subsystem 0 00:32:20.226 01:26:34 -- target/dif.sh@18 -- # local sub_id=0 00:32:20.226 01:26:34 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:32:20.226 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:20.226 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:32:20.226 bdev_null0 00:32:20.226 01:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:20.226 01:26:34 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:20.226 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:20.226 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:32:20.226 01:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:20.226 01:26:34 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:20.226 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:20.226 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:32:20.226 01:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:20.226 01:26:34 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:20.226 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:20.226 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:32:20.226 [2024-11-28 01:26:34.827038] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:20.485 01:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:20.485 01:26:34 -- target/dif.sh@30 -- # for sub in "$@" 00:32:20.485 01:26:34 -- target/dif.sh@31 -- # create_subsystem 1 00:32:20.485 01:26:34 -- target/dif.sh@18 -- # local sub_id=1 00:32:20.485 01:26:34 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:32:20.485 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:20.485 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:32:20.485 bdev_null1 00:32:20.485 01:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:20.485 01:26:34 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:20.485 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:20.485 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:32:20.485 01:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:20.485 01:26:34 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:20.485 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:20.485 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:32:20.485 01:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:20.485 01:26:34 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:20.485 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:20.485 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:32:20.485 01:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:20.485 01:26:34 -- target/dif.sh@30 -- # for sub in "$@" 00:32:20.485 01:26:34 -- target/dif.sh@31 -- # create_subsystem 2 00:32:20.485 01:26:34 -- target/dif.sh@18 -- # local sub_id=2 00:32:20.485 01:26:34 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:32:20.485 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:20.485 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:32:20.485 bdev_null2 00:32:20.485 01:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:20.485 01:26:34 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:32:20.485 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:20.485 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:32:20.485 01:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:20.485 01:26:34 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:32:20.485 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:20.485 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:32:20.485 01:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:20.485 01:26:34 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:32:20.485 01:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:20.485 01:26:34 -- common/autotest_common.sh@10 -- # set +x 00:32:20.485 01:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:20.485 01:26:34 -- target/dif.sh@112 -- # fio /dev/fd/62 00:32:20.485 01:26:34 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:32:20.485 01:26:34 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:32:20.485 01:26:34 -- nvmf/common.sh@520 -- # config=() 00:32:20.485 01:26:34 -- nvmf/common.sh@520 -- # local subsystem config 00:32:20.485 01:26:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:20.486 01:26:34 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:20.486 01:26:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:20.486 { 00:32:20.486 "params": { 00:32:20.486 "name": "Nvme$subsystem", 00:32:20.486 "trtype": "$TEST_TRANSPORT", 00:32:20.486 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:20.486 "adrfam": "ipv4", 00:32:20.486 "trsvcid": "$NVMF_PORT", 00:32:20.486 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:20.486 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:20.486 "hdgst": ${hdgst:-false}, 00:32:20.486 "ddgst": ${ddgst:-false} 00:32:20.486 }, 00:32:20.486 "method": "bdev_nvme_attach_controller" 00:32:20.486 } 00:32:20.486 EOF 00:32:20.486 )") 00:32:20.486 01:26:34 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:20.486 01:26:34 -- target/dif.sh@82 -- # gen_fio_conf 00:32:20.486 01:26:34 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:20.486 01:26:34 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:20.486 01:26:34 -- target/dif.sh@54 -- # local file 00:32:20.486 01:26:34 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:20.486 01:26:34 -- target/dif.sh@56 -- # cat 00:32:20.486 01:26:34 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:20.486 01:26:34 -- common/autotest_common.sh@1330 -- # shift 00:32:20.486 01:26:34 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:20.486 01:26:34 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:20.486 01:26:34 -- nvmf/common.sh@542 -- # cat 00:32:20.486 01:26:34 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:20.486 01:26:34 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:20.486 01:26:34 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:20.486 01:26:34 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:20.486 01:26:34 -- target/dif.sh@72 -- # (( file <= files )) 00:32:20.486 01:26:34 -- target/dif.sh@73 -- # cat 00:32:20.486 01:26:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:20.486 01:26:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:20.486 { 00:32:20.486 "params": { 00:32:20.486 "name": "Nvme$subsystem", 00:32:20.486 "trtype": "$TEST_TRANSPORT", 00:32:20.486 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:20.486 "adrfam": "ipv4", 00:32:20.486 "trsvcid": "$NVMF_PORT", 00:32:20.486 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:20.486 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:20.486 "hdgst": ${hdgst:-false}, 00:32:20.486 "ddgst": ${ddgst:-false} 00:32:20.486 }, 00:32:20.486 "method": "bdev_nvme_attach_controller" 00:32:20.486 } 00:32:20.486 EOF 00:32:20.486 )") 00:32:20.486 01:26:34 -- nvmf/common.sh@542 -- # cat 00:32:20.486 01:26:34 -- target/dif.sh@72 -- # (( file++ )) 00:32:20.486 01:26:34 -- target/dif.sh@72 -- # (( file <= files )) 00:32:20.486 01:26:34 -- target/dif.sh@73 -- # cat 00:32:20.486 01:26:34 -- target/dif.sh@72 -- # (( file++ )) 00:32:20.486 01:26:34 -- target/dif.sh@72 -- # (( file <= files )) 00:32:20.486 01:26:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:20.486 01:26:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:20.486 { 00:32:20.486 "params": { 00:32:20.486 "name": "Nvme$subsystem", 00:32:20.486 "trtype": "$TEST_TRANSPORT", 00:32:20.486 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:20.486 "adrfam": "ipv4", 00:32:20.486 "trsvcid": "$NVMF_PORT", 00:32:20.486 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:20.486 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:20.486 "hdgst": ${hdgst:-false}, 00:32:20.486 "ddgst": ${ddgst:-false} 00:32:20.486 }, 00:32:20.486 "method": "bdev_nvme_attach_controller" 00:32:20.486 } 00:32:20.486 EOF 00:32:20.486 )") 00:32:20.486 01:26:34 -- nvmf/common.sh@542 -- # cat 00:32:20.486 01:26:34 -- nvmf/common.sh@544 -- # jq . 00:32:20.486 01:26:34 -- nvmf/common.sh@545 -- # IFS=, 00:32:20.486 01:26:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:20.486 "params": { 00:32:20.486 "name": "Nvme0", 00:32:20.486 "trtype": "tcp", 00:32:20.486 "traddr": "10.0.0.2", 00:32:20.486 "adrfam": "ipv4", 00:32:20.486 "trsvcid": "4420", 00:32:20.486 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:20.486 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:20.486 "hdgst": false, 00:32:20.486 "ddgst": false 00:32:20.486 }, 00:32:20.486 "method": "bdev_nvme_attach_controller" 00:32:20.486 },{ 00:32:20.486 "params": { 00:32:20.486 "name": "Nvme1", 00:32:20.486 "trtype": "tcp", 00:32:20.486 "traddr": "10.0.0.2", 00:32:20.486 "adrfam": "ipv4", 00:32:20.486 "trsvcid": "4420", 00:32:20.486 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:20.486 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:20.486 "hdgst": false, 00:32:20.486 "ddgst": false 00:32:20.486 }, 00:32:20.486 "method": "bdev_nvme_attach_controller" 00:32:20.486 },{ 00:32:20.486 "params": { 00:32:20.486 "name": "Nvme2", 00:32:20.486 "trtype": "tcp", 00:32:20.486 "traddr": "10.0.0.2", 00:32:20.486 "adrfam": "ipv4", 00:32:20.486 "trsvcid": "4420", 00:32:20.486 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:32:20.486 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:32:20.486 "hdgst": false, 00:32:20.486 "ddgst": false 00:32:20.486 }, 00:32:20.486 "method": "bdev_nvme_attach_controller" 00:32:20.486 }' 00:32:20.486 01:26:34 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:20.486 01:26:34 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:20.486 01:26:34 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:20.486 01:26:34 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:20.486 01:26:34 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:20.486 01:26:34 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:20.486 01:26:34 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:20.486 01:26:34 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:20.486 01:26:34 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:20.486 01:26:34 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:20.744 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:20.744 ... 00:32:20.744 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:20.744 ... 00:32:20.744 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:20.744 ... 00:32:20.744 fio-3.35 00:32:20.744 Starting 24 threads 00:32:20.744 EAL: No free 2048 kB hugepages reported on node 1 00:32:21.678 [2024-11-28 01:26:36.014383] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:21.678 [2024-11-28 01:26:36.014432] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:31.731 00:32:31.731 filename0: (groupid=0, jobs=1): err= 0: pid=2182695: Thu Nov 28 01:26:46 2024 00:32:31.731 read: IOPS=474, BW=1899KiB/s (1945kB/s)(18.6MiB/10009msec) 00:32:31.731 slat (usec): min=8, max=126, avg=39.24, stdev=16.04 00:32:31.731 clat (msec): min=10, max=453, avg=33.39, stdev=17.66 00:32:31.731 lat (msec): min=10, max=453, avg=33.43, stdev=17.66 00:32:31.731 clat percentiles (msec): 00:32:31.731 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.731 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 33], 00:32:31.731 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.731 | 99.00th=[ 41], 99.50th=[ 220], 99.90th=[ 247], 99.95th=[ 247], 00:32:31.731 | 99.99th=[ 456] 00:32:31.731 bw ( KiB/s): min= 384, max= 2048, per=4.15%, avg=1894.40, stdev=361.08, samples=20 00:32:31.731 iops : min= 96, max= 512, avg=473.60, stdev=90.27, samples=20 00:32:31.731 lat (msec) : 20=0.04%, 50=99.33%, 250=0.59%, 500=0.04% 00:32:31.731 cpu : usr=98.75%, sys=0.85%, ctx=14, majf=0, minf=50 00:32:31.731 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:32:31.731 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.731 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.731 issued rwts: total=4752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.731 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.731 filename0: (groupid=0, jobs=1): err= 0: pid=2182696: Thu Nov 28 01:26:46 2024 00:32:31.731 read: IOPS=474, BW=1899KiB/s (1945kB/s)(18.6MiB/10009msec) 00:32:31.731 slat (usec): min=7, max=151, avg=45.85, stdev=22.65 00:32:31.731 clat (msec): min=15, max=444, avg=33.22, stdev=23.96 00:32:31.731 lat (msec): min=15, max=444, avg=33.27, stdev=23.96 00:32:31.731 clat percentiles (msec): 00:32:31.731 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.731 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:31.731 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.731 | 99.00th=[ 39], 99.50th=[ 41], 99.90th=[ 447], 99.95th=[ 447], 00:32:31.731 | 99.99th=[ 447] 00:32:31.731 bw ( KiB/s): min= 256, max= 2048, per=4.15%, avg=1894.40, stdev=390.90, samples=20 00:32:31.731 iops : min= 64, max= 512, avg=473.60, stdev=97.72, samples=20 00:32:31.731 lat (msec) : 20=0.34%, 50=99.33%, 500=0.34% 00:32:31.731 cpu : usr=93.84%, sys=2.96%, ctx=145, majf=0, minf=29 00:32:31.731 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:31.731 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.731 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.731 issued rwts: total=4752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.731 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.731 filename0: (groupid=0, jobs=1): err= 0: pid=2182697: Thu Nov 28 01:26:46 2024 00:32:31.731 read: IOPS=474, BW=1899KiB/s (1944kB/s)(18.6MiB/10012msec) 00:32:31.731 slat (usec): min=10, max=109, avg=44.96, stdev=12.69 00:32:31.731 clat (msec): min=28, max=265, avg=33.32, stdev=16.60 00:32:31.731 lat (msec): min=28, max=265, avg=33.37, stdev=16.60 00:32:31.731 clat percentiles (msec): 00:32:31.731 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.731 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:31.731 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.731 | 99.00th=[ 41], 99.50th=[ 199], 99.90th=[ 266], 99.95th=[ 266], 00:32:31.731 | 99.99th=[ 266] 00:32:31.731 bw ( KiB/s): min= 384, max= 2048, per=4.15%, avg=1894.40, stdev=361.08, samples=20 00:32:31.731 iops : min= 96, max= 512, avg=473.60, stdev=90.27, samples=20 00:32:31.731 lat (msec) : 50=99.33%, 250=0.34%, 500=0.34% 00:32:31.731 cpu : usr=94.93%, sys=2.63%, ctx=293, majf=0, minf=30 00:32:31.731 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:32:31.731 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.731 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.731 issued rwts: total=4752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.731 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.731 filename0: (groupid=0, jobs=1): err= 0: pid=2182698: Thu Nov 28 01:26:46 2024 00:32:31.731 read: IOPS=474, BW=1899KiB/s (1944kB/s)(18.6MiB/10012msec) 00:32:31.731 slat (usec): min=9, max=160, avg=57.77, stdev=24.20 00:32:31.731 clat (msec): min=23, max=265, avg=33.21, stdev=16.61 00:32:31.731 lat (msec): min=23, max=265, avg=33.27, stdev=16.61 00:32:31.731 clat percentiles (msec): 00:32:31.731 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.731 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:31.731 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.731 | 99.00th=[ 41], 99.50th=[ 199], 99.90th=[ 266], 99.95th=[ 266], 00:32:31.731 | 99.99th=[ 266] 00:32:31.731 bw ( KiB/s): min= 384, max= 2048, per=4.15%, avg=1894.40, stdev=361.08, samples=20 00:32:31.731 iops : min= 96, max= 512, avg=473.60, stdev=90.27, samples=20 00:32:31.731 lat (msec) : 50=99.33%, 250=0.34%, 500=0.34% 00:32:31.731 cpu : usr=94.23%, sys=2.94%, ctx=354, majf=0, minf=40 00:32:31.731 IO depths : 1=6.0%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:32:31.731 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.731 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.731 issued rwts: total=4752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.731 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.731 filename0: (groupid=0, jobs=1): err= 0: pid=2182699: Thu Nov 28 01:26:46 2024 00:32:31.731 read: IOPS=474, BW=1899KiB/s (1944kB/s)(18.6MiB/10012msec) 00:32:31.731 slat (usec): min=8, max=169, avg=47.64, stdev=21.46 00:32:31.731 clat (msec): min=28, max=266, avg=33.28, stdev=16.58 00:32:31.731 lat (msec): min=28, max=266, avg=33.33, stdev=16.58 00:32:31.731 clat percentiles (msec): 00:32:31.731 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.731 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:31.731 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.731 | 99.00th=[ 41], 99.50th=[ 199], 99.90th=[ 266], 99.95th=[ 266], 00:32:31.731 | 99.99th=[ 266] 00:32:31.731 bw ( KiB/s): min= 384, max= 2048, per=4.15%, avg=1894.40, stdev=361.08, samples=20 00:32:31.731 iops : min= 96, max= 512, avg=473.60, stdev=90.27, samples=20 00:32:31.731 lat (msec) : 50=99.33%, 250=0.38%, 500=0.29% 00:32:31.731 cpu : usr=97.36%, sys=1.37%, ctx=55, majf=0, minf=54 00:32:31.731 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:31.731 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.731 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.731 issued rwts: total=4752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.731 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.731 filename0: (groupid=0, jobs=1): err= 0: pid=2182700: Thu Nov 28 01:26:46 2024 00:32:31.731 read: IOPS=474, BW=1899KiB/s (1945kB/s)(18.6MiB/10003msec) 00:32:31.731 slat (usec): min=9, max=132, avg=49.77, stdev=17.51 00:32:31.731 clat (msec): min=15, max=440, avg=33.24, stdev=23.64 00:32:31.731 lat (msec): min=15, max=440, avg=33.29, stdev=23.64 00:32:31.731 clat percentiles (msec): 00:32:31.731 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.731 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:31.731 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.731 | 99.00th=[ 39], 99.50th=[ 41], 99.90th=[ 439], 99.95th=[ 439], 00:32:31.731 | 99.99th=[ 443] 00:32:31.731 bw ( KiB/s): min= 256, max= 2048, per=4.14%, avg=1892.21, stdev=401.24, samples=19 00:32:31.731 iops : min= 64, max= 512, avg=473.05, stdev=100.31, samples=19 00:32:31.731 lat (msec) : 20=0.34%, 50=99.28%, 100=0.04%, 500=0.34% 00:32:31.731 cpu : usr=95.80%, sys=2.16%, ctx=272, majf=0, minf=50 00:32:31.731 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:31.731 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.732 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.732 issued rwts: total=4750,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.732 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.732 filename0: (groupid=0, jobs=1): err= 0: pid=2182701: Thu Nov 28 01:26:46 2024 00:32:31.732 read: IOPS=477, BW=1911KiB/s (1956kB/s)(18.7MiB/10003msec) 00:32:31.732 slat (usec): min=7, max=147, avg=44.35, stdev=20.80 00:32:31.732 clat (msec): min=14, max=467, avg=33.11, stdev=23.98 00:32:31.732 lat (msec): min=14, max=467, avg=33.15, stdev=23.98 00:32:31.732 clat percentiles (msec): 00:32:31.732 | 1.00th=[ 19], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.732 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:31.732 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 34], 00:32:31.732 | 99.00th=[ 44], 99.50th=[ 50], 99.90th=[ 443], 99.95th=[ 443], 00:32:31.732 | 99.99th=[ 468] 00:32:31.732 bw ( KiB/s): min= 240, max= 2272, per=4.17%, avg=1904.00, stdev=412.74, samples=19 00:32:31.732 iops : min= 60, max= 568, avg=476.00, stdev=103.18, samples=19 00:32:31.732 lat (msec) : 20=1.36%, 50=98.30%, 500=0.33% 00:32:31.732 cpu : usr=97.14%, sys=1.63%, ctx=224, majf=0, minf=46 00:32:31.732 IO depths : 1=4.5%, 2=10.2%, 4=23.0%, 8=54.1%, 16=8.3%, 32=0.0%, >=64=0.0% 00:32:31.732 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.732 complete : 0=0.0%, 4=93.7%, 8=0.9%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.732 issued rwts: total=4778,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.732 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.732 filename0: (groupid=0, jobs=1): err= 0: pid=2182702: Thu Nov 28 01:26:46 2024 00:32:31.732 read: IOPS=483, BW=1932KiB/s (1979kB/s)(18.9MiB/10003msec) 00:32:31.732 slat (usec): min=3, max=109, avg=41.65, stdev=17.33 00:32:31.732 clat (msec): min=4, max=262, avg=32.78, stdev=15.58 00:32:31.732 lat (msec): min=4, max=262, avg=32.82, stdev=15.57 00:32:31.732 clat percentiles (msec): 00:32:31.732 | 1.00th=[ 8], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.732 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 33], 00:32:31.732 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.732 | 99.00th=[ 41], 99.50th=[ 167], 99.90th=[ 257], 99.95th=[ 257], 00:32:31.732 | 99.99th=[ 264] 00:32:31.732 bw ( KiB/s): min= 1008, max= 2048, per=4.22%, avg=1926.74, stdev=231.21, samples=19 00:32:31.732 iops : min= 252, max= 512, avg=481.68, stdev=57.80, samples=19 00:32:31.732 lat (msec) : 10=1.32%, 20=0.66%, 50=97.02%, 100=0.33%, 250=0.33% 00:32:31.732 lat (msec) : 500=0.33% 00:32:31.732 cpu : usr=95.46%, sys=2.34%, ctx=117, majf=0, minf=51 00:32:31.732 IO depths : 1=6.0%, 2=12.1%, 4=24.6%, 8=50.7%, 16=6.5%, 32=0.0%, >=64=0.0% 00:32:31.732 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.732 complete : 0=0.0%, 4=94.0%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.732 issued rwts: total=4832,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.732 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.732 filename1: (groupid=0, jobs=1): err= 0: pid=2182703: Thu Nov 28 01:26:46 2024 00:32:31.732 read: IOPS=474, BW=1899KiB/s (1944kB/s)(18.6MiB/10012msec) 00:32:31.732 slat (usec): min=8, max=107, avg=33.41, stdev=17.14 00:32:31.732 clat (msec): min=25, max=265, avg=33.43, stdev=16.58 00:32:31.732 lat (msec): min=25, max=265, avg=33.47, stdev=16.58 00:32:31.732 clat percentiles (msec): 00:32:31.732 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.732 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 33], 60.00th=[ 33], 00:32:31.732 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.732 | 99.00th=[ 42], 99.50th=[ 199], 99.90th=[ 266], 99.95th=[ 266], 00:32:31.732 | 99.99th=[ 266] 00:32:31.732 bw ( KiB/s): min= 384, max= 2048, per=4.15%, avg=1894.40, stdev=361.08, samples=20 00:32:31.732 iops : min= 96, max= 512, avg=473.60, stdev=90.27, samples=20 00:32:31.732 lat (msec) : 50=99.33%, 250=0.34%, 500=0.34% 00:32:31.732 cpu : usr=97.82%, sys=1.44%, ctx=182, majf=0, minf=36 00:32:31.732 IO depths : 1=6.1%, 2=12.4%, 4=24.9%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:32:31.732 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.732 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.732 issued rwts: total=4752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.732 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.732 filename1: (groupid=0, jobs=1): err= 0: pid=2182704: Thu Nov 28 01:26:46 2024 00:32:31.732 read: IOPS=484, BW=1938KiB/s (1984kB/s)(18.9MiB/10007msec) 00:32:31.732 slat (usec): min=3, max=114, avg=28.49, stdev=18.77 00:32:31.732 clat (msec): min=3, max=276, avg=32.82, stdev=15.94 00:32:31.732 lat (msec): min=3, max=276, avg=32.85, stdev=15.94 00:32:31.732 clat percentiles (msec): 00:32:31.732 | 1.00th=[ 6], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.732 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 33], 60.00th=[ 33], 00:32:31.732 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.732 | 99.00th=[ 41], 99.50th=[ 148], 99.90th=[ 275], 99.95th=[ 275], 00:32:31.732 | 99.99th=[ 279] 00:32:31.732 bw ( KiB/s): min= 1152, max= 2048, per=4.23%, avg=1933.47, stdev=199.15, samples=19 00:32:31.732 iops : min= 288, max= 512, avg=483.37, stdev=49.79, samples=19 00:32:31.732 lat (msec) : 4=0.17%, 10=1.49%, 20=0.41%, 50=97.19%, 100=0.08% 00:32:31.732 lat (msec) : 250=0.33%, 500=0.33% 00:32:31.732 cpu : usr=95.37%, sys=2.30%, ctx=125, majf=0, minf=58 00:32:31.732 IO depths : 1=4.2%, 2=10.5%, 4=24.9%, 8=52.1%, 16=8.3%, 32=0.0%, >=64=0.0% 00:32:31.732 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.732 complete : 0=0.0%, 4=94.2%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.732 issued rwts: total=4848,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.732 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.732 filename1: (groupid=0, jobs=1): err= 0: pid=2182705: Thu Nov 28 01:26:46 2024 00:32:31.732 read: IOPS=474, BW=1899KiB/s (1945kB/s)(18.6MiB/10008msec) 00:32:31.732 slat (usec): min=15, max=550, avg=46.66, stdev=23.99 00:32:31.732 clat (msec): min=15, max=443, avg=33.21, stdev=23.86 00:32:31.732 lat (msec): min=15, max=443, avg=33.26, stdev=23.86 00:32:31.732 clat percentiles (msec): 00:32:31.732 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.732 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:31.732 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.732 | 99.00th=[ 39], 99.50th=[ 41], 99.90th=[ 443], 99.95th=[ 443], 00:32:31.732 | 99.99th=[ 443] 00:32:31.732 bw ( KiB/s): min= 256, max= 2048, per=4.13%, avg=1886.32, stdev=399.89, samples=19 00:32:31.732 iops : min= 64, max= 512, avg=471.58, stdev=99.97, samples=19 00:32:31.732 lat (msec) : 20=0.34%, 50=99.28%, 100=0.04%, 500=0.34% 00:32:31.732 cpu : usr=96.04%, sys=2.09%, ctx=74, majf=0, minf=39 00:32:31.732 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:31.732 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.732 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.732 issued rwts: total=4752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.732 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.732 filename1: (groupid=0, jobs=1): err= 0: pid=2182706: Thu Nov 28 01:26:46 2024 00:32:31.732 read: IOPS=474, BW=1899KiB/s (1944kB/s)(18.6MiB/10012msec) 00:32:31.732 slat (usec): min=7, max=158, avg=36.54, stdev=21.72 00:32:31.732 clat (msec): min=28, max=265, avg=33.40, stdev=16.58 00:32:31.732 lat (msec): min=28, max=265, avg=33.44, stdev=16.58 00:32:31.732 clat percentiles (msec): 00:32:31.732 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.732 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 33], 00:32:31.732 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 34], 00:32:31.732 | 99.00th=[ 43], 99.50th=[ 199], 99.90th=[ 266], 99.95th=[ 266], 00:32:31.732 | 99.99th=[ 266] 00:32:31.732 bw ( KiB/s): min= 384, max= 2048, per=4.15%, avg=1894.40, stdev=361.08, samples=20 00:32:31.732 iops : min= 96, max= 512, avg=473.60, stdev=90.27, samples=20 00:32:31.732 lat (msec) : 50=99.33%, 250=0.34%, 500=0.34% 00:32:31.732 cpu : usr=97.69%, sys=1.74%, ctx=29, majf=0, minf=63 00:32:31.732 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:31.732 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.732 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.732 issued rwts: total=4752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.732 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.732 filename1: (groupid=0, jobs=1): err= 0: pid=2182707: Thu Nov 28 01:26:46 2024 00:32:31.732 read: IOPS=474, BW=1898KiB/s (1944kB/s)(18.6MiB/10015msec) 00:32:31.732 slat (nsec): min=3919, max=94941, avg=30784.39, stdev=11189.56 00:32:31.732 clat (msec): min=15, max=450, avg=33.43, stdev=24.27 00:32:31.732 lat (msec): min=15, max=450, avg=33.47, stdev=24.27 00:32:31.732 clat percentiles (msec): 00:32:31.732 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.732 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 33], 00:32:31.732 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.732 | 99.00th=[ 39], 99.50th=[ 42], 99.90th=[ 451], 99.95th=[ 451], 00:32:31.732 | 99.99th=[ 451] 00:32:31.732 bw ( KiB/s): min= 256, max= 2048, per=4.15%, avg=1894.40, stdev=390.90, samples=20 00:32:31.732 iops : min= 64, max= 512, avg=473.60, stdev=97.72, samples=20 00:32:31.732 lat (msec) : 20=0.34%, 50=99.33%, 500=0.34% 00:32:31.732 cpu : usr=97.01%, sys=1.59%, ctx=302, majf=0, minf=44 00:32:31.732 IO depths : 1=6.1%, 2=12.3%, 4=24.8%, 8=50.4%, 16=6.4%, 32=0.0%, >=64=0.0% 00:32:31.732 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.732 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.732 issued rwts: total=4752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.732 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.732 filename1: (groupid=0, jobs=1): err= 0: pid=2182708: Thu Nov 28 01:26:46 2024 00:32:31.732 read: IOPS=474, BW=1899KiB/s (1944kB/s)(18.6MiB/10012msec) 00:32:31.732 slat (usec): min=10, max=101, avg=44.24, stdev=13.30 00:32:31.732 clat (msec): min=26, max=266, avg=33.32, stdev=16.61 00:32:31.732 lat (msec): min=26, max=266, avg=33.36, stdev=16.60 00:32:31.732 clat percentiles (msec): 00:32:31.732 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.732 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:31.733 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.733 | 99.00th=[ 41], 99.50th=[ 199], 99.90th=[ 266], 99.95th=[ 266], 00:32:31.733 | 99.99th=[ 268] 00:32:31.733 bw ( KiB/s): min= 384, max= 2048, per=4.15%, avg=1894.40, stdev=361.08, samples=20 00:32:31.733 iops : min= 96, max= 512, avg=473.60, stdev=90.27, samples=20 00:32:31.733 lat (msec) : 50=99.33%, 250=0.34%, 500=0.34% 00:32:31.733 cpu : usr=98.61%, sys=0.97%, ctx=17, majf=0, minf=48 00:32:31.733 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:31.733 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.733 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.733 issued rwts: total=4752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.733 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.733 filename1: (groupid=0, jobs=1): err= 0: pid=2182709: Thu Nov 28 01:26:46 2024 00:32:31.733 read: IOPS=476, BW=1905KiB/s (1951kB/s)(18.6MiB/10005msec) 00:32:31.733 slat (usec): min=7, max=165, avg=38.58, stdev=36.58 00:32:31.733 clat (msec): min=5, max=442, avg=33.26, stdev=23.81 00:32:31.733 lat (msec): min=5, max=442, avg=33.30, stdev=23.81 00:32:31.733 clat percentiles (msec): 00:32:31.733 | 1.00th=[ 18], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:31.733 | 30.00th=[ 32], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:32:31.733 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.733 | 99.00th=[ 43], 99.50th=[ 53], 99.90th=[ 443], 99.95th=[ 443], 00:32:31.733 | 99.99th=[ 443] 00:32:31.733 bw ( KiB/s): min= 256, max= 2208, per=4.14%, avg=1892.21, stdev=403.82, samples=19 00:32:31.733 iops : min= 64, max= 552, avg=473.05, stdev=100.95, samples=19 00:32:31.733 lat (msec) : 10=0.08%, 20=0.99%, 50=98.07%, 100=0.52%, 500=0.34% 00:32:31.733 cpu : usr=97.77%, sys=1.22%, ctx=141, majf=0, minf=39 00:32:31.733 IO depths : 1=5.0%, 2=11.1%, 4=24.3%, 8=52.1%, 16=7.5%, 32=0.0%, >=64=0.0% 00:32:31.733 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.733 complete : 0=0.0%, 4=94.0%, 8=0.2%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.733 issued rwts: total=4766,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.733 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.733 filename1: (groupid=0, jobs=1): err= 0: pid=2182710: Thu Nov 28 01:26:46 2024 00:32:31.733 read: IOPS=475, BW=1903KiB/s (1949kB/s)(18.6MiB/10009msec) 00:32:31.733 slat (usec): min=7, max=166, avg=39.96, stdev=20.68 00:32:31.733 clat (msec): min=15, max=446, avg=33.27, stdev=24.13 00:32:31.733 lat (msec): min=15, max=446, avg=33.31, stdev=24.13 00:32:31.733 clat percentiles (msec): 00:32:31.733 | 1.00th=[ 22], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.733 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:31.733 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 34], 00:32:31.733 | 99.00th=[ 45], 99.50th=[ 52], 99.90th=[ 447], 99.95th=[ 447], 00:32:31.733 | 99.99th=[ 447] 00:32:31.733 bw ( KiB/s): min= 240, max= 2128, per=4.16%, avg=1900.80, stdev=396.89, samples=20 00:32:31.733 iops : min= 60, max= 532, avg=475.20, stdev=99.22, samples=20 00:32:31.733 lat (msec) : 20=0.92%, 50=98.15%, 100=0.59%, 500=0.34% 00:32:31.733 cpu : usr=98.38%, sys=1.06%, ctx=70, majf=0, minf=46 00:32:31.733 IO depths : 1=3.6%, 2=8.6%, 4=20.5%, 8=57.5%, 16=9.8%, 32=0.0%, >=64=0.0% 00:32:31.733 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.733 complete : 0=0.0%, 4=93.2%, 8=2.0%, 16=4.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.733 issued rwts: total=4762,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.733 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.733 filename2: (groupid=0, jobs=1): err= 0: pid=2182711: Thu Nov 28 01:26:46 2024 00:32:31.733 read: IOPS=474, BW=1899KiB/s (1945kB/s)(18.6MiB/10008msec) 00:32:31.733 slat (usec): min=8, max=182, avg=44.05, stdev=21.49 00:32:31.733 clat (msec): min=28, max=266, avg=33.30, stdev=16.60 00:32:31.733 lat (msec): min=28, max=266, avg=33.34, stdev=16.60 00:32:31.733 clat percentiles (msec): 00:32:31.733 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.733 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 33], 00:32:31.733 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.733 | 99.00th=[ 41], 99.50th=[ 199], 99.90th=[ 266], 99.95th=[ 266], 00:32:31.733 | 99.99th=[ 266] 00:32:31.733 bw ( KiB/s): min= 384, max= 2048, per=4.15%, avg=1894.40, stdev=361.08, samples=20 00:32:31.733 iops : min= 96, max= 512, avg=473.60, stdev=90.27, samples=20 00:32:31.733 lat (msec) : 50=99.33%, 250=0.34%, 500=0.34% 00:32:31.733 cpu : usr=98.34%, sys=1.04%, ctx=54, majf=0, minf=41 00:32:31.733 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:32:31.733 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.733 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.733 issued rwts: total=4752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.733 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.733 filename2: (groupid=0, jobs=1): err= 0: pid=2182712: Thu Nov 28 01:26:46 2024 00:32:31.733 read: IOPS=481, BW=1926KiB/s (1972kB/s)(18.8MiB/10002msec) 00:32:31.733 slat (usec): min=4, max=142, avg=34.72, stdev=18.63 00:32:31.733 clat (msec): min=3, max=266, avg=32.94, stdev=15.78 00:32:31.733 lat (msec): min=3, max=266, avg=32.98, stdev=15.78 00:32:31.733 clat percentiles (msec): 00:32:31.733 | 1.00th=[ 7], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.733 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 33], 60.00th=[ 33], 00:32:31.733 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.733 | 99.00th=[ 41], 99.50th=[ 167], 99.90th=[ 266], 99.95th=[ 266], 00:32:31.733 | 99.99th=[ 266] 00:32:31.733 bw ( KiB/s): min= 896, max= 2048, per=4.20%, avg=1920.00, stdev=256.00, samples=19 00:32:31.733 iops : min= 224, max= 512, avg=480.00, stdev=64.00, samples=19 00:32:31.733 lat (msec) : 4=0.10%, 10=1.23%, 50=97.97%, 100=0.04%, 250=0.33% 00:32:31.733 lat (msec) : 500=0.33% 00:32:31.733 cpu : usr=97.96%, sys=1.27%, ctx=182, majf=0, minf=39 00:32:31.733 IO depths : 1=6.1%, 2=12.4%, 4=24.8%, 8=50.3%, 16=6.4%, 32=0.0%, >=64=0.0% 00:32:31.733 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.733 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.733 issued rwts: total=4816,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.733 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.733 filename2: (groupid=0, jobs=1): err= 0: pid=2182713: Thu Nov 28 01:26:46 2024 00:32:31.733 read: IOPS=474, BW=1899KiB/s (1944kB/s)(18.6MiB/10012msec) 00:32:31.733 slat (usec): min=7, max=138, avg=49.40, stdev=17.89 00:32:31.733 clat (msec): min=27, max=265, avg=33.29, stdev=16.59 00:32:31.733 lat (msec): min=27, max=265, avg=33.34, stdev=16.59 00:32:31.733 clat percentiles (msec): 00:32:31.733 | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.733 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:31.733 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.733 | 99.00th=[ 41], 99.50th=[ 199], 99.90th=[ 266], 99.95th=[ 266], 00:32:31.733 | 99.99th=[ 266] 00:32:31.733 bw ( KiB/s): min= 384, max= 2048, per=4.15%, avg=1894.40, stdev=361.08, samples=20 00:32:31.733 iops : min= 96, max= 512, avg=473.60, stdev=90.27, samples=20 00:32:31.733 lat (msec) : 50=99.33%, 250=0.34%, 500=0.34% 00:32:31.733 cpu : usr=97.97%, sys=1.13%, ctx=144, majf=0, minf=42 00:32:31.733 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:32:31.733 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.733 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.733 issued rwts: total=4752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.733 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.733 filename2: (groupid=0, jobs=1): err= 0: pid=2182714: Thu Nov 28 01:26:46 2024 00:32:31.733 read: IOPS=474, BW=1899KiB/s (1944kB/s)(18.6MiB/10012msec) 00:32:31.733 slat (usec): min=8, max=106, avg=45.14, stdev=14.84 00:32:31.733 clat (msec): min=11, max=453, avg=33.31, stdev=24.49 00:32:31.733 lat (msec): min=11, max=454, avg=33.36, stdev=24.49 00:32:31.733 clat percentiles (msec): 00:32:31.733 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.733 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:31.733 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.733 | 99.00th=[ 39], 99.50th=[ 41], 99.90th=[ 456], 99.95th=[ 456], 00:32:31.733 | 99.99th=[ 456] 00:32:31.733 bw ( KiB/s): min= 384, max= 2048, per=4.15%, avg=1894.40, stdev=361.08, samples=20 00:32:31.733 iops : min= 96, max= 512, avg=473.60, stdev=90.27, samples=20 00:32:31.733 lat (msec) : 20=0.38%, 50=99.24%, 100=0.04%, 500=0.34% 00:32:31.733 cpu : usr=98.68%, sys=0.90%, ctx=17, majf=0, minf=39 00:32:31.733 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:31.733 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.733 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.733 issued rwts: total=4752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.733 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.733 filename2: (groupid=0, jobs=1): err= 0: pid=2182715: Thu Nov 28 01:26:46 2024 00:32:31.733 read: IOPS=472, BW=1892KiB/s (1937kB/s)(18.5MiB/10013msec) 00:32:31.733 slat (usec): min=7, max=101, avg=38.40, stdev=16.69 00:32:31.733 clat (msec): min=23, max=454, avg=33.54, stdev=24.51 00:32:31.733 lat (msec): min=23, max=454, avg=33.58, stdev=24.51 00:32:31.733 clat percentiles (msec): 00:32:31.733 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.733 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 33], 00:32:31.733 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.733 | 99.00th=[ 42], 99.50th=[ 43], 99.90th=[ 456], 99.95th=[ 456], 00:32:31.733 | 99.99th=[ 456] 00:32:31.733 bw ( KiB/s): min= 256, max= 2048, per=4.13%, avg=1888.00, stdev=388.81, samples=20 00:32:31.733 iops : min= 64, max= 512, avg=472.00, stdev=97.20, samples=20 00:32:31.733 lat (msec) : 50=99.66%, 500=0.34% 00:32:31.733 cpu : usr=98.39%, sys=1.17%, ctx=14, majf=0, minf=44 00:32:31.733 IO depths : 1=1.0%, 2=7.2%, 4=24.8%, 8=55.4%, 16=11.5%, 32=0.0%, >=64=0.0% 00:32:31.733 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.733 complete : 0=0.0%, 4=94.4%, 8=0.1%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.733 issued rwts: total=4736,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.734 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.734 filename2: (groupid=0, jobs=1): err= 0: pid=2182716: Thu Nov 28 01:26:46 2024 00:32:31.734 read: IOPS=474, BW=1900KiB/s (1945kB/s)(18.6MiB/10009msec) 00:32:31.734 slat (nsec): min=7981, max=95202, avg=37630.94, stdev=15691.93 00:32:31.734 clat (msec): min=14, max=444, avg=33.39, stdev=23.96 00:32:31.734 lat (msec): min=14, max=444, avg=33.43, stdev=23.96 00:32:31.734 clat percentiles (msec): 00:32:31.734 | 1.00th=[ 29], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.734 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 33], 00:32:31.734 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.734 | 99.00th=[ 40], 99.50th=[ 46], 99.90th=[ 447], 99.95th=[ 447], 00:32:31.734 | 99.99th=[ 447] 00:32:31.734 bw ( KiB/s): min= 256, max= 2048, per=4.15%, avg=1895.20, stdev=390.00, samples=20 00:32:31.734 iops : min= 64, max= 512, avg=473.80, stdev=97.50, samples=20 00:32:31.734 lat (msec) : 20=0.50%, 50=99.16%, 500=0.34% 00:32:31.734 cpu : usr=98.42%, sys=1.18%, ctx=15, majf=0, minf=43 00:32:31.734 IO depths : 1=0.8%, 2=6.9%, 4=24.5%, 8=56.1%, 16=11.8%, 32=0.0%, >=64=0.0% 00:32:31.734 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.734 complete : 0=0.0%, 4=94.3%, 8=0.2%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.734 issued rwts: total=4754,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.734 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.734 filename2: (groupid=0, jobs=1): err= 0: pid=2182717: Thu Nov 28 01:26:46 2024 00:32:31.734 read: IOPS=476, BW=1905KiB/s (1951kB/s)(18.6MiB/10014msec) 00:32:31.734 slat (usec): min=7, max=101, avg=42.18, stdev=13.96 00:32:31.734 clat (msec): min=15, max=450, avg=33.20, stdev=24.22 00:32:31.734 lat (msec): min=15, max=450, avg=33.24, stdev=24.21 00:32:31.734 clat percentiles (msec): 00:32:31.734 | 1.00th=[ 23], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.734 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:31.734 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.734 | 99.00th=[ 39], 99.50th=[ 41], 99.90th=[ 451], 99.95th=[ 451], 00:32:31.734 | 99.99th=[ 451] 00:32:31.734 bw ( KiB/s): min= 256, max= 2144, per=4.16%, avg=1901.60, stdev=393.75, samples=20 00:32:31.734 iops : min= 64, max= 536, avg=475.40, stdev=98.44, samples=20 00:32:31.734 lat (msec) : 20=0.71%, 50=98.95%, 500=0.34% 00:32:31.734 cpu : usr=98.63%, sys=0.97%, ctx=16, majf=0, minf=40 00:32:31.734 IO depths : 1=6.0%, 2=12.0%, 4=24.3%, 8=51.2%, 16=6.6%, 32=0.0%, >=64=0.0% 00:32:31.734 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.734 complete : 0=0.0%, 4=93.9%, 8=0.3%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.734 issued rwts: total=4770,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.734 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.734 filename2: (groupid=0, jobs=1): err= 0: pid=2182718: Thu Nov 28 01:26:46 2024 00:32:31.734 read: IOPS=476, BW=1905KiB/s (1950kB/s)(18.6MiB/10014msec) 00:32:31.734 slat (nsec): min=7839, max=56375, avg=23066.65, stdev=10693.21 00:32:31.734 clat (msec): min=9, max=450, avg=33.40, stdev=24.26 00:32:31.734 lat (msec): min=9, max=450, avg=33.42, stdev=24.25 00:32:31.734 clat percentiles (msec): 00:32:31.734 | 1.00th=[ 27], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:31.734 | 30.00th=[ 32], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 33], 00:32:31.734 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 33], 00:32:31.734 | 99.00th=[ 39], 99.50th=[ 42], 99.90th=[ 451], 99.95th=[ 451], 00:32:31.734 | 99.99th=[ 451] 00:32:31.734 bw ( KiB/s): min= 256, max= 2064, per=4.16%, avg=1900.80, stdev=392.69, samples=20 00:32:31.734 iops : min= 64, max= 516, avg=475.20, stdev=98.17, samples=20 00:32:31.734 lat (msec) : 10=0.04%, 20=0.67%, 50=98.91%, 100=0.04%, 500=0.34% 00:32:31.734 cpu : usr=98.61%, sys=1.00%, ctx=15, majf=0, minf=33 00:32:31.734 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:32:31.734 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.734 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:31.734 issued rwts: total=4768,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:31.734 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:31.734 00:32:31.734 Run status group 0 (all jobs): 00:32:31.734 READ: bw=44.6MiB/s (46.8MB/s), 1892KiB/s-1938KiB/s (1937kB/s-1984kB/s), io=447MiB (468MB), run=10002-10015msec 00:32:32.048 01:26:46 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:32:32.048 01:26:46 -- target/dif.sh@43 -- # local sub 00:32:32.048 01:26:46 -- target/dif.sh@45 -- # for sub in "$@" 00:32:32.048 01:26:46 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:32.048 01:26:46 -- target/dif.sh@36 -- # local sub_id=0 00:32:32.048 01:26:46 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:32.048 01:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.048 01:26:46 -- common/autotest_common.sh@10 -- # set +x 00:32:32.048 01:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:32.048 01:26:46 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:32.048 01:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.048 01:26:46 -- common/autotest_common.sh@10 -- # set +x 00:32:32.048 01:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:32.048 01:26:46 -- target/dif.sh@45 -- # for sub in "$@" 00:32:32.048 01:26:46 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:32.048 01:26:46 -- target/dif.sh@36 -- # local sub_id=1 00:32:32.048 01:26:46 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:32.048 01:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.048 01:26:46 -- common/autotest_common.sh@10 -- # set +x 00:32:32.048 01:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:32.048 01:26:46 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:32.048 01:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.048 01:26:46 -- common/autotest_common.sh@10 -- # set +x 00:32:32.048 01:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:32.048 01:26:46 -- target/dif.sh@45 -- # for sub in "$@" 00:32:32.048 01:26:46 -- target/dif.sh@46 -- # destroy_subsystem 2 00:32:32.048 01:26:46 -- target/dif.sh@36 -- # local sub_id=2 00:32:32.048 01:26:46 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:32:32.048 01:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.048 01:26:46 -- common/autotest_common.sh@10 -- # set +x 00:32:32.048 01:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:32.048 01:26:46 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:32:32.048 01:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.048 01:26:46 -- common/autotest_common.sh@10 -- # set +x 00:32:32.048 01:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:32.048 01:26:46 -- target/dif.sh@115 -- # NULL_DIF=1 00:32:32.048 01:26:46 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:32:32.048 01:26:46 -- target/dif.sh@115 -- # numjobs=2 00:32:32.048 01:26:46 -- target/dif.sh@115 -- # iodepth=8 00:32:32.048 01:26:46 -- target/dif.sh@115 -- # runtime=5 00:32:32.048 01:26:46 -- target/dif.sh@115 -- # files=1 00:32:32.048 01:26:46 -- target/dif.sh@117 -- # create_subsystems 0 1 00:32:32.048 01:26:46 -- target/dif.sh@28 -- # local sub 00:32:32.048 01:26:46 -- target/dif.sh@30 -- # for sub in "$@" 00:32:32.048 01:26:46 -- target/dif.sh@31 -- # create_subsystem 0 00:32:32.048 01:26:46 -- target/dif.sh@18 -- # local sub_id=0 00:32:32.048 01:26:46 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:32:32.048 01:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.049 01:26:46 -- common/autotest_common.sh@10 -- # set +x 00:32:32.049 bdev_null0 00:32:32.049 01:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:32.049 01:26:46 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:32.049 01:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.049 01:26:46 -- common/autotest_common.sh@10 -- # set +x 00:32:32.049 01:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:32.049 01:26:46 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:32.049 01:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.049 01:26:46 -- common/autotest_common.sh@10 -- # set +x 00:32:32.049 01:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:32.049 01:26:46 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:32.049 01:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.049 01:26:46 -- common/autotest_common.sh@10 -- # set +x 00:32:32.049 [2024-11-28 01:26:46.567305] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:32.049 01:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:32.049 01:26:46 -- target/dif.sh@30 -- # for sub in "$@" 00:32:32.049 01:26:46 -- target/dif.sh@31 -- # create_subsystem 1 00:32:32.049 01:26:46 -- target/dif.sh@18 -- # local sub_id=1 00:32:32.049 01:26:46 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:32:32.049 01:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.049 01:26:46 -- common/autotest_common.sh@10 -- # set +x 00:32:32.049 bdev_null1 00:32:32.049 01:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:32.049 01:26:46 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:32.049 01:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.049 01:26:46 -- common/autotest_common.sh@10 -- # set +x 00:32:32.049 01:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:32.049 01:26:46 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:32.049 01:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.049 01:26:46 -- common/autotest_common.sh@10 -- # set +x 00:32:32.049 01:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:32.049 01:26:46 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:32.049 01:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.049 01:26:46 -- common/autotest_common.sh@10 -- # set +x 00:32:32.049 01:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:32.049 01:26:46 -- target/dif.sh@118 -- # fio /dev/fd/62 00:32:32.049 01:26:46 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:32:32.049 01:26:46 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:32:32.049 01:26:46 -- nvmf/common.sh@520 -- # config=() 00:32:32.049 01:26:46 -- nvmf/common.sh@520 -- # local subsystem config 00:32:32.049 01:26:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:32.049 01:26:46 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:32.049 01:26:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:32.049 { 00:32:32.049 "params": { 00:32:32.049 "name": "Nvme$subsystem", 00:32:32.049 "trtype": "$TEST_TRANSPORT", 00:32:32.049 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:32.049 "adrfam": "ipv4", 00:32:32.049 "trsvcid": "$NVMF_PORT", 00:32:32.049 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:32.049 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:32.049 "hdgst": ${hdgst:-false}, 00:32:32.049 "ddgst": ${ddgst:-false} 00:32:32.049 }, 00:32:32.049 "method": "bdev_nvme_attach_controller" 00:32:32.049 } 00:32:32.049 EOF 00:32:32.049 )") 00:32:32.049 01:26:46 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:32.049 01:26:46 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:32.049 01:26:46 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:32.049 01:26:46 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:32.049 01:26:46 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:32.049 01:26:46 -- target/dif.sh@82 -- # gen_fio_conf 00:32:32.049 01:26:46 -- common/autotest_common.sh@1330 -- # shift 00:32:32.049 01:26:46 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:32.049 01:26:46 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:32.049 01:26:46 -- target/dif.sh@54 -- # local file 00:32:32.049 01:26:46 -- target/dif.sh@56 -- # cat 00:32:32.049 01:26:46 -- nvmf/common.sh@542 -- # cat 00:32:32.049 01:26:46 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:32.049 01:26:46 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:32.049 01:26:46 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:32.049 01:26:46 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:32.049 01:26:46 -- target/dif.sh@72 -- # (( file <= files )) 00:32:32.049 01:26:46 -- target/dif.sh@73 -- # cat 00:32:32.049 01:26:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:32.049 01:26:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:32.049 { 00:32:32.049 "params": { 00:32:32.049 "name": "Nvme$subsystem", 00:32:32.049 "trtype": "$TEST_TRANSPORT", 00:32:32.049 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:32.049 "adrfam": "ipv4", 00:32:32.049 "trsvcid": "$NVMF_PORT", 00:32:32.049 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:32.049 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:32.049 "hdgst": ${hdgst:-false}, 00:32:32.049 "ddgst": ${ddgst:-false} 00:32:32.049 }, 00:32:32.049 "method": "bdev_nvme_attach_controller" 00:32:32.049 } 00:32:32.049 EOF 00:32:32.049 )") 00:32:32.049 01:26:46 -- nvmf/common.sh@542 -- # cat 00:32:32.049 01:26:46 -- target/dif.sh@72 -- # (( file++ )) 00:32:32.049 01:26:46 -- target/dif.sh@72 -- # (( file <= files )) 00:32:32.049 01:26:46 -- nvmf/common.sh@544 -- # jq . 00:32:32.332 01:26:46 -- nvmf/common.sh@545 -- # IFS=, 00:32:32.332 01:26:46 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:32.332 "params": { 00:32:32.332 "name": "Nvme0", 00:32:32.332 "trtype": "tcp", 00:32:32.332 "traddr": "10.0.0.2", 00:32:32.332 "adrfam": "ipv4", 00:32:32.332 "trsvcid": "4420", 00:32:32.332 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:32.332 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:32.332 "hdgst": false, 00:32:32.332 "ddgst": false 00:32:32.332 }, 00:32:32.332 "method": "bdev_nvme_attach_controller" 00:32:32.332 },{ 00:32:32.332 "params": { 00:32:32.332 "name": "Nvme1", 00:32:32.332 "trtype": "tcp", 00:32:32.332 "traddr": "10.0.0.2", 00:32:32.332 "adrfam": "ipv4", 00:32:32.332 "trsvcid": "4420", 00:32:32.332 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:32.332 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:32.332 "hdgst": false, 00:32:32.332 "ddgst": false 00:32:32.332 }, 00:32:32.332 "method": "bdev_nvme_attach_controller" 00:32:32.332 }' 00:32:32.332 01:26:46 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:32.332 01:26:46 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:32.332 01:26:46 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:32.332 01:26:46 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:32.332 01:26:46 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:32.332 01:26:46 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:32.332 01:26:46 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:32.332 01:26:46 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:32.332 01:26:46 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:32.332 01:26:46 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:32.332 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:32.332 ... 00:32:32.332 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:32.332 ... 00:32:32.332 fio-3.35 00:32:32.332 Starting 4 threads 00:32:32.332 EAL: No free 2048 kB hugepages reported on node 1 00:32:33.266 [2024-11-28 01:26:47.502421] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:33.266 [2024-11-28 01:26:47.502481] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:38.559 00:32:38.559 filename0: (groupid=0, jobs=1): err= 0: pid=2184048: Thu Nov 28 01:26:52 2024 00:32:38.559 read: IOPS=1878, BW=14.7MiB/s (15.4MB/s)(73.4MiB/5001msec) 00:32:38.559 slat (nsec): min=3762, max=60618, avg=18451.35, stdev=9518.14 00:32:38.559 clat (usec): min=724, max=10017, avg=4194.91, stdev=586.18 00:32:38.559 lat (usec): min=736, max=10028, avg=4213.36, stdev=586.26 00:32:38.559 clat percentiles (usec): 00:32:38.559 | 1.00th=[ 2540], 5.00th=[ 3392], 10.00th=[ 3752], 20.00th=[ 3982], 00:32:38.559 | 30.00th=[ 4047], 40.00th=[ 4113], 50.00th=[ 4178], 60.00th=[ 4228], 00:32:38.559 | 70.00th=[ 4293], 80.00th=[ 4359], 90.00th=[ 4555], 95.00th=[ 5211], 00:32:38.559 | 99.00th=[ 6521], 99.50th=[ 6849], 99.90th=[ 7308], 99.95th=[ 7439], 00:32:38.559 | 99.99th=[10028] 00:32:38.559 bw ( KiB/s): min=14658, max=15296, per=24.87%, avg=15027.78, stdev=185.37, samples=9 00:32:38.559 iops : min= 1832, max= 1912, avg=1878.44, stdev=23.23, samples=9 00:32:38.559 lat (usec) : 750=0.01%, 1000=0.09% 00:32:38.559 lat (msec) : 2=0.44%, 4=22.87%, 10=76.59%, 20=0.01% 00:32:38.559 cpu : usr=95.04%, sys=4.32%, ctx=15, majf=0, minf=9 00:32:38.559 IO depths : 1=0.1%, 2=13.6%, 4=58.3%, 8=28.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:38.559 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:38.559 complete : 0=0.0%, 4=92.6%, 8=7.4%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:38.559 issued rwts: total=9394,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:38.559 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:38.559 filename0: (groupid=0, jobs=1): err= 0: pid=2184049: Thu Nov 28 01:26:52 2024 00:32:38.559 read: IOPS=1890, BW=14.8MiB/s (15.5MB/s)(73.9MiB/5002msec) 00:32:38.559 slat (nsec): min=3899, max=62032, avg=16770.82, stdev=9072.15 00:32:38.559 clat (usec): min=835, max=8333, avg=4176.50, stdev=489.95 00:32:38.559 lat (usec): min=843, max=8359, avg=4193.27, stdev=490.09 00:32:38.559 clat percentiles (usec): 00:32:38.559 | 1.00th=[ 2868], 5.00th=[ 3458], 10.00th=[ 3752], 20.00th=[ 4015], 00:32:38.559 | 30.00th=[ 4080], 40.00th=[ 4146], 50.00th=[ 4178], 60.00th=[ 4228], 00:32:38.559 | 70.00th=[ 4293], 80.00th=[ 4359], 90.00th=[ 4490], 95.00th=[ 4752], 00:32:38.559 | 99.00th=[ 6194], 99.50th=[ 6652], 99.90th=[ 7701], 99.95th=[ 7898], 00:32:38.559 | 99.99th=[ 8356] 00:32:38.559 bw ( KiB/s): min=14752, max=15920, per=25.03%, avg=15127.11, stdev=340.18, samples=9 00:32:38.559 iops : min= 1844, max= 1990, avg=1890.89, stdev=42.52, samples=9 00:32:38.559 lat (usec) : 1000=0.04% 00:32:38.559 lat (msec) : 2=0.14%, 4=19.85%, 10=79.97% 00:32:38.559 cpu : usr=94.76%, sys=4.70%, ctx=11, majf=0, minf=0 00:32:38.559 IO depths : 1=0.1%, 2=11.6%, 4=60.6%, 8=27.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:38.559 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:38.559 complete : 0=0.0%, 4=92.3%, 8=7.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:38.559 issued rwts: total=9456,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:38.559 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:38.559 filename1: (groupid=0, jobs=1): err= 0: pid=2184050: Thu Nov 28 01:26:52 2024 00:32:38.559 read: IOPS=1897, BW=14.8MiB/s (15.5MB/s)(74.1MiB/5001msec) 00:32:38.559 slat (nsec): min=3795, max=62826, avg=18870.38, stdev=9838.91 00:32:38.559 clat (usec): min=826, max=7600, avg=4150.36, stdev=504.97 00:32:38.559 lat (usec): min=844, max=7612, avg=4169.23, stdev=505.15 00:32:38.559 clat percentiles (usec): 00:32:38.559 | 1.00th=[ 2573], 5.00th=[ 3392], 10.00th=[ 3752], 20.00th=[ 3949], 00:32:38.559 | 30.00th=[ 4047], 40.00th=[ 4113], 50.00th=[ 4178], 60.00th=[ 4228], 00:32:38.559 | 70.00th=[ 4293], 80.00th=[ 4359], 90.00th=[ 4424], 95.00th=[ 4686], 00:32:38.559 | 99.00th=[ 6194], 99.50th=[ 6587], 99.90th=[ 7177], 99.95th=[ 7439], 00:32:38.559 | 99.99th=[ 7570] 00:32:38.559 bw ( KiB/s): min=14877, max=15440, per=25.12%, avg=15176.56, stdev=178.99, samples=9 00:32:38.559 iops : min= 1859, max= 1930, avg=1897.00, stdev=22.51, samples=9 00:32:38.559 lat (usec) : 1000=0.07% 00:32:38.559 lat (msec) : 2=0.40%, 4=23.02%, 10=76.50% 00:32:38.559 cpu : usr=95.14%, sys=4.30%, ctx=11, majf=0, minf=9 00:32:38.559 IO depths : 1=0.1%, 2=16.6%, 4=56.7%, 8=26.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:38.559 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:38.559 complete : 0=0.0%, 4=91.5%, 8=8.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:38.559 issued rwts: total=9487,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:38.559 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:38.559 filename1: (groupid=0, jobs=1): err= 0: pid=2184052: Thu Nov 28 01:26:52 2024 00:32:38.559 read: IOPS=1888, BW=14.8MiB/s (15.5MB/s)(73.8MiB/5001msec) 00:32:38.559 slat (nsec): min=3753, max=64836, avg=21459.61, stdev=7985.23 00:32:38.559 clat (usec): min=709, max=9857, avg=4162.52, stdev=573.79 00:32:38.559 lat (usec): min=734, max=9873, avg=4183.98, stdev=573.46 00:32:38.559 clat percentiles (usec): 00:32:38.559 | 1.00th=[ 2442], 5.00th=[ 3392], 10.00th=[ 3687], 20.00th=[ 3982], 00:32:38.559 | 30.00th=[ 4047], 40.00th=[ 4113], 50.00th=[ 4146], 60.00th=[ 4228], 00:32:38.559 | 70.00th=[ 4293], 80.00th=[ 4359], 90.00th=[ 4490], 95.00th=[ 4883], 00:32:38.559 | 99.00th=[ 6390], 99.50th=[ 6783], 99.90th=[ 7635], 99.95th=[ 9765], 00:32:38.559 | 99.99th=[ 9896] 00:32:38.559 bw ( KiB/s): min=14704, max=15680, per=24.99%, avg=15098.67, stdev=288.44, samples=9 00:32:38.559 iops : min= 1838, max= 1960, avg=1887.33, stdev=36.06, samples=9 00:32:38.559 lat (usec) : 750=0.01%, 1000=0.13% 00:32:38.559 lat (msec) : 2=0.62%, 4=22.69%, 10=76.55% 00:32:38.559 cpu : usr=94.10%, sys=4.68%, ctx=215, majf=0, minf=0 00:32:38.559 IO depths : 1=0.1%, 2=14.1%, 4=58.8%, 8=27.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:38.559 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:38.559 complete : 0=0.0%, 4=91.8%, 8=8.2%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:38.559 issued rwts: total=9444,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:38.560 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:38.560 00:32:38.560 Run status group 0 (all jobs): 00:32:38.560 READ: bw=59.0MiB/s (61.9MB/s), 14.7MiB/s-14.8MiB/s (15.4MB/s-15.5MB/s), io=295MiB (310MB), run=5001-5002msec 00:32:38.560 01:26:52 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:32:38.560 01:26:52 -- target/dif.sh@43 -- # local sub 00:32:38.560 01:26:52 -- target/dif.sh@45 -- # for sub in "$@" 00:32:38.560 01:26:52 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:38.560 01:26:52 -- target/dif.sh@36 -- # local sub_id=0 00:32:38.560 01:26:52 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:38.560 01:26:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:38.560 01:26:52 -- common/autotest_common.sh@10 -- # set +x 00:32:38.560 01:26:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:38.560 01:26:52 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:38.560 01:26:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:38.560 01:26:52 -- common/autotest_common.sh@10 -- # set +x 00:32:38.560 01:26:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:38.560 01:26:52 -- target/dif.sh@45 -- # for sub in "$@" 00:32:38.560 01:26:52 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:38.560 01:26:52 -- target/dif.sh@36 -- # local sub_id=1 00:32:38.560 01:26:52 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:38.560 01:26:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:38.560 01:26:52 -- common/autotest_common.sh@10 -- # set +x 00:32:38.560 01:26:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:38.560 01:26:52 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:38.560 01:26:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:38.560 01:26:52 -- common/autotest_common.sh@10 -- # set +x 00:32:38.560 01:26:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:38.560 00:32:38.560 real 0m24.228s 00:32:38.560 user 4m31.474s 00:32:38.560 sys 0m6.693s 00:32:38.560 01:26:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:38.560 01:26:52 -- common/autotest_common.sh@10 -- # set +x 00:32:38.560 ************************************ 00:32:38.560 END TEST fio_dif_rand_params 00:32:38.560 ************************************ 00:32:38.560 01:26:52 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:32:38.560 01:26:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:38.560 01:26:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:38.560 01:26:52 -- common/autotest_common.sh@10 -- # set +x 00:32:38.560 ************************************ 00:32:38.560 START TEST fio_dif_digest 00:32:38.560 ************************************ 00:32:38.560 01:26:52 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:32:38.560 01:26:52 -- target/dif.sh@123 -- # local NULL_DIF 00:32:38.560 01:26:52 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:32:38.560 01:26:52 -- target/dif.sh@125 -- # local hdgst ddgst 00:32:38.560 01:26:52 -- target/dif.sh@127 -- # NULL_DIF=3 00:32:38.560 01:26:52 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:32:38.560 01:26:52 -- target/dif.sh@127 -- # numjobs=3 00:32:38.560 01:26:52 -- target/dif.sh@127 -- # iodepth=3 00:32:38.560 01:26:52 -- target/dif.sh@127 -- # runtime=10 00:32:38.560 01:26:52 -- target/dif.sh@128 -- # hdgst=true 00:32:38.560 01:26:52 -- target/dif.sh@128 -- # ddgst=true 00:32:38.560 01:26:52 -- target/dif.sh@130 -- # create_subsystems 0 00:32:38.560 01:26:52 -- target/dif.sh@28 -- # local sub 00:32:38.560 01:26:52 -- target/dif.sh@30 -- # for sub in "$@" 00:32:38.560 01:26:52 -- target/dif.sh@31 -- # create_subsystem 0 00:32:38.560 01:26:52 -- target/dif.sh@18 -- # local sub_id=0 00:32:38.560 01:26:52 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:32:38.560 01:26:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:38.560 01:26:52 -- common/autotest_common.sh@10 -- # set +x 00:32:38.560 bdev_null0 00:32:38.560 01:26:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:38.560 01:26:52 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:38.560 01:26:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:38.560 01:26:52 -- common/autotest_common.sh@10 -- # set +x 00:32:38.560 01:26:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:38.560 01:26:52 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:38.560 01:26:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:38.560 01:26:52 -- common/autotest_common.sh@10 -- # set +x 00:32:38.560 01:26:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:38.560 01:26:52 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:38.560 01:26:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:38.560 01:26:52 -- common/autotest_common.sh@10 -- # set +x 00:32:38.560 [2024-11-28 01:26:52.899475] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:38.560 01:26:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:38.560 01:26:52 -- target/dif.sh@131 -- # fio /dev/fd/62 00:32:38.560 01:26:52 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:32:38.560 01:26:52 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:38.560 01:26:52 -- nvmf/common.sh@520 -- # config=() 00:32:38.560 01:26:52 -- nvmf/common.sh@520 -- # local subsystem config 00:32:38.560 01:26:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:38.560 01:26:52 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:38.560 01:26:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:38.560 { 00:32:38.560 "params": { 00:32:38.560 "name": "Nvme$subsystem", 00:32:38.560 "trtype": "$TEST_TRANSPORT", 00:32:38.560 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:38.560 "adrfam": "ipv4", 00:32:38.560 "trsvcid": "$NVMF_PORT", 00:32:38.560 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:38.560 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:38.560 "hdgst": ${hdgst:-false}, 00:32:38.560 "ddgst": ${ddgst:-false} 00:32:38.560 }, 00:32:38.560 "method": "bdev_nvme_attach_controller" 00:32:38.560 } 00:32:38.560 EOF 00:32:38.560 )") 00:32:38.560 01:26:52 -- target/dif.sh@82 -- # gen_fio_conf 00:32:38.560 01:26:52 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:38.560 01:26:52 -- target/dif.sh@54 -- # local file 00:32:38.560 01:26:52 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:38.560 01:26:52 -- target/dif.sh@56 -- # cat 00:32:38.560 01:26:52 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:38.560 01:26:52 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:38.560 01:26:52 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:38.560 01:26:52 -- common/autotest_common.sh@1330 -- # shift 00:32:38.560 01:26:52 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:38.560 01:26:52 -- nvmf/common.sh@542 -- # cat 00:32:38.560 01:26:52 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:38.560 01:26:52 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:38.560 01:26:52 -- target/dif.sh@72 -- # (( file <= files )) 00:32:38.560 01:26:52 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:38.560 01:26:52 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:38.560 01:26:52 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:38.560 01:26:52 -- nvmf/common.sh@544 -- # jq . 00:32:38.560 01:26:52 -- nvmf/common.sh@545 -- # IFS=, 00:32:38.560 01:26:52 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:38.560 "params": { 00:32:38.560 "name": "Nvme0", 00:32:38.560 "trtype": "tcp", 00:32:38.560 "traddr": "10.0.0.2", 00:32:38.560 "adrfam": "ipv4", 00:32:38.560 "trsvcid": "4420", 00:32:38.560 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:38.560 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:38.560 "hdgst": true, 00:32:38.560 "ddgst": true 00:32:38.560 }, 00:32:38.560 "method": "bdev_nvme_attach_controller" 00:32:38.560 }' 00:32:38.560 01:26:52 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:38.560 01:26:52 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:38.560 01:26:52 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:38.560 01:26:52 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:38.560 01:26:52 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:38.560 01:26:52 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:38.560 01:26:52 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:38.560 01:26:52 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:38.560 01:26:52 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:38.560 01:26:52 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:38.560 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:32:38.560 ... 00:32:38.560 fio-3.35 00:32:38.560 Starting 3 threads 00:32:38.819 EAL: No free 2048 kB hugepages reported on node 1 00:32:39.077 [2024-11-28 01:26:53.523738] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:39.077 [2024-11-28 01:26:53.523841] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:51.274 00:32:51.274 filename0: (groupid=0, jobs=1): err= 0: pid=2184916: Thu Nov 28 01:27:03 2024 00:32:51.274 read: IOPS=161, BW=20.2MiB/s (21.2MB/s)(203MiB/10046msec) 00:32:51.274 slat (nsec): min=7601, max=59632, avg=13644.77, stdev=3195.62 00:32:51.274 clat (usec): min=7954, max=55079, avg=18535.48, stdev=3262.61 00:32:51.274 lat (usec): min=7966, max=55093, avg=18549.13, stdev=3262.78 00:32:51.274 clat percentiles (usec): 00:32:51.274 | 1.00th=[ 9110], 5.00th=[10159], 10.00th=[15533], 20.00th=[17433], 00:32:51.274 | 30.00th=[18220], 40.00th=[18482], 50.00th=[19006], 60.00th=[19530], 00:32:51.274 | 70.00th=[20055], 80.00th=[20579], 90.00th=[21365], 95.00th=[21890], 00:32:51.274 | 99.00th=[23462], 99.50th=[23987], 99.90th=[52167], 99.95th=[55313], 00:32:51.274 | 99.99th=[55313] 00:32:51.274 bw ( KiB/s): min=19200, max=22528, per=30.90%, avg=20737.90, stdev=1114.70, samples=20 00:32:51.274 iops : min= 150, max= 176, avg=162.00, stdev= 8.73, samples=20 00:32:51.274 lat (msec) : 10=3.82%, 20=66.95%, 50=29.10%, 100=0.12% 00:32:51.274 cpu : usr=91.49%, sys=8.03%, ctx=25, majf=0, minf=172 00:32:51.274 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:51.274 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.274 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.274 issued rwts: total=1622,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.274 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:51.274 filename0: (groupid=0, jobs=1): err= 0: pid=2184917: Thu Nov 28 01:27:03 2024 00:32:51.274 read: IOPS=204, BW=25.6MiB/s (26.8MB/s)(257MiB/10048msec) 00:32:51.274 slat (nsec): min=3637, max=45002, avg=13026.03, stdev=3665.92 00:32:51.274 clat (usec): min=9249, max=57344, avg=14613.96, stdev=5595.63 00:32:51.274 lat (usec): min=9261, max=57358, avg=14626.99, stdev=5595.62 00:32:51.274 clat percentiles (usec): 00:32:51.274 | 1.00th=[10945], 5.00th=[11731], 10.00th=[12256], 20.00th=[12780], 00:32:51.274 | 30.00th=[13304], 40.00th=[13566], 50.00th=[13960], 60.00th=[14222], 00:32:51.274 | 70.00th=[14615], 80.00th=[15008], 90.00th=[15533], 95.00th=[16057], 00:32:51.274 | 99.00th=[54264], 99.50th=[55313], 99.90th=[56361], 99.95th=[57410], 00:32:51.274 | 99.99th=[57410] 00:32:51.274 bw ( KiB/s): min=22784, max=30208, per=39.20%, avg=26304.00, stdev=1886.47, samples=20 00:32:51.274 iops : min= 178, max= 236, avg=205.50, stdev=14.74, samples=20 00:32:51.274 lat (msec) : 10=0.10%, 20=97.91%, 50=0.24%, 100=1.75% 00:32:51.274 cpu : usr=89.80%, sys=9.68%, ctx=32, majf=0, minf=155 00:32:51.274 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:51.274 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.274 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.274 issued rwts: total=2057,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.274 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:51.274 filename0: (groupid=0, jobs=1): err= 0: pid=2184918: Thu Nov 28 01:27:03 2024 00:32:51.274 read: IOPS=158, BW=19.8MiB/s (20.7MB/s)(199MiB/10046msec) 00:32:51.274 slat (nsec): min=4132, max=38815, avg=13477.17, stdev=3543.83 00:32:51.274 clat (usec): min=8418, max=62391, avg=18922.23, stdev=3682.83 00:32:51.274 lat (usec): min=8431, max=62405, avg=18935.71, stdev=3682.99 00:32:51.274 clat percentiles (usec): 00:32:51.274 | 1.00th=[ 9503], 5.00th=[10814], 10.00th=[16188], 20.00th=[17957], 00:32:51.274 | 30.00th=[18482], 40.00th=[19006], 50.00th=[19268], 60.00th=[19792], 00:32:51.274 | 70.00th=[20317], 80.00th=[20841], 90.00th=[21365], 95.00th=[22152], 00:32:51.274 | 99.00th=[23725], 99.50th=[25822], 99.90th=[62129], 99.95th=[62653], 00:32:51.274 | 99.99th=[62653] 00:32:51.274 bw ( KiB/s): min=17920, max=22016, per=30.27%, avg=20313.60, stdev=1145.70, samples=20 00:32:51.274 iops : min= 140, max= 172, avg=158.70, stdev= 8.95, samples=20 00:32:51.274 lat (msec) : 10=2.45%, 20=63.25%, 50=34.05%, 100=0.25% 00:32:51.274 cpu : usr=92.49%, sys=7.05%, ctx=25, majf=0, minf=80 00:32:51.274 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:51.274 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.274 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:51.274 issued rwts: total=1589,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:51.274 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:51.274 00:32:51.274 Run status group 0 (all jobs): 00:32:51.274 READ: bw=65.5MiB/s (68.7MB/s), 19.8MiB/s-25.6MiB/s (20.7MB/s-26.8MB/s), io=659MiB (690MB), run=10046-10048msec 00:32:51.274 01:27:03 -- target/dif.sh@132 -- # destroy_subsystems 0 00:32:51.274 01:27:03 -- target/dif.sh@43 -- # local sub 00:32:51.274 01:27:03 -- target/dif.sh@45 -- # for sub in "$@" 00:32:51.274 01:27:03 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:51.274 01:27:03 -- target/dif.sh@36 -- # local sub_id=0 00:32:51.274 01:27:03 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:51.274 01:27:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:51.274 01:27:03 -- common/autotest_common.sh@10 -- # set +x 00:32:51.274 01:27:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:51.274 01:27:03 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:51.274 01:27:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:51.274 01:27:03 -- common/autotest_common.sh@10 -- # set +x 00:32:51.274 01:27:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:51.274 00:32:51.274 real 0m11.126s 00:32:51.274 user 0m28.506s 00:32:51.274 sys 0m2.732s 00:32:51.274 01:27:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:51.274 01:27:03 -- common/autotest_common.sh@10 -- # set +x 00:32:51.274 ************************************ 00:32:51.274 END TEST fio_dif_digest 00:32:51.274 ************************************ 00:32:51.274 01:27:04 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:32:51.274 01:27:04 -- target/dif.sh@147 -- # nvmftestfini 00:32:51.274 01:27:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:51.274 01:27:04 -- nvmf/common.sh@116 -- # sync 00:32:51.274 01:27:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:51.275 01:27:04 -- nvmf/common.sh@119 -- # set +e 00:32:51.275 01:27:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:51.275 01:27:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:51.275 rmmod nvme_tcp 00:32:51.275 rmmod nvme_fabrics 00:32:51.275 rmmod nvme_keyring 00:32:51.275 01:27:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:51.275 01:27:04 -- nvmf/common.sh@123 -- # set -e 00:32:51.275 01:27:04 -- nvmf/common.sh@124 -- # return 0 00:32:51.275 01:27:04 -- nvmf/common.sh@477 -- # '[' -n 2178687 ']' 00:32:51.275 01:27:04 -- nvmf/common.sh@478 -- # killprocess 2178687 00:32:51.275 01:27:04 -- common/autotest_common.sh@936 -- # '[' -z 2178687 ']' 00:32:51.275 01:27:04 -- common/autotest_common.sh@940 -- # kill -0 2178687 00:32:51.275 01:27:04 -- common/autotest_common.sh@941 -- # uname 00:32:51.275 01:27:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:51.275 01:27:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2178687 00:32:51.275 01:27:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:51.275 01:27:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:51.275 01:27:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2178687' 00:32:51.275 killing process with pid 2178687 00:32:51.275 01:27:04 -- common/autotest_common.sh@955 -- # kill 2178687 00:32:51.275 01:27:04 -- common/autotest_common.sh@960 -- # wait 2178687 00:32:51.275 01:27:04 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:51.275 01:27:04 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:51.275 Waiting for block devices as requested 00:32:51.275 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:51.275 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:51.275 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:51.533 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:51.533 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:51.533 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:51.533 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:51.792 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:51.792 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:51.792 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:51.792 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:52.051 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:52.051 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:52.051 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:52.051 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:52.310 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:52.310 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:52.310 01:27:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:52.310 01:27:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:52.310 01:27:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:52.310 01:27:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:52.310 01:27:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:52.310 01:27:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:52.310 01:27:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:54.841 01:27:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:54.841 00:32:54.841 real 1m7.061s 00:32:54.841 user 6m25.726s 00:32:54.841 sys 0m19.314s 00:32:54.841 01:27:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:54.841 01:27:08 -- common/autotest_common.sh@10 -- # set +x 00:32:54.841 ************************************ 00:32:54.841 END TEST nvmf_dif 00:32:54.841 ************************************ 00:32:54.841 01:27:08 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:54.841 01:27:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:54.841 01:27:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:54.841 01:27:08 -- common/autotest_common.sh@10 -- # set +x 00:32:54.841 ************************************ 00:32:54.841 START TEST nvmf_abort_qd_sizes 00:32:54.841 ************************************ 00:32:54.841 01:27:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:54.841 * Looking for test storage... 00:32:54.841 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:54.841 01:27:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:32:54.841 01:27:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:32:54.841 01:27:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:32:54.841 01:27:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:32:54.841 01:27:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:32:54.841 01:27:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:32:54.841 01:27:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:32:54.841 01:27:09 -- scripts/common.sh@335 -- # IFS=.-: 00:32:54.841 01:27:09 -- scripts/common.sh@335 -- # read -ra ver1 00:32:54.841 01:27:09 -- scripts/common.sh@336 -- # IFS=.-: 00:32:54.841 01:27:09 -- scripts/common.sh@336 -- # read -ra ver2 00:32:54.841 01:27:09 -- scripts/common.sh@337 -- # local 'op=<' 00:32:54.841 01:27:09 -- scripts/common.sh@339 -- # ver1_l=2 00:32:54.841 01:27:09 -- scripts/common.sh@340 -- # ver2_l=1 00:32:54.841 01:27:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:32:54.841 01:27:09 -- scripts/common.sh@343 -- # case "$op" in 00:32:54.841 01:27:09 -- scripts/common.sh@344 -- # : 1 00:32:54.841 01:27:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:32:54.841 01:27:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:32:54.841 01:27:09 -- scripts/common.sh@364 -- # decimal 1 00:32:54.841 01:27:09 -- scripts/common.sh@352 -- # local d=1 00:32:54.841 01:27:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:32:54.841 01:27:09 -- scripts/common.sh@354 -- # echo 1 00:32:54.841 01:27:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:32:54.841 01:27:09 -- scripts/common.sh@365 -- # decimal 2 00:32:54.841 01:27:09 -- scripts/common.sh@352 -- # local d=2 00:32:54.841 01:27:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:32:54.841 01:27:09 -- scripts/common.sh@354 -- # echo 2 00:32:54.841 01:27:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:32:54.841 01:27:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:32:54.841 01:27:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:32:54.841 01:27:09 -- scripts/common.sh@367 -- # return 0 00:32:54.841 01:27:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:32:54.841 01:27:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:32:54.841 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:54.842 --rc genhtml_branch_coverage=1 00:32:54.842 --rc genhtml_function_coverage=1 00:32:54.842 --rc genhtml_legend=1 00:32:54.842 --rc geninfo_all_blocks=1 00:32:54.842 --rc geninfo_unexecuted_blocks=1 00:32:54.842 00:32:54.842 ' 00:32:54.842 01:27:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:32:54.842 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:54.842 --rc genhtml_branch_coverage=1 00:32:54.842 --rc genhtml_function_coverage=1 00:32:54.842 --rc genhtml_legend=1 00:32:54.842 --rc geninfo_all_blocks=1 00:32:54.842 --rc geninfo_unexecuted_blocks=1 00:32:54.842 00:32:54.842 ' 00:32:54.842 01:27:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:32:54.842 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:54.842 --rc genhtml_branch_coverage=1 00:32:54.842 --rc genhtml_function_coverage=1 00:32:54.842 --rc genhtml_legend=1 00:32:54.842 --rc geninfo_all_blocks=1 00:32:54.842 --rc geninfo_unexecuted_blocks=1 00:32:54.842 00:32:54.842 ' 00:32:54.842 01:27:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:32:54.842 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:54.842 --rc genhtml_branch_coverage=1 00:32:54.842 --rc genhtml_function_coverage=1 00:32:54.842 --rc genhtml_legend=1 00:32:54.842 --rc geninfo_all_blocks=1 00:32:54.842 --rc geninfo_unexecuted_blocks=1 00:32:54.842 00:32:54.842 ' 00:32:54.842 01:27:09 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:54.842 01:27:09 -- nvmf/common.sh@7 -- # uname -s 00:32:54.842 01:27:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:54.842 01:27:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:54.842 01:27:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:54.842 01:27:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:54.842 01:27:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:54.842 01:27:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:54.842 01:27:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:54.842 01:27:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:54.842 01:27:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:54.842 01:27:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:54.842 01:27:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:32:54.842 01:27:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:32:54.842 01:27:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:54.842 01:27:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:54.842 01:27:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:54.842 01:27:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:54.842 01:27:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:54.842 01:27:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:54.842 01:27:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:54.842 01:27:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:54.842 01:27:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:54.842 01:27:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:54.842 01:27:09 -- paths/export.sh@5 -- # export PATH 00:32:54.842 01:27:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:54.842 01:27:09 -- nvmf/common.sh@46 -- # : 0 00:32:54.842 01:27:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:54.842 01:27:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:54.842 01:27:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:54.842 01:27:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:54.842 01:27:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:54.842 01:27:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:54.842 01:27:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:54.842 01:27:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:54.842 01:27:09 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:32:54.842 01:27:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:54.842 01:27:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:54.842 01:27:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:54.842 01:27:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:54.842 01:27:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:54.842 01:27:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:54.842 01:27:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:54.842 01:27:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:54.842 01:27:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:54.842 01:27:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:54.842 01:27:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:54.842 01:27:09 -- common/autotest_common.sh@10 -- # set +x 00:32:56.758 01:27:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:56.758 01:27:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:56.758 01:27:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:56.758 01:27:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:56.758 01:27:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:56.758 01:27:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:56.758 01:27:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:56.758 01:27:10 -- nvmf/common.sh@294 -- # net_devs=() 00:32:56.758 01:27:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:56.758 01:27:10 -- nvmf/common.sh@295 -- # e810=() 00:32:56.758 01:27:10 -- nvmf/common.sh@295 -- # local -ga e810 00:32:56.758 01:27:10 -- nvmf/common.sh@296 -- # x722=() 00:32:56.758 01:27:10 -- nvmf/common.sh@296 -- # local -ga x722 00:32:56.758 01:27:10 -- nvmf/common.sh@297 -- # mlx=() 00:32:56.758 01:27:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:56.758 01:27:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:56.758 01:27:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:56.758 01:27:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:56.758 01:27:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:56.758 01:27:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:56.758 01:27:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:56.758 01:27:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:56.758 01:27:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:56.758 01:27:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:56.758 01:27:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:56.758 01:27:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:56.758 01:27:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:56.758 01:27:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:56.758 01:27:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:56.758 01:27:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:56.758 01:27:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:56.758 01:27:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:56.758 01:27:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:56.758 01:27:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:32:56.758 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:32:56.758 01:27:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:56.758 01:27:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:56.758 01:27:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:56.758 01:27:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:56.758 01:27:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:56.758 01:27:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:56.758 01:27:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:32:56.758 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:32:56.758 01:27:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:56.758 01:27:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:56.758 01:27:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:56.758 01:27:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:56.758 01:27:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:56.758 01:27:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:56.758 01:27:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:56.758 01:27:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:56.758 01:27:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:56.758 01:27:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:56.758 01:27:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:56.758 01:27:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:56.758 01:27:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:32:56.758 Found net devices under 0000:0a:00.0: cvl_0_0 00:32:56.758 01:27:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:56.758 01:27:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:56.758 01:27:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:56.758 01:27:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:56.758 01:27:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:56.758 01:27:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:32:56.758 Found net devices under 0000:0a:00.1: cvl_0_1 00:32:56.758 01:27:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:56.758 01:27:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:56.758 01:27:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:56.758 01:27:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:56.758 01:27:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:56.758 01:27:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:56.758 01:27:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:56.758 01:27:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:56.758 01:27:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:56.758 01:27:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:56.758 01:27:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:56.758 01:27:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:56.759 01:27:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:56.759 01:27:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:56.759 01:27:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:56.759 01:27:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:56.759 01:27:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:56.759 01:27:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:56.759 01:27:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:56.759 01:27:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:56.759 01:27:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:56.759 01:27:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:56.759 01:27:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:56.759 01:27:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:56.759 01:27:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:56.759 01:27:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:56.759 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:56.759 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.225 ms 00:32:56.759 00:32:56.759 --- 10.0.0.2 ping statistics --- 00:32:56.759 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:56.759 rtt min/avg/max/mdev = 0.225/0.225/0.225/0.000 ms 00:32:56.759 01:27:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:56.759 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:56.759 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.092 ms 00:32:56.759 00:32:56.759 --- 10.0.0.1 ping statistics --- 00:32:56.759 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:56.759 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:32:56.759 01:27:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:56.759 01:27:11 -- nvmf/common.sh@410 -- # return 0 00:32:56.759 01:27:11 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:56.759 01:27:11 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:57.694 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:57.953 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:57.953 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:57.953 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:57.953 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:57.953 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:57.953 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:57.953 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:57.953 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:57.953 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:57.953 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:57.953 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:57.953 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:57.953 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:57.953 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:57.953 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:58.890 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:32:58.890 01:27:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:58.890 01:27:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:58.890 01:27:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:58.890 01:27:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:58.890 01:27:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:58.890 01:27:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:58.890 01:27:13 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:32:58.890 01:27:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:58.890 01:27:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:58.890 01:27:13 -- common/autotest_common.sh@10 -- # set +x 00:32:58.890 01:27:13 -- nvmf/common.sh@469 -- # nvmfpid=2190434 00:32:58.890 01:27:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:32:58.890 01:27:13 -- nvmf/common.sh@470 -- # waitforlisten 2190434 00:32:58.890 01:27:13 -- common/autotest_common.sh@829 -- # '[' -z 2190434 ']' 00:32:58.890 01:27:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:58.890 01:27:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:32:58.890 01:27:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:58.890 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:58.890 01:27:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:32:58.890 01:27:13 -- common/autotest_common.sh@10 -- # set +x 00:32:59.149 [2024-11-28 01:27:13.528168] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:32:59.149 [2024-11-28 01:27:13.528252] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:59.149 EAL: No free 2048 kB hugepages reported on node 1 00:32:59.149 [2024-11-28 01:27:13.592774] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:59.149 [2024-11-28 01:27:13.677313] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:59.149 [2024-11-28 01:27:13.677486] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:59.149 [2024-11-28 01:27:13.677503] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:59.149 [2024-11-28 01:27:13.677515] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:59.149 [2024-11-28 01:27:13.677574] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:59.149 [2024-11-28 01:27:13.677637] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:59.149 [2024-11-28 01:27:13.677687] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:59.149 [2024-11-28 01:27:13.677689] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:33:00.083 01:27:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:33:00.083 01:27:14 -- common/autotest_common.sh@862 -- # return 0 00:33:00.083 01:27:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:33:00.083 01:27:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:00.083 01:27:14 -- common/autotest_common.sh@10 -- # set +x 00:33:00.083 01:27:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:33:00.083 01:27:14 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:33:00.083 01:27:14 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:33:00.083 01:27:14 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:33:00.083 01:27:14 -- scripts/common.sh@311 -- # local bdf bdfs 00:33:00.083 01:27:14 -- scripts/common.sh@312 -- # local nvmes 00:33:00.083 01:27:14 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:33:00.083 01:27:14 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:33:00.083 01:27:14 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:33:00.083 01:27:14 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:33:00.083 01:27:14 -- scripts/common.sh@322 -- # uname -s 00:33:00.083 01:27:14 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:33:00.083 01:27:14 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:33:00.083 01:27:14 -- scripts/common.sh@327 -- # (( 1 )) 00:33:00.083 01:27:14 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:33:00.083 01:27:14 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:33:00.083 01:27:14 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:33:00.083 01:27:14 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:33:00.083 01:27:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:33:00.083 01:27:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:00.083 01:27:14 -- common/autotest_common.sh@10 -- # set +x 00:33:00.083 ************************************ 00:33:00.083 START TEST spdk_target_abort 00:33:00.083 ************************************ 00:33:00.083 01:27:14 -- common/autotest_common.sh@1114 -- # spdk_target 00:33:00.083 01:27:14 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:33:00.083 01:27:14 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:33:00.083 01:27:14 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:33:00.083 01:27:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:00.083 01:27:14 -- common/autotest_common.sh@10 -- # set +x 00:33:03.371 spdk_targetn1 00:33:03.371 01:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:33:03.371 01:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:03.371 01:27:17 -- common/autotest_common.sh@10 -- # set +x 00:33:03.371 [2024-11-28 01:27:17.378607] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:33:03.371 01:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:33:03.371 01:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:03.371 01:27:17 -- common/autotest_common.sh@10 -- # set +x 00:33:03.371 01:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:33:03.371 01:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:03.371 01:27:17 -- common/autotest_common.sh@10 -- # set +x 00:33:03.371 01:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:33:03.371 01:27:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:03.371 01:27:17 -- common/autotest_common.sh@10 -- # set +x 00:33:03.371 [2024-11-28 01:27:17.410911] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:33:03.371 01:27:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@24 -- # local target r 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:03.371 01:27:17 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:33:03.371 EAL: No free 2048 kB hugepages reported on node 1 00:33:06.649 Initializing NVMe Controllers 00:33:06.649 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:33:06.649 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:33:06.649 Initialization complete. Launching workers. 00:33:06.649 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 12261, failed: 0 00:33:06.649 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1177, failed to submit 11084 00:33:06.649 success 694, unsuccess 483, failed 0 00:33:06.649 01:27:20 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:06.649 01:27:20 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:33:06.649 EAL: No free 2048 kB hugepages reported on node 1 00:33:09.927 Initializing NVMe Controllers 00:33:09.927 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:33:09.927 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:33:09.927 Initialization complete. Launching workers. 00:33:09.927 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8783, failed: 0 00:33:09.927 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1245, failed to submit 7538 00:33:09.927 success 309, unsuccess 936, failed 0 00:33:09.927 01:27:23 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:09.927 01:27:23 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:33:09.927 EAL: No free 2048 kB hugepages reported on node 1 00:33:12.514 Initializing NVMe Controllers 00:33:12.514 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:33:12.514 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:33:12.514 Initialization complete. Launching workers. 00:33:12.514 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 30734, failed: 0 00:33:12.514 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2710, failed to submit 28024 00:33:12.514 success 517, unsuccess 2193, failed 0 00:33:12.514 01:27:26 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:33:12.514 01:27:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:12.514 01:27:26 -- common/autotest_common.sh@10 -- # set +x 00:33:12.514 01:27:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:12.514 01:27:26 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:33:12.514 01:27:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:12.514 01:27:26 -- common/autotest_common.sh@10 -- # set +x 00:33:13.889 01:27:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:13.890 01:27:28 -- target/abort_qd_sizes.sh@62 -- # killprocess 2190434 00:33:13.890 01:27:28 -- common/autotest_common.sh@936 -- # '[' -z 2190434 ']' 00:33:13.890 01:27:28 -- common/autotest_common.sh@940 -- # kill -0 2190434 00:33:13.890 01:27:28 -- common/autotest_common.sh@941 -- # uname 00:33:13.890 01:27:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:33:13.890 01:27:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2190434 00:33:13.890 01:27:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:33:13.890 01:27:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:33:13.890 01:27:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2190434' 00:33:13.890 killing process with pid 2190434 00:33:13.890 01:27:28 -- common/autotest_common.sh@955 -- # kill 2190434 00:33:13.890 01:27:28 -- common/autotest_common.sh@960 -- # wait 2190434 00:33:14.148 00:33:14.148 real 0m14.060s 00:33:14.148 user 0m55.896s 00:33:14.148 sys 0m2.540s 00:33:14.148 01:27:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:14.148 01:27:28 -- common/autotest_common.sh@10 -- # set +x 00:33:14.148 ************************************ 00:33:14.148 END TEST spdk_target_abort 00:33:14.148 ************************************ 00:33:14.148 01:27:28 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:33:14.148 01:27:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:33:14.148 01:27:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:14.148 01:27:28 -- common/autotest_common.sh@10 -- # set +x 00:33:14.148 ************************************ 00:33:14.148 START TEST kernel_target_abort 00:33:14.148 ************************************ 00:33:14.148 01:27:28 -- common/autotest_common.sh@1114 -- # kernel_target 00:33:14.148 01:27:28 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:33:14.148 01:27:28 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:33:14.148 01:27:28 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:33:14.148 01:27:28 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:33:14.148 01:27:28 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:33:14.148 01:27:28 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:14.148 01:27:28 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:33:14.148 01:27:28 -- nvmf/common.sh@627 -- # local block nvme 00:33:14.148 01:27:28 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:33:14.148 01:27:28 -- nvmf/common.sh@630 -- # modprobe nvmet 00:33:14.148 01:27:28 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:33:14.148 01:27:28 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:33:15.083 Waiting for block devices as requested 00:33:15.343 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:33:15.343 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:33:15.343 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:33:15.601 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:33:15.601 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:33:15.601 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:33:15.601 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:33:15.860 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:33:15.860 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:33:15.860 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:33:15.860 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:33:16.119 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:33:16.119 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:33:16.119 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:33:16.119 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:33:16.378 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:33:16.378 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:33:16.378 01:27:30 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:33:16.378 01:27:30 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:33:16.378 01:27:30 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:33:16.378 01:27:30 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:33:16.378 01:27:30 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:33:16.378 No valid GPT data, bailing 00:33:16.378 01:27:30 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:33:16.378 01:27:30 -- scripts/common.sh@393 -- # pt= 00:33:16.378 01:27:30 -- scripts/common.sh@394 -- # return 1 00:33:16.378 01:27:30 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:33:16.378 01:27:30 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:33:16.378 01:27:30 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:33:16.378 01:27:30 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:16.378 01:27:30 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:33:16.378 01:27:30 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:33:16.378 01:27:30 -- nvmf/common.sh@654 -- # echo 1 00:33:16.378 01:27:30 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:33:16.378 01:27:30 -- nvmf/common.sh@656 -- # echo 1 00:33:16.378 01:27:30 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:33:16.378 01:27:30 -- nvmf/common.sh@663 -- # echo tcp 00:33:16.378 01:27:30 -- nvmf/common.sh@664 -- # echo 4420 00:33:16.378 01:27:30 -- nvmf/common.sh@665 -- # echo ipv4 00:33:16.378 01:27:30 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:33:16.378 01:27:30 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:33:16.637 00:33:16.637 Discovery Log Number of Records 2, Generation counter 2 00:33:16.637 =====Discovery Log Entry 0====== 00:33:16.637 trtype: tcp 00:33:16.637 adrfam: ipv4 00:33:16.637 subtype: current discovery subsystem 00:33:16.637 treq: not specified, sq flow control disable supported 00:33:16.637 portid: 1 00:33:16.637 trsvcid: 4420 00:33:16.637 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:33:16.637 traddr: 10.0.0.1 00:33:16.637 eflags: none 00:33:16.637 sectype: none 00:33:16.637 =====Discovery Log Entry 1====== 00:33:16.637 trtype: tcp 00:33:16.637 adrfam: ipv4 00:33:16.637 subtype: nvme subsystem 00:33:16.637 treq: not specified, sq flow control disable supported 00:33:16.637 portid: 1 00:33:16.637 trsvcid: 4420 00:33:16.637 subnqn: kernel_target 00:33:16.637 traddr: 10.0.0.1 00:33:16.637 eflags: none 00:33:16.637 sectype: none 00:33:16.637 01:27:31 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:33:16.637 01:27:31 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:33:16.637 01:27:31 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:33:16.637 01:27:31 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:33:16.637 01:27:31 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:33:16.637 01:27:31 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:33:16.637 01:27:31 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:33:16.637 01:27:31 -- target/abort_qd_sizes.sh@24 -- # local target r 00:33:16.637 01:27:31 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:33:16.637 01:27:31 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:16.637 01:27:31 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:33:16.637 01:27:31 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:16.637 01:27:31 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:33:16.637 01:27:31 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:16.637 01:27:31 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:33:16.637 01:27:31 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:16.637 01:27:31 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:33:16.637 01:27:31 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:16.637 01:27:31 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:16.637 01:27:31 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:16.638 01:27:31 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:16.638 EAL: No free 2048 kB hugepages reported on node 1 00:33:19.921 Initializing NVMe Controllers 00:33:19.921 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:19.921 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:19.921 Initialization complete. Launching workers. 00:33:19.921 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 40557, failed: 0 00:33:19.921 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 40557, failed to submit 0 00:33:19.921 success 0, unsuccess 40557, failed 0 00:33:19.921 01:27:34 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:19.921 01:27:34 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:19.921 EAL: No free 2048 kB hugepages reported on node 1 00:33:23.205 Initializing NVMe Controllers 00:33:23.205 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:23.205 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:23.205 Initialization complete. Launching workers. 00:33:23.205 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 79409, failed: 0 00:33:23.205 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20022, failed to submit 59387 00:33:23.205 success 0, unsuccess 20022, failed 0 00:33:23.205 01:27:37 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:23.205 01:27:37 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:23.205 EAL: No free 2048 kB hugepages reported on node 1 00:33:26.489 Initializing NVMe Controllers 00:33:26.489 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:26.489 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:26.489 Initialization complete. Launching workers. 00:33:26.489 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 73775, failed: 0 00:33:26.489 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 18422, failed to submit 55353 00:33:26.489 success 0, unsuccess 18422, failed 0 00:33:26.489 01:27:40 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:33:26.489 01:27:40 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:33:26.490 01:27:40 -- nvmf/common.sh@677 -- # echo 0 00:33:26.490 01:27:40 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:33:26.490 01:27:40 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:26.490 01:27:40 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:33:26.490 01:27:40 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:33:26.490 01:27:40 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:33:26.490 01:27:40 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:33:26.490 00:33:26.490 real 0m11.801s 00:33:26.490 user 0m5.416s 00:33:26.490 sys 0m2.389s 00:33:26.490 01:27:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:26.490 01:27:40 -- common/autotest_common.sh@10 -- # set +x 00:33:26.490 ************************************ 00:33:26.490 END TEST kernel_target_abort 00:33:26.490 ************************************ 00:33:26.490 01:27:40 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:33:26.490 01:27:40 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:33:26.490 01:27:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:33:26.490 01:27:40 -- nvmf/common.sh@116 -- # sync 00:33:26.490 01:27:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:33:26.490 01:27:40 -- nvmf/common.sh@119 -- # set +e 00:33:26.490 01:27:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:33:26.490 01:27:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:33:26.490 rmmod nvme_tcp 00:33:26.490 rmmod nvme_fabrics 00:33:26.490 rmmod nvme_keyring 00:33:26.490 01:27:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:33:26.490 01:27:40 -- nvmf/common.sh@123 -- # set -e 00:33:26.490 01:27:40 -- nvmf/common.sh@124 -- # return 0 00:33:26.490 01:27:40 -- nvmf/common.sh@477 -- # '[' -n 2190434 ']' 00:33:26.490 01:27:40 -- nvmf/common.sh@478 -- # killprocess 2190434 00:33:26.490 01:27:40 -- common/autotest_common.sh@936 -- # '[' -z 2190434 ']' 00:33:26.490 01:27:40 -- common/autotest_common.sh@940 -- # kill -0 2190434 00:33:26.490 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2190434) - No such process 00:33:26.490 01:27:40 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2190434 is not found' 00:33:26.490 Process with pid 2190434 is not found 00:33:26.490 01:27:40 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:33:26.490 01:27:40 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:33:27.056 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:27.056 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:27.056 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:27.056 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:27.056 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:27.056 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:27.315 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:27.315 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:27.315 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:27.315 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:27.315 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:27.315 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:27.315 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:27.315 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:27.315 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:27.315 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:27.315 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:27.315 01:27:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:33:27.315 01:27:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:33:27.315 01:27:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:33:27.315 01:27:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:33:27.315 01:27:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:27.315 01:27:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:33:27.315 01:27:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:29.851 01:27:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:33:29.851 00:33:29.851 real 0m34.993s 00:33:29.851 user 1m3.661s 00:33:29.851 sys 0m8.316s 00:33:29.851 01:27:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:29.851 01:27:43 -- common/autotest_common.sh@10 -- # set +x 00:33:29.851 ************************************ 00:33:29.851 END TEST nvmf_abort_qd_sizes 00:33:29.851 ************************************ 00:33:29.851 01:27:43 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:33:29.851 01:27:43 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:33:29.851 01:27:43 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:33:29.851 01:27:43 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:33:29.851 01:27:43 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:33:29.851 01:27:43 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:33:29.851 01:27:43 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:33:29.851 01:27:43 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:33:29.851 01:27:43 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:33:29.851 01:27:43 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:33:29.851 01:27:43 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:33:29.851 01:27:43 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:33:29.851 01:27:43 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:33:29.851 01:27:43 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:33:29.851 01:27:43 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:33:29.851 01:27:43 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:33:29.851 01:27:43 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:33:29.851 01:27:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:33:29.852 01:27:43 -- common/autotest_common.sh@10 -- # set +x 00:33:29.852 01:27:43 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:33:29.852 01:27:43 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:33:29.852 01:27:43 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:33:29.852 01:27:43 -- common/autotest_common.sh@10 -- # set +x 00:33:31.225 INFO: APP EXITING 00:33:31.225 INFO: killing all VMs 00:33:31.225 INFO: killing vhost app 00:33:31.225 INFO: EXIT DONE 00:33:32.162 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:32.162 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:32.421 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:32.422 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:32.422 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:32.422 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:32.422 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:32.422 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:32.422 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:32.422 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:32.422 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:32.422 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:32.422 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:32.422 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:32.422 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:32.422 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:32.422 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:33.807 Cleaning 00:33:33.807 Removing: /var/run/dpdk/spdk0/config 00:33:33.807 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:33:33.807 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:33:33.807 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:33:33.807 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:33:33.807 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:33:33.807 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:33:33.807 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:33:33.807 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:33:33.808 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:33:33.808 Removing: /var/run/dpdk/spdk0/hugepage_info 00:33:33.808 Removing: /var/run/dpdk/spdk1/config 00:33:33.808 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:33:33.808 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:33:33.808 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:33:33.808 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:33:33.808 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:33:33.808 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:33:33.808 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:33:33.808 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:33:33.808 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:33:33.808 Removing: /var/run/dpdk/spdk1/hugepage_info 00:33:33.808 Removing: /var/run/dpdk/spdk1/mp_socket 00:33:33.808 Removing: /var/run/dpdk/spdk2/config 00:33:33.808 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:33:33.808 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:33:33.808 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:33:33.808 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:33:33.808 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:33:33.808 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:33:33.808 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:33:33.808 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:33:33.808 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:33:33.808 Removing: /var/run/dpdk/spdk2/hugepage_info 00:33:33.808 Removing: /var/run/dpdk/spdk3/config 00:33:33.808 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:33:33.808 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:33:33.808 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:33:33.808 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:33:33.808 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:33:33.808 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:33:33.808 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:33:33.808 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:33:33.808 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:33:33.808 Removing: /var/run/dpdk/spdk3/hugepage_info 00:33:33.808 Removing: /var/run/dpdk/spdk4/config 00:33:33.808 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:33:33.808 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:33:33.808 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:33:33.808 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:33:33.808 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:33:33.808 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:33:33.808 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:33:33.808 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:33:33.808 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:33:33.808 Removing: /var/run/dpdk/spdk4/hugepage_info 00:33:33.808 Removing: /dev/shm/bdev_svc_trace.1 00:33:33.808 Removing: /dev/shm/nvmf_trace.0 00:33:33.808 Removing: /dev/shm/spdk_tgt_trace.pid1910342 00:33:33.808 Removing: /var/run/dpdk/spdk0 00:33:33.808 Removing: /var/run/dpdk/spdk1 00:33:33.808 Removing: /var/run/dpdk/spdk2 00:33:33.808 Removing: /var/run/dpdk/spdk3 00:33:33.808 Removing: /var/run/dpdk/spdk4 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1908002 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1908923 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1910342 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1910837 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1912186 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1913141 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1913333 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1913664 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1914011 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1914215 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1914374 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1914588 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1914851 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1915337 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1917923 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1918164 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1918423 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1918481 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1918917 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1919057 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1919363 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1919503 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1919677 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1919817 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1919983 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1920125 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1920633 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1920791 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1920993 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1921175 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1921317 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1921378 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1921585 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1921800 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1921944 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1922097 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1922294 00:33:33.808 Removing: /var/run/dpdk/spdk_pid1922524 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1922665 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1922824 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1922988 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1923250 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1923392 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1923545 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1923706 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1923965 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1924119 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1924272 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1924415 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1924695 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1924843 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1925002 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1925140 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1925414 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1925567 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1925723 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1925867 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1926141 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1926283 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1926450 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1926588 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1926868 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1927008 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1927171 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1927318 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1927595 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1927744 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1927910 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1928054 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1928331 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1928473 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1928642 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1928833 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1929046 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1931262 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1988731 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1991409 00:33:34.068 Removing: /var/run/dpdk/spdk_pid1999270 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2002629 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2005018 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2005458 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2009460 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2009462 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2010137 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2010687 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2011370 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2011779 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2011785 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2012048 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2012067 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2012188 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2012746 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2013421 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2014098 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2014513 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2014515 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2014667 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2015840 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2016594 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2022206 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2022493 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2025178 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2029568 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2031805 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2038443 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2043996 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2045226 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2045910 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2056443 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2058787 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2061625 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2062841 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2064948 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2065099 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2065258 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2065524 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2066123 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2067354 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2068377 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2068937 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2072452 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2076030 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2079677 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2103979 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2106714 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2110656 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2111629 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2112746 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2115461 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2117961 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2122393 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2122395 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2125348 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2125623 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2125761 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2126038 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2126167 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2127845 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2129108 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2130323 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2131544 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2132765 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2133984 00:33:34.068 Removing: /var/run/dpdk/spdk_pid2138000 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2138338 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2139911 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2140669 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2144588 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2146637 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2150270 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2154020 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2158483 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2158905 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2159323 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2159745 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2160337 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2160888 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2161439 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2161991 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2164664 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2164818 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2168678 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2168856 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2170627 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2175795 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2175803 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2178868 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2180304 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2181743 00:33:34.327 Removing: /var/run/dpdk/spdk_pid2182509 00:33:34.328 Removing: /var/run/dpdk/spdk_pid2183956 00:33:34.328 Removing: /var/run/dpdk/spdk_pid2184733 00:33:34.328 Removing: /var/run/dpdk/spdk_pid2190869 00:33:34.328 Removing: /var/run/dpdk/spdk_pid2191271 00:33:34.328 Removing: /var/run/dpdk/spdk_pid2191675 00:33:34.328 Removing: /var/run/dpdk/spdk_pid2193153 00:33:34.328 Removing: /var/run/dpdk/spdk_pid2193564 00:33:34.328 Removing: /var/run/dpdk/spdk_pid2193915 00:33:34.328 Clean 00:33:34.328 killing process with pid 1880185 00:33:44.302 killing process with pid 1880182 00:33:44.302 killing process with pid 1880184 00:33:44.302 killing process with pid 1880183 00:33:44.302 01:27:57 -- common/autotest_common.sh@1446 -- # return 0 00:33:44.302 01:27:57 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:33:44.302 01:27:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:44.302 01:27:57 -- common/autotest_common.sh@10 -- # set +x 00:33:44.302 01:27:57 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:33:44.302 01:27:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:44.302 01:27:57 -- common/autotest_common.sh@10 -- # set +x 00:33:44.302 01:27:57 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:44.302 01:27:57 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:33:44.302 01:27:57 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:33:44.302 01:27:57 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:33:44.302 01:27:57 -- spdk/autotest.sh@383 -- # hostname 00:33:44.302 01:27:57 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:33:44.302 geninfo: WARNING: invalid characters removed from testname! 00:34:10.827 01:28:25 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:16.094 01:28:30 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:19.377 01:28:33 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:22.655 01:28:37 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:26.022 01:28:39 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:29.303 01:28:43 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:32.585 01:28:46 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:34:32.585 01:28:46 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:34:32.585 01:28:46 -- common/autotest_common.sh@1690 -- $ lcov --version 00:34:32.585 01:28:46 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:34:32.585 01:28:46 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:34:32.585 01:28:46 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:34:32.585 01:28:46 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:34:32.585 01:28:46 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:34:32.585 01:28:46 -- scripts/common.sh@335 -- $ IFS=.-: 00:34:32.585 01:28:46 -- scripts/common.sh@335 -- $ read -ra ver1 00:34:32.585 01:28:46 -- scripts/common.sh@336 -- $ IFS=.-: 00:34:32.585 01:28:46 -- scripts/common.sh@336 -- $ read -ra ver2 00:34:32.585 01:28:46 -- scripts/common.sh@337 -- $ local 'op=<' 00:34:32.585 01:28:46 -- scripts/common.sh@339 -- $ ver1_l=2 00:34:32.585 01:28:46 -- scripts/common.sh@340 -- $ ver2_l=1 00:34:32.585 01:28:46 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:34:32.585 01:28:46 -- scripts/common.sh@343 -- $ case "$op" in 00:34:32.585 01:28:46 -- scripts/common.sh@344 -- $ : 1 00:34:32.585 01:28:46 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:34:32.585 01:28:46 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:34:32.585 01:28:46 -- scripts/common.sh@364 -- $ decimal 1 00:34:32.585 01:28:46 -- scripts/common.sh@352 -- $ local d=1 00:34:32.585 01:28:46 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:34:32.585 01:28:46 -- scripts/common.sh@354 -- $ echo 1 00:34:32.585 01:28:46 -- scripts/common.sh@364 -- $ ver1[v]=1 00:34:32.585 01:28:46 -- scripts/common.sh@365 -- $ decimal 2 00:34:32.585 01:28:46 -- scripts/common.sh@352 -- $ local d=2 00:34:32.585 01:28:46 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:34:32.585 01:28:46 -- scripts/common.sh@354 -- $ echo 2 00:34:32.585 01:28:46 -- scripts/common.sh@365 -- $ ver2[v]=2 00:34:32.585 01:28:46 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:34:32.585 01:28:46 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:34:32.585 01:28:46 -- scripts/common.sh@367 -- $ return 0 00:34:32.585 01:28:46 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:34:32.585 01:28:46 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:34:32.585 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:32.585 --rc genhtml_branch_coverage=1 00:34:32.585 --rc genhtml_function_coverage=1 00:34:32.585 --rc genhtml_legend=1 00:34:32.585 --rc geninfo_all_blocks=1 00:34:32.585 --rc geninfo_unexecuted_blocks=1 00:34:32.585 00:34:32.585 ' 00:34:32.585 01:28:46 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:34:32.585 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:32.585 --rc genhtml_branch_coverage=1 00:34:32.585 --rc genhtml_function_coverage=1 00:34:32.585 --rc genhtml_legend=1 00:34:32.585 --rc geninfo_all_blocks=1 00:34:32.585 --rc geninfo_unexecuted_blocks=1 00:34:32.585 00:34:32.585 ' 00:34:32.585 01:28:46 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:34:32.585 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:32.585 --rc genhtml_branch_coverage=1 00:34:32.585 --rc genhtml_function_coverage=1 00:34:32.585 --rc genhtml_legend=1 00:34:32.585 --rc geninfo_all_blocks=1 00:34:32.585 --rc geninfo_unexecuted_blocks=1 00:34:32.585 00:34:32.585 ' 00:34:32.585 01:28:46 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:34:32.585 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:32.585 --rc genhtml_branch_coverage=1 00:34:32.585 --rc genhtml_function_coverage=1 00:34:32.585 --rc genhtml_legend=1 00:34:32.585 --rc geninfo_all_blocks=1 00:34:32.585 --rc geninfo_unexecuted_blocks=1 00:34:32.585 00:34:32.585 ' 00:34:32.585 01:28:46 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:34:32.585 01:28:46 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:34:32.585 01:28:46 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:34:32.585 01:28:46 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:34:32.585 01:28:46 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:32.585 01:28:46 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:32.585 01:28:46 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:32.585 01:28:46 -- paths/export.sh@5 -- $ export PATH 00:34:32.585 01:28:46 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:32.585 01:28:46 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:34:32.585 01:28:47 -- common/autobuild_common.sh@440 -- $ date +%s 00:34:32.585 01:28:47 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732753727.XXXXXX 00:34:32.585 01:28:47 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732753727.ucr9Oo 00:34:32.585 01:28:47 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:34:32.585 01:28:47 -- common/autobuild_common.sh@446 -- $ '[' -n v23.11 ']' 00:34:32.585 01:28:47 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:34:32.585 01:28:47 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:34:32.585 01:28:47 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:34:32.585 01:28:47 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:34:32.585 01:28:47 -- common/autobuild_common.sh@456 -- $ get_config_params 00:34:32.585 01:28:47 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:34:32.585 01:28:47 -- common/autotest_common.sh@10 -- $ set +x 00:34:32.585 01:28:47 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:34:32.585 01:28:47 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:34:32.585 01:28:47 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:32.585 01:28:47 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:34:32.585 01:28:47 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:34:32.585 01:28:47 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:34:32.585 01:28:47 -- spdk/autopackage.sh@19 -- $ timing_finish 00:34:32.585 01:28:47 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:34:32.585 01:28:47 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:34:32.585 01:28:47 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:34:32.585 01:28:47 -- spdk/autopackage.sh@20 -- $ exit 0 00:34:32.585 + [[ -n 1825051 ]] 00:34:32.585 + sudo kill 1825051 00:34:32.595 [Pipeline] } 00:34:32.611 [Pipeline] // stage 00:34:32.616 [Pipeline] } 00:34:32.631 [Pipeline] // timeout 00:34:32.636 [Pipeline] } 00:34:32.651 [Pipeline] // catchError 00:34:32.656 [Pipeline] } 00:34:32.672 [Pipeline] // wrap 00:34:32.678 [Pipeline] } 00:34:32.691 [Pipeline] // catchError 00:34:32.700 [Pipeline] stage 00:34:32.702 [Pipeline] { (Epilogue) 00:34:32.715 [Pipeline] catchError 00:34:32.716 [Pipeline] { 00:34:32.729 [Pipeline] echo 00:34:32.730 Cleanup processes 00:34:32.736 [Pipeline] sh 00:34:33.019 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:33.019 2206299 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:33.033 [Pipeline] sh 00:34:33.315 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:33.315 ++ grep -v 'sudo pgrep' 00:34:33.315 ++ awk '{print $1}' 00:34:33.315 + sudo kill -9 00:34:33.315 + true 00:34:33.327 [Pipeline] sh 00:34:33.608 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:34:43.592 [Pipeline] sh 00:34:43.876 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:34:43.876 Artifacts sizes are good 00:34:43.893 [Pipeline] archiveArtifacts 00:34:43.900 Archiving artifacts 00:34:44.059 [Pipeline] sh 00:34:44.340 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:34:44.355 [Pipeline] cleanWs 00:34:44.417 [WS-CLEANUP] Deleting project workspace... 00:34:44.417 [WS-CLEANUP] Deferred wipeout is used... 00:34:44.423 [WS-CLEANUP] done 00:34:44.425 [Pipeline] } 00:34:44.442 [Pipeline] // catchError 00:34:44.455 [Pipeline] sh 00:34:44.735 + logger -p user.info -t JENKINS-CI 00:34:44.742 [Pipeline] } 00:34:44.756 [Pipeline] // stage 00:34:44.761 [Pipeline] } 00:34:44.775 [Pipeline] // node 00:34:44.781 [Pipeline] End of Pipeline 00:34:44.821 Finished: SUCCESS